All scored servers

Gmail: tool descriptions scored

tools/list taken
(UTC)
Scoring rules
v2

Scores, issues and names only

This page shows how Gmail's tool descriptions scored, the issues found and the names of its tools and parameters. The descriptions are the server's own: read them where the copy came from.

This copy comes from Smithery's registry, which keeps each tool's name, description and input schema, but no output schema, annotations or instructions. Points for return values and for marking destructive tools can come out lower than the server's own tools/list would give.

A server with a public URL can be scored as it is today: score from a URL

servers/gmail
Average score
51.2 / 100Cloudy
Tools
31
Near-identical descriptions
7

Across the server

  • Minor
    31 tools. Above 25, models start to tell tools apart less well.many_tools

Tools whose descriptions are nearly the same

7 of 7 pairs shown, highest description similarity first.
ToolToolDescription similarityName similarity
Gmail_ReplyToEmailGmail_WriteDraftReplyEmail0.920.50
Gmail_ReplyToEmailGmail_SendEmail0.870.40
Gmail_SendEmailGmail_WriteDraftEmail0.850.40
Gmail_SendEmailGmail_WriteDraftReplyEmail0.800.33
Gmail_WriteDraftEmailGmail_WriteDraftReplyEmail0.800.80
Gmail_ReplyToEmailGmail_WriteDraftEmail0.730.33
Gmail_DeleteDraftEmailGmail_SendDraftEmail0.710.60

Tools

Gmail_ArchiveEmail

36 / 100Rain

Purpose
13 / 20
When to use
0 / 20
Arguments
15 / 25
Return value
8 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    It may be destructive, but destructiveHint is not set.destructive_unmarked
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

Gmail_DeleteDraftEmail

36 / 100Rain

Purpose
13 / 20
When to use
0 / 20
Arguments
15 / 25
Return value
8 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    It may be destructive, but destructiveHint is not set.destructive_unmarked
  • Minor
    Its description is nearly the same as Gmail_SendDraftEmail's (similarity 0.71); only the names and schemas tell them apart. Say in this description when to use Gmail_SendDraftEmail instead.confusable_pair
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

Gmail_GetThread

36 / 100Rain

Purpose
13 / 20
When to use
0 / 20
Arguments
15 / 25
Return value
8 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    The description is too short (6 words).too_short
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

Gmail_SendDraftEmail

36 / 100Rain

Purpose
13 / 20
When to use
0 / 20
Arguments
15 / 25
Return value
8 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    Its description is nearly the same as Gmail_DeleteDraftEmail's (similarity 0.71); only the names and schemas tell them apart. Say in this description when to use Gmail_DeleteDraftEmail instead.confusable_pair
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

Gmail_TrashEmail

36 / 100Rain

Purpose
13 / 20
When to use
0 / 20
Arguments
15 / 25
Return value
8 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

Gmail_ListDraftEmails

37 / 100Rain

Purpose
14 / 20
When to use
0 / 20
Arguments
15 / 25
Return value
8 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

Gmail_ReportSpam

40 / 100Cloudy

Purpose
17 / 20
When to use
0 / 20
Arguments
15 / 25
Return value
8 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    It may be destructive, but destructiveHint is not set.destructive_unmarked
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

Gmail_SetThreadTrashStatus

40 / 100Cloudy

Purpose
17 / 20
When to use
0 / 20
Arguments
15 / 25
Return value
8 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

Gmail_DeleteLabel

43 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
15 / 25
Return value
8 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    It may be destructive, but destructiveHint is not set.destructive_unmarked
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

Gmail_SearchThreads

43 / 100Cloudy

Purpose
13 / 20
When to use
0 / 20
Arguments
17 / 25
Return value
8 / 15
Constraints and side effects
0 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    The description mentions none of its 3 or more arguments.params_not_in_description
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

Gmail_ListLabels

46 / 100Cloudy

Purpose
13 / 20
When to use
0 / 20
Arguments
25 / 25
Return value
8 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

Gmail_ForwardEmail

48 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
15 / 25
Return value
8 / 15
Constraints and side effects
0 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

Gmail_ListEmailAttachmentMetadata

48 / 100Cloudy

Purpose
20 / 20
When to use
5 / 20
Arguments
15 / 25
Return value
8 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

Gmail_ListThreads

48 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
15 / 25
Return value
8 / 15
Constraints and side effects
0 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

Gmail_UpdateLabel

48 / 100Cloudy

Purpose
20 / 20
When to use
5 / 20
Arguments
15 / 25
Return value
8 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

Gmail_GetEmail

50 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
15 / 25
Return value
15 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

Gmail_CreateLabel

53 / 100Cloudy

Purpose
20 / 20
When to use
10 / 20
Arguments
15 / 25
Return value
8 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

Gmail_ChangeEmailLabels

55 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
17 / 25
Return value
15 / 15
Constraints and side effects
3 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    It may be destructive, but destructiveHint is not set.destructive_unmarked
  • Minor
    No `required` list, so every argument is optional.no_required

Gmail_WhoAmI

56 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
25 / 25
Return value
8 / 15
Constraints and side effects
3 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context

Gmail_WriteDraftEmail

58 / 100Cloudy

Purpose
17 / 20
When to use
10 / 20
Arguments
13 / 25
Return value
8 / 15
Constraints and side effects
0 / 10
Examples
10 / 10
  • Minor
    Its description is nearly the same as Gmail_SendEmail's (similarity 0.85); only the names and schemas tell them apart. Say in this description when to use Gmail_SendEmail instead.confusable_pair
  • Minor
    Its description is nearly the same as Gmail_WriteDraftReplyEmail's (similarity 0.80); only the names and schemas tell them apart. Say in this description when to use Gmail_WriteDraftReplyEmail instead.confusable_pair
  • Minor
    Its description is nearly the same as Gmail_ReplyToEmail's (similarity 0.73); only the names and schemas tell them apart. Say in this description when to use Gmail_ReplyToEmail instead.confusable_pair
  • Minor
    Arguments without a description: attachments[].source, attachments[].filename.param_no_description
  • Minor
    String arguments with no constraint or example: attachments[].source, attachments[].filename.loose_string_param
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

Gmail_WriteDraftReplyEmail

58 / 100Cloudy

Purpose
17 / 20
When to use
10 / 20
Arguments
13 / 25
Return value
8 / 15
Constraints and side effects
0 / 10
Examples
10 / 10
  • Minor
    Its description is nearly the same as Gmail_ReplyToEmail's (similarity 0.92); only the names and schemas tell them apart. Say in this description when to use Gmail_ReplyToEmail instead.confusable_pair
  • Minor
    Its description is nearly the same as Gmail_SendEmail's (similarity 0.80); only the names and schemas tell them apart. Say in this description when to use Gmail_SendEmail instead.confusable_pair
  • Minor
    Its description is nearly the same as Gmail_WriteDraftEmail's (similarity 0.80); only the names and schemas tell them apart. Say in this description when to use Gmail_WriteDraftEmail instead.confusable_pair
  • Minor
    Arguments without a description: attachments[].source, attachments[].filename.param_no_description
  • Minor
    String arguments with no constraint or example: attachments[].source, attachments[].filename.loose_string_param
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

Arcade_ListApps

59 / 100Cloudy

Purpose
17 / 20
When to use
5 / 20
Arguments
25 / 25
Return value
7 / 15
Constraints and side effects
0 / 10
Examples
5 / 10
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

Gmail_ListEmails

60 / 100Cloudy

Purpose
20 / 20
When to use
5 / 20
Arguments
15 / 25
Return value
15 / 15
Constraints and side effects
0 / 10
Examples
5 / 10
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

Gmail_TriageEmails

60 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
17 / 25
Return value
15 / 15
Constraints and side effects
3 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    No `required` list, so every argument is optional.no_required

Gmail_ReplyToEmail

61 / 100Cloudy

Purpose
20 / 20
When to use
10 / 20
Arguments
13 / 25
Return value
8 / 15
Constraints and side effects
0 / 10
Examples
10 / 10
  • Minor
    Its description is nearly the same as Gmail_WriteDraftReplyEmail's (similarity 0.92); only the names and schemas tell them apart. Say in this description when to use Gmail_WriteDraftReplyEmail instead.confusable_pair
  • Minor
    Its description is nearly the same as Gmail_SendEmail's (similarity 0.87); only the names and schemas tell them apart. Say in this description when to use Gmail_SendEmail instead.confusable_pair
  • Minor
    Its description is nearly the same as Gmail_WriteDraftEmail's (similarity 0.73); only the names and schemas tell them apart. Say in this description when to use Gmail_WriteDraftEmail instead.confusable_pair
  • Minor
    Arguments without a description: attachments[].source, attachments[].filename.param_no_description
  • Minor
    String arguments with no constraint or example: attachments[].source, attachments[].filename.loose_string_param
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

Gmail_SendEmail

61 / 100Cloudy

Purpose
20 / 20
When to use
10 / 20
Arguments
13 / 25
Return value
8 / 15
Constraints and side effects
0 / 10
Examples
10 / 10
  • Minor
    Its description is nearly the same as Gmail_ReplyToEmail's (similarity 0.87); only the names and schemas tell them apart. Say in this description when to use Gmail_ReplyToEmail instead.confusable_pair
  • Minor
    Its description is nearly the same as Gmail_WriteDraftEmail's (similarity 0.85); only the names and schemas tell them apart. Say in this description when to use Gmail_WriteDraftEmail instead.confusable_pair
  • Minor
    Its description is nearly the same as Gmail_WriteDraftReplyEmail's (similarity 0.80); only the names and schemas tell them apart. Say in this description when to use Gmail_WriteDraftReplyEmail instead.confusable_pair
  • Minor
    Arguments without a description: attachments[].source, attachments[].filename.param_no_description
  • Minor
    String arguments with no constraint or example: attachments[].source, attachments[].filename.loose_string_param
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

Gmail_ListEmailsByHeader

62 / 100Cloudy

Purpose
20 / 20
When to use
5 / 20
Arguments
17 / 25
Return value
15 / 15
Constraints and side effects
0 / 10
Examples
5 / 10
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

Gmail_UpdateDraftEmail

63 / 100Cloudy

Purpose
20 / 20
When to use
10 / 20
Arguments
15 / 25
Return value
8 / 15
Constraints and side effects
0 / 10
Examples
10 / 10
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

Gmail_ChangeThreadLabels

68 / 100Cloudy

Purpose
20 / 20
When to use
20 / 20
Arguments
15 / 25
Return value
8 / 15
Constraints and side effects
0 / 10
Examples
5 / 10
  • Major
    It may be destructive, but destructiveHint is not set.destructive_unmarked
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    The description mentions none of its 3 or more arguments.params_not_in_description
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

Gmail_SearchEmailsByQuery

70 / 100Clear

Purpose
20 / 20
When to use
5 / 20
Arguments
17 / 25
Return value
15 / 15
Constraints and side effects
3 / 10
Examples
10 / 10
  • Minor
    No `required` list, so every argument is optional.no_required

Gmail_UnsubscribeFromEmail

73 / 100Clear

Purpose
20 / 20
When to use
15 / 20
Arguments
15 / 25
Return value
15 / 15
Constraints and side effects
3 / 10
Examples
5 / 10
  • Minor
    No `required` list, so every argument is optional.no_required

What static scoring cannot tell

This score reads only the text of each description and schema: it says what is written, not what a model will do. Short tools whose names already say what they do, such as browser_close, score low here even when models use them well, and in our measurements current models chose the right tool in one step even from one-line descriptions, as long as the names and schemas differed. What the text cannot show, such as what happens over several steps and whether an added sentence helps or misleads, is what an evaluation measures, on the Pro and Team plans.

Is your server listed here and you would rather it were not? Email support@forecall.dev, and we will take it off within 7 days.

All scored servers