Forecall
Failure recordsDocs
All scored servers

GraphOS MCP Server: tool descriptions scored io.github.apollographql/graphos-mcp-server

tools/list taken
(UTC)
From
Official MCP Registry
Connected to
https://mcp.apollographql.com
Homepage
www.apollographql.com/docs/graphos/platform/graphos-mcp-tools
Scoring rules
v2
Removal
support@forecall.dev
Score this URL as it is today

Scores, issues and names only

This page shows how GraphOS MCP Server (io.github.apollographql/graphos-mcp-server)'s tool descriptions scored, the issues found and the names of its tools and parameters. The descriptions are the server's own: read them where the copy came from.

Forecall asked the URL this server lists in the official MCP Registry for its tools/list once, on the date above, without calling any tool. The server may have changed since.

servers/io.github.apollographql/graphos-mcp-server
Average score
55.8 / 100Cloudy
Tools
48
Near-identical descriptions
3

Across the server

  • Major
    48 tools. Above 40, models choose less accurately.too_many_tools
  • Minor
    The server's instructions are 2168 characters. Claude Code reads only the first 2,048 by default (Codex 0.154.0 reads them whole). Put what the server is for first.instructions_long

Tools whose descriptions are nearly the same

3 of 3 pairs shown, highest description similarity first.
ToolToolDescription similarityName similarity
RunSchemaCheckRunSubgraphCheck0.880.50
GetSubgraphMetricsGetOperationMetrics0.760.50
GetClientMetricsGetOperationMetrics0.660.50

Tools

GetProposals

41 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
3 / 25
Return value
8 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: graphId, status, sourceVariants, subgraphs, limit, offset.param_no_description
  • Minor
    String arguments with no constraint or example: graphId.loose_string_param
  • Minor
    Required identifiers whose description does not say where the value comes from: graphId. Name the tool or the place that returns it, or models look it up first.id_source_missing

GetReadme

43 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
3 / 25
Return value
8 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: graphId, variant.param_no_description
  • Minor
    String arguments with no constraint or example: graphId, variant.loose_string_param
  • Minor
    Required identifiers whose description does not say where the value comes from: graphId. Name the tool or the place that returns it, or models look it up first.id_source_missing

GetSchemaChecks

46 / 100Cloudy

Purpose
20 / 20
When to use
5 / 20
Arguments
3 / 25
Return value
8 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
  • Major
    Arguments without a description: graphId, limit, offset, status, subgraphs, branches, variants, authors, ids.param_no_description
  • Minor
    String arguments with no constraint or example: graphId.loose_string_param
  • Minor
    Required identifiers whose description does not say where the value comes from: graphId. Name the tool or the place that returns it, or models look it up first.id_source_missing

ApolloDocsRead

47 / 100Cloudy

Purpose
14 / 20
When to use
0 / 20
Arguments
18 / 25
Return value
8 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context

GetLaunch

48 / 100Cloudy

Purpose
20 / 20
When to use
5 / 20
Arguments
3 / 25
Return value
8 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
  • Major
    Arguments without a description: graphId, variant, launchId.param_no_description
  • Minor
    String arguments with no constraint or example: graphId, variant, launchId.loose_string_param
  • Minor
    Required identifiers whose description does not say where the value comes from: graphId, launchId. Name the tool or the place that returns it, or models look it up first.id_source_missing

GetProposal

48 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
3 / 25
Return value
15 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: proposalId.param_no_description
  • Minor
    String arguments with no constraint or example: proposalId.loose_string_param
  • Minor
    Required identifiers whose description does not say where the value comes from: proposalId. Name the tool or the place that returns it, or models look it up first.id_source_missing

GetVariantDetails

48 / 100Cloudy

Purpose
20 / 20
When to use
5 / 20
Arguments
3 / 25
Return value
8 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
  • Major
    Arguments without a description: graphId, variant.param_no_description
  • Minor
    String arguments with no constraint or example: graphId, variant.loose_string_param
  • Minor
    Required identifiers whose description does not say where the value comes from: graphId. Name the tool or the place that returns it, or models look it up first.id_source_missing

PublishReadme

48 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
8 / 25
Return value
8 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: graphId, variant.param_no_description
  • Minor
    String arguments with no constraint or example: graphId, variant.loose_string_param
  • Minor
    Required identifiers whose description does not say where the value comes from: graphId. Name the tool or the place that returns it, or models look it up first.id_source_missing

AddProposalComment

50 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
3 / 25
Return value
15 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: graphId, proposalVariant, revisionId, message, parentCommentId, schemaCoordinate, schemaScope.param_no_description
  • Minor
    String arguments with no constraint or example: graphId, proposalVariant, revisionId, message.loose_string_param
  • Minor
    Required identifiers whose description does not say where the value comes from: graphId, revisionId. Name the tool or the place that returns it, or models look it up first.id_source_missing

CreateProposal

50 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
3 / 25
Return value
15 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: graphId, displayName, sourceVariant, description.param_no_description
  • Minor
    String arguments with no constraint or example: graphId, displayName, sourceVariant.loose_string_param
  • Minor
    Required identifiers whose description does not say where the value comes from: graphId. Name the tool or the place that returns it, or models look it up first.id_source_missing

DeleteGraph

50 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
3 / 25
Return value
15 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: graphId.param_no_description
  • Minor
    String arguments with no constraint or example: graphId.loose_string_param
  • Minor
    Required identifiers whose description does not say where the value comes from: graphId. Name the tool or the place that returns it, or models look it up first.id_source_missing

GetContractConfig

50 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
3 / 25
Return value
15 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: graphId, variant.param_no_description
  • Minor
    String arguments with no constraint or example: graphId, variant.loose_string_param
  • Minor
    Required identifiers whose description does not say where the value comes from: graphId. Name the tool or the place that returns it, or models look it up first.id_source_missing

GetLatestLaunch

50 / 100Cloudy

Purpose
20 / 20
When to use
5 / 20
Arguments
3 / 25
Return value
15 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Arguments without a description: graphId, variant.param_no_description
  • Minor
    String arguments with no constraint or example: graphId, variant.loose_string_param
  • Minor
    Required identifiers whose description does not say where the value comes from: graphId. Name the tool or the place that returns it, or models look it up first.id_source_missing

GetPersistedQueryListStatus

50 / 100Cloudy

Purpose
20 / 20
When to use
5 / 20
Arguments
3 / 25
Return value
15 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Arguments without a description: graphId, variant.param_no_description
  • Minor
    String arguments with no constraint or example: graphId, variant.loose_string_param
  • Minor
    Required identifiers whose description does not say where the value comes from: graphId. Name the tool or the place that returns it, or models look it up first.id_source_missing

ReviewProposal

50 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
3 / 25
Return value
15 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: graphId, proposalVariant, revisionId, decision, comment.param_no_description
  • Minor
    String arguments with no constraint or example: graphId, proposalVariant, revisionId.loose_string_param
  • Minor
    Required identifiers whose description does not say where the value comes from: graphId, revisionId. Name the tool or the place that returns it, or models look it up first.id_source_missing

RunSubgraphCheck

50 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
3 / 25
Return value
15 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: graphId, variant, subgraphName, proposedSchema, branch, commit.param_no_description
  • Minor
    Its description is nearly the same as RunSchemaCheck's (similarity 0.88); only the names and schemas tell them apart. Say in this description when to use RunSchemaCheck instead.confusable_pair
  • Minor
    String arguments with no constraint or example: graphId, variant, subgraphName.loose_string_param
  • Minor
    Required identifiers whose description does not say where the value comes from: graphId. Name the tool or the place that returns it, or models look it up first.id_source_missing

TagGraphArtifact

50 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
3 / 25
Return value
15 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: graphId, tag, digest.param_no_description
  • Minor
    String arguments with no constraint or example: graphId, tag, digest.loose_string_param
  • Minor
    Required identifiers whose description does not say where the value comes from: graphId. Name the tool or the place that returns it, or models look it up first.id_source_missing

UntagGraphArtifact

50 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
3 / 25
Return value
15 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: graphId, tag.param_no_description
  • Minor
    String arguments with no constraint or example: graphId, tag.loose_string_param
  • Minor
    Required identifiers whose description does not say where the value comes from: graphId. Name the tool or the place that returns it, or models look it up first.id_source_missing

ValidateOperations

50 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
3 / 25
Return value
15 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: graphId, operations, variant.param_no_description
  • Minor
    String arguments with no constraint or example: graphId.loose_string_param
  • Minor
    Required identifiers whose description does not say where the value comes from: graphId. Name the tool or the place that returns it, or models look it up first.id_source_missing

GetLaunchHistory

51 / 100Cloudy

Purpose
20 / 20
When to use
5 / 20
Arguments
3 / 25
Return value
8 / 15
Constraints and side effects
10 / 10
Examples
5 / 10
  • Major
    Arguments without a description: graphId, variant, limit, offset.param_no_description
  • Minor
    String arguments with no constraint or example: graphId, variant.loose_string_param
  • Minor
    Required identifiers whose description does not say where the value comes from: graphId. Name the tool or the place that returns it, or models look it up first.id_source_missing

GetLintResults

51 / 100Cloudy

Purpose
20 / 20
When to use
5 / 20
Arguments
3 / 25
Return value
8 / 15
Constraints and side effects
10 / 10
Examples
5 / 10
  • Major
    Arguments without a description: graphId, limit.param_no_description
  • Minor
    String arguments with no constraint or example: graphId.loose_string_param
  • Minor
    Required identifiers whose description does not say where the value comes from: graphId. Name the tool or the place that returns it, or models look it up first.id_source_missing

GetSubgraphSchema

51 / 100Cloudy

Purpose
20 / 20
When to use
5 / 20
Arguments
3 / 25
Return value
8 / 15
Constraints and side effects
10 / 10
Examples
5 / 10
  • Major
    Arguments without a description: graphId, variant, subgraphName.param_no_description
  • Minor
    String arguments with no constraint or example: graphId, variant, subgraphName.loose_string_param
  • Minor
    Required identifiers whose description does not say where the value comes from: graphId. Name the tool or the place that returns it, or models look it up first.id_source_missing

DeleteApiKey

53 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
3 / 25
Return value
15 / 15
Constraints and side effects
10 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: organizationId, keyId.param_no_description
  • Minor
    String arguments with no constraint or example: organizationId, keyId.loose_string_param
  • Minor
    Required identifiers whose description does not say where the value comes from: organizationId, keyId. Name the tool or the place that returns it, or models look it up first.id_source_missing

ApolloDocsSearch

54 / 100Cloudy

Purpose
14 / 20
When to use
0 / 20
Arguments
18 / 25
Return value
15 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context

DeleteSubgraph

54 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
7 / 25
Return value
15 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: graphId, variant, subgraphName.param_no_description
  • Minor
    String arguments with no constraint or example: graphId, variant, subgraphName.loose_string_param
  • Minor
    Required identifiers whose description does not say where the value comes from: graphId. Name the tool or the place that returns it, or models look it up first.id_source_missing

GetSupergraphSchema

55 / 100Cloudy

Purpose
20 / 20
When to use
5 / 20
Arguments
3 / 25
Return value
15 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
  • Major
    Arguments without a description: graphId, variant.param_no_description
  • Minor
    String arguments with no constraint or example: graphId, variant.loose_string_param
  • Minor
    Required identifiers whose description does not say where the value comes from: graphId. Name the tool or the place that returns it, or models look it up first.id_source_missing

PublishGraphSchema

55 / 100Cloudy

Purpose
20 / 20
When to use
5 / 20
Arguments
3 / 25
Return value
15 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
  • Major
    Arguments without a description: graphId, variant, schemaDocument, branch, commit.param_no_description
  • Minor
    String arguments with no constraint or example: graphId, variant, schemaDocument.loose_string_param
  • Minor
    Required identifiers whose description does not say where the value comes from: graphId. Name the tool or the place that returns it, or models look it up first.id_source_missing

PublishSubgraph

55 / 100Cloudy

Purpose
20 / 20
When to use
5 / 20
Arguments
3 / 25
Return value
15 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
  • Major
    Arguments without a description: graphId, variant, subgraphName, sdl, url, revision, branch, commit.param_no_description
  • Minor
    String arguments with no constraint or example: graphId, variant, subgraphName, sdl.loose_string_param
  • Minor
    Required identifiers whose description does not say where the value comes from: graphId. Name the tool or the place that returns it, or models look it up first.id_source_missing

RenameApiKey

55 / 100Cloudy

Purpose
20 / 20
When to use
5 / 20
Arguments
3 / 25
Return value
15 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
  • Major
    Arguments without a description: organizationId, keyId, name.param_no_description
  • Minor
    String arguments with no constraint or example: organizationId, keyId, name.loose_string_param
  • Minor
    Required identifiers whose description does not say where the value comes from: organizationId, keyId. Name the tool or the place that returns it, or models look it up first.id_source_missing

RunSchemaCheck

55 / 100Cloudy

Purpose
20 / 20
When to use
5 / 20
Arguments
3 / 25
Return value
15 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
  • Major
    Arguments without a description: graphId, variant, proposedSchema, branch, commit.param_no_description
  • Minor
    Its description is nearly the same as RunSubgraphCheck's (similarity 0.88); only the names and schemas tell them apart. Say in this description when to use RunSubgraphCheck instead.confusable_pair
  • Minor
    String arguments with no constraint or example: graphId, variant, proposedSchema.loose_string_param
  • Minor
    Required identifiers whose description does not say where the value comes from: graphId. Name the tool or the place that returns it, or models look it up first.id_source_missing

LintSchema

57 / 100Cloudy

Purpose
17 / 20
When to use
0 / 20
Arguments
13 / 25
Return value
15 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    Arguments without a description: graphId.param_no_description
  • Minor
    String arguments with no constraint or example: graphId.loose_string_param
  • Minor
    Required identifiers whose description does not say where the value comes from: graphId. Name the tool or the place that returns it, or models look it up first.id_source_missing

UpdateProposalStatus

57 / 100Cloudy

Purpose
17 / 20
When to use
15 / 20
Arguments
3 / 25
Return value
15 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Arguments without a description: graphId, proposalVariant, status.param_no_description
  • Minor
    String arguments with no constraint or example: graphId, proposalVariant.loose_string_param
  • Minor
    Required identifiers whose description does not say where the value comes from: graphId. Name the tool or the place that returns it, or models look it up first.id_source_missing

CreateApiKey

58 / 100Cloudy

Purpose
20 / 20
When to use
10 / 20
Arguments
3 / 25
Return value
15 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
  • Major
    Arguments without a description: organizationId, name, type, resources.param_no_description
  • Minor
    String arguments with no constraint or example: organizationId, name.loose_string_param
  • Minor
    Required identifiers whose description does not say where the value comes from: organizationId. Name the tool or the place that returns it, or models look it up first.id_source_missing

GetOfflineLicense

60 / 100Cloudy

Purpose
20 / 20
When to use
10 / 20
Arguments
3 / 25
Return value
15 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
  • Major
    Arguments without a description: graphId.param_no_description
  • Minor
    String arguments with no constraint or example: graphId.loose_string_param
  • Minor
    Required identifiers whose description does not say where the value comes from: graphId. Name the tool or the place that returns it, or models look it up first.id_source_missing

PublishPersistedQueries

60 / 100Cloudy

Purpose
20 / 20
When to use
10 / 20
Arguments
3 / 25
Return value
15 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
  • Major
    Arguments without a description: graphId, listId, operations, remove, allowOverwrittenOperations.param_no_description
  • Minor
    String arguments with no constraint or example: graphId, listId.loose_string_param
  • Minor
    Required identifiers whose description does not say where the value comes from: graphId, listId. Name the tool or the place that returns it, or models look it up first.id_source_missing

PublishProposalRevision

60 / 100Cloudy

Purpose
20 / 20
When to use
15 / 20
Arguments
3 / 25
Return value
15 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Arguments without a description: graphId, proposalVariant, previousLaunchId, revision, summary, subgraphs, gitContext.param_no_description
  • Minor
    String arguments with no constraint or example: graphId, proposalVariant, previousLaunchId, revision, summary.loose_string_param
  • Minor
    Required identifiers whose description does not say where the value comes from: graphId, previousLaunchId. Name the tool or the place that returns it, or models look it up first.id_source_missing

ApolloConnectorsSpec

61 / 100Cloudy

Purpose
14 / 20
When to use
0 / 20
Arguments
25 / 25
Return value
15 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context

GetCheckResults

61 / 100Cloudy

Purpose
20 / 20
When to use
10 / 20
Arguments
11 / 25
Return value
8 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
  • Minor
    Arguments without a description: graphId, checkId.param_no_description
  • Minor
    String arguments with no constraint or example: graphId, checkId.loose_string_param
  • Minor
    Required identifiers whose description does not say where the value comes from: graphId, checkId. Name the tool or the place that returns it, or models look it up first.id_source_missing

GetSubgraphMetrics

63 / 100Cloudy

Purpose
20 / 20
When to use
5 / 20
Arguments
10 / 25
Return value
8 / 15
Constraints and side effects
10 / 10
Examples
10 / 10
  • Major
    Arguments without a description: graphId, orderBy, variantName, subgraphName, clients.param_no_description
  • Minor
    Its description is nearly the same as GetOperationMetrics's (similarity 0.76); only the names and schemas tell them apart. Say in this description when to use GetOperationMetrics instead.confusable_pair
  • Minor
    String arguments with no constraint or example: graphId.loose_string_param
  • Minor
    Required identifiers whose description does not say where the value comes from: graphId. Name the tool or the place that returns it, or models look it up first.id_source_missing

GetOperationMetrics

64 / 100Cloudy

Purpose
20 / 20
When to use
5 / 20
Arguments
11 / 25
Return value
8 / 15
Constraints and side effects
10 / 10
Examples
10 / 10
  • Minor
    Its description is nearly the same as GetSubgraphMetrics's (similarity 0.76); only the names and schemas tell them apart. Say in this description when to use GetSubgraphMetrics instead.confusable_pair
  • Minor
    Its description is nearly the same as GetClientMetrics's (similarity 0.66); only the names and schemas tell them apart. Say in this description when to use GetClientMetrics instead.confusable_pair
  • Minor
    Arguments without a description: graphId, orderBy, variantName, clients.param_no_description
  • Minor
    String arguments with no constraint or example: graphId.loose_string_param
  • Minor
    Required identifiers whose description does not say where the value comes from: graphId. Name the tool or the place that returns it, or models look it up first.id_source_missing

GetGraphArtifact

65 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
18 / 25
Return value
15 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    Required identifiers whose description does not say where the value comes from: graphId. Name the tool or the place that returns it, or models look it up first.id_source_missing

GetTopOperations

67 / 100Cloudy

Purpose
17 / 20
When to use
10 / 20
Arguments
12 / 25
Return value
8 / 15
Constraints and side effects
10 / 10
Examples
10 / 10
  • Minor
    Arguments without a description: graphId, variant.param_no_description
  • Minor
    String arguments with no constraint or example: graphId, variant.loose_string_param
  • Minor
    Required identifiers whose description does not say where the value comes from: graphId. Name the tool or the place that returns it, or models look it up first.id_source_missing

GetGraphSchema

70 / 100Clear

Purpose
20 / 20
When to use
20 / 20
Arguments
3 / 25
Return value
15 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
  • Major
    Arguments without a description: graphId, variant.param_no_description
  • Minor
    String arguments with no constraint or example: graphId, variant.loose_string_param
  • Minor
    Required identifiers whose description does not say where the value comes from: graphId. Name the tool or the place that returns it, or models look it up first.id_source_missing

GetClientMetrics

71 / 100Clear

Purpose
17 / 20
When to use
15 / 20
Arguments
11 / 25
Return value
8 / 15
Constraints and side effects
10 / 10
Examples
10 / 10
  • Minor
    Its description is nearly the same as GetOperationMetrics's (similarity 0.66); only the names and schemas tell them apart. Say in this description when to use GetOperationMetrics instead.confusable_pair
  • Minor
    Arguments without a description: graphId, orderBy, variantName, operationName.param_no_description
  • Minor
    String arguments with no constraint or example: graphId.loose_string_param
  • Minor
    Required identifiers whose description does not say where the value comes from: graphId. Name the tool or the place that returns it, or models look it up first.id_source_missing

PublishContract

71 / 100Clear

Purpose
20 / 20
When to use
10 / 20
Arguments
9 / 25
Return value
15 / 15
Constraints and side effects
7 / 10
Examples
10 / 10
  • Major
    Arguments without a description: graphId, include, exclude, hideUnreachableTypes.param_no_description
  • Minor
    String arguments with no constraint or example: graphId.loose_string_param
  • Minor
    The meaning of the boolean argument hideUnreachableTypes is unclear.vague_boolean
  • Minor
    Required identifiers whose description does not say where the value comes from: graphId. Name the tool or the place that returns it, or models look it up first.id_source_missing

GetApiKeys

72 / 100Clear

Purpose
20 / 20
When to use
15 / 20
Arguments
7 / 25
Return value
15 / 15
Constraints and side effects
10 / 10
Examples
5 / 10
  • Major
    Arguments without a description: organizationId, status, type, first, after.param_no_description
  • Minor
    String arguments with no constraint or example: organizationId.loose_string_param
  • Minor
    Required identifiers whose description does not say where the value comes from: organizationId. Name the tool or the place that returns it, or models look it up first.id_source_missing

GetMyIdentity

75 / 100Clear

Purpose
20 / 20
When to use
10 / 20
Arguments
25 / 25
Return value
8 / 15
Constraints and side effects
7 / 10
Examples
5 / 10

No issues.

GetGraphArtifactTags

78 / 100Clear

Purpose
20 / 20
When to use
20 / 20
Arguments
18 / 25
Return value
8 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
  • Minor
    Required identifiers whose description does not say where the value comes from: graphId. Name the tool or the place that returns it, or models look it up first.id_source_missing

What static scoring cannot tell

This score reads only the text of each description and schema: it says what is written, not what a model will do. Short tools whose names already say what they do, such as browser_close, score low here even when models use them well, and in our measurements current models chose the right tool in one step even from one-line descriptions, as long as the names and schemas differed. What the text cannot show, such as what happens over several steps and whether an added sentence helps or misleads, is what an evaluation measures, on the Pro and Team plans.

Is your server listed here and you would rather it were not? Email support@forecall.dev, and we will take it off within 7 days.

All scored servers