Forecall
Failure recordsDocs
All scored servers

pubmed-mcp-server: tool descriptions scored

tools/list taken
(UTC)
From
smithery.ai/servers/cyanheads/pubmed-mcp-server
Homepage
pubmed.caseyjhand.com
Scoring rules
v2

Scores, issues and names only

This page shows how pubmed-mcp-server's tool descriptions scored, the issues found and the names of its tools and parameters. The descriptions are the server's own: read them where the copy came from.

This copy comes from Smithery's registry, which keeps each tool's name, description and input schema, but no output schema, annotations or instructions. Points for return values and for marking destructive tools can come out lower than the server's own tools/list would give.

A server with a public URL can be scored as it is today: score from a URL

servers/cyanheads-pubmed-mcp-server
Average score
57.6 / 100Cloudy
Tools
10
Near-identical descriptions
0

Across the server

No server-wide issues.

Tools

pubmed_spell_check

42 / 100Cloudy

Purpose
14 / 20
When to use
0 / 20
Arguments
20 / 25
Return value
8 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

pubmed_format_citations

48 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
20 / 25
Return value
8 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

pubmed_find_related

53 / 100Cloudy

Purpose
20 / 20
When to use
5 / 20
Arguments
20 / 25
Return value
8 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    The description mentions none of its 3 or more arguments.params_not_in_description
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

pubmed_fetch_articles

55 / 100Cloudy

Purpose
17 / 20
When to use
0 / 20
Arguments
20 / 25
Return value
15 / 15
Constraints and side effects
3 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    The description mentions none of its 3 or more arguments.params_not_in_description
  • Minor
    The meaning of the boolean argument includeMesh is unclear.vague_boolean
  • Minor
    The meaning of the boolean argument includeGrants is unclear.vague_boolean

pubmed_lookup_citation

58 / 100Cloudy

Purpose
17 / 20
When to use
10 / 20
Arguments
15 / 25
Return value
8 / 15
Constraints and side effects
3 / 10
Examples
5 / 10
  • Minor
    String arguments with no constraint or example: citations[].volume, citations[].firstPage.loose_string_param
  • Minor
    No `required` list, so every argument is optional.no_required

pubmed_search_articles

61 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
18 / 25
Return value
15 / 15
Constraints and side effects
3 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    No `required` list, so every argument is optional.no_required

pubmed_convert_ids

63 / 100Cloudy

Purpose
20 / 20
When to use
10 / 20
Arguments
20 / 25
Return value
8 / 15
Constraints and side effects
0 / 10
Examples
5 / 10
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

pubmed_fetch_fulltext

63 / 100Cloudy

Purpose
20 / 20
When to use
5 / 20
Arguments
20 / 25
Return value
8 / 15
Constraints and side effects
0 / 10
Examples
10 / 10
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

pubmed_lookup_mesh

63 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
20 / 25
Return value
15 / 15
Constraints and side effects
3 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    No `required` list, so every argument is optional.no_required

pubmed_europepmc_search

70 / 100Clear

Purpose
20 / 20
When to use
10 / 20
Arguments
19 / 25
Return value
8 / 15
Constraints and side effects
3 / 10
Examples
10 / 10
  • Minor
    No `required` list, so every argument is optional.no_required

What static scoring cannot tell

This score reads only the text of each description and schema: it says what is written, not what a model will do. Short tools whose names already say what they do, such as browser_close, score low here even when models use them well, and in our measurements current models chose the right tool in one step even from one-line descriptions, as long as the names and schemas differed. What the text cannot show, such as what happens over several steps and whether an added sentence helps or misleads, is what an evaluation measures, on the Pro and Team plans.

Is your server listed here and you would rather it were not? Email support@forecall.dev, and we will take it off within 7 days.

All scored servers