Forecall
Failure recordsDocs
All scored servers

Paper Search: tool descriptions scored

tools/list taken
(UTC)
From
smithery.ai/servers/adamamer20/paper-search-mcp-openai
Homepage
github.com
Scoring rules
v2

Scores, issues and names only

This page shows how Paper Search's tool descriptions scored, the issues found and the names of its tools and parameters. The descriptions are the server's own: read them where the copy came from.

This copy comes from Smithery's registry, which keeps each tool's name, description and input schema, but no output schema, annotations or instructions. Points for return values and for marking destructive tools can come out lower than the server's own tools/list would give.

A server with a public URL can be scored as it is today: score from a URL

servers/adamamer20-paper-search-mcp-openai
Average score
39.9 / 100Rain
Tools
25
Near-identical descriptions
29

Across the server

  • Minor
    29 pairs with nearly the same description in all; the top 12 are shown.confusable_pair_total

Tools whose descriptions are nearly the same

12 of 29 pairs shown, highest description similarity first.
ToolToolDescription similarityName similarity
search_arxivsearch_pubmed0.900.33
search_arxivsearch_biorxiv0.900.33
search_arxivsearch_medrxiv0.900.33
search_pubmedsearch_biorxiv0.900.33
search_pubmedsearch_medrxiv0.900.33
search_biorxivsearch_medrxiv0.900.33
read_biorxiv_paperread_medrxiv_paper0.900.50
download_biorxivdownload_medrxiv0.880.33
search_arxivsearch_google_scholar0.860.25
search_pubmedsearch_google_scholar0.860.25
search_biorxivsearch_google_scholar0.860.25
search_medrxivsearch_google_scholar0.860.25

Tools

search

14 / 100Rain

Purpose
6 / 20
When to use
0 / 20
Arguments
0 / 25
Return value
8 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    The description only restates the name (8 words).restates_name
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: query, max_results.param_no_description
  • Minor
    String arguments with no constraint or example: query.loose_string_param
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

fetch

26 / 100Rain

Purpose
6 / 20
When to use
0 / 20
Arguments
5 / 25
Return value
15 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    The description only restates the name (8 words).restates_name
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: id, document_id.param_no_description
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

read_pubmed_paper

37 / 100Rain

Purpose
20 / 20
When to use
0 / 20
Arguments
2 / 25
Return value
15 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: paper_id, save_path.param_no_description
  • Minor
    String arguments with no constraint or example: paper_id.loose_string_param
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

download_crossref

39 / 100Rain

Purpose
17 / 20
When to use
0 / 20
Arguments
2 / 25
Return value
15 / 15
Constraints and side effects
0 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: paper_id, save_path.param_no_description
  • Minor
    String arguments with no constraint or example: paper_id.loose_string_param
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

download_pubmed

39 / 100Rain

Purpose
17 / 20
When to use
0 / 20
Arguments
2 / 25
Return value
15 / 15
Constraints and side effects
0 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: paper_id, save_path.param_no_description
  • Minor
    String arguments with no constraint or example: paper_id.loose_string_param
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

read_crossref_paper

39 / 100Rain

Purpose
17 / 20
When to use
0 / 20
Arguments
2 / 25
Return value
15 / 15
Constraints and side effects
0 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: paper_id, save_path.param_no_description
  • Minor
    String arguments with no constraint or example: paper_id.loose_string_param
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

get_crossref_paper_by_doi

40 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
0 / 25
Return value
15 / 15
Constraints and side effects
0 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: doi.param_no_description
  • Minor
    String arguments with no constraint or example: doi.loose_string_param
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

download_arxiv

42 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
2 / 25
Return value
15 / 15
Constraints and side effects
0 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: paper_id, save_path.param_no_description
  • Minor
    String arguments with no constraint or example: paper_id.loose_string_param
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

download_biorxiv

42 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
2 / 25
Return value
15 / 15
Constraints and side effects
0 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: paper_id, save_path.param_no_description
  • Minor
    Its description is nearly the same as download_medrxiv's (similarity 0.88); only the names and schemas tell them apart. Say in this description when to use download_medrxiv instead.confusable_pair
  • Minor
    String arguments with no constraint or example: paper_id.loose_string_param
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

download_iacr

42 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
2 / 25
Return value
15 / 15
Constraints and side effects
0 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: paper_id, save_path.param_no_description
  • Minor
    String arguments with no constraint or example: paper_id.loose_string_param
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

download_medrxiv

42 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
2 / 25
Return value
15 / 15
Constraints and side effects
0 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: paper_id, save_path.param_no_description
  • Minor
    Its description is nearly the same as download_biorxiv's (similarity 0.88); only the names and schemas tell them apart. Say in this description when to use download_biorxiv instead.confusable_pair
  • Minor
    String arguments with no constraint or example: paper_id.loose_string_param
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

download_semantic

42 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
2 / 25
Return value
15 / 15
Constraints and side effects
0 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: paper_id, save_path.param_no_description
  • Minor
    String arguments with no constraint or example: paper_id.loose_string_param
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

read_arxiv_paper

42 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
2 / 25
Return value
15 / 15
Constraints and side effects
0 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: paper_id, save_path.param_no_description
  • Minor
    String arguments with no constraint or example: paper_id.loose_string_param
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

read_biorxiv_paper

42 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
2 / 25
Return value
15 / 15
Constraints and side effects
0 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: paper_id, save_path.param_no_description
  • Minor
    Its description is nearly the same as read_medrxiv_paper's (similarity 0.90); only the names and schemas tell them apart. Say in this description when to use read_medrxiv_paper instead.confusable_pair
  • Minor
    String arguments with no constraint or example: paper_id.loose_string_param
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

read_iacr_paper

42 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
2 / 25
Return value
15 / 15
Constraints and side effects
0 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: paper_id, save_path.param_no_description
  • Minor
    String arguments with no constraint or example: paper_id.loose_string_param
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

read_medrxiv_paper

42 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
2 / 25
Return value
15 / 15
Constraints and side effects
0 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: paper_id, save_path.param_no_description
  • Minor
    Its description is nearly the same as read_biorxiv_paper's (similarity 0.90); only the names and schemas tell them apart. Say in this description when to use read_biorxiv_paper instead.confusable_pair
  • Minor
    String arguments with no constraint or example: paper_id.loose_string_param
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

read_semantic_paper

42 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
2 / 25
Return value
15 / 15
Constraints and side effects
0 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: paper_id, save_path.param_no_description
  • Minor
    String arguments with no constraint or example: paper_id.loose_string_param
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

search_arxiv

43 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
0 / 25
Return value
15 / 15
Constraints and side effects
3 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: query, max_results.param_no_description
  • Minor
    Its description is nearly the same as search_pubmed's (similarity 0.90); only the names and schemas tell them apart. Say in this description when to use search_pubmed instead.confusable_pair
  • Minor
    Its description is nearly the same as search_biorxiv's (similarity 0.90); only the names and schemas tell them apart. Say in this description when to use search_biorxiv instead.confusable_pair
  • Minor
    Its description is nearly the same as search_medrxiv's (similarity 0.90); only the names and schemas tell them apart. Say in this description when to use search_medrxiv instead.confusable_pair
  • Minor
    Its description is nearly the same as search_google_scholar's (similarity 0.86); only the names and schemas tell them apart. Say in this description when to use search_google_scholar instead.confusable_pair
  • Minor
    String arguments with no constraint or example: query.loose_string_param
  • Minor
    No `required` list, so every argument is optional.no_required

search_biorxiv

43 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
0 / 25
Return value
15 / 15
Constraints and side effects
3 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: query, max_results.param_no_description
  • Minor
    Its description is nearly the same as search_arxiv's (similarity 0.90); only the names and schemas tell them apart. Say in this description when to use search_arxiv instead.confusable_pair
  • Minor
    Its description is nearly the same as search_pubmed's (similarity 0.90); only the names and schemas tell them apart. Say in this description when to use search_pubmed instead.confusable_pair
  • Minor
    Its description is nearly the same as search_medrxiv's (similarity 0.90); only the names and schemas tell them apart. Say in this description when to use search_medrxiv instead.confusable_pair
  • Minor
    Its description is nearly the same as search_google_scholar's (similarity 0.86); only the names and schemas tell them apart. Say in this description when to use search_google_scholar instead.confusable_pair
  • Minor
    String arguments with no constraint or example: query.loose_string_param
  • Minor
    No `required` list, so every argument is optional.no_required

search_crossref

43 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
0 / 25
Return value
15 / 15
Constraints and side effects
3 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: query, kwargs, max_results.param_no_description
  • Minor
    String arguments with no constraint or example: query, kwargs.loose_string_param
  • Minor
    No `required` list, so every argument is optional.no_required

search_google_scholar

43 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
0 / 25
Return value
15 / 15
Constraints and side effects
3 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: query, max_results.param_no_description
  • Minor
    Its description is nearly the same as search_arxiv's (similarity 0.86); only the names and schemas tell them apart. Say in this description when to use search_arxiv instead.confusable_pair
  • Minor
    Its description is nearly the same as search_pubmed's (similarity 0.86); only the names and schemas tell them apart. Say in this description when to use search_pubmed instead.confusable_pair
  • Minor
    Its description is nearly the same as search_biorxiv's (similarity 0.86); only the names and schemas tell them apart. Say in this description when to use search_biorxiv instead.confusable_pair
  • Minor
    Its description is nearly the same as search_medrxiv's (similarity 0.86); only the names and schemas tell them apart. Say in this description when to use search_medrxiv instead.confusable_pair
  • Minor
    String arguments with no constraint or example: query.loose_string_param
  • Minor
    No `required` list, so every argument is optional.no_required

search_iacr

43 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
0 / 25
Return value
15 / 15
Constraints and side effects
3 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: query, max_results, fetch_details.param_no_description
  • Minor
    String arguments with no constraint or example: query.loose_string_param
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    The meaning of the boolean argument fetch_details is unclear.vague_boolean

search_medrxiv

43 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
0 / 25
Return value
15 / 15
Constraints and side effects
3 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: query, max_results.param_no_description
  • Minor
    Its description is nearly the same as search_arxiv's (similarity 0.90); only the names and schemas tell them apart. Say in this description when to use search_arxiv instead.confusable_pair
  • Minor
    Its description is nearly the same as search_pubmed's (similarity 0.90); only the names and schemas tell them apart. Say in this description when to use search_pubmed instead.confusable_pair
  • Minor
    Its description is nearly the same as search_biorxiv's (similarity 0.90); only the names and schemas tell them apart. Say in this description when to use search_biorxiv instead.confusable_pair
  • Minor
    Its description is nearly the same as search_google_scholar's (similarity 0.86); only the names and schemas tell them apart. Say in this description when to use search_google_scholar instead.confusable_pair
  • Minor
    String arguments with no constraint or example: query.loose_string_param
  • Minor
    No `required` list, so every argument is optional.no_required

search_pubmed

43 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
0 / 25
Return value
15 / 15
Constraints and side effects
3 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: query, max_results.param_no_description
  • Minor
    Its description is nearly the same as search_arxiv's (similarity 0.90); only the names and schemas tell them apart. Say in this description when to use search_arxiv instead.confusable_pair
  • Minor
    Its description is nearly the same as search_biorxiv's (similarity 0.90); only the names and schemas tell them apart. Say in this description when to use search_biorxiv instead.confusable_pair
  • Minor
    Its description is nearly the same as search_medrxiv's (similarity 0.90); only the names and schemas tell them apart. Say in this description when to use search_medrxiv instead.confusable_pair
  • Minor
    Its description is nearly the same as search_google_scholar's (similarity 0.86); only the names and schemas tell them apart. Say in this description when to use search_google_scholar instead.confusable_pair
  • Minor
    String arguments with no constraint or example: query.loose_string_param
  • Minor
    No `required` list, so every argument is optional.no_required

search_semantic

43 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
0 / 25
Return value
15 / 15
Constraints and side effects
3 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: year, query, max_results.param_no_description
  • Minor
    String arguments with no constraint or example: query.loose_string_param
  • Minor
    No `required` list, so every argument is optional.no_required

What static scoring cannot tell

This score reads only the text of each description and schema: it says what is written, not what a model will do. Short tools whose names already say what they do, such as browser_close, score low here even when models use them well, and in our measurements current models chose the right tool in one step even from one-line descriptions, as long as the names and schemas differed. What the text cannot show, such as what happens over several steps and whether an added sentence helps or misleads, is what an evaluation measures, on the Pro and Team plans.

Is your server listed here and you would rather it were not? Email support@forecall.dev, and we will take it off within 7 days.

All scored servers