Forecall
Failure recordsDocs
All scored servers

io.github.MCPServings/paper-mcp: tool descriptions scored

tools/list taken
(UTC)
From
Official MCP Registry
Connected to
https://latex-tools.online/mcp
Homepage
latex-tools.online/mcp
Repository
github.com/MCPServings/paper-mcp
Scoring rules
v2
Removal
support@forecall.dev
Score this URL as it is today

Scores, issues and names only

This page shows how io.github.MCPServings/paper-mcp's tool descriptions scored, the issues found and the names of its tools and parameters. The descriptions are the server's own: read them where the copy came from.

Forecall asked the URL this server lists in the official MCP Registry for its tools/list once, on the date above, without calling any tool. The server may have changed since.

servers/io.github.MCPServings/paper-mcp
Average score
24.0 / 100Rain
Tools
41
Near-identical descriptions
3

Across the server

  • Major
    41 tools. Above 40, models choose less accurately.too_many_tools
  • Minor
    The server's instructions are 3518 characters. Claude Code reads only the first 2,048 by default (Codex 0.154.0 reads them whole). Put what the server is for first.instructions_long

Tools whose descriptions are nearly the same

3 of 3 pairs shown, highest description similarity first.
ToolToolDescription similarityName similarity
recognize_formularecognize_table0.670.33
get_paper_authorssearch_authors0.640.25
search_authorssearch_openalex_authors0.470.67

Tools

get_openalex_references

9 / 100Rain

Purpose
6 / 20
When to use
0 / 20
Arguments
3 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    The description only restates the name (8 words).restates_name
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: work_id, max_results.param_no_description
  • Minor
    String arguments with no constraint or example: work_id.loose_string_param
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints
  • Minor
    Required identifiers whose description does not say where the value comes from: work_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

list_categories

11 / 100Rain

Purpose
6 / 20
When to use
0 / 20
Arguments
5 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    The description only restates the name (8 words).restates_name
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: source.param_no_description
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

get_author

12 / 100Rain

Purpose
6 / 20
When to use
0 / 20
Arguments
3 / 25
Return value
0 / 15
Constraints and side effects
3 / 10
Examples
0 / 10
  • Major
    The description only restates the name (9 words).restates_name
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: author_id.param_no_description
  • Minor
    String arguments with no constraint or example: author_id.loose_string_param
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    Required identifiers whose description does not say where the value comes from: author_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

autocomplete_papers

13 / 100Rain

Purpose
10 / 20
When to use
0 / 20
Arguments
3 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: query.param_no_description
  • Minor
    String arguments with no constraint or example: query.loose_string_param
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

get_openalex_citations

13 / 100Rain

Purpose
10 / 20
When to use
0 / 20
Arguments
3 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: work_id, max_results, start.param_no_description
  • Minor
    String arguments with no constraint or example: work_id.loose_string_param
  • Minor
    The description mentions none of its 3 or more arguments.params_not_in_description
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints
  • Minor
    Required identifiers whose description does not say where the value comes from: work_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

get_author_papers

16 / 100Rain

Purpose
10 / 20
When to use
0 / 20
Arguments
3 / 25
Return value
0 / 15
Constraints and side effects
3 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: author_id, max_results, start.param_no_description
  • Minor
    String arguments with no constraint or example: author_id.loose_string_param
  • Minor
    The description mentions none of its 3 or more arguments.params_not_in_description
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    Required identifiers whose description does not say where the value comes from: author_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

get_openalex_work

17 / 100Rain

Purpose
14 / 20
When to use
0 / 20
Arguments
3 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: work_id.param_no_description
  • Minor
    String arguments with no constraint or example: work_id.loose_string_param
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints
  • Minor
    Required identifiers whose description does not say where the value comes from: work_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

get_paper_citations

17 / 100Rain

Purpose
14 / 20
When to use
0 / 20
Arguments
3 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: paper_id, max_results, start.param_no_description
  • Minor
    String arguments with no constraint or example: paper_id.loose_string_param
  • Minor
    The description mentions none of its 3 or more arguments.params_not_in_description
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints
  • Minor
    Required identifiers whose description does not say where the value comes from: paper_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

get_paper_references

17 / 100Rain

Purpose
14 / 20
When to use
0 / 20
Arguments
3 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: paper_id, max_results, start.param_no_description
  • Minor
    String arguments with no constraint or example: paper_id.loose_string_param
  • Minor
    The description mentions none of its 3 or more arguments.params_not_in_description
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints
  • Minor
    Required identifiers whose description does not say where the value comes from: paper_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

list_openalex_topics

17 / 100Rain

Purpose
14 / 20
When to use
0 / 20
Arguments
3 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: query, max_results.param_no_description
  • Minor
    String arguments with no constraint or example: query.loose_string_param
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

match_paper_title

17 / 100Rain

Purpose
14 / 20
When to use
0 / 20
Arguments
3 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: title.param_no_description
  • Minor
    String arguments with no constraint or example: title.loose_string_param
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

search_openalex_institutions

17 / 100Rain

Purpose
14 / 20
When to use
0 / 20
Arguments
3 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: query, max_results.param_no_description
  • Minor
    String arguments with no constraint or example: query.loose_string_param
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

get_paper

18 / 100Rain

Purpose
13 / 20
When to use
0 / 20
Arguments
5 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: paper_id, source.param_no_description
  • Minor
    String arguments with no constraint or example: paper_id.loose_string_param
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints
  • Minor
    Required identifiers whose description does not say where the value comes from: paper_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

list_recent

18 / 100Rain

Purpose
13 / 20
When to use
0 / 20
Arguments
5 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: category, source, max_results, start.param_no_description
  • Minor
    String arguments with no constraint or example: category.loose_string_param
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

get_dataset_diffs

19 / 100Rain

Purpose
14 / 20
When to use
0 / 20
Arguments
5 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: dataset_name, start_release, end_release.param_no_description
  • Minor
    String arguments with no constraint or example: dataset_name, start_release.loose_string_param
  • Minor
    The description mentions none of its 3 or more arguments.params_not_in_description
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

get_dataset_download_links

19 / 100Rain

Purpose
14 / 20
When to use
0 / 20
Arguments
5 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: dataset_name, release_id.param_no_description
  • Minor
    String arguments with no constraint or example: dataset_name.loose_string_param
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

search_openalex_works

19 / 100Rain

Purpose
14 / 20
When to use
0 / 20
Arguments
5 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: query, from_year, to_year, is_oa, min_citations, institution_id, sort_by, max_results.param_no_description
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    The meaning of the boolean argument is_oa is unclear.vague_boolean
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

get_paper_authors

20 / 100Rain

Purpose
14 / 20
When to use
0 / 20
Arguments
3 / 25
Return value
0 / 15
Constraints and side effects
3 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: paper_id, max_results, start.param_no_description
  • Minor
    Its description is nearly the same as search_authors's (similarity 0.64); only the names and schemas tell them apart. Say in this description when to use search_authors instead.confusable_pair
  • Minor
    String arguments with no constraint or example: paper_id.loose_string_param
  • Minor
    The description mentions none of its 3 or more arguments.params_not_in_description
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    Required identifiers whose description does not say where the value comes from: paper_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

get_authors_batch

21 / 100Rain

Purpose
10 / 20
When to use
0 / 20
Arguments
8 / 25
Return value
0 / 15
Constraints and side effects
3 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: ids.param_no_description
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    Required identifiers whose description does not say where the value comes from: ids. Name the tool or the place that returns it, or models look it up first.id_source_missing

search_by_author

21 / 100Rain

Purpose
13 / 20
When to use
0 / 20
Arguments
5 / 25
Return value
0 / 15
Constraints and side effects
3 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: author, source, max_results, start.param_no_description
  • Minor
    String arguments with no constraint or example: author.loose_string_param
  • Minor
    Says nothing about what it returns.no_return_info

get_papers_batch

22 / 100Rain

Purpose
14 / 20
When to use
0 / 20
Arguments
8 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: ids.param_no_description
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints
  • Minor
    Required identifiers whose description does not say where the value comes from: ids. Name the tool or the place that returns it, or models look it up first.id_source_missing

get_dataset_release

24 / 100Rain

Purpose
14 / 20
When to use
0 / 20
Arguments
5 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: release_id.param_no_description
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

search_snippets

24 / 100Rain

Purpose
14 / 20
When to use
0 / 20
Arguments
3 / 25
Return value
7 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: query, max_results.param_no_description
  • Minor
    String arguments with no constraint or example: query.loose_string_param
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

recommend_papers_from_examples

27 / 100Rain

Purpose
14 / 20
When to use
0 / 20
Arguments
8 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: positive_ids, negative_ids, max_results.param_no_description
  • Minor
    The description mentions none of its 3 or more arguments.params_not_in_description
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints
  • Minor
    Required identifiers whose description does not say where the value comes from: positive_ids. Name the tool or the place that returns it, or models look it up first.id_source_missing

search_authors

27 / 100Rain

Purpose
14 / 20
When to use
0 / 20
Arguments
3 / 25
Return value
7 / 15
Constraints and side effects
3 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: query, max_results, start.param_no_description
  • Minor
    Its description is nearly the same as get_paper_authors's (similarity 0.64); only the names and schemas tell them apart. Say in this description when to use get_paper_authors instead.confusable_pair
  • Minor
    Its description is nearly the same as search_openalex_authors's (similarity 0.47); only the names and schemas tell them apart. Say in this description when to use search_openalex_authors instead.confusable_pair
  • Minor
    String arguments with no constraint or example: query.loose_string_param
  • Minor
    The description mentions none of its 3 or more arguments.params_not_in_description

search_openalex_authors

27 / 100Rain

Purpose
14 / 20
When to use
0 / 20
Arguments
3 / 25
Return value
7 / 15
Constraints and side effects
3 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: query, max_results, start.param_no_description
  • Minor
    Its description is nearly the same as search_authors's (similarity 0.47); only the names and schemas tell them apart. Say in this description when to use search_authors instead.confusable_pair
  • Minor
    String arguments with no constraint or example: query.loose_string_param
  • Minor
    The description mentions none of its 3 or more arguments.params_not_in_description

lint_latex

29 / 100Rain

Purpose
14 / 20
When to use
0 / 20
Arguments
3 / 25
Return value
7 / 15
Constraints and side effects
0 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: code.param_no_description
  • Minor
    String arguments with no constraint or example: code.loose_string_param
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

recognize_formula

29 / 100Rain

Purpose
17 / 20
When to use
0 / 20
Arguments
5 / 25
Return value
7 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: image_url, image_base64, model.param_no_description
  • Minor
    Its description is nearly the same as recognize_table's (similarity 0.67); only the names and schemas tell them apart. Say in this description when to use recognize_table instead.confusable_pair
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

recognize_table

29 / 100Rain

Purpose
17 / 20
When to use
0 / 20
Arguments
5 / 25
Return value
7 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: image_url, image_base64, model.param_no_description
  • Minor
    Its description is nearly the same as recognize_formula's (similarity 0.67); only the names and schemas tell them apart. Say in this description when to use recognize_formula instead.confusable_pair
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

search_papers_bulk

29 / 100Rain

Purpose
17 / 20
When to use
0 / 20
Arguments
7 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: query, sort, fields_of_study, year, venue, publication_types, open_access_pdf, token, max_results.param_no_description
  • Minor
    String arguments with no constraint or example: query.loose_string_param
  • Minor
    The meaning of the boolean argument open_access_pdf is unclear.vague_boolean
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

search_papers

30 / 100Rain

Purpose
17 / 20
When to use
0 / 20
Arguments
6 / 25
Return value
7 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: query, source, max_results, start, sort_by.param_no_description
  • Minor
    String arguments with no constraint or example: query.loose_string_param
  • Minor
    The description mentions none of its 3 or more arguments.params_not_in_description
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

list_ocr_models

31 / 100Rain

Purpose
6 / 20
When to use
0 / 20
Arguments
25 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    The description only restates the name (8 words).restates_name
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

list_paper_sources

31 / 100Rain

Purpose
6 / 20
When to use
0 / 20
Arguments
25 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    The description only restates the name (4 words).restates_name
  • Major
    The description is too short (4 words).too_short
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

read_paper

31 / 100Rain

Purpose
20 / 20
When to use
0 / 20
Arguments
6 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: paper_id, format, source.param_no_description
  • Minor
    String arguments with no constraint or example: paper_id.loose_string_param
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints
  • Minor
    Required identifiers whose description does not say where the value comes from: paper_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

recommend_papers_for_paper

34 / 100Rain

Purpose
17 / 20
When to use
0 / 20
Arguments
5 / 25
Return value
7 / 15
Constraints and side effects
0 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: paper_id, max_results, pool.param_no_description
  • Minor
    String arguments with no constraint or example: paper_id.loose_string_param
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints
  • Minor
    Required identifiers whose description does not say where the value comes from: paper_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

extract_pdf_result

35 / 100Rain

Purpose
20 / 20
When to use
0 / 20
Arguments
3 / 25
Return value
7 / 15
Constraints and side effects
0 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: task_id.param_no_description
  • Minor
    String arguments with no constraint or example: task_id.loose_string_param
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints
  • Minor
    Required identifiers whose description does not say where the value comes from: task_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

extract_pdf

37 / 100Rain

Purpose
20 / 20
When to use
0 / 20
Arguments
5 / 25
Return value
7 / 15
Constraints and side effects
0 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: pdf_url, pdf_base64, formula, table.param_no_description
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    The meaning of the boolean argument formula is unclear.vague_boolean
  • Minor
    The meaning of the boolean argument table is unclear.vague_boolean
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

get_openalex_trends

37 / 100Rain

Purpose
17 / 20
When to use
0 / 20
Arguments
5 / 25
Return value
7 / 15
Constraints and side effects
3 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: query, group_by.param_no_description
  • Minor
    String arguments with no constraint or example: query.loose_string_param

search_all

37 / 100Rain

Purpose
17 / 20
When to use
10 / 20
Arguments
5 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
5 / 10
  • Major
    Arguments without a description: query, max_results, sources, per_source.param_no_description
  • Minor
    String arguments with no constraint or example: query.loose_string_param
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

list_dataset_releases

39 / 100Rain

Purpose
14 / 20
When to use
0 / 20
Arguments
25 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

search_medical

44 / 100Cloudy

Purpose
17 / 20
When to use
10 / 20
Arguments
5 / 25
Return value
7 / 15
Constraints and side effects
0 / 10
Examples
5 / 10
  • Major
    Arguments without a description: query, study_types, year_from, max_results, fetch_fulltext.param_no_description
  • Minor
    String arguments with no constraint or example: query.loose_string_param
  • Minor
    The meaning of the boolean argument fetch_fulltext is unclear.vague_boolean
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

What static scoring cannot tell

This score reads only the text of each description and schema: it says what is written, not what a model will do. Short tools whose names already say what they do, such as browser_close, score low here even when models use them well, and in our measurements current models chose the right tool in one step even from one-line descriptions, as long as the names and schemas differed. What the text cannot show, such as what happens over several steps and whether an added sentence helps or misleads, is what an evaluation measures, on the Pro and Team plans.

Is your server listed here and you would rather it were not? Email support@forecall.dev, and we will take it off within 7 days.

All scored servers