Forecall
Failure recordsDocs
All scored servers

ResearchPilot: tool descriptions scored io.github.cnucho/researchpilot

tools/list taken
(UTC)
From
Official MCP Registry
Connected to
https://researchpilot-academy-production.up.railway.app/mcp
Repository
github.com/cnucho/AcademicResearchCopilot
Scoring rules
v2
Removal
support@forecall.dev
Score this URL as it is today

Scores, issues and names only

This page shows how ResearchPilot (io.github.cnucho/researchpilot)'s tool descriptions scored, the issues found and the names of its tools and parameters. The descriptions are the server's own: read them where the copy came from.

Forecall asked the URL this server lists in the official MCP Registry for its tools/list once, on the date above, without calling any tool. The server may have changed since.

servers/io.github.cnucho/researchpilot
Average score
46.1 / 100Cloudy
Tools
23
Near-identical descriptions
0

Across the server

No server-wide issues.

Tools

researchpilot_check_method

34 / 100Rain

Purpose
17 / 20
When to use
0 / 20
Arguments
10 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: capabilityId.param_no_description
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    Required identifiers whose description does not say where the value comes from: capabilityId. Name the tool or the place that returns it, or models look it up first.id_source_missing

researchpilot_search_datasets

34 / 100Rain

Purpose
17 / 20
When to use
0 / 20
Arguments
10 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: query, scope.param_no_description
  • Minor
    Says nothing about what it returns.no_return_info

researchpilot_search_literature

34 / 100Rain

Purpose
17 / 20
When to use
0 / 20
Arguments
10 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: query.param_no_description
  • Minor
    Says nothing about what it returns.no_return_info

researchpilot_content_analysis_template

37 / 100Rain

Purpose
20 / 20
When to use
0 / 20
Arguments
10 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: researchQuestion, approach, codingMode.param_no_description
  • Minor
    The description mentions none of its 3 or more arguments.params_not_in_description
  • Minor
    Says nothing about what it returns.no_return_info

researchpilot_prepare_specialist_execution

37 / 100Rain

Purpose
17 / 20
When to use
0 / 20
Arguments
10 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: projectId, capabilityId, requestedWork, rigor, requiredOutputs.param_no_description
  • Minor
    The description mentions none of its 3 or more arguments.params_not_in_description
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    The name is long (42 characters).long_name
  • Minor
    Required identifiers whose description does not say where the value comes from: projectId, capabilityId. Name the tool or the place that returns it, or models look it up first.id_source_missing

researchpilot_text_analysis_pilot

37 / 100Rain

Purpose
20 / 20
When to use
0 / 20
Arguments
10 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: researchQuestion, sourceType, query, period, targetSize, approach, codingMode, corpusItems, corpusItems[].id, corpusItems[].title, corpusItems[].source, corpusItems[].text, corpusItems[].digest, corpusItems[].provenance, categories.param_no_description
  • Minor
    The description mentions none of its 3 or more arguments.params_not_in_description
  • Minor
    Says nothing about what it returns.no_return_info

researchpilot_read_handoff_evidence

39 / 100Rain

Purpose
17 / 20
When to use
5 / 20
Arguments
10 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Arguments without a description: handoff, sourceId, offset.param_no_description
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    Required identifiers whose description does not say where the value comes from: sourceId. Name the tool or the place that returns it, or models look it up first.id_source_missing

researchpilot_handoff_context

40 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
10 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: handoff.param_no_description
  • Minor
    Says nothing about what it returns.no_return_info

researchpilot_validate_specialist_receipt

40 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
10 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: request, receipt.param_no_description
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    The name is long (41 characters).long_name

researchpilot_read_work_artifact

42 / 100Cloudy

Purpose
17 / 20
When to use
5 / 20
Arguments
10 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
  • Major
    Arguments without a description: projectId, artifactId.param_no_description
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    Required identifiers whose description does not say where the value comes from: projectId, artifactId. Name the tool or the place that returns it, or models look it up first.id_source_missing

researchpilot_research_registry

42 / 100Cloudy

Purpose
17 / 20
When to use
5 / 20
Arguments
10 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
  • Major
    Arguments without a description: kind, query, limit.param_no_description
  • Minor
    The description mentions none of its 3 or more arguments.params_not_in_description
  • Minor
    Says nothing about what it returns.no_return_info

researchpilot_handoff_summary

44 / 100Cloudy

Purpose
17 / 20
When to use
0 / 20
Arguments
10 / 25
Return value
7 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: handoff.param_no_description

researchpilot_list_work_artifacts

45 / 100Cloudy

Purpose
20 / 20
When to use
5 / 20
Arguments
10 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
  • Major
    Arguments without a description: projectId.param_no_description
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    Required identifiers whose description does not say where the value comes from: projectId. Name the tool or the place that returns it, or models look it up first.id_source_missing

researchpilot_get_project_context

47 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
10 / 25
Return value
7 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: projectId.param_no_description
  • Minor
    Required identifiers whose description does not say where the value comes from: projectId. Name the tool or the place that returns it, or models look it up first.id_source_missing

researchpilot_build_collection_recipe

49 / 100Cloudy

Purpose
20 / 20
When to use
5 / 20
Arguments
10 / 25
Return value
7 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Arguments without a description: goal, sourceType, query, period, targetSize.param_no_description
  • Minor
    The description mentions none of its 3 or more arguments.params_not_in_description

researchpilot_capabilities

52 / 100Cloudy

Purpose
17 / 20
When to use
0 / 20
Arguments
25 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    Says nothing about what it returns.no_return_info

researchpilot_record_routing_feedback

52 / 100Cloudy

Purpose
20 / 20
When to use
15 / 20
Arguments
10 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Arguments without a description: projectId, taskFamily, capabilityId, toolName, outcome, feedback.param_no_description
  • Minor
    Says nothing about what it returns.no_return_info

researchpilot_update_user_preferences

52 / 100Cloudy

Purpose
20 / 20
When to use
15 / 20
Arguments
7 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
  • Major
    Arguments without a description: answerStyle, resultFirst, writingVoice, avoidTextbookStyle, preferEvidenceBeforeAdvice, preferredOutput, discipline, targetGenre, citationStyle.param_no_description
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    The description mentions none of its 3 or more arguments.params_not_in_description
  • Minor
    Says nothing about what it returns.no_return_info

researchpilot_get_user_memory

57 / 100Cloudy

Purpose
17 / 20
When to use
5 / 20
Arguments
25 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
  • Minor
    Says nothing about what it returns.no_return_info

researchpilot_open_workspace

57 / 100Cloudy

Purpose
20 / 20
When to use
5 / 20
Arguments
25 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Minor
    Says nothing about what it returns.no_return_info

researchpilot_save_work_artifact

57 / 100Cloudy

Purpose
20 / 20
When to use
10 / 20
Arguments
10 / 25
Return value
7 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
  • Major
    Arguments without a description: projectId, contextDigest, kind, title, text, sourceRefs.param_no_description
  • Minor
    The description mentions none of its 3 or more arguments.params_not_in_description
  • Minor
    Required identifiers whose description does not say where the value comes from: projectId. Name the tool or the place that returns it, or models look it up first.id_source_missing

researchpilot_list_projects

65 / 100Cloudy

Purpose
20 / 20
When to use
5 / 20
Arguments
25 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
5 / 10
  • Minor
    Says nothing about what it returns.no_return_info

researchpilot_get_profile

67 / 100Cloudy

Purpose
17 / 20
When to use
0 / 20
Arguments
25 / 25
Return value
15 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context

What static scoring cannot tell

This score reads only the text of each description and schema: it says what is written, not what a model will do. Short tools whose names already say what they do, such as browser_close, score low here even when models use them well, and in our measurements current models chose the right tool in one step even from one-line descriptions, as long as the names and schemas differed. What the text cannot show, such as what happens over several steps and whether an added sentence helps or misleads, is what an evaluation measures, on the Pro and Team plans.

Is your server listed here and you would rather it were not? Email support@forecall.dev, and we will take it off within 7 days.

All scored servers