This page shows how MethodIQ Tools (io.github.cnucho/methodiq-tools)'s tool descriptions scored, the issues found and the names of its tools and parameters. The descriptions are the server's own: read them where the copy came from.
Forecall asked the URL this server lists in the official MCP Registry for its tools/list once, on the date above, without calling any tool. The server may have changed since.
servers/io.github.cnucho/methodiq-tools
Average score
36.4/ 100Rain
Tools
101
Near-identical descriptions
120
Across the server
Major
101 tools. Above 40, models choose less accurately.too_many_tools
Minor
120 pairs with nearly the same description in all; the top 12 are shown.confusable_pair_total
Minor
The server's instructions are 2422 characters. Claude Code reads only the first 2,048 by default (Codex 0.154.0 reads them whole). Put what the server is for first.instructions_long
Tools whose descriptions are nearly the same
12 of 120 pairs shown, highest description similarity first.
Tool
Tool
Description similarity
Name similarity
create_chart
create_report_chart
0.94
0.67
update_report_chart
update_chart
0.94
0.67
create_report_chart
update_report_chart
0.89
0.50
create_chart
get_chart
0.88
0.33
create_chart
update_chart
0.88
0.33
create_chart
undo_chart
0.88
0.33
create_chart
validate_chart
0.88
0.33
create_chart
export_chart
0.88
0.33
get_chart
update_chart
0.88
0.33
get_chart
undo_chart
0.88
0.33
get_chart
validate_chart
0.88
0.33
get_chart
export_chart
0.88
0.33
Tools
create_pptx_from_outline
13/ 100Rain
Purpose
6 / 20
When to use
0 / 20
Arguments
0 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
Major
The description only restates the name (9 words).restates_name
Major
Says nothing about when to use it, or when not to.no_usage_context
Major
Arguments without a description: plan, plan.title, plan.slides.param_no_description
Minor
String arguments with no constraint or example: plan.title.loose_string_param
Minor
No `required` list, so every argument is optional.no_required
Minor
The description mentions none of its 3 or more arguments.params_not_in_description
Minor
Says nothing about what it returns.no_return_info
surveyviz_export_chart_book_html
13/ 100Rain
Purpose
6 / 20
When to use
0 / 20
Arguments
0 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
Major
The description only restates the name (9 words).restates_name
Major
Says nothing about when to use it, or when not to.no_usage_context
Major
Arguments without a description: specs, packets, title, locale.param_no_description
Minor
String arguments with no constraint or example: title, locale.loose_string_param
Minor
No `required` list, so every argument is optional.no_required
Minor
Says nothing about what it returns.no_return_info
validate_slide_plan
13/ 100Rain
Purpose
6 / 20
When to use
0 / 20
Arguments
0 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
Major
The description only restates the name (5 words).restates_name
Major
The description is too short (5 words).too_short
Major
Says nothing about when to use it, or when not to.no_usage_context
Major
Arguments without a description: plan, plan.title, plan.slides.param_no_description
Minor
String arguments with no constraint or example: plan.title.loose_string_param
Minor
No `required` list, so every argument is optional.no_required
Minor
Says nothing about what it returns.no_return_info
surveyviz_render_chart_html
18/ 100Rain
Purpose
6 / 20
When to use
0 / 20
Arguments
5 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
Major
The description only restates the name (6 words).restates_name
Major
The description is too short (6 words).too_short
Major
Says nothing about when to use it, or when not to.no_usage_context
Major
Arguments without a description: spec, chart_spec, width.param_no_description
Minor
No `required` list, so every argument is optional.no_required
Minor
Says nothing about what it returns.no_return_info
export_graphviz_dot
19/ 100Rain
Purpose
6 / 20
When to use
0 / 20
Arguments
6 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
Major
The description only restates the name (8 words).restates_name
Major
Says nothing about when to use it, or when not to.no_usage_context
Major
Arguments without a description: graph, graph.direction, graph.nodes, graph.nodes[].id, graph.nodes[].label, graph.nodes[].group, graph.nodes[].shape, graph.edges, graph.edges[].from, graph.edges[].to, graph.edges[].label, graph.edges[].style, graph.edges[].direction, graph.edges[].curve.param_no_description
Minor
String arguments with no constraint or example: graph.nodes[].label, graph.nodes[].group, graph.edges[].label.loose_string_param
Minor
The meaning of the boolean argument graph.edges[].curve is unclear.vague_boolean
Minor
Says nothing about what it returns.no_return_info
export_mermaid_flowchart
19/ 100Rain
Purpose
6 / 20
When to use
0 / 20
Arguments
6 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
Major
The description only restates the name (8 words).restates_name
Major
Says nothing about when to use it, or when not to.no_usage_context
Major
Arguments without a description: graph, graph.direction, graph.nodes, graph.nodes[].id, graph.nodes[].label, graph.nodes[].group, graph.nodes[].shape, graph.edges, graph.edges[].from, graph.edges[].to, graph.edges[].label, graph.edges[].style, graph.edges[].direction, graph.edges[].curve.param_no_description
Minor
String arguments with no constraint or example: graph.nodes[].label, graph.nodes[].group, graph.edges[].label.loose_string_param
Minor
The meaning of the boolean argument graph.edges[].curve is unclear.vague_boolean
Minor
Says nothing about what it returns.no_return_info
normalize_graph
19/ 100Rain
Purpose
6 / 20
When to use
0 / 20
Arguments
6 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
Major
The description only restates the name (9 words).restates_name
Major
Says nothing about when to use it, or when not to.no_usage_context
Major
Arguments without a description: graph, graph.direction, graph.nodes, graph.nodes[].id, graph.nodes[].label, graph.nodes[].group, graph.nodes[].shape, graph.edges, graph.edges[].from, graph.edges[].to, graph.edges[].label, graph.edges[].style, graph.edges[].direction, graph.edges[].curve.param_no_description
Minor
String arguments with no constraint or example: graph.nodes[].label, graph.nodes[].group, graph.edges[].label.loose_string_param
Minor
The meaning of the boolean argument graph.edges[].curve is unclear.vague_boolean
Minor
Says nothing about what it returns.no_return_info
summarize_slide_plan
20/ 100Rain
Purpose
13 / 20
When to use
0 / 20
Arguments
0 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
Major
The description is too short (6 words).too_short
Major
Says nothing about when to use it, or when not to.no_usage_context
Major
Arguments without a description: plan, plan.title, plan.slides.param_no_description
Minor
String arguments with no constraint or example: plan.title.loose_string_param
Minor
No `required` list, so every argument is optional.no_required
Minor
The description mentions none of its 3 or more arguments.params_not_in_description
Minor
Says nothing about what it returns.no_return_info
get_pptx_document
23/ 100Rain
Purpose
6 / 20
When to use
0 / 20
Arguments
10 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
Major
The description only restates the name (7 words).restates_name
Major
The description is too short (7 words).too_short
Major
Says nothing about when to use it, or when not to.no_usage_context
Major
Arguments without a description: documentId, revision.param_no_description
Minor
Says nothing about what it returns.no_return_info
Minor
Required identifiers whose description does not say where the value comes from: documentId. Name the tool or the place that returns it, or models look it up first.id_source_missing
review_layout_plan
23/ 100Rain
Purpose
10 / 20
When to use
0 / 20
Arguments
6 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
Major
Says nothing about when to use it, or when not to.no_usage_context
Major
Arguments without a description: graph, graph.direction, graph.nodes, graph.nodes[].id, graph.nodes[].label, graph.nodes[].group, graph.nodes[].shape, graph.edges, graph.edges[].from, graph.edges[].to, graph.edges[].label, graph.edges[].style, graph.edges[].direction, graph.edges[].curve.param_no_description
Minor
String arguments with no constraint or example: graph.nodes[].label, graph.nodes[].group, graph.edges[].label.loose_string_param
Minor
The meaning of the boolean argument graph.edges[].curve is unclear.vague_boolean
Minor
Says nothing about what it returns.no_return_info
render_diagram_editor
25/ 100Rain
Purpose
13 / 20
When to use
0 / 20
Arguments
5 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
Major
Says nothing about when to use it, or when not to.no_usage_context
Major
Arguments without a description: diagramId.param_no_description
Minor
String arguments with no constraint or example: diagramId.loose_string_param
Minor
Says nothing about what it returns.no_return_info
set_diagram_selection
25/ 100Rain
Purpose
13 / 20
When to use
0 / 20
Arguments
5 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
Major
Says nothing about when to use it, or when not to.no_usage_context
Major
Arguments without a description: diagramId, expectedRevision, selection, selection[].kind, selection[].id.param_no_description
Minor
String arguments with no constraint or example: diagramId, selection[].id.loose_string_param
Minor
The description mentions none of its 3 or more arguments.params_not_in_description
Minor
Says nothing about what it returns.no_return_info
Minor
Required identifiers whose description does not say where the value comes from: diagramId. Name the tool or the place that returns it, or models look it up first.id_source_missing
undo_diagram
25/ 100Rain
Purpose
13 / 20
When to use
0 / 20
Arguments
5 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
Major
Says nothing about when to use it, or when not to.no_usage_context
Major
Arguments without a description: diagramId, expectedRevision, redo.param_no_description
Minor
String arguments with no constraint or example: diagramId.loose_string_param
Minor
The meaning of the boolean argument redo is unclear.vague_boolean
Minor
Says nothing about what it returns.no_return_info
Minor
Required identifiers whose description does not say where the value comes from: diagramId. Name the tool or the place that returns it, or models look it up first.id_source_missing
extract_focus_graph
26/ 100Rain
Purpose
13 / 20
When to use
0 / 20
Arguments
6 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
Major
Says nothing about when to use it, or when not to.no_usage_context
Major
Arguments without a description: graph, graph.direction, graph.nodes, graph.nodes[].id, graph.nodes[].label, graph.nodes[].group, graph.nodes[].shape, graph.edges, graph.edges[].from, graph.edges[].to, graph.edges[].label, graph.edges[].style, graph.edges[].direction, graph.edges[].curve, center, depth, traversal.param_no_description
Minor
String arguments with no constraint or example: graph.nodes[].label, graph.nodes[].group, graph.edges[].label, center.loose_string_param
Minor
The description mentions none of its 3 or more arguments.params_not_in_description
Minor
The meaning of the boolean argument graph.edges[].curve is unclear.vague_boolean
Minor
Says nothing about what it returns.no_return_info
analysis_test_variance_homogeneity
27/ 100Rain
Purpose
10 / 20
When to use
0 / 20
Arguments
10 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
Major
Says nothing about when to use it, or when not to.no_usage_context
Major
Arguments without a description: groups.param_no_description
Minor
Says nothing about what it returns.no_return_info
get_diagram
28/ 100Rain
Purpose
13 / 20
When to use
0 / 20
Arguments
5 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
Major
Says nothing about when to use it, or when not to.no_usage_context
Major
Arguments without a description: diagramId.param_no_description
Minor
String arguments with no constraint or example: diagramId.loose_string_param
Minor
Says nothing about what it returns.no_return_info
Minor
Required identifiers whose description does not say where the value comes from: diagramId. Name the tool or the place that returns it, or models look it up first.id_source_missing
surveyviz_render_chart_svg
29/ 100Rain
Purpose
17 / 20
When to use
0 / 20
Arguments
5 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
Major
Says nothing about when to use it, or when not to.no_usage_context
Major
Arguments without a description: spec, chart_spec, width.param_no_description
Minor
No `required` list, so every argument is optional.no_required
Minor
Says nothing about what it returns.no_return_info
analyze_graph
30/ 100Rain
Purpose
17 / 20
When to use
0 / 20
Arguments
6 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
Major
Says nothing about when to use it, or when not to.no_usage_context
Major
Arguments without a description: graph, graph.direction, graph.nodes, graph.nodes[].id, graph.nodes[].label, graph.nodes[].group, graph.nodes[].shape, graph.edges, graph.edges[].from, graph.edges[].to, graph.edges[].label, graph.edges[].style, graph.edges[].direction, graph.edges[].curve, start.param_no_description
Minor
String arguments with no constraint or example: graph.nodes[].label, graph.nodes[].group, graph.edges[].label, start.loose_string_param
Minor
The description mentions none of its 3 or more arguments.params_not_in_description
Minor
The meaning of the boolean argument graph.edges[].curve is unclear.vague_boolean
Minor
Says nothing about what it returns.no_return_info
create_chart
30/ 100Rain
Purpose
17 / 20
When to use
0 / 20
Arguments
6 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
Major
Says nothing about when to use it, or when not to.no_usage_context
Its description is nearly the same as create_report_chart's (similarity 0.94); only the names and schemas tell them apart. Say in this description when to use create_report_chart instead.confusable_pair
Minor
Its description is nearly the same as get_chart's (similarity 0.88); only the names and schemas tell them apart. Say in this description when to use get_chart instead.confusable_pair
Minor
Its description is nearly the same as update_chart's (similarity 0.88); only the names and schemas tell them apart. Say in this description when to use update_chart instead.confusable_pair
Minor
Its description is nearly the same as undo_chart's (similarity 0.88); only the names and schemas tell them apart. Say in this description when to use undo_chart instead.confusable_pair
Minor
Its description is nearly the same as validate_chart's (similarity 0.88); only the names and schemas tell them apart. Say in this description when to use validate_chart instead.confusable_pair
Minor
Its description is nearly the same as export_chart's (similarity 0.88); only the names and schemas tell them apart. Say in this description when to use export_chart instead.confusable_pair
Minor
String arguments with no constraint or example: chartId, packet.table.category, packet.semantics.unit, packet.semantics.denominator.description, packet.semantics.weightDescription, packet.semantics.missingRule, packet.evidence[].id, packet.evidence[].producer, spec.type, feedback, format, text, data, sheetName.loose_string_param
Minor
The description mentions none of its 3 or more arguments.params_not_in_description
Minor
The meaning of the boolean argument confirmation is unclear.vague_boolean
Minor
The meaning of the boolean argument packet.semantics.weighted is unclear.vague_boolean
Minor
The meaning of the boolean argument packet.semantics.multipleResponse is unclear.vague_boolean
Minor
Says nothing about what it returns.no_return_info
create_report_chart
30/ 100Rain
Purpose
17 / 20
When to use
0 / 20
Arguments
6 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
Major
Says nothing about when to use it, or when not to.no_usage_context
Its description is nearly the same as create_chart's (similarity 0.94); only the names and schemas tell them apart. Say in this description when to use create_chart instead.confusable_pair
Minor
Its description is nearly the same as update_report_chart's (similarity 0.89); only the names and schemas tell them apart. Say in this description when to use update_report_chart instead.confusable_pair
Minor
String arguments with no constraint or example: chartId, packet.table.category, packet.semantics.unit, packet.semantics.denominator.description, packet.semantics.weightDescription, packet.semantics.missingRule, packet.evidence[].id, packet.evidence[].producer, spec.type, feedback, format, text, data, sheetName.loose_string_param
Minor
The description mentions none of its 3 or more arguments.params_not_in_description
Minor
The meaning of the boolean argument confirmation is unclear.vague_boolean
Minor
The meaning of the boolean argument packet.semantics.weighted is unclear.vague_boolean
Minor
The meaning of the boolean argument packet.semantics.multipleResponse is unclear.vague_boolean
Minor
Says nothing about what it returns.no_return_info
export_chart
30/ 100Rain
Purpose
17 / 20
When to use
0 / 20
Arguments
6 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
Major
Says nothing about when to use it, or when not to.no_usage_context
Its description is nearly the same as create_chart's (similarity 0.88); only the names and schemas tell them apart. Say in this description when to use create_chart instead.confusable_pair
Minor
Its description is nearly the same as get_chart's (similarity 0.88); only the names and schemas tell them apart. Say in this description when to use get_chart instead.confusable_pair
Minor
String arguments with no constraint or example: chartId, packet.table.category, packet.semantics.unit, packet.semantics.denominator.description, packet.semantics.weightDescription, packet.semantics.missingRule, packet.evidence[].id, packet.evidence[].producer, spec.type, feedback, format, text, data, sheetName.loose_string_param
Minor
The description mentions none of its 3 or more arguments.params_not_in_description
Minor
The meaning of the boolean argument confirmation is unclear.vague_boolean
Minor
The meaning of the boolean argument packet.semantics.weighted is unclear.vague_boolean
Minor
The meaning of the boolean argument packet.semantics.multipleResponse is unclear.vague_boolean
Minor
Says nothing about what it returns.no_return_info
Minor
Required identifiers whose description does not say where the value comes from: chartId. Name the tool or the place that returns it, or models look it up first.id_source_missing
get_chart
30/ 100Rain
Purpose
17 / 20
When to use
0 / 20
Arguments
6 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
Major
Says nothing about when to use it, or when not to.no_usage_context
Its description is nearly the same as create_chart's (similarity 0.88); only the names and schemas tell them apart. Say in this description when to use create_chart instead.confusable_pair
Minor
Its description is nearly the same as update_chart's (similarity 0.88); only the names and schemas tell them apart. Say in this description when to use update_chart instead.confusable_pair
Minor
Its description is nearly the same as undo_chart's (similarity 0.88); only the names and schemas tell them apart. Say in this description when to use undo_chart instead.confusable_pair
Minor
Its description is nearly the same as validate_chart's (similarity 0.88); only the names and schemas tell them apart. Say in this description when to use validate_chart instead.confusable_pair
Minor
Its description is nearly the same as export_chart's (similarity 0.88); only the names and schemas tell them apart. Say in this description when to use export_chart instead.confusable_pair
Minor
String arguments with no constraint or example: chartId, packet.table.category, packet.semantics.unit, packet.semantics.denominator.description, packet.semantics.weightDescription, packet.semantics.missingRule, packet.evidence[].id, packet.evidence[].producer, spec.type, feedback, format, text, data, sheetName.loose_string_param
Minor
The description mentions none of its 3 or more arguments.params_not_in_description
Minor
The meaning of the boolean argument confirmation is unclear.vague_boolean
Minor
The meaning of the boolean argument packet.semantics.weighted is unclear.vague_boolean
Minor
The meaning of the boolean argument packet.semantics.multipleResponse is unclear.vague_boolean
Minor
Says nothing about what it returns.no_return_info
Minor
Required identifiers whose description does not say where the value comes from: chartId. Name the tool or the place that returns it, or models look it up first.id_source_missing
import_chart_workbook
30/ 100Rain
Purpose
17 / 20
When to use
0 / 20
Arguments
6 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
Major
Says nothing about when to use it, or when not to.no_usage_context
String arguments with no constraint or example: chartId, packet.table.category, packet.semantics.unit, packet.semantics.denominator.description, packet.semantics.weightDescription, packet.semantics.missingRule, packet.evidence[].id, packet.evidence[].producer, spec.type, feedback, format, text, data, sheetName.loose_string_param
Minor
The description mentions none of its 3 or more arguments.params_not_in_description
Minor
The meaning of the boolean argument confirmation is unclear.vague_boolean
Minor
The meaning of the boolean argument packet.semantics.weighted is unclear.vague_boolean
Minor
The meaning of the boolean argument packet.semantics.multipleResponse is unclear.vague_boolean
Minor
Says nothing about what it returns.no_return_info
Minor
Required identifiers whose description does not say where the value comes from: chartId. Name the tool or the place that returns it, or models look it up first.id_source_missing
select_chart_element
30/ 100Rain
Purpose
17 / 20
When to use
0 / 20
Arguments
6 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
Major
Says nothing about when to use it, or when not to.no_usage_context
String arguments with no constraint or example: chartId, packet.table.category, packet.semantics.unit, packet.semantics.denominator.description, packet.semantics.weightDescription, packet.semantics.missingRule, packet.evidence[].id, packet.evidence[].producer, spec.type, feedback, format, text, data, sheetName.loose_string_param
Minor
The description mentions none of its 3 or more arguments.params_not_in_description
Minor
The meaning of the boolean argument confirmation is unclear.vague_boolean
Minor
The meaning of the boolean argument packet.semantics.weighted is unclear.vague_boolean
Minor
The meaning of the boolean argument packet.semantics.multipleResponse is unclear.vague_boolean
Minor
Says nothing about what it returns.no_return_info
Minor
Required identifiers whose description does not say where the value comes from: chartId. Name the tool or the place that returns it, or models look it up first.id_source_missing
submit_chart_feedback
30/ 100Rain
Purpose
17 / 20
When to use
0 / 20
Arguments
6 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
Major
Says nothing about when to use it, or when not to.no_usage_context
String arguments with no constraint or example: chartId, packet.table.category, packet.semantics.unit, packet.semantics.denominator.description, packet.semantics.weightDescription, packet.semantics.missingRule, packet.evidence[].id, packet.evidence[].producer, spec.type, feedback, format, text, data, sheetName.loose_string_param
Minor
The meaning of the boolean argument confirmation is unclear.vague_boolean
Minor
The meaning of the boolean argument packet.semantics.weighted is unclear.vague_boolean
Minor
The meaning of the boolean argument packet.semantics.multipleResponse is unclear.vague_boolean
Minor
Says nothing about what it returns.no_return_info
Minor
Required identifiers whose description does not say where the value comes from: chartId. Name the tool or the place that returns it, or models look it up first.id_source_missing
undo_chart
30/ 100Rain
Purpose
17 / 20
When to use
0 / 20
Arguments
6 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
Major
Says nothing about when to use it, or when not to.no_usage_context
Its description is nearly the same as create_chart's (similarity 0.88); only the names and schemas tell them apart. Say in this description when to use create_chart instead.confusable_pair
Minor
Its description is nearly the same as get_chart's (similarity 0.88); only the names and schemas tell them apart. Say in this description when to use get_chart instead.confusable_pair
Minor
String arguments with no constraint or example: chartId, packet.table.category, packet.semantics.unit, packet.semantics.denominator.description, packet.semantics.weightDescription, packet.semantics.missingRule, packet.evidence[].id, packet.evidence[].producer, spec.type, feedback, format, text, data, sheetName.loose_string_param
Minor
The description mentions none of its 3 or more arguments.params_not_in_description
Minor
The meaning of the boolean argument confirmation is unclear.vague_boolean
Minor
The meaning of the boolean argument packet.semantics.weighted is unclear.vague_boolean
Minor
The meaning of the boolean argument packet.semantics.multipleResponse is unclear.vague_boolean
Minor
Says nothing about what it returns.no_return_info
Minor
Required identifiers whose description does not say where the value comes from: chartId. Name the tool or the place that returns it, or models look it up first.id_source_missing
update_chart
30/ 100Rain
Purpose
17 / 20
When to use
0 / 20
Arguments
6 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
Major
Says nothing about when to use it, or when not to.no_usage_context
Its description is nearly the same as update_report_chart's (similarity 0.94); only the names and schemas tell them apart. Say in this description when to use update_report_chart instead.confusable_pair
Minor
Its description is nearly the same as create_chart's (similarity 0.88); only the names and schemas tell them apart. Say in this description when to use create_chart instead.confusable_pair
Minor
Its description is nearly the same as get_chart's (similarity 0.88); only the names and schemas tell them apart. Say in this description when to use get_chart instead.confusable_pair
Minor
String arguments with no constraint or example: chartId, packet.table.category, packet.semantics.unit, packet.semantics.denominator.description, packet.semantics.weightDescription, packet.semantics.missingRule, packet.evidence[].id, packet.evidence[].producer, spec.type, feedback, format, text, data, sheetName.loose_string_param
Minor
The description mentions none of its 3 or more arguments.params_not_in_description
Minor
The meaning of the boolean argument confirmation is unclear.vague_boolean
Minor
The meaning of the boolean argument packet.semantics.weighted is unclear.vague_boolean
Minor
The meaning of the boolean argument packet.semantics.multipleResponse is unclear.vague_boolean
Minor
Says nothing about what it returns.no_return_info
Minor
Required identifiers whose description does not say where the value comes from: chartId. Name the tool or the place that returns it, or models look it up first.id_source_missing
update_report_chart
30/ 100Rain
Purpose
17 / 20
When to use
0 / 20
Arguments
6 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
Major
Says nothing about when to use it, or when not to.no_usage_context
Its description is nearly the same as update_chart's (similarity 0.94); only the names and schemas tell them apart. Say in this description when to use update_chart instead.confusable_pair
Minor
Its description is nearly the same as create_report_chart's (similarity 0.89); only the names and schemas tell them apart. Say in this description when to use create_report_chart instead.confusable_pair
Minor
String arguments with no constraint or example: chartId, packet.table.category, packet.semantics.unit, packet.semantics.denominator.description, packet.semantics.weightDescription, packet.semantics.missingRule, packet.evidence[].id, packet.evidence[].producer, spec.type, feedback, format, text, data, sheetName.loose_string_param
Minor
The description mentions none of its 3 or more arguments.params_not_in_description
Minor
The meaning of the boolean argument confirmation is unclear.vague_boolean
Minor
The meaning of the boolean argument packet.semantics.weighted is unclear.vague_boolean
Minor
The meaning of the boolean argument packet.semantics.multipleResponse is unclear.vague_boolean
Minor
Says nothing about what it returns.no_return_info
Minor
Required identifiers whose description does not say where the value comes from: chartId. Name the tool or the place that returns it, or models look it up first.id_source_missing
validate_chart
30/ 100Rain
Purpose
17 / 20
When to use
0 / 20
Arguments
6 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
Major
Says nothing about when to use it, or when not to.no_usage_context
Its description is nearly the same as create_chart's (similarity 0.88); only the names and schemas tell them apart. Say in this description when to use create_chart instead.confusable_pair
Minor
Its description is nearly the same as get_chart's (similarity 0.88); only the names and schemas tell them apart. Say in this description when to use get_chart instead.confusable_pair
Minor
String arguments with no constraint or example: chartId, packet.table.category, packet.semantics.unit, packet.semantics.denominator.description, packet.semantics.weightDescription, packet.semantics.missingRule, packet.evidence[].id, packet.evidence[].producer, spec.type, feedback, format, text, data, sheetName.loose_string_param
Minor
The description mentions none of its 3 or more arguments.params_not_in_description
Minor
The meaning of the boolean argument confirmation is unclear.vague_boolean
Minor
The meaning of the boolean argument packet.semantics.weighted is unclear.vague_boolean
Minor
The meaning of the boolean argument packet.semantics.multipleResponse is unclear.vague_boolean
Minor
Says nothing about what it returns.no_return_info
analysis_analyze_correspondence
31/ 100Rain
Purpose
14 / 20
When to use
0 / 20
Arguments
10 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
Major
Says nothing about when to use it, or when not to.no_usage_context
Major
Arguments without a description: table, axes.param_no_description
Minor
Says nothing about what it returns.no_return_info
analysis_audit_reported_statistics
31/ 100Rain
Purpose
14 / 20
When to use
0 / 20
Arguments
10 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
Major
Says nothing about when to use it, or when not to.no_usage_context
Major
Arguments without a description: test, statistic, reported_p, df, df2, tolerance.param_no_description
Minor
Says nothing about what it returns.no_return_info
analysis_estimate_propensity_scores
31/ 100Rain
Purpose
14 / 20
When to use
0 / 20
Arguments
10 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
Major
Says nothing about when to use it, or when not to.no_usage_context
Major
Arguments without a description: X, treatment, regularization_C.param_no_description
Minor
The description mentions none of its 3 or more arguments.params_not_in_description
Minor
Says nothing about what it returns.no_return_info
analysis_fit_pls_regression
31/ 100Rain
Purpose
14 / 20
When to use
0 / 20
Arguments
10 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
Major
Says nothing about when to use it, or when not to.no_usage_context
Major
Arguments without a description: X, Y, components, folds.param_no_description
Minor
Says nothing about what it returns.no_return_info
create_diagram
31/ 100Rain
Purpose
17 / 20
When to use
0 / 20
Arguments
7 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
Major
Says nothing about when to use it, or when not to.no_usage_context
Major
Arguments without a description: templateId, title, graph, graph.direction, graph.nodes, graph.nodes[].id, graph.nodes[].label, graph.nodes[].group, graph.nodes[].shape, graph.edges, graph.edges[].from, graph.edges[].to, graph.edges[].label, graph.edges[].style, graph.edges[].direction, graph.edges[].curve.param_no_description
Minor
String arguments with no constraint or example: templateId, title, graph.nodes[].label, graph.nodes[].group, graph.edges[].label.loose_string_param
Minor
The meaning of the boolean argument graph.edges[].curve is unclear.vague_boolean
Minor
Says nothing about what it returns.no_return_info
delete_pptx_document
31/ 100Rain
Purpose
14 / 20
When to use
0 / 20
Arguments
10 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
Major
Says nothing about when to use it, or when not to.no_usage_context
Major
Arguments without a description: documentId, revision.param_no_description
Minor
Says nothing about what it returns.no_return_info
Minor
Required identifiers whose description does not say where the value comes from: documentId. Name the tool or the place that returns it, or models look it up first.id_source_missing
analysis_diagnose_covariate_balance
34/ 100Rain
Purpose
17 / 20
When to use
0 / 20
Arguments
10 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
Major
Says nothing about when to use it, or when not to.no_usage_context
Major
Arguments without a description: X, treatment.param_no_description
Minor
Says nothing about what it returns.no_return_info
apply_diagram_changes
34/ 100Rain
Purpose
17 / 20
When to use
5 / 20
Arguments
5 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
Major
Arguments without a description: diagramId, expectedRevision, changes, changes[].op, changes[].id, changes[].node, changes[].edge, changes[].patch, changes[].title, changes[].direction.param_no_description
Minor
String arguments with no constraint or example: diagramId, changes[].id, changes[].title.loose_string_param
Minor
Says nothing about what it returns.no_return_info
Minor
Required identifiers whose description does not say where the value comes from: diagramId. Name the tool or the place that returns it, or models look it up first.id_source_missing
apply_pptx_patch
34/ 100Rain
Purpose
17 / 20
When to use
0 / 20
Arguments
10 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
Major
Says nothing about when to use it, or when not to.no_usage_context
The description mentions none of its 3 or more arguments.params_not_in_description
Minor
The meaning of the boolean argument operations[].style.bold is unclear.vague_boolean
Minor
Says nothing about what it returns.no_return_info
Minor
Required identifiers whose description does not say where the value comes from: documentId. Name the tool or the place that returns it, or models look it up first.id_source_missing
create_deck
34/ 100Rain
Purpose
17 / 20
When to use
5 / 20
Arguments
5 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
Major
Arguments without a description: deckId, revision, plan, slideId, feedback, data, selectedSlides.param_no_description
Minor
String arguments with no constraint or example: deckId, slideId, feedback, data.loose_string_param
Minor
Says nothing about what it returns.no_return_info
export_pptx_document
34/ 100Rain
Purpose
17 / 20
When to use
0 / 20
Arguments
10 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
Major
Says nothing about when to use it, or when not to.no_usage_context
Major
Arguments without a description: documentId, revision.param_no_description
Minor
Says nothing about what it returns.no_return_info
Minor
Required identifiers whose description does not say where the value comes from: documentId. Name the tool or the place that returns it, or models look it up first.id_source_missing
get_deck
34/ 100Rain
Purpose
17 / 20
When to use
5 / 20
Arguments
5 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
Major
Arguments without a description: deckId, revision, plan, slideId, feedback, data, selectedSlides.param_no_description
Minor
String arguments with no constraint or example: deckId, slideId, feedback, data.loose_string_param
Minor
Says nothing about what it returns.no_return_info
Minor
Required identifiers whose description does not say where the value comes from: deckId. Name the tool or the place that returns it, or models look it up first.id_source_missing
import_pptx
34/ 100Rain
Purpose
17 / 20
When to use
5 / 20
Arguments
5 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
Major
Arguments without a description: deckId, revision, plan, slideId, feedback, data, selectedSlides.param_no_description
Minor
String arguments with no constraint or example: deckId, slideId, feedback, data.loose_string_param
Minor
Says nothing about what it returns.no_return_info
read_pptx_part
34/ 100Rain
Purpose
17 / 20
When to use
0 / 20
Arguments
10 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
Major
Says nothing about when to use it, or when not to.no_usage_context
Major
Arguments without a description: documentId, slideNumbers.param_no_description
Minor
Says nothing about what it returns.no_return_info
Minor
Required identifiers whose description does not say where the value comes from: documentId. Name the tool or the place that returns it, or models look it up first.id_source_missing
render_pptx_editor
34/ 100Rain
Purpose
17 / 20
When to use
5 / 20
Arguments
5 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
Major
Arguments without a description: deckId, revision, plan, slideId, feedback, data, selectedSlides.param_no_description
Minor
String arguments with no constraint or example: deckId, slideId, feedback, data.loose_string_param
Minor
Says nothing about what it returns.no_return_info
Minor
Required identifiers whose description does not say where the value comes from: deckId. Name the tool or the place that returns it, or models look it up first.id_source_missing
render_pptx_part
34/ 100Rain
Purpose
17 / 20
When to use
0 / 20
Arguments
10 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
Major
Says nothing about when to use it, or when not to.no_usage_context
Major
Arguments without a description: revision, slides, dpi, documentId.param_no_description
Minor
Says nothing about what it returns.no_return_info
Minor
Required identifiers whose description does not say where the value comes from: documentId. Name the tool or the place that returns it, or models look it up first.id_source_missing
researchpilot_check_method
34/ 100Rain
Purpose
17 / 20
When to use
0 / 20
Arguments
10 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
Major
Says nothing about when to use it, or when not to.no_usage_context
Major
Arguments without a description: capabilityId.param_no_description
Minor
Says nothing about what it returns.no_return_info
Minor
Required identifiers whose description does not say where the value comes from: capabilityId. Name the tool or the place that returns it, or models look it up first.id_source_missing
researchpilot_search_datasets
34/ 100Rain
Purpose
17 / 20
When to use
0 / 20
Arguments
10 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
Major
Says nothing about when to use it, or when not to.no_usage_context
Major
Arguments without a description: query, scope.param_no_description
Minor
Says nothing about what it returns.no_return_info
researchpilot_search_literature
34/ 100Rain
Purpose
17 / 20
When to use
0 / 20
Arguments
10 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
Major
Says nothing about when to use it, or when not to.no_usage_context
Major
Arguments without a description: query.param_no_description
Minor
Says nothing about what it returns.no_return_info
select_slide
34/ 100Rain
Purpose
17 / 20
When to use
5 / 20
Arguments
5 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
Major
Arguments without a description: deckId, revision, plan, slideId, feedback, data, selectedSlides.param_no_description
Minor
String arguments with no constraint or example: deckId, slideId, feedback, data.loose_string_param
Minor
Says nothing about what it returns.no_return_info
Minor
Required identifiers whose description does not say where the value comes from: deckId, slideId. Name the tool or the place that returns it, or models look it up first.id_source_missing
submit_deck_feedback
34/ 100Rain
Purpose
17 / 20
When to use
5 / 20
Arguments
5 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
Major
Arguments without a description: deckId, revision, plan, slideId, feedback, data, selectedSlides.param_no_description
Minor
String arguments with no constraint or example: deckId, slideId, feedback, data.loose_string_param
Minor
Says nothing about what it returns.no_return_info
Minor
Required identifiers whose description does not say where the value comes from: deckId. Name the tool or the place that returns it, or models look it up first.id_source_missing
undo_deck
34/ 100Rain
Purpose
17 / 20
When to use
5 / 20
Arguments
5 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
Major
Arguments without a description: deckId, revision, plan, slideId, feedback, data, selectedSlides.param_no_description
Minor
String arguments with no constraint or example: deckId, slideId, feedback, data.loose_string_param
Minor
Says nothing about what it returns.no_return_info
Minor
Required identifiers whose description does not say where the value comes from: deckId. Name the tool or the place that returns it, or models look it up first.id_source_missing
update_deck
34/ 100Rain
Purpose
17 / 20
When to use
5 / 20
Arguments
5 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
Major
Arguments without a description: deckId, revision, plan, slideId, feedback, data, selectedSlides.param_no_description
Minor
String arguments with no constraint or example: deckId, slideId, feedback, data.loose_string_param
Minor
Says nothing about what it returns.no_return_info
Minor
Required identifiers whose description does not say where the value comes from: deckId. Name the tool or the place that returns it, or models look it up first.id_source_missing
analysis_match_propensity_scores
36/ 100Rain
Purpose
14 / 20
When to use
5 / 20
Arguments
10 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
Major
Arguments without a description: X, treatment, scores, caliper_sd, outcome.param_no_description
Minor
The description mentions none of its 3 or more arguments.params_not_in_description
Minor
Says nothing about what it returns.no_return_info
analysis_test_mean_equivalence
36/ 100Rain
Purpose
14 / 20
When to use
5 / 20
Arguments
10 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
Major
Arguments without a description: sample1, sample2, lower, upper, alpha, design.param_no_description
Minor
The description mentions none of its 3 or more arguments.params_not_in_description
Minor
Says nothing about what it returns.no_return_info
render_deck
37/ 100Rain
Purpose
17 / 20
When to use
0 / 20
Arguments
10 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
Major
Says nothing about when to use it, or when not to.no_usage_context
Major
Arguments without a description: deckId, revision, slides, dpi.param_no_description
Minor
Says nothing about what it returns.no_return_info
Minor
Required identifiers whose description does not say where the value comes from: deckId. Name the tool or the place that returns it, or models look it up first.id_source_missing
researchpilot_content_analysis_template
37/ 100Rain
Purpose
20 / 20
When to use
0 / 20
Arguments
10 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
Major
Says nothing about when to use it, or when not to.no_usage_context
Major
Arguments without a description: researchQuestion, approach, codingMode.param_no_description
Minor
The description mentions none of its 3 or more arguments.params_not_in_description
Minor
Says nothing about what it returns.no_return_info
researchpilot_prepare_specialist_execution
37/ 100Rain
Purpose
17 / 20
When to use
0 / 20
Arguments
10 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
Major
Says nothing about when to use it, or when not to.no_usage_context
Major
Arguments without a description: projectId, capabilityId, requestedWork, rigor, requiredOutputs.param_no_description
Minor
The description mentions none of its 3 or more arguments.params_not_in_description
Minor
Says nothing about what it returns.no_return_info
Minor
The name is long (42 characters).long_name
Minor
Required identifiers whose description does not say where the value comes from: projectId, capabilityId. Name the tool or the place that returns it, or models look it up first.id_source_missing
researchpilot_text_analysis_pilot
37/ 100Rain
Purpose
20 / 20
When to use
0 / 20
Arguments
10 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
Major
Says nothing about when to use it, or when not to.no_usage_context
Major
Arguments without a description: researchQuestion, sourceType, query, period, targetSize, approach, codingMode, corpusItems, corpusItems[].id, corpusItems[].title, corpusItems[].source, corpusItems[].text, corpusItems[].digest, corpusItems[].provenance, categories.param_no_description
Minor
The description mentions none of its 3 or more arguments.params_not_in_description
Minor
Says nothing about what it returns.no_return_info
trace_path
37/ 100Rain
Purpose
17 / 20
When to use
0 / 20
Arguments
6 / 25
Return value
7 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
Major
Says nothing about when to use it, or when not to.no_usage_context
Major
Arguments without a description: graph, graph.direction, graph.nodes, graph.nodes[].id, graph.nodes[].label, graph.nodes[].group, graph.nodes[].shape, graph.edges, graph.edges[].from, graph.edges[].to, graph.edges[].label, graph.edges[].style, graph.edges[].direction, graph.edges[].curve, from, to.param_no_description
Minor
String arguments with no constraint or example: graph.nodes[].label, graph.nodes[].group, graph.edges[].label, from, to.loose_string_param
Minor
The description mentions none of its 3 or more arguments.params_not_in_description
Minor
The meaning of the boolean argument graph.edges[].curve is unclear.vague_boolean
diagram_list_capabilities
38/ 100Rain
Purpose
6 / 20
When to use
0 / 20
Arguments
25 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
Major
The description only restates the name (4 words).restates_name
Major
The description is too short (4 words).too_short
Major
Says nothing about when to use it, or when not to.no_usage_context
Minor
Says nothing about what it returns.no_return_info
list_capabilities
38/ 100Rain
Purpose
6 / 20
When to use
0 / 20
Arguments
25 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
Major
The description only restates the name (4 words).restates_name
Major
The description is too short (4 words).too_short
Major
Says nothing about when to use it, or when not to.no_usage_context
Minor
Says nothing about what it returns.no_return_info
submit_diagram_feedback
38/ 100Rain
Purpose
17 / 20
When to use
0 / 20
Arguments
7 / 25
Return value
7 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
Major
Says nothing about when to use it, or when not to.no_usage_context
Major
Arguments without a description: diagramId, expectedRevision, text.param_no_description
Minor
String arguments with no constraint or example: diagramId.loose_string_param
Minor
The description mentions none of its 3 or more arguments.params_not_in_description
Minor
Required identifiers whose description does not say where the value comes from: diagramId. Name the tool or the place that returns it, or models look it up first.id_source_missing
sync_pptx_document
38/ 100Rain
Purpose
17 / 20
When to use
0 / 20
Arguments
14 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
Major
Says nothing about when to use it, or when not to.no_usage_context
Major
Arguments without a description: documentId, revision, name.param_no_description
Minor
Says nothing about what it returns.no_return_info
Minor
Required identifiers whose description does not say where the value comes from: documentId. Name the tool or the place that returns it, or models look it up first.id_source_missing
export_deck
39/ 100Rain
Purpose
20 / 20
When to use
0 / 20
Arguments
5 / 25
Return value
7 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
Major
Says nothing about when to use it, or when not to.no_usage_context
Major
Arguments without a description: deckId, revision, plan, slideId, feedback, data, selectedSlides.param_no_description
Minor
String arguments with no constraint or example: deckId, slideId, feedback, data.loose_string_param
Minor
The description mentions none of its 3 or more arguments.params_not_in_description
Minor
Required identifiers whose description does not say where the value comes from: deckId. Name the tool or the place that returns it, or models look it up first.id_source_missing
get_methodiq_tool_guide
39/ 100Rain
Purpose
20 / 20
When to use
0 / 20
Arguments
7 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
Major
Says nothing about when to use it, or when not to.no_usage_context
Major
Arguments without a description: toolId.param_no_description
Minor
No `required` list, so every argument is optional.no_required
Minor
Says nothing about what it returns.no_return_info
list_methodiq_tools
39/ 100Rain
Purpose
20 / 20
When to use
5 / 20
Arguments
2 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
Major
Arguments without a description: category, functionName.param_no_description
Minor
String arguments with no constraint or example: category, functionName.loose_string_param
Minor
No `required` list, so every argument is optional.no_required
Minor
Says nothing about what it returns.no_return_info
researchpilot_read_handoff_evidence
39/ 100Rain
Purpose
17 / 20
When to use
5 / 20
Arguments
10 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
Major
Arguments without a description: handoff, sourceId, offset.param_no_description
Minor
Says nothing about what it returns.no_return_info
Minor
Required identifiers whose description does not say where the value comes from: sourceId. Name the tool or the place that returns it, or models look it up first.id_source_missing
researchpilot_handoff_context
40/ 100Cloudy
Purpose
20 / 20
When to use
0 / 20
Arguments
10 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
Major
Says nothing about when to use it, or when not to.no_usage_context
Major
Arguments without a description: handoff.param_no_description
Minor
Says nothing about what it returns.no_return_info
researchpilot_validate_specialist_receipt
40/ 100Cloudy
Purpose
20 / 20
When to use
0 / 20
Arguments
10 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
Major
Says nothing about when to use it, or when not to.no_usage_context
Major
Arguments without a description: request, receipt.param_no_description
Minor
Says nothing about what it returns.no_return_info
Minor
The name is long (41 characters).long_name
analysis_run_classroom_demo
41/ 100Cloudy
Purpose
17 / 20
When to use
0 / 20
Arguments
10 / 25
Return value
7 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
Major
Says nothing about when to use it, or when not to.no_usage_context
Major
Arguments without a description: kind, method.param_no_description
gwriter_get_gwriter_edit_result
41/ 100Cloudy
Purpose
17 / 20
When to use
5 / 20
Arguments
5 / 25
Return value
7 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
Major
Arguments without a description: editSessionId.param_no_description
Minor
String arguments with no constraint or example: editSessionId.loose_string_param
Minor
Required identifiers whose description does not say where the value comes from: editSessionId. Name the tool or the place that returns it, or models look it up first.id_source_missing
String arguments with no constraint or example: chartId, packet.table.category, packet.semantics.unit, packet.semantics.denominator.description, packet.semantics.weightDescription, packet.semantics.missingRule, packet.evidence[].id, packet.evidence[].producer, spec.type, feedback, format, text, data, sheetName.loose_string_param
Minor
The meaning of the boolean argument confirmation is unclear.vague_boolean
Minor
The meaning of the boolean argument packet.semantics.weighted is unclear.vague_boolean
Minor
The meaning of the boolean argument packet.semantics.multipleResponse is unclear.vague_boolean
Minor
Required identifiers whose description does not say where the value comes from: chartId. Name the tool or the place that returns it, or models look it up first.id_source_missing
researchpilot_read_work_artifact
42/ 100Cloudy
Purpose
17 / 20
When to use
5 / 20
Arguments
10 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
Major
Arguments without a description: projectId, artifactId.param_no_description
Minor
Says nothing about what it returns.no_return_info
Minor
Required identifiers whose description does not say where the value comes from: projectId, artifactId. Name the tool or the place that returns it, or models look it up first.id_source_missing
researchpilot_research_registry
42/ 100Cloudy
Purpose
17 / 20
When to use
5 / 20
Arguments
10 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
Major
Arguments without a description: kind, query, limit.param_no_description
Minor
The description mentions none of its 3 or more arguments.params_not_in_description
Minor
Says nothing about what it returns.no_return_info
researchpilot_handoff_summary
44/ 100Cloudy
Purpose
17 / 20
When to use
0 / 20
Arguments
10 / 25
Return value
7 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
Major
Says nothing about when to use it, or when not to.no_usage_context
Major
Arguments without a description: handoff.param_no_description
surveyviz_build_comparison_chart_spec
44/ 100Cloudy
Purpose
17 / 20
When to use
0 / 20
Arguments
8 / 25
Return value
7 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
Major
Says nothing about when to use it, or when not to.no_usage_context
String arguments with no constraint or example: packet.table_id, packet.source_table_id, packet.canonical_table_id, packet.locale, packet.display.title, packet.display.unit_label, packet.display.case_count_label, packet.columns[].column_id, packet.columns[].label, packet.columns[].value_type, packet.row_groups[].group_id, packet.row_groups[].label, packet.row_groups[].rows[].row_id, packet.row_groups[].rows[].label, title, subtitle.loose_string_param
Minor
No `required` list, so every argument is optional.no_required
researchpilot_list_work_artifacts
45/ 100Cloudy
Purpose
20 / 20
When to use
5 / 20
Arguments
10 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
Major
Arguments without a description: projectId.param_no_description
Minor
Says nothing about what it returns.no_return_info
Minor
Required identifiers whose description does not say where the value comes from: projectId. Name the tool or the place that returns it, or models look it up first.id_source_missing
researchpilot_get_project_context
47/ 100Cloudy
Purpose
20 / 20
When to use
0 / 20
Arguments
10 / 25
Return value
7 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
Major
Says nothing about when to use it, or when not to.no_usage_context
Major
Arguments without a description: projectId.param_no_description
Minor
Required identifiers whose description does not say where the value comes from: projectId. Name the tool or the place that returns it, or models look it up first.id_source_missing
analysis_get_classroom_demo_catalog
49/ 100Cloudy
Purpose
17 / 20
When to use
0 / 20
Arguments
25 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
Major
Says nothing about when to use it, or when not to.no_usage_context
Minor
Says nothing about what it returns.no_return_info
get_pptx_workspace_status
49/ 100Cloudy
Purpose
17 / 20
When to use
0 / 20
Arguments
25 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
Major
Says nothing about when to use it, or when not to.no_usage_context
Minor
Says nothing about what it returns.no_return_info
get_renderer_status
49/ 100Cloudy
Purpose
17 / 20
When to use
0 / 20
Arguments
25 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
Major
Says nothing about when to use it, or when not to.no_usage_context
Minor
Says nothing about what it returns.no_return_info
list_pptx_documents
49/ 100Cloudy
Purpose
17 / 20
When to use
0 / 20
Arguments
25 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
Major
Says nothing about when to use it, or when not to.no_usage_context
Minor
Says nothing about what it returns.no_return_info
researchpilot_build_collection_recipe
49/ 100Cloudy
Purpose
20 / 20
When to use
5 / 20
Arguments
10 / 25
Return value
7 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
Major
Arguments without a description: goal, sourceType, query, period, targetSize.param_no_description
Minor
The description mentions none of its 3 or more arguments.params_not_in_description
save_pptx_document
49/ 100Cloudy
Purpose
17 / 20
When to use
0 / 20
Arguments
18 / 25
Return value
7 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
Major
Says nothing about when to use it, or when not to.no_usage_context
Minor
Arguments without a description: name.param_no_description
analysis_get_special_analysis_guide
50/ 100Cloudy
Purpose
13 / 20
When to use
0 / 20
Arguments
25 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
Major
Says nothing about when to use it, or when not to.no_usage_context
Minor
Says nothing about what it returns.no_return_info
list_diagram_templates
50/ 100Cloudy
Purpose
6 / 20
When to use
0 / 20
Arguments
25 / 25
Return value
7 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
Major
The description only restates the name (7 words).restates_name
Major
The description is too short (7 words).too_short
Major
Says nothing about when to use it, or when not to.no_usage_context
surveyviz_list_capabilities
50/ 100Cloudy
Purpose
13 / 20
When to use
0 / 20
Arguments
25 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
Major
Says nothing about when to use it, or when not to.no_usage_context
Minor
Says nothing about what it returns.no_return_info
render_methodiq_tool_directory
52/ 100Cloudy
Purpose
20 / 20
When to use
0 / 20
Arguments
25 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
Major
Says nothing about when to use it, or when not to.no_usage_context
Minor
Says nothing about what it returns.no_return_info
researchpilot_capabilities
52/ 100Cloudy
Purpose
17 / 20
When to use
0 / 20
Arguments
25 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
Major
Says nothing about when to use it, or when not to.no_usage_context
Minor
Says nothing about what it returns.no_return_info
researchpilot_record_routing_feedback
52/ 100Cloudy
Purpose
20 / 20
When to use
15 / 20
Arguments
10 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
Major
Arguments without a description: projectId, taskFamily, capabilityId, toolName, outcome, feedback.param_no_description
Minor
Says nothing about what it returns.no_return_info
researchpilot_update_user_preferences
52/ 100Cloudy
Purpose
20 / 20
When to use
15 / 20
Arguments
7 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
Major
Arguments without a description: answerStyle, resultFirst, writingVoice, avoidTextbookStyle, preferEvidenceBeforeAdvice, preferredOutput, discipline, targetGenre, citationStyle.param_no_description
Minor
No `required` list, so every argument is optional.no_required
Minor
The description mentions none of its 3 or more arguments.params_not_in_description
Minor
Says nothing about what it returns.no_return_info
surveyviz_build_overall_chart_spec
52/ 100Cloudy
Purpose
20 / 20
When to use
0 / 20
Arguments
8 / 25
Return value
7 / 15
Constraints and side effects
7 / 10
Examples
10 / 10
Major
Says nothing about when to use it, or when not to.no_usage_context
String arguments with no constraint or example: packet.table_id, packet.source_table_id, packet.canonical_table_id, packet.locale, packet.display.title, packet.display.unit_label, packet.display.case_count_label, packet.columns[].column_id, packet.columns[].label, packet.columns[].value_type, packet.row_groups[].group_id, packet.row_groups[].label, packet.row_groups[].rows[].row_id, packet.row_groups[].rows[].label, title, subtitle.loose_string_param
Minor
No `required` list, so every argument is optional.no_required
gwriter_start_gwriter_edit
57/ 100Cloudy
Purpose
20 / 20
When to use
10 / 20
Arguments
20 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
Minor
String arguments with no constraint or example: title.loose_string_param
Minor
Says nothing about what it returns.no_return_info
researchpilot_get_user_memory
57/ 100Cloudy
Purpose
17 / 20
When to use
5 / 20
Arguments
25 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
Minor
Says nothing about what it returns.no_return_info
researchpilot_open_workspace
57/ 100Cloudy
Purpose
20 / 20
When to use
5 / 20
Arguments
25 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
Minor
Says nothing about what it returns.no_return_info
researchpilot_save_work_artifact
57/ 100Cloudy
Purpose
20 / 20
When to use
10 / 20
Arguments
10 / 25
Return value
7 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
Major
Arguments without a description: projectId, contextDigest, kind, title, text, sourceRefs.param_no_description
Minor
The description mentions none of its 3 or more arguments.params_not_in_description
Minor
Required identifiers whose description does not say where the value comes from: projectId. Name the tool or the place that returns it, or models look it up first.id_source_missing
researchpilot_list_projects
65/ 100Cloudy
Purpose
20 / 20
When to use
5 / 20
Arguments
25 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
5 / 10
Minor
Says nothing about what it returns.no_return_info
researchpilot_get_profile
67/ 100Cloudy
Purpose
17 / 20
When to use
0 / 20
Arguments
25 / 25
Return value
15 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
Major
Says nothing about when to use it, or when not to.no_usage_context
What static scoring cannot tell
This score reads only the text of each description and schema: it says what is written, not what a model will do. Short tools whose names already say what they do, such as browser_close, score low here even when models use them well, and in our measurements current models chose the right tool in one step even from one-line descriptions, as long as the names and schemas differed. What the text cannot show, such as what happens over several steps and whether an added sentence helps or misleads, is what an evaluation measures, on the Pro and Team plans.
Is your server listed here and you would rather it were not? Email support@forecall.dev, and we will take it off within 7 days.