Forecall
Failure recordsDocs
All scored servers

io.github.vinsenzo83/baton: tool descriptions scored

tools/list taken
(UTC)
From
Official MCP Registry
Connected to
https://baton-mcp-production.up.railway.app/mcp
Repository
github.com/vinsenzo83/baton
Scoring rules
v2
Removal
support@forecall.dev
Score this URL as it is today

Scores, issues and names only

This page shows how io.github.vinsenzo83/baton's tool descriptions scored, the issues found and the names of its tools and parameters. The descriptions are the server's own: read them where the copy came from.

Forecall asked the URL this server lists in the official MCP Registry for its tools/list once, on the date above, without calling any tool. The server may have changed since.

servers/io.github.vinsenzo83/baton
Average score
18.2 / 100Rain
Tools
45
Near-identical descriptions
2

Across the server

  • Major
    45 tools. Above 40, models choose less accurately.too_many_tools
  • Minor
    The server has no instructions. Say there, once, what the server is for and when to use it: Claude Code and Gemini CLI read the instructions before the tool descriptions.instructions_missing

Tools whose descriptions are nearly the same

2 of 2 pairs shown, highest description similarity first.
ToolToolDescription similarityName similarity
baton_memory_putbaton_memory_get1.000.50
baton_cost_recordbaton_cost_summary0.750.50

Tools

baton_git_evidence

9 / 100Rain

Purpose
6 / 20
When to use
0 / 20
Arguments
3 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    The description only restates the name (2 words).restates_name
  • Major
    The description is too short (2 words).too_short
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: api_key, task_id.param_no_description
  • Minor
    String arguments with no constraint or example: api_key, task_id.loose_string_param
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

baton_agent_list

10 / 100Rain

Purpose
10 / 20
When to use
0 / 20
Arguments
0 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    The description is too short (2 words).too_short
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: specialty, limit.param_no_description
  • Minor
    String arguments with no constraint or example: specialty.loose_string_param
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

baton_who

10 / 100Rain

Purpose
10 / 20
When to use
0 / 20
Arguments
0 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    The description is too short (3 words).too_short
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: member_id, room_id, api_key.param_no_description
  • Minor
    String arguments with no constraint or example: member_id, room_id, api_key.loose_string_param
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

baton_pass

12 / 100Rain

Purpose
6 / 20
When to use
0 / 20
Arguments
6 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    The description only restates the name (7 words).restates_name
  • Major
    The description is too short (7 words).too_short
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: snapshot.meta, snapshot.meta.title, snapshot.meta.author, snapshot.meta.source_model, snapshot.meta.project, snapshot.context, snapshot.context.goal, snapshot.context.current_state, snapshot.context.decisions, snapshot.context.decisions[].what, snapshot.context.decisions[].why, snapshot.context.constraints, snapshot.artifacts, snapshot.artifacts.files, snapshot.artifacts.links, snapshot.artifacts.commands, snapshot.next_steps, snapshot.warnings, ttl_hours, verify.static_checks, verify.static_checks[].dim, verify.static_checks[].passed, verify.static_checks[].evidence, verify.e2e_evidence, verify.e2e_evidence[].claim, verify.e2e_evidence[].observed, verify.e2e_evidence[].detail, verify.e2e_evidence[].method, verify.e2e_evidence[].evidence_refs, verify.environment, verify.artifacts, verify.verifier.param_no_description
  • Minor
    String arguments with no constraint or example: snapshot.meta.title, snapshot.meta.author, snapshot.meta.source_model, snapshot.meta.project, snapshot.context.goal, snapshot.context.current_state, snapshot.context.decisions[].what, snapshot.context.decisions[].why, verify.static_checks[].dim, verify.static_checks[].evidence, verify.e2e_evidence[].claim, verify.e2e_evidence[].detail, verify.verifier, parent_code, api_key, member_id.loose_string_param
  • Minor
    The meaning of the boolean argument one_time is unclear.vague_boolean
  • Minor
    The meaning of the boolean argument verify.static_checks[].passed is unclear.vague_boolean
  • Minor
    The meaning of the boolean argument verify.e2e_evidence[].observed is unclear.vague_boolean
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

baton_agent_record_result

13 / 100Rain

Purpose
10 / 20
When to use
0 / 20
Arguments
3 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    The description is too short (2 words).too_short
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: api_key, agent_id, receipt.param_no_description
  • Minor
    String arguments with no constraint or example: api_key, agent_id.loose_string_param
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints
  • Minor
    Required identifiers whose description does not say where the value comes from: agent_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

baton_agent_register

13 / 100Rain

Purpose
10 / 20
When to use
0 / 20
Arguments
3 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    The description is too short (4 words).too_short
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: api_key, name, description, specialties.param_no_description
  • Minor
    String arguments with no constraint or example: api_key, name, description.loose_string_param
  • Minor
    The description mentions none of its 3 or more arguments.params_not_in_description
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

baton_cost_record

13 / 100Rain

Purpose
10 / 20
When to use
0 / 20
Arguments
3 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    The description is too short (3 words).too_short
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: api_key, task_id, provider, model, input_tokens, output_tokens, amount_usd, source, idempotency_key.param_no_description
  • Minor
    Its description is nearly the same as baton_cost_summary's (similarity 0.75); only the names and schemas tell them apart. Say in this description when to use baton_cost_summary instead.confusable_pair
  • Minor
    String arguments with no constraint or example: api_key, task_id, provider, model, source, idempotency_key.loose_string_param
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

baton_cost_summary

13 / 100Rain

Purpose
10 / 20
When to use
0 / 20
Arguments
3 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    The description is too short (4 words).too_short
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: api_key.param_no_description
  • Minor
    Its description is nearly the same as baton_cost_record's (similarity 0.75); only the names and schemas tell them apart. Say in this description when to use baton_cost_record instead.confusable_pair
  • Minor
    String arguments with no constraint or example: api_key.loose_string_param
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

baton_diff

13 / 100Rain

Purpose
10 / 20
When to use
0 / 20
Arguments
3 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: from_code, to_code.param_no_description
  • Minor
    String arguments with no constraint or example: from_code, to_code.loose_string_param
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

baton_hub_list

13 / 100Rain

Purpose
10 / 20
When to use
0 / 20
Arguments
3 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    The description is too short (2 words).too_short
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: api_key.param_no_description
  • Minor
    String arguments with no constraint or example: api_key.loose_string_param
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

baton_hub_observe

13 / 100Rain

Purpose
10 / 20
When to use
0 / 20
Arguments
3 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    The description is too short (5 words).too_short
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: api_key, server_id, receipt.param_no_description
  • Minor
    String arguments with no constraint or example: api_key, server_id.loose_string_param
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints
  • Minor
    Required identifiers whose description does not say where the value comes from: server_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

baton_hub_register

13 / 100Rain

Purpose
10 / 20
When to use
0 / 20
Arguments
3 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    The description is too short (5 words).too_short
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: api_key, name, url, capabilities.param_no_description
  • Minor
    String arguments with no constraint or example: api_key, name, url.loose_string_param
  • Minor
    The description mentions none of its 3 or more arguments.params_not_in_description
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

baton_leave

13 / 100Rain

Purpose
10 / 20
When to use
0 / 20
Arguments
3 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: member_id.param_no_description
  • Minor
    String arguments with no constraint or example: member_id.loose_string_param
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints
  • Minor
    Required identifiers whose description does not say where the value comes from: member_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

baton_memory_delete

13 / 100Rain

Purpose
10 / 20
When to use
0 / 20
Arguments
3 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: api_key, memory_id.param_no_description
  • Minor
    String arguments with no constraint or example: api_key, memory_id.loose_string_param
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints
  • Minor
    Required identifiers whose description does not say where the value comes from: memory_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

baton_memory_get

13 / 100Rain

Purpose
10 / 20
When to use
0 / 20
Arguments
3 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    The description is too short (2 words).too_short
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: api_key, memory_id.param_no_description
  • Minor
    Its description is nearly the same as baton_memory_put's (similarity 1.00); only the names and schemas tell them apart. Say in this description when to use baton_memory_put instead.confusable_pair
  • Minor
    String arguments with no constraint or example: api_key, memory_id.loose_string_param
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints
  • Minor
    Required identifiers whose description does not say where the value comes from: memory_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

baton_memory_put

13 / 100Rain

Purpose
10 / 20
When to use
0 / 20
Arguments
3 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    The description is too short (2 words).too_short
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: api_key, title, body, tags, ttl_hours.param_no_description
  • Minor
    Its description is nearly the same as baton_memory_get's (similarity 1.00); only the names and schemas tell them apart. Say in this description when to use baton_memory_get instead.confusable_pair
  • Minor
    String arguments with no constraint or example: api_key, title.loose_string_param
  • Minor
    The description mentions none of its 3 or more arguments.params_not_in_description
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

baton_memory_search

13 / 100Rain

Purpose
10 / 20
When to use
0 / 20
Arguments
3 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: api_key, query, tags, limit.param_no_description
  • Minor
    String arguments with no constraint or example: api_key, query.loose_string_param
  • Minor
    The description mentions none of its 3 or more arguments.params_not_in_description
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

baton_revoke

13 / 100Rain

Purpose
10 / 20
When to use
0 / 20
Arguments
3 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    The description is too short (1 word).too_short
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: code.param_no_description
  • Minor
    String arguments with no constraint or example: code.loose_string_param
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

baton_task_create

13 / 100Rain

Purpose
10 / 20
When to use
0 / 20
Arguments
3 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    The description is too short (3 words).too_short
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: api_key, title, room_id, assignee, depends_on.param_no_description
  • Minor
    String arguments with no constraint or example: api_key, title, room_id, assignee.loose_string_param
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

baton_task_graph

13 / 100Rain

Purpose
10 / 20
When to use
0 / 20
Arguments
3 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    The description is too short (3 words).too_short
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: api_key.param_no_description
  • Minor
    String arguments with no constraint or example: api_key.loose_string_param
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

baton_task_link

14 / 100Rain

Purpose
10 / 20
When to use
0 / 20
Arguments
4 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    The description is too short (6 words).too_short
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: api_key, from_task_id, to_task_id, edge_type.param_no_description
  • Minor
    String arguments with no constraint or example: api_key, from_task_id, to_task_id.loose_string_param
  • Minor
    The description mentions none of its 3 or more arguments.params_not_in_description
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints
  • Minor
    Required identifiers whose description does not say where the value comes from: from_task_id, to_task_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

baton_confirm_payment

15 / 100Rain

Purpose
10 / 20
When to use
0 / 20
Arguments
5 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: invoice_id, token, chain, api_key, tx_hash.param_no_description
  • Minor
    String arguments with no constraint or example: invoice_id, api_key, tx_hash.loose_string_param
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints
  • Minor
    Required identifiers whose description does not say where the value comes from: invoice_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

baton_task_update

15 / 100Rain

Purpose
10 / 20
When to use
0 / 20
Arguments
5 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    The description is too short (6 words).too_short
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: api_key, task_id, status.param_no_description
  • Minor
    String arguments with no constraint or example: api_key, task_id.loose_string_param
  • Minor
    The description mentions none of its 3 or more arguments.params_not_in_description
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints
  • Minor
    Required identifiers whose description does not say where the value comes from: task_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

baton_git_record

16 / 100Rain

Purpose
13 / 20
When to use
0 / 20
Arguments
3 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    The description is too short (7 words).too_short
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: api_key, task_id, repository, commit_sha, branch, diff_sha256, test_command, test_exit_code, artifact_refs.param_no_description
  • Minor
    String arguments with no constraint or example: api_key, task_id, repository, commit_sha, branch, diff_sha256, test_command.loose_string_param
  • Minor
    The description mentions none of its 3 or more arguments.params_not_in_description
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

baton_kick

18 / 100Rain

Purpose
10 / 20
When to use
0 / 20
Arguments
8 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: room_id, target_member_id.param_no_description
  • Minor
    String arguments with no constraint or example: room_id, api_key, target_member_id.loose_string_param
  • Minor
    The description mentions none of its 3 or more arguments.params_not_in_description
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints
  • Minor
    Required identifiers whose description does not say where the value comes from: room_id, target_member_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

baton_new_invite

18 / 100Rain

Purpose
10 / 20
When to use
0 / 20
Arguments
8 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    The description is too short (3 words).too_short
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: room_id, revoke_old.param_no_description
  • Minor
    String arguments with no constraint or example: room_id, api_key.loose_string_param
  • Minor
    The meaning of the boolean argument revoke_old is unclear.vague_boolean
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints
  • Minor
    Required identifiers whose description does not say where the value comes from: room_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

baton_receive

18 / 100Rain

Purpose
10 / 20
When to use
0 / 20
Arguments
3 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: code.param_no_description
  • Minor
    String arguments with no constraint or example: code.loose_string_param
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

baton_send

18 / 100Rain

Purpose
10 / 20
When to use
0 / 20
Arguments
8 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    The description is too short (2 words).too_short
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: member_id, text.param_no_description
  • Minor
    String arguments with no constraint or example: member_id, to, text.loose_string_param
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints
  • Minor
    Required identifiers whose description does not say where the value comes from: member_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

spider_pull_corpus

18 / 100Rain

Purpose
10 / 20
When to use
0 / 20
Arguments
8 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    The description is too short (6 words).too_short
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    Arguments without a description: klass, limit.param_no_description
  • Minor
    String arguments with no constraint or example: tags, klass.loose_string_param
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    The meaning of the boolean argument verified is unclear.vague_boolean
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

baton_close_room

21 / 100Rain

Purpose
10 / 20
When to use
0 / 20
Arguments
11 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    Arguments without a description: room_id.param_no_description
  • Minor
    String arguments with no constraint or example: room_id, api_key.loose_string_param
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints
  • Minor
    Required identifiers whose description does not say where the value comes from: room_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

spider_signals

22 / 100Rain

Purpose
10 / 20
When to use
0 / 20
Arguments
12 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    The description is too short (4 words).too_short
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    Arguments without a description: tier.param_no_description
  • Minor
    String arguments with no constraint or example: klass, tag.loose_string_param
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

baton_approve

23 / 100Rain

Purpose
10 / 20
When to use
0 / 20
Arguments
13 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    The description is too short (1 word).too_short
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    Arguments without a description: room_id.param_no_description
  • Minor
    String arguments with no constraint or example: room_id, api_key, member_id.loose_string_param
  • Minor
    The description mentions none of its 3 or more arguments.params_not_in_description
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints
  • Minor
    Required identifiers whose description does not say where the value comes from: room_id, member_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

baton_upgrade

23 / 100Rain

Purpose
10 / 20
When to use
0 / 20
Arguments
13 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    Arguments without a description: plan.param_no_description
  • Minor
    String arguments with no constraint or example: api_key.loose_string_param
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

spider_classify_tier

23 / 100Rain

Purpose
10 / 20
When to use
0 / 20
Arguments
13 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    The description is too short (4 words).too_short
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    Arguments without a description: severity.param_no_description
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

baton_account

25 / 100Rain

Purpose
10 / 20
When to use
0 / 20
Arguments
15 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    The description is too short (5 words).too_short
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    String arguments with no constraint or example: api_key.loose_string_param
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

baton_create_room

25 / 100Rain

Purpose
10 / 20
When to use
0 / 20
Arguments
15 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    The description is too short (5 words).too_short
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    String arguments with no constraint or example: name, alias, api_key.loose_string_param
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    The meaning of the boolean argument require_approval is unclear.vague_boolean
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

spider_checklist

25 / 100Rain

Purpose
10 / 20
When to use
0 / 20
Arguments
15 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    The description is too short (1 word).too_short
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    String arguments with no constraint or example: dimension.loose_string_param
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

baton_inbox

26 / 100Rain

Purpose
10 / 20
When to use
0 / 20
Arguments
11 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    Arguments without a description: member_id.param_no_description
  • Minor
    String arguments with no constraint or example: member_id.loose_string_param
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints
  • Minor
    Required identifiers whose description does not say where the value comes from: member_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

baton_join

28 / 100Rain

Purpose
10 / 20
When to use
0 / 20
Arguments
18 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    The description is too short (4 words).too_short
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    String arguments with no constraint or example: code, alias, model.loose_string_param
  • Minor
    The description mentions none of its 3 or more arguments.params_not_in_description
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

baton_signup

28 / 100Rain

Purpose
10 / 20
When to use
0 / 20
Arguments
15 / 25
Return value
0 / 15
Constraints and side effects
3 / 10
Examples
0 / 10
  • Major
    The description is too short (4 words).too_short
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    String arguments with no constraint or example: api_key.loose_string_param
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    Says nothing about what it returns.no_return_info

spider_plan

28 / 100Rain

Purpose
10 / 20
When to use
0 / 20
Arguments
18 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    String arguments with no constraint or example: target.loose_string_param
  • Minor
    The meaning of the boolean argument thorough is unclear.vague_boolean
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

spider_record_pattern

28 / 100Rain

Purpose
10 / 20
When to use
0 / 20
Arguments
18 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    The description is too short (1 word).too_short
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    String arguments with no constraint or example: klass, name, signal, fix, hit, tags.loose_string_param
  • Minor
    The description mentions none of its 3 or more arguments.params_not_in_description
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

baton_consolidate

30 / 100Rain

Purpose
10 / 20
When to use
0 / 20
Arguments
15 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
5 / 10
  • Major
    The description is too short (3 words).too_short
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    String arguments with no constraint or example: room_id, api_key.loose_string_param
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

baton_verify

31 / 100Rain

Purpose
10 / 20
When to use
0 / 20
Arguments
11 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
10 / 10
  • Major
    The description is too short (7 words).too_short
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: static_checks, static_checks[].dim, static_checks[].passed, static_checks[].evidence, e2e_evidence[].claim, e2e_evidence[].observed, e2e_evidence[].detail, e2e_evidence[].method, e2e_evidence[].evidence_refs.param_no_description
  • Minor
    String arguments with no constraint or example: target, verifier, capsule, static_checks[].dim, static_checks[].evidence, e2e_evidence[].claim, e2e_evidence[].detail, api_key.loose_string_param
  • Minor
    The description mentions none of its 3 or more arguments.params_not_in_description
  • Minor
    The meaning of the boolean argument static_checks[].passed is unclear.vague_boolean
  • Minor
    The meaning of the boolean argument e2e_evidence[].observed is unclear.vague_boolean
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

baton_verify_plan

33 / 100Rain

Purpose
10 / 20
When to use
0 / 20
Arguments
18 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
5 / 10
  • Major
    The description is too short (1 word).too_short
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    String arguments with no constraint or example: target.loose_string_param
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

What static scoring cannot tell

This score reads only the text of each description and schema: it says what is written, not what a model will do. Short tools whose names already say what they do, such as browser_close, score low here even when models use them well, and in our measurements current models chose the right tool in one step even from one-line descriptions, as long as the names and schemas differed. What the text cannot show, such as what happens over several steps and whether an added sentence helps or misleads, is what an evaluation measures, on the Pro and Team plans.

Is your server listed here and you would rather it were not? Email support@forecall.dev, and we will take it off within 7 days.

All scored servers