Forecall
Failure recordsDocs
All scored servers

Agent Arcade: tool descriptions scored site.chatgpt.cursoraikk.agent-arcade-ai/agent-arcade

tools/list taken
(UTC)
From
Official MCP Registry
Connected to
https://agent-arcade-ai.cursoraikk.chatgpt.site/api/v3/mcp?campaign=mcp-registry-create-w1
Homepage
agent-arcade-ai.cursoraikk.chatgpt.site
Scoring rules
v2
Removal
support@forecall.dev
Score this URL as it is today

Scores, issues and names only

This page shows how Agent Arcade (site.chatgpt.cursoraikk.agent-arcade-ai/agent-arcade)'s tool descriptions scored, the issues found and the names of its tools and parameters. The descriptions are the server's own: read them where the copy came from.

Forecall asked the URL this server lists in the official MCP Registry for its tools/list once, on the date above, without calling any tool. The server may have changed since.

servers/site.chatgpt.cursoraikk.agent-arcade-ai/agent-arcade
Average score
43.8 / 100Cloudy
Tools
49
Near-identical descriptions
24

Across the server

  • Major
    49 tools. Above 40, models choose less accurately.too_many_tools
  • Minor
    24 pairs with nearly the same description in all; the top 12 are shown.confusable_pair_total

Tools whose descriptions are nearly the same

12 of 24 pairs shown, highest description similarity first.
ToolToolDescription similarityName similarity
author_test_replaycertification_replay0.890.25
submit_author_actionsubmit_certification_action0.790.50
submit_play_actionsubmit_author_action0.740.50
certification_statecertification_replay0.730.33
submit_play_actionsubmit_certification_action0.700.50
start_author_testrelease_readiness0.670.00
submit_certification_actioncertification_state0.670.25
author_test_replaycertification_task0.650.00
author_test_replayplay_status0.650.00
start_author_testauthor_test_replay0.640.50
author_test_replaycertification_state0.640.00
play_assignmentplay_status0.630.33

Tools

prepare_play

19 / 100Rain

Purpose
17 / 20
When to use
0 / 20
Arguments
2 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: slug, campaign.param_no_description
  • Minor
    String arguments with no constraint or example: slug, campaign.loose_string_param
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

game_details

23 / 100Rain

Purpose
6 / 20
When to use
0 / 20
Arguments
10 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    The description only restates the name (9 words).restates_name
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: slug.param_no_description
  • Minor
    Says nothing about what it returns.no_return_info

register_flow

24 / 100Rain

Purpose
13 / 20
When to use
0 / 20
Arguments
4 / 25
Return value
7 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: campaign, intent.param_no_description
  • Minor
    String arguments with no constraint or example: campaign.loose_string_param
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

release_flow

25 / 100Rain

Purpose
13 / 20
When to use
0 / 20
Arguments
5 / 25
Return value
7 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: slug.param_no_description
  • Minor
    String arguments with no constraint or example: slug.loose_string_param
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

play_replay

28 / 100Rain

Purpose
6 / 20
When to use
5 / 20
Arguments
10 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    The description only restates the name (8 words).restates_name
  • Major
    Arguments without a description: id.param_no_description
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    Required identifiers whose description does not say where the value comes from: id. Name the tool or the place that returns it, or models look it up first.id_source_missing

feedback_flow

30 / 100Rain

Purpose
13 / 20
When to use
0 / 20
Arguments
7 / 25
Return value
7 / 15
Constraints and side effects
3 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: target_type.param_no_description
  • Minor
    No `required` list, so every argument is optional.no_required

register_agent

33 / 100Rain

Purpose
14 / 20
When to use
0 / 20
Arguments
12 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: intent, name, model, campaign, capabilities.param_no_description
  • Minor
    The description mentions none of its 3 or more arguments.params_not_in_description
  • Minor
    Says nothing about what it returns.no_return_info

play_challenges

34 / 100Rain

Purpose
17 / 20
When to use
0 / 20
Arguments
10 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: campaign.param_no_description
  • Minor
    Says nothing about what it returns.no_return_info

player_rankings

34 / 100Rain

Purpose
17 / 20
When to use
0 / 20
Arguments
10 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: game, difficulty, challenge_id.param_no_description
  • Minor
    The description mentions none of its 3 or more arguments.params_not_in_description
  • Minor
    Says nothing about what it returns.no_return_info

prepare_create

34 / 100Rain

Purpose
17 / 20
When to use
5 / 20
Arguments
2 / 25
Return value
7 / 15
Constraints and side effects
3 / 10
Examples
0 / 10
  • Major
    Arguments without a description: campaign.param_no_description
  • Minor
    String arguments with no constraint or example: campaign.loose_string_param
  • Minor
    No `required` list, so every argument is optional.no_required

preview_author_step

37 / 100Rain

Purpose
17 / 20
When to use
5 / 20
Arguments
5 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
  • Major
    Arguments without a description: definition, gameplay_contract, prior_actions, action, action.type.param_no_description
  • Minor
    String arguments with no constraint or example: action.type.loose_string_param
  • Minor
    Says nothing about what it returns.no_return_info

certify_flow

38 / 100Rain

Purpose
6 / 20
When to use
0 / 20
Arguments
25 / 25
Return value
7 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    The description only restates the name (8 words).restates_name
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

store

38 / 100Rain

Purpose
6 / 20
When to use
0 / 20
Arguments
25 / 25
Return value
7 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    The description only restates the name (6 words).restates_name
  • Major
    The description is too short (6 words).too_short
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

browse_store

40 / 100Cloudy

Purpose
17 / 20
When to use
0 / 20
Arguments
16 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: q, genre, sort.param_no_description
  • Minor
    Says nothing about what it returns.no_return_info

preflight_create

40 / 100Cloudy

Purpose
17 / 20
When to use
0 / 20
Arguments
20 / 25
Return value
0 / 15
Constraints and side effects
3 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    Says nothing about what it returns.no_return_info

create_flow

41 / 100Cloudy

Purpose
6 / 20
When to use
0 / 20
Arguments
25 / 25
Return value
7 / 15
Constraints and side effects
3 / 10
Examples
0 / 10
  • Major
    The description only restates the name (6 words).restates_name
  • Major
    The description is too short (6 words).too_short
  • Major
    Says nothing about when to use it, or when not to.no_usage_context

protocol_index

45 / 100Cloudy

Purpose
13 / 20
When to use
0 / 20
Arguments
25 / 25
Return value
7 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

publish_game

45 / 100Cloudy

Purpose
17 / 20
When to use
5 / 20
Arguments
13 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
  • Major
    Arguments without a description: slug, version_id.param_no_description
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    Required identifiers whose description does not say where the value comes from: version_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

publishing_contract

45 / 100Cloudy

Purpose
13 / 20
When to use
0 / 20
Arguments
25 / 25
Return value
7 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    The description is too short (7 words).too_short
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

release_readiness

45 / 100Cloudy

Purpose
17 / 20
When to use
5 / 20
Arguments
13 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
  • Major
    Arguments without a description: slug, version_id.param_no_description
  • Minor
    Its description is nearly the same as start_author_test's (similarity 0.67); only the names and schemas tell them apart. Say in this description when to use start_author_test instead.confusable_pair
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    Required identifiers whose description does not say where the value comes from: version_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

submit_author_action

46 / 100Cloudy

Purpose
20 / 20
When to use
5 / 20
Arguments
11 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
  • Major
    Arguments without a description: id, revision, action.param_no_description
  • Minor
    Its description is nearly the same as submit_certification_action's (similarity 0.79); only the names and schemas tell them apart. Say in this description when to use submit_certification_action instead.confusable_pair
  • Minor
    Its description is nearly the same as submit_play_action's (similarity 0.74); only the names and schemas tell them apart. Say in this description when to use submit_play_action instead.confusable_pair
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    Required identifiers whose description does not say where the value comes from: id. Name the tool or the place that returns it, or models look it up first.id_source_missing

submit_certification_action

46 / 100Cloudy

Purpose
20 / 20
When to use
5 / 20
Arguments
11 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
  • Major
    Arguments without a description: id, revision, action.param_no_description
  • Minor
    Its description is nearly the same as submit_author_action's (similarity 0.79); only the names and schemas tell them apart. Say in this description when to use submit_author_action instead.confusable_pair
  • Minor
    Its description is nearly the same as submit_play_action's (similarity 0.70); only the names and schemas tell them apart. Say in this description when to use submit_play_action instead.confusable_pair
  • Minor
    Its description is nearly the same as certification_state's (similarity 0.67); only the names and schemas tell them apart. Say in this description when to use certification_state instead.confusable_pair
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    Required identifiers whose description does not say where the value comes from: id. Name the tool or the place that returns it, or models look it up first.id_source_missing

submit_play_action

46 / 100Cloudy

Purpose
20 / 20
When to use
5 / 20
Arguments
11 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
  • Major
    Arguments without a description: id, revision, action.param_no_description
  • Minor
    Its description is nearly the same as submit_author_action's (similarity 0.74); only the names and schemas tell them apart. Say in this description when to use submit_author_action instead.confusable_pair
  • Minor
    Its description is nearly the same as submit_certification_action's (similarity 0.70); only the names and schemas tell them apart. Say in this description when to use submit_certification_action instead.confusable_pair
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    Required identifiers whose description does not say where the value comes from: id. Name the tool or the place that returns it, or models look it up first.id_source_missing

verify_agent

46 / 100Cloudy

Purpose
17 / 20
When to use
5 / 20
Arguments
10 / 25
Return value
7 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Arguments without a description: agent_id, challenge_id, solution.param_no_description
  • Minor
    The description mentions none of its 3 or more arguments.params_not_in_description
  • Minor
    Required identifiers whose description does not say where the value comes from: agent_id, challenge_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

work_queue

46 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
19 / 25
Return value
7 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

author_test_state

47 / 100Cloudy

Purpose
17 / 20
When to use
5 / 20
Arguments
15 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
  • Minor
    Arguments without a description: id.param_no_description
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    Required identifiers whose description does not say where the value comes from: id. Name the tool or the place that returns it, or models look it up first.id_source_missing

certification_state

47 / 100Cloudy

Purpose
17 / 20
When to use
5 / 20
Arguments
15 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
  • Minor
    Its description is nearly the same as certification_replay's (similarity 0.73); only the names and schemas tell them apart. Say in this description when to use certification_replay instead.confusable_pair
  • Minor
    Its description is nearly the same as submit_certification_action's (similarity 0.67); only the names and schemas tell them apart. Say in this description when to use submit_certification_action instead.confusable_pair
  • Minor
    Its description is nearly the same as author_test_replay's (similarity 0.64); only the names and schemas tell them apart. Say in this description when to use author_test_replay instead.confusable_pair
  • Minor
    Arguments without a description: id.param_no_description
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    Required identifiers whose description does not say where the value comes from: id. Name the tool or the place that returns it, or models look it up first.id_source_missing

declare_probe

47 / 100Cloudy

Purpose
17 / 20
When to use
5 / 20
Arguments
15 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
  • Minor
    Arguments without a description: traffic_class.param_no_description
  • Minor
    Says nothing about what it returns.no_return_info

start_author_test

48 / 100Cloudy

Purpose
20 / 20
When to use
5 / 20
Arguments
13 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
  • Major
    Arguments without a description: slug, version_id.param_no_description
  • Minor
    Its description is nearly the same as release_readiness's (similarity 0.67); only the names and schemas tell them apart. Say in this description when to use release_readiness instead.confusable_pair
  • Minor
    Its description is nearly the same as author_test_replay's (similarity 0.64); only the names and schemas tell them apart. Say in this description when to use author_test_replay instead.confusable_pair
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    Required identifiers whose description does not say where the value comes from: version_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

start_certification

48 / 100Cloudy

Purpose
20 / 20
When to use
5 / 20
Arguments
13 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
  • Major
    Arguments without a description: objective_summary, selected_success_condition.param_no_description
  • Minor
    Says nothing about what it returns.no_return_info

upload_game

48 / 100Cloudy

Purpose
20 / 20
When to use
5 / 20
Arguments
13 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
  • Minor
    Arguments without a description: draft.param_no_description
  • Minor
    Says nothing about what it returns.no_return_info

daily_challenges

49 / 100Cloudy

Purpose
17 / 20
When to use
0 / 20
Arguments
25 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    Says nothing about what it returns.no_return_info

live_sessions

49 / 100Cloudy

Purpose
17 / 20
When to use
0 / 20
Arguments
25 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    Says nothing about what it returns.no_return_info

public_replays

49 / 100Cloudy

Purpose
17 / 20
When to use
0 / 20
Arguments
25 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    Says nothing about what it returns.no_return_info

trust_record

49 / 100Cloudy

Purpose
17 / 20
When to use
0 / 20
Arguments
25 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    Says nothing about what it returns.no_return_info

author_test_replay

50 / 100Cloudy

Purpose
20 / 20
When to use
5 / 20
Arguments
15 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
  • Minor
    Its description is nearly the same as certification_replay's (similarity 0.89); only the names and schemas tell them apart. Say in this description when to use certification_replay instead.confusable_pair
  • Minor
    Its description is nearly the same as certification_task's (similarity 0.65); only the names and schemas tell them apart. Say in this description when to use certification_task instead.confusable_pair
  • Minor
    Its description is nearly the same as play_status's (similarity 0.65); only the names and schemas tell them apart. Say in this description when to use play_status instead.confusable_pair
  • Minor
    Its description is nearly the same as start_author_test's (similarity 0.64); only the names and schemas tell them apart. Say in this description when to use start_author_test instead.confusable_pair
  • Minor
    Its description is nearly the same as certification_state's (similarity 0.64); only the names and schemas tell them apart. Say in this description when to use certification_state instead.confusable_pair
  • Minor
    Arguments without a description: id.param_no_description
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    Required identifiers whose description does not say where the value comes from: id. Name the tool or the place that returns it, or models look it up first.id_source_missing

certification_replay

50 / 100Cloudy

Purpose
20 / 20
When to use
5 / 20
Arguments
15 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
  • Minor
    Its description is nearly the same as author_test_replay's (similarity 0.89); only the names and schemas tell them apart. Say in this description when to use author_test_replay instead.confusable_pair
  • Minor
    Its description is nearly the same as certification_state's (similarity 0.73); only the names and schemas tell them apart. Say in this description when to use certification_state instead.confusable_pair
  • Minor
    Arguments without a description: id.param_no_description
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    Required identifiers whose description does not say where the value comes from: id. Name the tool or the place that returns it, or models look it up first.id_source_missing

idempotency_status

50 / 100Cloudy

Purpose
20 / 20
When to use
5 / 20
Arguments
15 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
  • Minor
    Arguments without a description: idempotency_key.param_no_description
  • Minor
    Says nothing about what it returns.no_return_info

play_assignment

50 / 100Cloudy

Purpose
20 / 20
When to use
5 / 20
Arguments
15 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
  • Minor
    Its description is nearly the same as play_status's (similarity 0.63); only the names and schemas tell them apart. Say in this description when to use play_status instead.confusable_pair
  • Minor
    Arguments without a description: slug.param_no_description
  • Minor
    Says nothing about what it returns.no_return_info

start_play

51 / 100Cloudy

Purpose
20 / 20
When to use
10 / 20
Arguments
11 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
  • Major
    Arguments without a description: slug, challenge_id, mode, difficulty, accepted_version_id, ready_to_act, idempotency_key.param_no_description
  • Minor
    The meaning of the boolean argument ready_to_act is unclear.vague_boolean
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    Required identifiers whose description does not say where the value comes from: accepted_version_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

play_state

52 / 100Cloudy

Purpose
17 / 20
When to use
10 / 20
Arguments
15 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
  • Minor
    Arguments without a description: id.param_no_description
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    Required identifiers whose description does not say where the value comes from: id. Name the tool or the place that returns it, or models look it up first.id_source_missing

submit_certification_report

52 / 100Cloudy

Purpose
20 / 20
When to use
10 / 20
Arguments
12 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
  • Major
    Arguments without a description: session_id, objective_summary, strategy_summary, feedback.param_no_description
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    Required identifiers whose description does not say where the value comes from: session_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

exact_game_version

53 / 100Cloudy

Purpose
20 / 20
When to use
10 / 20
Arguments
13 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
  • Major
    Arguments without a description: slug, versionId, include.param_no_description
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    Required identifiers whose description does not say where the value comes from: versionId. Name the tool or the place that returns it, or models look it up first.id_source_missing

claim_certification

54 / 100Cloudy

Purpose
17 / 20
When to use
5 / 20
Arguments
15 / 25
Return value
7 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
  • Minor
    Arguments without a description: version_id.param_no_description
  • Minor
    Required identifiers whose description does not say where the value comes from: version_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

author_status

55 / 100Cloudy

Purpose
20 / 20
When to use
5 / 20
Arguments
20 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
  • Minor
    Says nothing about what it returns.no_return_info

certification_task

55 / 100Cloudy

Purpose
20 / 20
When to use
5 / 20
Arguments
20 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
  • Minor
    Its description is nearly the same as author_test_replay's (similarity 0.65); only the names and schemas tell them apart. Say in this description when to use author_test_replay instead.confusable_pair
  • Minor
    Says nothing about what it returns.no_return_info

certify_status

55 / 100Cloudy

Purpose
20 / 20
When to use
5 / 20
Arguments
20 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
  • Minor
    Says nothing about what it returns.no_return_info

play_status

55 / 100Cloudy

Purpose
20 / 20
When to use
5 / 20
Arguments
20 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
  • Minor
    Its description is nearly the same as author_test_replay's (similarity 0.65); only the names and schemas tell them apart. Say in this description when to use author_test_replay instead.confusable_pair
  • Minor
    Its description is nearly the same as play_assignment's (similarity 0.63); only the names and schemas tell them apart. Say in this description when to use play_assignment instead.confusable_pair
  • Minor
    Says nothing about what it returns.no_return_info

traffic_status

55 / 100Cloudy

Purpose
20 / 20
When to use
5 / 20
Arguments
20 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
  • Minor
    Says nothing about what it returns.no_return_info

What static scoring cannot tell

This score reads only the text of each description and schema: it says what is written, not what a model will do. Short tools whose names already say what they do, such as browser_close, score low here even when models use them well, and in our measurements current models chose the right tool in one step even from one-line descriptions, as long as the names and schemas differed. What the text cannot show, such as what happens over several steps and whether an added sentence helps or misleads, is what an evaluation measures, on the Pro and Team plans.

Is your server listed here and you would rather it were not? Email support@forecall.dev, and we will take it off within 7 days.

All scored servers