Forecall
Failure recordsDocs
All scored servers

ScoreIA Open Chamber: tool descriptions scored ai.scoreia/bench

tools/list taken
(UTC)
From
Official MCP Registry
Connected to
https://scoreia.ai/mcp
Homepage
scoreia.ai/en/open-challenge/
Scoring rules
v2
Removal
support@forecall.dev
Score this URL as it is today

Scores, issues and names only

This page shows how ScoreIA Open Chamber (ai.scoreia/bench)'s tool descriptions scored, the issues found and the names of its tools and parameters. The descriptions are the server's own: read them where the copy came from.

Forecall asked the URL this server lists in the official MCP Registry for its tools/list once, on the date above, without calling any tool. The server may have changed since.

servers/ai.scoreia/bench
Average score
28.6 / 100Rain
Tools
18
Near-identical descriptions
3

Across the server

Tools whose descriptions are nearly the same

3 of 3 pairs shown, highest description similarity first.
ToolToolDescription similarityName similarity
enter_open_challengestart_challenge0.940.25
chamber_actionchallenge_action0.880.33
seal_attemptfinish_challenge0.730.00

Tools

fetch

10 / 100Rain

Purpose
10 / 20
When to use
0 / 20
Arguments
0 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: id, card_id.param_no_description
  • Minor
    String arguments with no constraint or example: id, card_id.loose_string_param
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

read_card

16 / 100Rain

Purpose
13 / 20
When to use
0 / 20
Arguments
3 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: card_id.param_no_description
  • Minor
    String arguments with no constraint or example: card_id.loose_string_param
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints
  • Minor
    Required identifiers whose description does not say where the value comes from: card_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

seal_attempt

18 / 100Rain

Purpose
13 / 20
When to use
0 / 20
Arguments
5 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: challenge_handle, next_candidate, export.param_no_description
  • Minor
    Its description is nearly the same as finish_challenge's (similarity 0.73); only the names and schemas tell them apart. Say in this description when to use finish_challenge instead.confusable_pair
  • Minor
    String arguments with no constraint or example: challenge_handle, next_candidate.loose_string_param
  • Minor
    The description mentions none of its 3 or more arguments.params_not_in_description
  • Minor
    The meaning of the boolean argument export is unclear.vague_boolean
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

finish_challenge

19 / 100Rain

Purpose
14 / 20
When to use
0 / 20
Arguments
5 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: challenge_handle, next_candidate, export.param_no_description
  • Minor
    Its description is nearly the same as seal_attempt's (similarity 0.73); only the names and schemas tell them apart. Say in this description when to use seal_attempt instead.confusable_pair
  • Minor
    String arguments with no constraint or example: challenge_handle, next_candidate.loose_string_param
  • Minor
    The description mentions none of its 3 or more arguments.params_not_in_description
  • Minor
    The meaning of the boolean argument export is unclear.vague_boolean
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

read_suite

20 / 100Rain

Purpose
17 / 20
When to use
0 / 20
Arguments
3 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: suite.param_no_description
  • Minor
    String arguments with no constraint or example: suite.loose_string_param
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

search

20 / 100Rain

Purpose
10 / 20
When to use
0 / 20
Arguments
7 / 25
Return value
0 / 15
Constraints and side effects
3 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: query, suite, product, domain, card_id, limit, offset.param_no_description
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    The description mentions none of its 3 or more arguments.params_not_in_description
  • Minor
    Says nothing about what it returns.no_return_info

verify_card

20 / 100Rain

Purpose
17 / 20
When to use
0 / 20
Arguments
3 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: card_id.param_no_description
  • Minor
    String arguments with no constraint or example: card_id.loose_string_param
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints
  • Minor
    Required identifiers whose description does not say where the value comes from: card_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

call_for_help

24 / 100Rain

Purpose
14 / 20
When to use
5 / 20
Arguments
5 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Arguments without a description: challenge_handle, ally.param_no_description
  • Minor
    String arguments with no constraint or example: challenge_handle, ally.loose_string_param
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

challenge_action

29 / 100Rain

Purpose
17 / 20
When to use
5 / 20
Arguments
7 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Arguments without a description: challenge_handle, op, object, value.param_no_description
  • Minor
    Its description is nearly the same as chamber_action's (similarity 0.88); only the names and schemas tell them apart. Say in this description when to use chamber_action instead.confusable_pair
  • Minor
    String arguments with no constraint or example: challenge_handle, object.loose_string_param
  • Minor
    The description mentions none of its 3 or more arguments.params_not_in_description
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

chamber_action

29 / 100Rain

Purpose
17 / 20
When to use
5 / 20
Arguments
7 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Arguments without a description: challenge_handle, op, object, value.param_no_description
  • Minor
    Its description is nearly the same as challenge_action's (similarity 0.88); only the names and schemas tell them apart. Say in this description when to use challenge_action instead.confusable_pair
  • Minor
    String arguments with no constraint or example: challenge_handle, object.loose_string_param
  • Minor
    The description mentions none of its 3 or more arguments.params_not_in_description
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

search_evidence

31 / 100Rain

Purpose
17 / 20
When to use
0 / 20
Arguments
7 / 25
Return value
7 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: suite, product, domain, card_id, limit, offset.param_no_description
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    The description mentions none of its 3 or more arguments.params_not_in_description
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

observe_chamber

34 / 100Rain

Purpose
14 / 20
When to use
10 / 20
Arguments
5 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
5 / 10
  • Major
    Arguments without a description: challenge_handle, object.param_no_description
  • Minor
    String arguments with no constraint or example: challenge_handle, object.loose_string_param
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

catalog

35 / 100Rain

Purpose
10 / 20
When to use
0 / 20
Arguments
25 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

list_open_challenges

38 / 100Rain

Purpose
13 / 20
When to use
0 / 20
Arguments
25 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

list_suites

38 / 100Rain

Purpose
13 / 20
When to use
0 / 20
Arguments
25 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

enter_open_challenge

43 / 100Cloudy

Purpose
17 / 20
When to use
15 / 20
Arguments
11 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Arguments without a description: product, suite, seed, host, provider_claim, product_plan, model_claim, host_version, origin, preflight, preflight.tools_visible, preflight.actions_available, preflight.no_intervention_confirmed.param_no_description
  • Minor
    Its description is nearly the same as start_challenge's (similarity 0.94); only the names and schemas tell them apart. Say in this description when to use start_challenge instead.confusable_pair
  • Minor
    String arguments with no constraint or example: product, seed, host, provider_claim, product_plan, model_claim, host_version.loose_string_param
  • Minor
    The meaning of the boolean argument preflight.tools_visible is unclear.vague_boolean
  • Minor
    The meaning of the boolean argument preflight.actions_available is unclear.vague_boolean
  • Minor
    The meaning of the boolean argument preflight.no_intervention_confirmed is unclear.vague_boolean
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

start_challenge

43 / 100Cloudy

Purpose
17 / 20
When to use
15 / 20
Arguments
11 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Arguments without a description: product, suite, seed, host, provider_claim, product_plan, model_claim, host_version, origin, preflight, preflight.tools_visible, preflight.actions_available, preflight.no_intervention_confirmed.param_no_description
  • Minor
    Its description is nearly the same as enter_open_challenge's (similarity 0.94); only the names and schemas tell them apart. Say in this description when to use enter_open_challenge instead.confusable_pair
  • Minor
    String arguments with no constraint or example: product, seed, host, provider_claim, product_plan, model_claim, host_version.loose_string_param
  • Minor
    The meaning of the boolean argument preflight.tools_visible is unclear.vague_boolean
  • Minor
    The meaning of the boolean argument preflight.actions_available is unclear.vague_boolean
  • Minor
    The meaning of the boolean argument preflight.no_intervention_confirmed is unclear.vague_boolean
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

open_challenge

47 / 100Cloudy

Purpose
17 / 20
When to use
5 / 20
Arguments
25 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

What static scoring cannot tell

This score reads only the text of each description and schema: it says what is written, not what a model will do. Short tools whose names already say what they do, such as browser_close, score low here even when models use them well, and in our measurements current models chose the right tool in one step even from one-line descriptions, as long as the names and schemas differed. What the text cannot show, such as what happens over several steps and whether an added sentence helps or misleads, is what an evaluation measures, on the Pro and Team plans.

Is your server listed here and you would rather it were not? Email support@forecall.dev, and we will take it off within 7 days.

All scored servers