All scored servers

Mostly Right: tool descriptions scored md.mostlyright/datasets

tools/list taken
(UTC)
Connected to
https://mostlyright.md/api/mcp
Scoring rules
v2
Score this URL as it is today

Scores, issues and names only

This page shows how Mostly Right (md.mostlyright/datasets)'s tool descriptions scored, the issues found and the names of its tools and parameters. The descriptions are the server's own: read them where the copy came from.

Forecall asked the URL this server lists in the official MCP Registry for its tools/list once, on the date above, without calling any tool. The server may have changed since.

servers/md.mostlyright/datasets
Average score
57.3 / 100Cloudy
Tools
81
Near-identical descriptions
1

Across the server

  • Major
    81 tools. Above 40, models choose less accurately.too_many_tools
  • Minor
    The server's instructions are 6238 characters. Claude Code reads only the first 2,048 by default (Codex 0.154.0 reads them whole). Put what the server is for first.instructions_long

Tools whose descriptions are nearly the same

1 of 1 pairs shown, highest description similarity first.
ToolToolDescription similarityName similarity
sample_tablelist_column_values0.620.00

Tools

get_access_instructions

39 / 100Rain

Purpose
17 / 20
When to use
0 / 20
Arguments
7 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: dataset_slug.param_no_description
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    Says nothing about what it returns.no_return_info

build_table_search

41 / 100Cloudy

Purpose
17 / 20
When to use
0 / 20
Arguments
10 / 25
Return value
7 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: table_id, table_version_id, search_revision_id.param_no_description
  • Minor
    Required identifiers whose description does not say where the value comes from: table_id, table_version_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

list_recipes

41 / 100Cloudy

Purpose
17 / 20
When to use
0 / 20
Arguments
7 / 25
Return value
7 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: table_id, current_only, cursor, limit.param_no_description
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    The meaning of the boolean argument current_only is unclear.vague_boolean

get_dataset

44 / 100Cloudy

Purpose
17 / 20
When to use
5 / 20
Arguments
10 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
  • Major
    Arguments without a description: slug.param_no_description
  • Minor
    Says nothing about what it returns.no_return_info

cancel_search_job

46 / 100Cloudy

Purpose
17 / 20
When to use
5 / 20
Arguments
10 / 25
Return value
7 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Arguments without a description: job_id.param_no_description
  • Minor
    Required identifiers whose description does not say where the value comes from: job_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

control_stream_subscription

46 / 100Cloudy

Purpose
17 / 20
When to use
5 / 20
Arguments
10 / 25
Return value
7 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Arguments without a description: subscription_id, action, expected_version.param_no_description
  • Minor
    Required identifiers whose description does not say where the value comes from: subscription_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

create_stream_registry

46 / 100Cloudy

Purpose
17 / 20
When to use
5 / 20
Arguments
10 / 25
Return value
7 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Arguments without a description: document_digests.param_no_description

run_events

46 / 100Cloudy

Purpose
17 / 20
When to use
0 / 20
Arguments
10 / 25
Return value
7 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: run_id, from_seq, max_events, wait_seconds.param_no_description
  • Minor
    Required identifiers whose description does not say where the value comes from: run_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

start_source_inspection

46 / 100Cloudy

Purpose
17 / 20
When to use
5 / 20
Arguments
10 / 25
Return value
7 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Arguments without a description: dataset_id, question, archive_members, source, source.name, source.url, source.rights_claim, source.rights_claim.claimed_basis, source.rights_claim.claim_evidence_digest, source.rights_claim.claim_note.param_no_description
  • Minor
    The meaning of the boolean argument archive_members is unclear.vague_boolean

connect_dataset

47 / 100Cloudy

Purpose
17 / 20
When to use
5 / 20
Arguments
10 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
5 / 10
  • Major
    Arguments without a description: dataset_slug.param_no_description
  • Minor
    Says nothing about what it returns.no_return_info

list_source_credentials

48 / 100Cloudy

Purpose
17 / 20
When to use
10 / 20
Arguments
7 / 25
Return value
7 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Arguments without a description: dataset_id, connection_offset.param_no_description
  • Minor
    No `required` list, so every argument is optional.no_required

start_stream

48 / 100Cloudy

Purpose
17 / 20
When to use
10 / 20
Arguments
7 / 25
Return value
7 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Arguments without a description: kind, connector_document_digest, registry_id, secret_name, members, seconds, kind, connector_document_digest, registry_id, secret_name, members, until, until.events, until.bytes, until.seconds, kind, connector_document_digest, registry_id, secret_name, members, series_id, volume_policy, volume_policy.max_bytes, volume_policy.max_duration_seconds, no_data_timeout_seconds.param_no_description
  • Minor
    String arguments with no constraint or example: kind, kind, kind.loose_string_param

search

49 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
10 / 25
Return value
7 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: query.param_no_description

write_note

49 / 100Cloudy

Purpose
17 / 20
When to use
0 / 20
Arguments
10 / 25
Return value
7 / 15
Constraints and side effects
10 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: run_id, dataset_id, heading, markdown, cell_id, phase, checkpoint_seq, revision_of, blocks.param_no_description

fetch

51 / 100Cloudy

Purpose
17 / 20
When to use
5 / 20
Arguments
10 / 25
Return value
7 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
  • Major
    Arguments without a description: id.param_no_description

get_source_probe

51 / 100Cloudy

Purpose
17 / 20
When to use
5 / 20
Arguments
10 / 25
Return value
7 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
  • Major
    Arguments without a description: session_id, probe_id, wait_seconds.param_no_description
  • Minor
    Required identifiers whose description does not say where the value comes from: session_id, probe_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

list_my_datasets

51 / 100Cloudy

Purpose
17 / 20
When to use
5 / 20
Arguments
7 / 25
Return value
7 / 15
Constraints and side effects
10 / 10
Examples
5 / 10
  • Major
    Arguments without a description: limit.param_no_description
  • Minor
    No `required` list, so every argument is optional.no_required

list_notes

51 / 100Cloudy

Purpose
17 / 20
When to use
5 / 20
Arguments
7 / 25
Return value
7 / 15
Constraints and side effects
10 / 10
Examples
5 / 10
  • Major
    Arguments without a description: run_id, dataset_id, cell_id, include_superseded, limit.param_no_description
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    The meaning of the boolean argument include_superseded is unclear.vague_boolean

normalize_reader_options

51 / 100Cloudy

Purpose
17 / 20
When to use
10 / 20
Arguments
10 / 25
Return value
7 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Arguments without a description: family_id, family_version, decode_options.param_no_description
  • Minor
    Required identifiers whose description does not say where the value comes from: family_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

replay_run

51 / 100Cloudy

Purpose
17 / 20
When to use
10 / 20
Arguments
10 / 25
Return value
7 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Arguments without a description: recipe_id, recipe_digest, sources_from_run.param_no_description
  • Minor
    The description mentions none of its 3 or more arguments.params_not_in_description
  • Minor
    Required identifiers whose description does not say where the value comes from: recipe_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

run_artifacts

51 / 100Cloudy

Purpose
17 / 20
When to use
5 / 20
Arguments
10 / 25
Return value
7 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
  • Major
    Arguments without a description: run_id.param_no_description
  • Minor
    Required identifiers whose description does not say where the value comes from: run_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

search_datasets

51 / 100Cloudy

Purpose
17 / 20
When to use
5 / 20
Arguments
7 / 25
Return value
7 / 15
Constraints and side effects
10 / 10
Examples
5 / 10
  • Major
    Arguments without a description: query, topic, limit, cursor.param_no_description
  • Minor
    No `required` list, so every argument is optional.no_required

activate_table_search

54 / 100Cloudy

Purpose
17 / 20
When to use
10 / 20
Arguments
10 / 25
Return value
7 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
  • Major
    Arguments without a description: table_id, table_version_id, search_revision_id, generation_id, action, expected_active_revision_id, expected_active_generation_id, idempotency_key.param_no_description
  • Minor
    Required identifiers whose description does not say where the value comes from: table_id, table_version_id, search_revision_id, generation_id, expected_active_revision_id, expected_active_generation_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

configure_table_search

54 / 100Cloudy

Purpose
17 / 20
When to use
10 / 20
Arguments
10 / 25
Return value
7 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
  • Major
    Arguments without a description: table_id, table_version_id, expected_revision, spec, semantic_evaluation, idempotency_key.param_no_description
  • Minor
    Required identifiers whose description does not say where the value comes from: table_id, table_version_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

forecast_recipe

54 / 100Cloudy

Purpose
17 / 20
When to use
5 / 20
Arguments
10 / 25
Return value
7 / 15
Constraints and side effects
10 / 10
Examples
5 / 10
  • Major
    Arguments without a description: recipe_id, recipe_digest, mode.param_no_description
  • Minor
    Required identifiers whose description does not say where the value comes from: recipe_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

list_table_parts

54 / 100Cloudy

Purpose
17 / 20
When to use
5 / 20
Arguments
10 / 25
Return value
7 / 15
Constraints and side effects
10 / 10
Examples
5 / 10
  • Major
    Arguments without a description: table_id, table_version_id, cursor, limit.param_no_description
  • Minor
    Required identifiers whose description does not say where the value comes from: table_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

register_stream_document

54 / 100Cloudy

Purpose
17 / 20
When to use
10 / 20
Arguments
10 / 25
Return value
7 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
  • Major
    Arguments without a description: document_name, document, idempotency_key.param_no_description

test_recipe

54 / 100Cloudy

Purpose
17 / 20
When to use
5 / 20
Arguments
10 / 25
Return value
7 / 15
Constraints and side effects
10 / 10
Examples
5 / 10
  • Major
    Arguments without a description: recipe_id, recipe_digest, max_pages_per_source, max_upstream_rows.param_no_description
  • Minor
    Required identifiers whose description does not say where the value comes from: recipe_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

verify_run

54 / 100Cloudy

Purpose
17 / 20
When to use
5 / 20
Arguments
10 / 25
Return value
7 / 15
Constraints and side effects
10 / 10
Examples
5 / 10
  • Major
    Arguments without a description: run_id, deep.param_no_description
  • Minor
    The meaning of the boolean argument deep is unclear.vague_boolean
  • Minor
    Required identifiers whose description does not say where the value comes from: run_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

approve_full_run

56 / 100Cloudy

Purpose
17 / 20
When to use
10 / 20
Arguments
10 / 25
Return value
7 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
  • Major
    Arguments without a description: run_id, expected_version.param_no_description
  • Minor
    Required identifiers whose description does not say where the value comes from: run_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

archive_table

56 / 100Cloudy

Purpose
17 / 20
When to use
10 / 20
Arguments
10 / 25
Return value
7 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
  • Major
    Arguments without a description: table_id.param_no_description

cancel_run

56 / 100Cloudy

Purpose
17 / 20
When to use
10 / 20
Arguments
10 / 25
Return value
7 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
  • Major
    Arguments without a description: run_id, expected_version.param_no_description
  • Minor
    Required identifiers whose description does not say where the value comes from: run_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

get_my_dataset

56 / 100Cloudy

Purpose
17 / 20
When to use
10 / 20
Arguments
10 / 25
Return value
7 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
  • Major
    Arguments without a description: dataset_id.param_no_description
  • Minor
    Required identifiers whose description does not say where the value comes from: dataset_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

get_source_inspection

56 / 100Cloudy

Purpose
17 / 20
When to use
15 / 20
Arguments
10 / 25
Return value
7 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Arguments without a description: session_id, probe_id, wait_seconds.param_no_description
  • Minor
    Required identifiers whose description does not say where the value comes from: session_id, probe_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

get_table

56 / 100Cloudy

Purpose
17 / 20
When to use
10 / 20
Arguments
10 / 25
Return value
7 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
  • Major
    Arguments without a description: table_id.param_no_description

get_table_schema

56 / 100Cloudy

Purpose
17 / 20
When to use
10 / 20
Arguments
10 / 25
Return value
7 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
  • Major
    Arguments without a description: table_id.param_no_description

inspect_table_search

56 / 100Cloudy

Purpose
17 / 20
When to use
15 / 20
Arguments
10 / 25
Return value
7 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Arguments without a description: operation, table_id, table_version_id, search_revision_id, recipe, spec, query, pointer, offset, expected_snapshot_digest.param_no_description

promote_table

56 / 100Cloudy

Purpose
17 / 20
When to use
10 / 20
Arguments
10 / 25
Return value
7 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
  • Major
    Arguments without a description: table_id, confirm, cadence.param_no_description
  • Minor
    The meaning of the boolean argument confirm is unclear.vague_boolean

refresh_table

56 / 100Cloudy

Purpose
17 / 20
When to use
10 / 20
Arguments
10 / 25
Return value
7 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
  • Major
    Arguments without a description: table_id, expected_version.param_no_description
  • Minor
    Required identifiers whose description does not say where the value comes from: table_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

rename_table

56 / 100Cloudy

Purpose
17 / 20
When to use
10 / 20
Arguments
10 / 25
Return value
7 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
  • Major
    Arguments without a description: table_id, name.param_no_description
  • Minor
    Required identifiers whose description does not say where the value comes from: table_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

get_stream

58 / 100Cloudy

Purpose
17 / 20
When to use
20 / 20
Arguments
7 / 25
Return value
7 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Arguments without a description: kind, id, pointer, offset, expected_snapshot_digest, kind, connector_document_digest, members, pointer, offset, expected_snapshot_digest.param_no_description
  • Minor
    String arguments with no constraint or example: kind.loose_string_param

compare_runs

59 / 100Cloudy

Purpose
17 / 20
When to use
10 / 20
Arguments
10 / 25
Return value
7 / 15
Constraints and side effects
10 / 10
Examples
5 / 10
  • Major
    Arguments without a description: run_id, other_run_id.param_no_description
  • Minor
    Required identifiers whose description does not say where the value comes from: run_id, other_run_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

confirm_run

59 / 100Cloudy

Purpose
17 / 20
When to use
10 / 20
Arguments
10 / 25
Return value
7 / 15
Constraints and side effects
10 / 10
Examples
5 / 10
  • Major
    Arguments without a description: run_id, expected_version.param_no_description
  • Minor
    Required identifiers whose description does not say where the value comes from: run_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

diagnose_table

59 / 100Cloudy

Purpose
17 / 20
When to use
10 / 20
Arguments
10 / 25
Return value
7 / 15
Constraints and side effects
10 / 10
Examples
5 / 10
  • Major
    Arguments without a description: table_id.param_no_description

explain_recipe

59 / 100Cloudy

Purpose
17 / 20
When to use
10 / 20
Arguments
10 / 25
Return value
7 / 15
Constraints and side effects
10 / 10
Examples
5 / 10
  • Major
    Arguments without a description: recipe.param_no_description

get_run_attempts

59 / 100Cloudy

Purpose
17 / 20
When to use
15 / 20
Arguments
10 / 25
Return value
7 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
  • Major
    Arguments without a description: run_id, pointer, offset, expected_snapshot_digest.param_no_description
  • Minor
    Required identifiers whose description does not say where the value comes from: run_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

get_search_evaluation

59 / 100Cloudy

Purpose
17 / 20
When to use
15 / 20
Arguments
10 / 25
Return value
7 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
  • Major
    Arguments without a description: table_id, table_version_id, search_revision_id, cases_revision_id, pointer, offset, expected_snapshot_digest.param_no_description
  • Minor
    Required identifiers whose description does not say where the value comes from: table_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

list_dataset_events

59 / 100Cloudy

Purpose
17 / 20
When to use
10 / 20
Arguments
10 / 25
Return value
7 / 15
Constraints and side effects
10 / 10
Examples
5 / 10
  • Major
    Arguments without a description: dataset_id, before_cursor, limit.param_no_description
  • Minor
    Required identifiers whose description does not say where the value comes from: dataset_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

register_recipe

59 / 100Cloudy

Purpose
17 / 20
When to use
10 / 20
Arguments
10 / 25
Return value
7 / 15
Constraints and side effects
10 / 10
Examples
5 / 10
  • Major
    Arguments without a description: recipe.param_no_description

search_table

59 / 100Cloudy

Purpose
17 / 20
When to use
10 / 20
Arguments
10 / 25
Return value
7 / 15
Constraints and side effects
10 / 10
Examples
5 / 10
  • Major
    Arguments without a description: table_id, query, settled, plan, cursor, like, mode, page_size, count, columns.param_no_description
  • Minor
    The meaning of the boolean argument settled is unclear.vague_boolean
  • Minor
    The meaning of the boolean argument count is unclear.vague_boolean

suggest_enrichments

59 / 100Cloudy

Purpose
17 / 20
When to use
10 / 20
Arguments
10 / 25
Return value
7 / 15
Constraints and side effects
10 / 10
Examples
5 / 10
  • Major
    Arguments without a description: run_id, max_rows, wait_seconds.param_no_description
  • Minor
    Required identifiers whose description does not say where the value comes from: run_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

archive_dataset

61 / 100Cloudy

Purpose
17 / 20
When to use
15 / 20
Arguments
10 / 25
Return value
7 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
  • Major
    Arguments without a description: dataset_id, confirm.param_no_description
  • Minor
    The meaning of the boolean argument confirm is unclear.vague_boolean

get_recipe_readiness

61 / 100Cloudy

Purpose
17 / 20
When to use
20 / 20
Arguments
7 / 25
Return value
7 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
  • Major
    Arguments without a description: recipe_id, table_id, current_only, cursor, limit, pointer, offset, expected_snapshot_digest.param_no_description
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    The meaning of the boolean argument current_only is unclear.vague_boolean

get_search_job

61 / 100Cloudy

Purpose
17 / 20
When to use
20 / 20
Arguments
10 / 25
Return value
7 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Arguments without a description: job_id, pointer, offset, expected_snapshot_digest.param_no_description
  • Minor
    Required identifiers whose description does not say where the value comes from: job_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

list_runs

61 / 100Cloudy

Purpose
17 / 20
When to use
15 / 20
Arguments
7 / 25
Return value
7 / 15
Constraints and side effects
10 / 10
Examples
5 / 10
  • Major
    Arguments without a description: dataset_id, status, mode, limit.param_no_description
  • Minor
    No `required` list, so every argument is optional.no_required

list_tables

61 / 100Cloudy

Purpose
17 / 20
When to use
15 / 20
Arguments
10 / 25
Return value
7 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
  • Major
    Arguments without a description: dataset_slug.param_no_description

set_dataset_visibility

61 / 100Cloudy

Purpose
17 / 20
When to use
15 / 20
Arguments
10 / 25
Return value
7 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
  • Major
    Arguments without a description: dataset_id, visibility, reset_link.param_no_description
  • Minor
    The meaning of the boolean argument reset_link is unclear.vague_boolean
  • Minor
    Required identifiers whose description does not say where the value comes from: dataset_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

add_search_cases

64 / 100Cloudy

Purpose
17 / 20
When to use
15 / 20
Arguments
10 / 25
Return value
7 / 15
Constraints and side effects
10 / 10
Examples
5 / 10
  • Major
    Arguments without a description: table_id, table_version_id, search_revision_id, cases, cases[].case_id, cases[].kind, cases[].query, cases[].top_k, cases[].required_locators, cases[].forbidden_locators, idempotency_key.param_no_description

configure_table_view

64 / 100Cloudy

Purpose
17 / 20
When to use
20 / 20
Arguments
10 / 25
Return value
7 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
  • Major
    Arguments without a description: dataset_id, table_id, table_version_id, expected_revision, dry_run, config, config.version, config.template, config.fields, config.fields.title, config.fields.image, config.fields.description, config.fields.subtitle, config.fields.address, config.fields.category, config.fields.rating, config.fields.reviewCount, config.fields.price, config.fields.currency, config.fields.start, config.fields.end, config.fields.organization, config.fields.location, config.fields.author, config.fields.published, config.fields.url, config.fields.salaryMin, config.fields.salaryMax, config.fields.employmentType, config.fields.seniority, config.fields.stockStatus, config.fields.latitude, config.fields.longitude, config.facts, config.imageStyle.param_no_description
  • Minor
    The meaning of the boolean argument dry_run is unclear.vague_boolean

generate_cover

64 / 100Cloudy

Purpose
17 / 20
When to use
15 / 20
Arguments
10 / 25
Return value
7 / 15
Constraints and side effects
10 / 10
Examples
5 / 10
  • Major
    Arguments without a description: dataset_id, subject, idempotency_key, replace.param_no_description
  • Minor
    The meaning of the boolean argument replace is unclear.vague_boolean
  • Minor
    Required identifiers whose description does not say where the value comes from: dataset_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

get_artifact_download

64 / 100Cloudy

Purpose
17 / 20
When to use
15 / 20
Arguments
10 / 25
Return value
7 / 15
Constraints and side effects
10 / 10
Examples
5 / 10
  • Major
    Arguments without a description: run_id, artifact_id.param_no_description

get_download_instructions

64 / 100Cloudy

Purpose
17 / 20
When to use
15 / 20
Arguments
10 / 25
Return value
7 / 15
Constraints and side effects
10 / 10
Examples
5 / 10
  • Major
    Arguments without a description: table_id.param_no_description

get_recipe

64 / 100Cloudy

Purpose
17 / 20
When to use
20 / 20
Arguments
10 / 25
Return value
7 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
  • Major
    Arguments without a description: recipe_id, pointer, offset.param_no_description

list_connected_datasets

64 / 100Cloudy

Purpose
17 / 20
When to use
5 / 20
Arguments
25 / 25
Return value
7 / 15
Constraints and side effects
10 / 10
Examples
0 / 10

No issues.

probe_source

64 / 100Cloudy

Purpose
17 / 20
When to use
15 / 20
Arguments
10 / 25
Return value
7 / 15
Constraints and side effects
10 / 10
Examples
5 / 10
  • Major
    Arguments without a description: dataset_id, question_id, source_id, kind, limit, offset, columns, scan_rows, expression.param_no_description
  • Minor
    Required identifiers whose description does not say where the value comes from: dataset_id, question_id, source_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

query_run

64 / 100Cloudy

Purpose
17 / 20
When to use
15 / 20
Arguments
10 / 25
Return value
7 / 15
Constraints and side effects
10 / 10
Examples
5 / 10
  • Major
    Arguments without a description: run_id, sql, query_id, max_rows, wait_seconds.param_no_description
  • Minor
    Required identifiers whose description does not say where the value comes from: run_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

query_table

64 / 100Cloudy

Purpose
17 / 20
When to use
15 / 20
Arguments
10 / 25
Return value
7 / 15
Constraints and side effects
10 / 10
Examples
5 / 10
  • Major
    Arguments without a description: table_id, columns, filters, filters[].column, filters[].operator, filters[].value, order_by, order_by[].column, order_by[].direction, aggregates, aggregates[].function, aggregates[].column, aggregates[].as, group_by, limit, offset, cursor, search, search.text, search.columns, search.spec_digest, search.engine, search.settled, search.plan, search.cursor, search.count, search.mode, search.generation_digest.param_no_description
  • Minor
    The description is long (623 words). It helps selection but costs steps and tokens.too_long
  • Minor
    String arguments with no constraint or example: search.engine.loose_string_param
  • Minor
    The meaning of the boolean argument search.settled is unclear.vague_boolean

resync_table

64 / 100Cloudy

Purpose
17 / 20
When to use
15 / 20
Arguments
10 / 25
Return value
7 / 15
Constraints and side effects
10 / 10
Examples
5 / 10
  • Major
    Arguments without a description: table_id, expected_version, request_id, reuse_saved_answers, discard_snapshot_history.param_no_description
  • Minor
    The meaning of the boolean argument reuse_saved_answers is unclear.vague_boolean
  • Minor
    The meaning of the boolean argument discard_snapshot_history is unclear.vague_boolean
  • Minor
    Required identifiers whose description does not say where the value comes from: table_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

sample_rows

64 / 100Cloudy

Purpose
17 / 20
When to use
15 / 20
Arguments
10 / 25
Return value
7 / 15
Constraints and side effects
10 / 10
Examples
5 / 10
  • Major
    Arguments without a description: table_id, limit.param_no_description

demote_table

66 / 100Cloudy

Purpose
17 / 20
When to use
20 / 20
Arguments
10 / 25
Return value
7 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
  • Major
    Arguments without a description: table_id, expected_version.param_no_description
  • Minor
    Required identifiers whose description does not say where the value comes from: table_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

get_run

66 / 100Cloudy

Purpose
17 / 20
When to use
20 / 20
Arguments
10 / 25
Return value
7 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
  • Major
    Arguments without a description: run_id.param_no_description
  • Major
    The name is made of generic words only.generic_name
  • Minor
    Required identifiers whose description does not say where the value comes from: run_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

propose_revision

66 / 100Cloudy

Purpose
17 / 20
When to use
20 / 20
Arguments
10 / 25
Return value
7 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
  • Major
    Arguments without a description: recipe, sources_from_run.param_no_description

reschedule_table

66 / 100Cloudy

Purpose
17 / 20
When to use
20 / 20
Arguments
10 / 25
Return value
7 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
  • Major
    Arguments without a description: table_id, cron, interval_seconds, timezone, rationale, lock, expected_version.param_no_description
  • Minor
    The meaning of the boolean argument lock is unclear.vague_boolean
  • Minor
    Required identifiers whose description does not say where the value comes from: table_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

start_run

66 / 100Cloudy

Purpose
17 / 20
When to use
20 / 20
Arguments
10 / 25
Return value
7 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
  • Major
    Arguments without a description: recipe_id, recipe_digest, mode, retry_of_run_id, max_rows, max_source_bytes, window, window.start, window.end, resource_class, reuse_saved_answers, discard_snapshot_history, resume_capture_run_id.param_no_description
  • Minor
    The meaning of the boolean argument reuse_saved_answers is unclear.vague_boolean
  • Minor
    The meaning of the boolean argument discard_snapshot_history is unclear.vague_boolean

update_dataset

66 / 100Cloudy

Purpose
17 / 20
When to use
20 / 20
Arguments
10 / 25
Return value
7 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
  • Major
    Arguments without a description: dataset_id, sync_only, expected_version, name, description, category_id, main_table_id.param_no_description
  • Minor
    The description is long (504 words). It helps selection but costs steps and tokens.too_long
  • Minor
    The meaning of the boolean argument sync_only is unclear.vague_boolean
  • Minor
    Required identifiers whose description does not say where the value comes from: dataset_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

create_dataset

69 / 100Cloudy

Purpose
17 / 20
When to use
20 / 20
Arguments
10 / 25
Return value
7 / 15
Constraints and side effects
10 / 10
Examples
5 / 10
  • Major
    Arguments without a description: name, description, separate.param_no_description
  • Minor
    The meaning of the boolean argument separate is unclear.vague_boolean

list_column_values

69 / 100Cloudy

Purpose
17 / 20
When to use
20 / 20
Arguments
10 / 25
Return value
7 / 15
Constraints and side effects
10 / 10
Examples
5 / 10
  • Major
    Arguments without a description: table_id, column, prefix, limit, table_version_id, search_revision_id, wait_seconds.param_no_description
  • Minor
    Its description is nearly the same as sample_table's (similarity 0.62); only the names and schemas tell them apart. Say in this description when to use sample_table instead.confusable_pair

preview_table_search

69 / 100Cloudy

Purpose
17 / 20
When to use
20 / 20
Arguments
10 / 25
Return value
7 / 15
Constraints and side effects
10 / 10
Examples
5 / 10
  • Major
    Arguments without a description: table_id, table_version_id, search_revision_id, query, plan, limit, columns, wait_seconds.param_no_description

sample_table

69 / 100Cloudy

Purpose
17 / 20
When to use
20 / 20
Arguments
10 / 25
Return value
7 / 15
Constraints and side effects
10 / 10
Examples
5 / 10
  • Major
    Arguments without a description: table_id, table_version_id, search_revision_id, limit, columns, wait_seconds.param_no_description
  • Minor
    Its description is nearly the same as list_column_values's (similarity 0.62); only the names and schemas tell them apart. Say in this description when to use list_column_values instead.confusable_pair

catalog_search

72 / 100Clear

Purpose
20 / 20
When to use
20 / 20
Arguments
10 / 25
Return value
7 / 15
Constraints and side effects
10 / 10
Examples
5 / 10
  • Major
    Arguments without a description: question, limit, format.param_no_description
  • Minor
    The description is long (413 words). It helps selection but costs steps and tokens.too_long

list_models

74 / 100Clear

Purpose
17 / 20
When to use
15 / 20
Arguments
25 / 25
Return value
7 / 15
Constraints and side effects
10 / 10
Examples
0 / 10

No issues.

What static scoring cannot tell

This score reads only the text of each description and schema: it says what is written, not what a model will do. Short tools whose names already say what they do, such as browser_close, score low here even when models use them well, and in our measurements current models chose the right tool in one step even from one-line descriptions, as long as the names and schemas differed. What the text cannot show, such as what happens over several steps and whether an added sentence helps or misleads, is what an evaluation measures, on the Pro and Team plans.

Is your server listed here and you would rather it were not? Email support@forecall.dev, and we will take it off within 7 days.

All scored servers