All scored servers

com.rubrkit/rubrkit: tool descriptions scored

tools/list taken
(UTC)
Connected to
https://www.rubrkit.com/api/v1/mcp
Scoring rules
v2
Score this URL as it is today

Scores, issues and names only

This page shows how com.rubrkit/rubrkit's tool descriptions scored, the issues found and the names of its tools and parameters. The descriptions are the server's own: read them where the copy came from.

Forecall asked the URL this server lists in the official MCP Registry for its tools/list once, on the date above, without calling any tool. The server may have changed since.

servers/com.rubrkit/rubrkit
Average score
30.4 / 100Rain
Tools
41
Near-identical descriptions
6

Across the server

  • Major
    41 tools. Above 40, models choose less accurately.too_many_tools

Tools whose descriptions are nearly the same

6 of 6 pairs shown, highest description similarity first.
ToolToolDescription similarityName similarity
rubrkit_restore_artifact_bundle_versionrubrkit_restore_file_version0.790.50
rubrkit_list_auditsrubrkit_list_evals0.700.50
rubrkit_poll_jobrubrkit_list_job_events0.700.40
rubrkit_list_golden_casesrubrkit_list_drift_monitors0.680.33
rubrkit_update_artifact_filerubrkit_restore_file_version0.670.33
rubrkit_delete_artifact_bundlerubrkit_hard_delete_artifact_bundle0.390.80

Tools

rubrkit_search_api_docs

21 / 100Rain

Purpose
13 / 20
When to use
0 / 20
Arguments
8 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: query, limit.param_no_description
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

rubrkit_read_api_doc

25 / 100Rain

Purpose
17 / 20
When to use
0 / 20
Arguments
8 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Major
    Arguments without a description: slugOrPath.param_no_description
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

rubrkit_list_artifact_bundle_versions

26 / 100Rain

Purpose
13 / 20
When to use
5 / 20
Arguments
8 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Arguments without a description: artifactBundleId, limit.param_no_description
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints
  • Minor
    Required identifiers whose description does not say where the value comes from: artifactBundleId. Name the tool or the place that returns it, or models look it up first.id_source_missing

rubrkit_list_audits

26 / 100Rain

Purpose
13 / 20
When to use
5 / 20
Arguments
8 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Arguments without a description: artifactBundleId, limit.param_no_description
  • Minor
    Its description is nearly the same as rubrkit_list_evals's (similarity 0.70); only the names and schemas tell them apart. Say in this description when to use rubrkit_list_evals instead.confusable_pair
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints
  • Minor
    Required identifiers whose description does not say where the value comes from: artifactBundleId. Name the tool or the place that returns it, or models look it up first.id_source_missing

rubrkit_list_evals

26 / 100Rain

Purpose
13 / 20
When to use
5 / 20
Arguments
8 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Arguments without a description: artifactBundleId, limit.param_no_description
  • Minor
    Its description is nearly the same as rubrkit_list_audits's (similarity 0.70); only the names and schemas tell them apart. Say in this description when to use rubrkit_list_audits instead.confusable_pair
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints
  • Minor
    Required identifiers whose description does not say where the value comes from: artifactBundleId. Name the tool or the place that returns it, or models look it up first.id_source_missing

rubrkit_list_job_events

26 / 100Rain

Purpose
13 / 20
When to use
5 / 20
Arguments
8 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Arguments without a description: jobId, limit.param_no_description
  • Minor
    Its description is nearly the same as rubrkit_poll_job's (similarity 0.70); only the names and schemas tell them apart. Say in this description when to use rubrkit_poll_job instead.confusable_pair
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints
  • Minor
    Required identifiers whose description does not say where the value comes from: jobId. Name the tool or the place that returns it, or models look it up first.id_source_missing

rubrkit_poll_job

26 / 100Rain

Purpose
13 / 20
When to use
5 / 20
Arguments
8 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Arguments without a description: jobId.param_no_description
  • Minor
    Its description is nearly the same as rubrkit_list_job_events's (similarity 0.70); only the names and schemas tell them apart. Say in this description when to use rubrkit_list_job_events instead.confusable_pair
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints
  • Minor
    Required identifiers whose description does not say where the value comes from: jobId. Name the tool or the place that returns it, or models look it up first.id_source_missing

rubrkit_read_audit

26 / 100Rain

Purpose
13 / 20
When to use
5 / 20
Arguments
8 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Arguments without a description: artifactBundleId, auditRunId.param_no_description
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints
  • Minor
    Required identifiers whose description does not say where the value comes from: artifactBundleId, auditRunId. Name the tool or the place that returns it, or models look it up first.id_source_missing

rubrkit_read_proof_report

26 / 100Rain

Purpose
13 / 20
When to use
5 / 20
Arguments
8 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Arguments without a description: artifactBundleId, proofReportId.param_no_description
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints
  • Minor
    Required identifiers whose description does not say where the value comes from: artifactBundleId, proofReportId. Name the tool or the place that returns it, or models look it up first.id_source_missing

rubrkit_list_artifact_bundles

27 / 100Rain

Purpose
17 / 20
When to use
5 / 20
Arguments
5 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Arguments without a description: status, limit.param_no_description
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

rubrkit_retire_golden_case

27 / 100Rain

Purpose
14 / 20
When to use
5 / 20
Arguments
8 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Arguments without a description: goldenCaseId.param_no_description
  • Major
    It may be destructive, but destructiveHint is not set.destructive_unmarked
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints
  • Minor
    Required identifiers whose description does not say where the value comes from: goldenCaseId. Name the tool or the place that returns it, or models look it up first.id_source_missing

rubrkit_upload_artifact_files

27 / 100Rain

Purpose
17 / 20
When to use
5 / 20
Arguments
5 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Arguments without a description: artifactBundleId, files, files[].path, files[].content, files[].mediaType, files[].artifactType, files[].message.param_no_description
  • Minor
    String arguments with no constraint or example: files[].content, files[].mediaType, files[].artifactType.loose_string_param
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints
  • Minor
    Required identifiers whose description does not say where the value comes from: artifactBundleId. Name the tool or the place that returns it, or models look it up first.id_source_missing

rubrkit_create_drift_monitor

28 / 100Rain

Purpose
17 / 20
When to use
5 / 20
Arguments
6 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Arguments without a description: artifactBundleId, pinnedVersionId, cadence, repeats.param_no_description
  • Minor
    String arguments with no constraint or example: cadence.loose_string_param
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints
  • Minor
    Required identifiers whose description does not say where the value comes from: artifactBundleId, pinnedVersionId. Name the tool or the place that returns it, or models look it up first.id_source_missing

rubrkit_update_artifact_file

28 / 100Rain

Purpose
17 / 20
When to use
5 / 20
Arguments
6 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Arguments without a description: artifactBundleId, fileId, content, mediaType, message.param_no_description
  • Minor
    Its description is nearly the same as rubrkit_restore_file_version's (similarity 0.67); only the names and schemas tell them apart. Say in this description when to use rubrkit_restore_file_version instead.confusable_pair
  • Minor
    String arguments with no constraint or example: content, mediaType.loose_string_param
  • Minor
    The description mentions none of its 3 or more arguments.params_not_in_description
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints
  • Minor
    Required identifiers whose description does not say where the value comes from: artifactBundleId, fileId. Name the tool or the place that returns it, or models look it up first.id_source_missing

rubrkit_export_proof_report

29 / 100Rain

Purpose
17 / 20
When to use
5 / 20
Arguments
7 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Arguments without a description: artifactBundleId, evalRunId, auditRunId, sourceFileVersionId, sourceFileId, sourceVersionNumber, candidateFileVersionId, candidateFileId, candidateVersionNumber, rubricVersion, includeExport.param_no_description
  • Minor
    String arguments with no constraint or example: rubricVersion.loose_string_param
  • Minor
    The description mentions none of its 3 or more arguments.params_not_in_description
  • Minor
    The meaning of the boolean argument includeExport is unclear.vague_boolean
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints
  • Minor
    Required identifiers whose description does not say where the value comes from: artifactBundleId. Name the tool or the place that returns it, or models look it up first.id_source_missing

rubrkit_apply_audit_rewrite

30 / 100Rain

Purpose
17 / 20
When to use
5 / 20
Arguments
8 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Arguments without a description: artifactBundleId, auditRunId.param_no_description
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints
  • Minor
    Required identifiers whose description does not say where the value comes from: artifactBundleId, auditRunId. Name the tool or the place that returns it, or models look it up first.id_source_missing

rubrkit_create_artifact_bundle

30 / 100Rain

Purpose
17 / 20
When to use
5 / 20
Arguments
8 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Arguments without a description: name, description, customRubric, settings.param_no_description
  • Minor
    The description mentions none of its 3 or more arguments.params_not_in_description
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

rubrkit_list_artifact_files

30 / 100Rain

Purpose
17 / 20
When to use
5 / 20
Arguments
8 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Arguments without a description: artifactBundleId, limit.param_no_description
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints
  • Minor
    Required identifiers whose description does not say where the value comes from: artifactBundleId. Name the tool or the place that returns it, or models look it up first.id_source_missing

rubrkit_list_drift_monitors

30 / 100Rain

Purpose
17 / 20
When to use
5 / 20
Arguments
8 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Arguments without a description: artifactBundleId.param_no_description
  • Minor
    Its description is nearly the same as rubrkit_list_golden_cases's (similarity 0.68); only the names and schemas tell them apart. Say in this description when to use rubrkit_list_golden_cases instead.confusable_pair
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints
  • Minor
    Required identifiers whose description does not say where the value comes from: artifactBundleId. Name the tool or the place that returns it, or models look it up first.id_source_missing

rubrkit_list_file_versions

30 / 100Rain

Purpose
17 / 20
When to use
5 / 20
Arguments
8 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Arguments without a description: artifactBundleId, fileId, limit.param_no_description
  • Minor
    The description mentions none of its 3 or more arguments.params_not_in_description
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints
  • Minor
    Required identifiers whose description does not say where the value comes from: artifactBundleId, fileId. Name the tool or the place that returns it, or models look it up first.id_source_missing

rubrkit_list_golden_cases

30 / 100Rain

Purpose
17 / 20
When to use
5 / 20
Arguments
8 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Arguments without a description: artifactBundleId, status.param_no_description
  • Minor
    Its description is nearly the same as rubrkit_list_drift_monitors's (similarity 0.68); only the names and schemas tell them apart. Say in this description when to use rubrkit_list_drift_monitors instead.confusable_pair
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints
  • Minor
    Required identifiers whose description does not say where the value comes from: artifactBundleId. Name the tool or the place that returns it, or models look it up first.id_source_missing

rubrkit_read_artifact_bundle

30 / 100Rain

Purpose
17 / 20
When to use
5 / 20
Arguments
8 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Arguments without a description: artifactBundleId.param_no_description
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints
  • Minor
    Required identifiers whose description does not say where the value comes from: artifactBundleId. Name the tool or the place that returns it, or models look it up first.id_source_missing

rubrkit_read_artifact_file

30 / 100Rain

Purpose
17 / 20
When to use
5 / 20
Arguments
8 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Arguments without a description: artifactBundleId, fileId.param_no_description
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints
  • Minor
    Required identifiers whose description does not say where the value comes from: artifactBundleId, fileId. Name the tool or the place that returns it, or models look it up first.id_source_missing

rubrkit_read_drift_observations

30 / 100Rain

Purpose
17 / 20
When to use
5 / 20
Arguments
8 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Arguments without a description: driftMonitorId.param_no_description
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints
  • Minor
    Required identifiers whose description does not say where the value comes from: driftMonitorId. Name the tool or the place that returns it, or models look it up first.id_source_missing

rubrkit_read_validity_drift

30 / 100Rain

Purpose
17 / 20
When to use
5 / 20
Arguments
8 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Arguments without a description: artifactBundleId.param_no_description
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints
  • Minor
    Required identifiers whose description does not say where the value comes from: artifactBundleId. Name the tool or the place that returns it, or models look it up first.id_source_missing

rubrkit_restore_artifact_bundle_version

30 / 100Rain

Purpose
17 / 20
When to use
5 / 20
Arguments
8 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Arguments without a description: artifactBundleId, versionNumber, message.param_no_description
  • Minor
    Its description is nearly the same as rubrkit_restore_file_version's (similarity 0.79); only the names and schemas tell them apart. Say in this description when to use rubrkit_restore_file_version instead.confusable_pair
  • Minor
    The description mentions none of its 3 or more arguments.params_not_in_description
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints
  • Minor
    Required identifiers whose description does not say where the value comes from: artifactBundleId. Name the tool or the place that returns it, or models look it up first.id_source_missing

rubrkit_restore_file_version

30 / 100Rain

Purpose
17 / 20
When to use
5 / 20
Arguments
8 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Arguments without a description: artifactBundleId, fileId, versionNumber, message.param_no_description
  • Minor
    Its description is nearly the same as rubrkit_restore_artifact_bundle_version's (similarity 0.79); only the names and schemas tell them apart. Say in this description when to use rubrkit_restore_artifact_bundle_version instead.confusable_pair
  • Minor
    Its description is nearly the same as rubrkit_update_artifact_file's (similarity 0.67); only the names and schemas tell them apart. Say in this description when to use rubrkit_update_artifact_file instead.confusable_pair
  • Minor
    The description mentions none of its 3 or more arguments.params_not_in_description
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints
  • Minor
    Required identifiers whose description does not say where the value comes from: artifactBundleId, fileId. Name the tool or the place that returns it, or models look it up first.id_source_missing

rubrkit_set_drift_monitor_status

30 / 100Rain

Purpose
17 / 20
When to use
5 / 20
Arguments
8 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Arguments without a description: driftMonitorId, status.param_no_description
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints
  • Minor
    Required identifiers whose description does not say where the value comes from: driftMonitorId. Name the tool or the place that returns it, or models look it up first.id_source_missing

rubrkit_read_openapi_contract

31 / 100Rain

Purpose
6 / 20
When to use
0 / 20
Arguments
25 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    The description only restates the name (8 words).restates_name
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints

rubrkit_record_outcome

31 / 100Rain

Purpose
20 / 20
When to use
5 / 20
Arguments
6 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Arguments without a description: artifactBundleId, artifactVersionId, inputHash, inputFeature, outcomeMetric, outcomeLabel, occurredAt.param_no_description
  • Minor
    String arguments with no constraint or example: inputHash, outcomeLabel.loose_string_param
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints
  • Minor
    Required identifiers whose description does not say where the value comes from: artifactBundleId. Name the tool or the place that returns it, or models look it up first.id_source_missing

rubrkit_start_audit

31 / 100Rain

Purpose
20 / 20
When to use
5 / 20
Arguments
6 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Arguments without a description: artifactBundleId, targetFileId, targetVersionNumber, artifactBundleVersionNumber, rubricKey, artifactType, customRequirements, modelTier, reasoningEffort, force.param_no_description
  • Minor
    String arguments with no constraint or example: rubricKey, artifactType.loose_string_param
  • Minor
    The meaning of the boolean argument force is unclear.vague_boolean
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints
  • Minor
    Required identifiers whose description does not say where the value comes from: artifactBundleId. Name the tool or the place that returns it, or models look it up first.id_source_missing

rubrkit_delete_artifact_bundle

33 / 100Rain

Purpose
20 / 20
When to use
5 / 20
Arguments
8 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Arguments without a description: artifactBundleId.param_no_description
  • Major
    It may be destructive, but destructiveHint is not set.destructive_unmarked
  • Minor
    Its description is nearly the same as rubrkit_hard_delete_artifact_bundle's (similarity 0.39); only the names and schemas tell them apart. Say in this description when to use rubrkit_hard_delete_artifact_bundle instead.confusable_pair
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints
  • Minor
    Required identifiers whose description does not say where the value comes from: artifactBundleId. Name the tool or the place that returns it, or models look it up first.id_source_missing

rubrkit_estimate_deep_compaction

33 / 100Rain

Purpose
17 / 20
When to use
5 / 20
Arguments
8 / 25
Return value
0 / 15
Constraints and side effects
3 / 10
Examples
0 / 10
  • Major
    Arguments without a description: artifactBundleId, fileId.param_no_description
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    Required identifiers whose description does not say where the value comes from: artifactBundleId, fileId. Name the tool or the place that returns it, or models look it up first.id_source_missing

rubrkit_hard_delete_artifact_bundle

33 / 100Rain

Purpose
17 / 20
When to use
5 / 20
Arguments
8 / 25
Return value
0 / 15
Constraints and side effects
3 / 10
Examples
0 / 10
  • Major
    Arguments without a description: artifactBundleId.param_no_description
  • Major
    It may be destructive, but destructiveHint is not set.destructive_unmarked
  • Minor
    Its description is nearly the same as rubrkit_delete_artifact_bundle's (similarity 0.39); only the names and schemas tell them apart. Say in this description when to use rubrkit_delete_artifact_bundle instead.confusable_pair
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    Required identifiers whose description does not say where the value comes from: artifactBundleId. Name the tool or the place that returns it, or models look it up first.id_source_missing

rubrkit_read_input_drift

33 / 100Rain

Purpose
20 / 20
When to use
5 / 20
Arguments
8 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Arguments without a description: artifactBundleId, windowDays, binCount.param_no_description
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints
  • Minor
    Required identifiers whose description does not say where the value comes from: artifactBundleId. Name the tool or the place that returns it, or models look it up first.id_source_missing

rubrkit_read_eval

35 / 100Rain

Purpose
17 / 20
When to use
5 / 20
Arguments
8 / 25
Return value
0 / 15
Constraints and side effects
0 / 10
Examples
5 / 10
  • Major
    Arguments without a description: artifactBundleId, evalRunId.param_no_description
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints
  • Minor
    Required identifiers whose description does not say where the value comes from: artifactBundleId, evalRunId. Name the tool or the place that returns it, or models look it up first.id_source_missing

rubrkit_compact_artifact_file

38 / 100Rain

Purpose
17 / 20
When to use
10 / 20
Arguments
8 / 25
Return value
0 / 15
Constraints and side effects
3 / 10
Examples
0 / 10
  • Major
    Arguments without a description: artifactBundleId, fileId, mode, dryRun.param_no_description
  • Minor
    The meaning of the boolean argument dryRun is unclear.vague_boolean
  • Minor
    Says nothing about what it returns.no_return_info

rubrkit_add_golden_case

40 / 100Cloudy

Purpose
20 / 20
When to use
5 / 20
Arguments
8 / 25
Return value
7 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Arguments without a description: artifactBundleId, input, expectedOutput, criteria, origin, originRef, weight, tags.param_no_description
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints
  • Minor
    Required identifiers whose description does not say where the value comes from: artifactBundleId. Name the tool or the place that returns it, or models look it up first.id_source_missing

rubrkit_apply_deep_compaction

40 / 100Cloudy

Purpose
20 / 20
When to use
5 / 20
Arguments
8 / 25
Return value
7 / 15
Constraints and side effects
0 / 10
Examples
0 / 10
  • Major
    Arguments without a description: artifactBundleId, fileId, jobId.param_no_description
  • Minor
    The description mentions none of its 3 or more arguments.params_not_in_description
  • Minor
    No constraints, side effects, auth or rate limits described, and no annotations.no_constraints
  • Minor
    Required identifiers whose description does not say where the value comes from: artifactBundleId, fileId, jobId. Name the tool or the place that returns it, or models look it up first.id_source_missing

rubrkit_run_evals

40 / 100Cloudy

Purpose
20 / 20
When to use
5 / 20
Arguments
7 / 25
Return value
0 / 15
Constraints and side effects
3 / 10
Examples
5 / 10
  • Major
    Arguments without a description: artifactBundleId, auditRunId, sourceFileVersionId, sourceFileId, sourceVersionNumber, candidateFileVersionId, candidateFileId, candidateVersionNumber, rubricVersion, maxCases, testCases, mode, repeats, baselineVersionId, candidateVersionId.param_no_description
  • Minor
    String arguments with no constraint or example: rubricVersion.loose_string_param
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    Required identifiers whose description does not say where the value comes from: artifactBundleId. Name the tool or the place that returns it, or models look it up first.id_source_missing

rubrkit_run_drift_check

43 / 100Cloudy

Purpose
17 / 20
When to use
15 / 20
Arguments
8 / 25
Return value
0 / 15
Constraints and side effects
3 / 10
Examples
0 / 10
  • Major
    Arguments without a description: driftMonitorId.param_no_description
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    Required identifiers whose description does not say where the value comes from: driftMonitorId. Name the tool or the place that returns it, or models look it up first.id_source_missing

What static scoring cannot tell

This score reads only the text of each description and schema: it says what is written, not what a model will do. Short tools whose names already say what they do, such as browser_close, score low here even when models use them well, and in our measurements current models chose the right tool in one step even from one-line descriptions, as long as the names and schemas differed. What the text cannot show, such as what happens over several steps and whether an added sentence helps or misleads, is what an evaluation measures, on the Pro and Team plans.

Is your server listed here and you would rather it were not? Email support@forecall.dev, and we will take it off within 7 days.

All scored servers