Forecall
Failure recordsDocs
All scored servers

io.github.warpfreight/warp-agent-mcp: tool descriptions scored

tools/list taken
(UTC)
From
Official MCP Registry
Connected to
https://mcp.wearewarp.com/api/mcp
Homepage
wearewarp.com
Repository
github.com/warpfreight/warp-agent-mcp
Scoring rules
v2
Removal
support@forecall.dev
Score this URL as it is today

Scores, issues and names only

This page shows how io.github.warpfreight/warp-agent-mcp's tool descriptions scored, the issues found and the names of its tools and parameters. The descriptions are the server's own: read them where the copy came from.

Forecall asked the URL this server lists in the official MCP Registry for its tools/list once, on the date above, without calling any tool. The server may have changed since.

servers/io.github.warpfreight/warp-agent-mcp
Average score
58.9 / 100Cloudy
Tools
42
Near-identical descriptions
0

Across the server

  • Major
    42 tools. Above 40, models choose less accurately.too_many_tools
  • Minor
    The server has no instructions. Say there, once, what the server is for and when to use it: Claude Code and Gemini CLI read the instructions before the tool descriptions.instructions_missing

Tools

box_truck_quote

37 / 100Rain

Purpose
6 / 20
When to use
0 / 20
Arguments
24 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    The description only restates the name (8 words).restates_name
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    String arguments with no constraint or example: commodity.loose_string_param
  • Minor
    Says nothing about what it returns.no_return_info

van_quote

37 / 100Rain

Purpose
6 / 20
When to use
0 / 20
Arguments
24 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    The description only restates the name (8 words).restates_name
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    String arguments with no constraint or example: commodity.loose_string_param
  • Minor
    Says nothing about what it returns.no_return_info

automation_receipts

47 / 100Cloudy

Purpose
17 / 20
When to use
0 / 20
Arguments
20 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    Says nothing about what it returns.no_return_info

delete_load_template

47 / 100Cloudy

Purpose
17 / 20
When to use
0 / 20
Arguments
20 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    Required identifiers whose description does not say where the value comes from: load_template_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

events

47 / 100Cloudy

Purpose
17 / 20
When to use
0 / 20
Arguments
20 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    Required identifiers whose description does not say where the value comes from: shipment_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

freight_workflow

47 / 100Cloudy

Purpose
20 / 20
When to use
10 / 20
Arguments
10 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Arguments without a description: workflow.param_no_description
  • Minor
    Says nothing about what it returns.no_return_info

get_invoice

47 / 100Cloudy

Purpose
17 / 20
When to use
0 / 20
Arguments
20 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    Required identifiers whose description does not say where the value comes from: order_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

compare_freight_costs

48 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
18 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    Arguments without a description: rows, rows[].shipment_id, rows[].baseline_amount_usd, rows[].candidate_amount_usd, rows[].baseline_kind, rows[].candidate_kind.param_no_description
  • Minor
    The description mentions none of its 3 or more arguments.params_not_in_description
  • Minor
    Says nothing about what it returns.no_return_info

ftl_quote

48 / 100Cloudy

Purpose
17 / 20
When to use
0 / 20
Arguments
24 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    String arguments with no constraint or example: commodity.loose_string_param
  • Minor
    The description mentions none of its 3 or more arguments.params_not_in_description
  • Minor
    Says nothing about what it returns.no_return_info

track

48 / 100Cloudy

Purpose
13 / 20
When to use
0 / 20
Arguments
20 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    Required identifiers whose description does not say where the value comes from: shipment_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

international_customs

49 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
14 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    Arguments without a description: customs.exporter_of_record.street, customs.exporter_of_record.street2, customs.exporter_of_record.city, customs.exporter_of_record.state, customs.exporter_of_record.country, customs.exporter_of_record.contact_name, customs.exporter_of_record.email, customs.importer_of_record.street, customs.importer_of_record.street2, customs.importer_of_record.city, customs.importer_of_record.state, customs.importer_of_record.country, customs.importer_of_record.contact_name, customs.importer_of_record.email, customs.commodities[].quantity, customs.isf.seller, customs.isf.seller.name, customs.isf.seller.country, customs.isf.buyer, customs.isf.buyer.name, customs.isf.buyer.country, customs.isf.manufacturer, customs.isf.manufacturer.name, customs.isf.manufacturer.country, customs.isf.ship_to, customs.isf.ship_to.name, customs.isf.ship_to.country, customs.isf.container_stuffing_location, customs.isf.container_stuffing_location.name, customs.isf.container_stuffing_location.country, customs.isf.consolidator, customs.isf.consolidator.name, customs.isf.consolidator.country, customs.isf.importer_of_record_number, customs.isf.consignee_number.param_no_description
  • Minor
    String arguments with no constraint or example: customs.exporter_of_record.street, customs.exporter_of_record.street2, customs.exporter_of_record.city, customs.exporter_of_record.state, customs.exporter_of_record.contact_name, customs.exporter_of_record.email, customs.importer_of_record.street, customs.importer_of_record.street2, customs.importer_of_record.city, customs.importer_of_record.state, customs.importer_of_record.contact_name, customs.importer_of_record.email, customs.isf.seller.name, customs.isf.seller.address, customs.isf.buyer.name, customs.isf.buyer.address, customs.isf.manufacturer.name, customs.isf.manufacturer.address, customs.isf.ship_to.name, customs.isf.ship_to.address, customs.isf.container_stuffing_location.name, customs.isf.container_stuffing_location.address, customs.isf.consolidator.name, customs.isf.consolidator.address, customs.isf.importer_of_record_number, customs.isf.consignee_number.loose_string_param
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    Required identifiers whose description does not say where the value comes from: order_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

status

49 / 100Cloudy

Purpose
17 / 20
When to use
0 / 20
Arguments
25 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    Says nothing about what it returns.no_return_info

international_settings

51 / 100Cloudy

Purpose
17 / 20
When to use
5 / 20
Arguments
22 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    Says nothing about what it returns.no_return_info

lane_history

52 / 100Cloudy

Purpose
17 / 20
When to use
0 / 20
Arguments
25 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    Says nothing about what it returns.no_return_info

quote_history

52 / 100Cloudy

Purpose
17 / 20
When to use
0 / 20
Arguments
25 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    Says nothing about what it returns.no_return_info

save_load_template

52 / 100Cloudy

Purpose
17 / 20
When to use
0 / 20
Arguments
20 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    String arguments with no constraint or example: commodity.loose_string_param
  • Minor
    The description mentions none of its 3 or more arguments.params_not_in_description
  • Minor
    Says nothing about what it returns.no_return_info

analytics

54 / 100Cloudy

Purpose
17 / 20
When to use
5 / 20
Arguments
22 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    Says nothing about what it returns.no_return_info

load_templates

55 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
25 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    Says nothing about what it returns.no_return_info

multistop_book

55 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
20 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    Arguments without a description: shipments[].list_items[].stackable.param_no_description
  • Minor
    String arguments with no constraint or example: shipments[].pickup_info.address.street, shipments[].pickup_info.address.city, shipments[].pickup_info.address.state, shipments[].pickup_info.contact_name, shipments[].pickup_info.contact_phone, shipments[].pickup_info.contact_email, shipments[].delivery_info.address.street, shipments[].delivery_info.address.city, shipments[].delivery_info.address.state, shipments[].delivery_info.contact_name, shipments[].delivery_info.contact_phone, shipments[].delivery_info.contact_email, shipments[].list_items[].name, shipments[].list_items[].packaging, shipments[].list_items[].weight_unit, shipments[].list_items[].size_unit.loose_string_param
  • Minor
    The meaning of the boolean argument shipments[].list_items[].stackable is unclear.vague_boolean
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    Required identifiers whose description does not say where the value comes from: quote_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

shipper_profile

56 / 100Cloudy

Purpose
20 / 20
When to use
10 / 20
Arguments
11 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
5 / 10
  • Major
    Arguments without a description: set_preferences.default_accessorials.pickup, set_preferences.default_accessorials.delivery, set_preferences.preferred_mode, set_preferences.standard_pallet_dims.length, set_preferences.standard_pallet_dims.width, set_preferences.standard_pallet_dims.height, set_preferences.max_transit_days, set_preferences.notes.param_no_description
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    Says nothing about what it returns.no_return_info

international_duty_estimate

57 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
22 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    The description mentions none of its 3 or more arguments.params_not_in_description
  • Minor
    Says nothing about what it returns.no_return_info

manage_automation

57 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
22 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    Says nothing about what it returns.no_return_info

multistop_quote

58 / 100Cloudy

Purpose
20 / 20
When to use
5 / 20
Arguments
23 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
  • Minor
    String arguments with no constraint or example: commodity.loose_string_param
  • Minor
    The description mentions none of its 3 or more arguments.params_not_in_description
  • Minor
    Says nothing about what it returns.no_return_info

list_bookings

59 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
22 / 25
Return value
7 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    No `required` list, so every argument is optional.no_required

payment_status

59 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
25 / 25
Return value
7 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context

batch_book

62 / 100Cloudy

Purpose
20 / 20
When to use
15 / 20
Arguments
8 / 25
Return value
7 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
  • Major
    Arguments without a description: bookings[].pickup.zipCode, bookings[].pickup.city, bookings[].pickup.state, bookings[].pickup.street, bookings[].pickup.contactName, bookings[].pickup.phone, bookings[].pickup.email, bookings[].pickup.specialInstruction, bookings[].delivery.zipCode, bookings[].delivery.city, bookings[].delivery.state, bookings[].delivery.street, bookings[].delivery.contactName, bookings[].delivery.phone, bookings[].delivery.specialInstruction, bookings[].accessorials.pickup, bookings[].accessorials.delivery, bookings[].pickup_window, bookings[].pickup_window.from, bookings[].pickup_window.to, bookings[].delivery_window, bookings[].delivery_window.from, bookings[].delivery_window.to, shared_pickup.zipCode, shared_pickup.city, shared_pickup.state, shared_pickup.street, shared_pickup.contactName, shared_pickup.phone, shared_pickup.email, shared_pickup.specialInstruction, shared_delivery.zipCode, shared_delivery.city, shared_delivery.state, shared_delivery.street, shared_delivery.contactName, shared_delivery.phone, shared_delivery.specialInstruction, shared_accessorials, shared_accessorials.pickup, shared_accessorials.delivery, shared_pickup_window, shared_pickup_window.from, shared_pickup_window.to, shared_delivery_window, shared_delivery_window.from, shared_delivery_window.to.param_no_description
  • Minor
    String arguments with no constraint or example: bookings[].pickup.city, bookings[].pickup.state, bookings[].pickup.street, bookings[].pickup.contactName, bookings[].pickup.phone, bookings[].pickup.email, bookings[].pickup.specialInstruction, bookings[].delivery.city, bookings[].delivery.state, bookings[].delivery.street, bookings[].delivery.contactName, bookings[].delivery.phone, bookings[].delivery.specialInstruction, bookings[].pickup_window.from, bookings[].pickup_window.to, bookings[].delivery_window.from, bookings[].delivery_window.to, shared_pickup.city, shared_pickup.state, shared_pickup.street, shared_pickup.contactName, shared_pickup.phone, shared_pickup.email, shared_pickup.specialInstruction, shared_delivery.city, shared_delivery.state, shared_delivery.street, shared_delivery.contactName, shared_delivery.phone, shared_delivery.specialInstruction, shared_pickup_window.from, shared_pickup_window.to, shared_delivery_window.from, shared_delivery_window.to.loose_string_param
  • Minor
    The description mentions none of its 3 or more arguments.params_not_in_description

batch_quote

62 / 100Cloudy

Purpose
20 / 20
When to use
5 / 20
Arguments
13 / 25
Return value
7 / 15
Constraints and side effects
7 / 10
Examples
10 / 10
  • Major
    Arguments without a description: lanes[].pallets, lanes[].weight_lbs_per_pallet, lanes[].commodity, lanes[].length_in, lanes[].width_in, lanes[].height_in, lanes[].freight_class, lanes[].stackable, lanes[].hazmat, lanes[].pickup_services, lanes[].delivery_services.param_no_description
  • Minor
    String arguments with no constraint or example: lanes[].commodity, lanes[].freight_class.loose_string_param
  • Minor
    The meaning of the boolean argument lanes[].stackable is unclear.vague_boolean
  • Minor
    The meaning of the boolean argument lanes[].hazmat is unclear.vague_boolean

hs_code_search

62 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
25 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
10 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    Says nothing about what it returns.no_return_info

automate_lane

65 / 100Cloudy

Purpose
20 / 20
When to use
5 / 20
Arguments
25 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
5 / 10
  • Minor
    Says nothing about what it returns.no_return_info

international_book

66 / 100Cloudy

Purpose
20 / 20
When to use
15 / 20
Arguments
16 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
5 / 10
  • Minor
    Arguments without a description: pickup.latitude, pickup.longitude, pickup.window.from, pickup.window.to, delivery.latitude, delivery.longitude, delivery.window.from, delivery.window.to, customs.exporter_of_record.street, customs.exporter_of_record.street2, customs.exporter_of_record.city, customs.exporter_of_record.state, customs.exporter_of_record.country, customs.exporter_of_record.contact_name, customs.exporter_of_record.email, customs.importer_of_record.street, customs.importer_of_record.street2, customs.importer_of_record.city, customs.importer_of_record.state, customs.importer_of_record.country, customs.importer_of_record.contact_name, customs.importer_of_record.email, customs.commodities[].quantity, customs.isf.seller, customs.isf.seller.name, customs.isf.seller.country, customs.isf.buyer, customs.isf.buyer.name, customs.isf.buyer.country, customs.isf.manufacturer, customs.isf.manufacturer.name, customs.isf.manufacturer.country, customs.isf.ship_to, customs.isf.ship_to.name, customs.isf.ship_to.country, customs.isf.container_stuffing_location, customs.isf.container_stuffing_location.name, customs.isf.container_stuffing_location.country, customs.isf.consolidator, customs.isf.consolidator.name, customs.isf.consolidator.country, customs.isf.importer_of_record_number, customs.isf.consignee_number.param_no_description
  • Minor
    String arguments with no constraint or example: pickup.company, pickup.contact_name, pickup.email, pickup.street, pickup.street2, pickup.city, pickup.window.from, pickup.window.to, delivery.company, delivery.contact_name, delivery.email, delivery.street, delivery.street2, delivery.city, delivery.window.from, delivery.window.to, customs.exporter_of_record.street, customs.exporter_of_record.street2, customs.exporter_of_record.city, customs.exporter_of_record.state, customs.exporter_of_record.contact_name, customs.exporter_of_record.email, customs.importer_of_record.street, customs.importer_of_record.street2, customs.importer_of_record.city, customs.importer_of_record.state, customs.importer_of_record.contact_name, customs.importer_of_record.email, customs.isf.seller.name, customs.isf.seller.address, customs.isf.buyer.name, customs.isf.buyer.address, customs.isf.manufacturer.name, customs.isf.manufacturer.address, customs.isf.ship_to.name, customs.isf.ship_to.address, customs.isf.container_stuffing_location.name, customs.isf.container_stuffing_location.address, customs.isf.consolidator.name, customs.isf.consolidator.address, customs.isf.importer_of_record_number, customs.isf.consignee_number.loose_string_param
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    Required identifiers whose description does not say where the value comes from: option_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

get_documents

67 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
20 / 25
Return value
7 / 15
Constraints and side effects
10 / 10
Examples
10 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    Required identifiers whose description does not say where the value comes from: order_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

book

68 / 100Cloudy

Purpose
20 / 20
When to use
15 / 20
Arguments
18 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
5 / 10
  • Minor
    Arguments without a description: pickup_window.from, pickup_window.to, delivery_window.from, delivery_window.to.param_no_description
  • Minor
    String arguments with no constraint or example: pickup.city, pickup.state, pickup.street, pickup.contactName, pickup.phone, pickup.email, pickup.specialInstruction, delivery.city, delivery.state, delivery.street, delivery.contactName, delivery.phone, delivery.specialInstruction, pickup_window.from, pickup_window.to, delivery_window.from, delivery_window.to.loose_string_param
  • Minor
    Says nothing about what it returns.no_return_info

parcel_book

68 / 100Cloudy

Purpose
20 / 20
When to use
15 / 20
Arguments
18 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
5 / 10
  • Minor
    Arguments without a description: pickup_window.from, pickup_window.to, delivery_window.from, delivery_window.to.param_no_description
  • Minor
    String arguments with no constraint or example: pickup.city, pickup.state, pickup.street, pickup.street2, pickup.contactName, pickup.email, pickup.company, delivery.city, delivery.state, delivery.street, delivery.street2, delivery.contactName, delivery.email, delivery.company, pickup_window.from, pickup_window.to, delivery_window.from, delivery_window.to.loose_string_param
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    Required identifiers whose description does not say where the value comes from: quote_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

locations

70 / 100Clear

Purpose
20 / 20
When to use
15 / 20
Arguments
25 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
  • Minor
    Says nothing about what it returns.no_return_info

consolidate

71 / 100Clear

Purpose
20 / 20
When to use
15 / 20
Arguments
21 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
5 / 10
  • Minor
    Arguments without a description: loads[].pallets, loads[].weight_lbs_per_pallet, loads[].width.param_no_description
  • Minor
    Says nothing about what it returns.no_return_info

price_check

71 / 100Clear

Purpose
17 / 20
When to use
15 / 20
Arguments
22 / 25
Return value
7 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
  • Minor
    String arguments with no constraint or example: origin_zip, destination_zip.loose_string_param

parcel_quote

75 / 100Clear

Purpose
17 / 20
When to use
10 / 20
Arguments
24 / 25
Return value
7 / 15
Constraints and side effects
7 / 10
Examples
10 / 10
  • Major
    It may be destructive, but destructiveHint is not set.destructive_unmarked

ltl_market_options

77 / 100Clear

Purpose
17 / 20
When to use
15 / 20
Arguments
23 / 25
Return value
7 / 15
Constraints and side effects
10 / 10
Examples
5 / 10
  • Minor
    String arguments with no constraint or example: commodity.loose_string_param
  • Minor
    The description mentions none of its 3 or more arguments.params_not_in_description
  • Minor
    The meaning of the boolean argument hazmat is unclear.vague_boolean

ltl_quote

77 / 100Clear

Purpose
20 / 20
When to use
15 / 20
Arguments
23 / 25
Return value
7 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
  • Minor
    String arguments with no constraint or example: commodity.loose_string_param
  • Minor
    The meaning of the boolean argument hazmat is unclear.vague_boolean

report_issue

78 / 100Clear

Purpose
20 / 20
When to use
15 / 20
Arguments
24 / 25
Return value
7 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
  • Minor
    The description mentions none of its 3 or more arguments.params_not_in_description

international_quote

82 / 100Clear

Purpose
17 / 20
When to use
20 / 20
Arguments
21 / 25
Return value
7 / 15
Constraints and side effects
7 / 10
Examples
10 / 10
  • Minor
    String arguments with no constraint or example: origin.state, origin.street, destination.state, destination.street.loose_string_param

compare_modes

84 / 100Clear

Purpose
17 / 20
When to use
20 / 20
Arguments
23 / 25
Return value
7 / 15
Constraints and side effects
7 / 10
Examples
10 / 10
  • Minor
    String arguments with no constraint or example: commodity.loose_string_param
  • Minor
    The meaning of the boolean argument hazmat is unclear.vague_boolean

What static scoring cannot tell

This score reads only the text of each description and schema: it says what is written, not what a model will do. Short tools whose names already say what they do, such as browser_close, score low here even when models use them well, and in our measurements current models chose the right tool in one step even from one-line descriptions, as long as the names and schemas differed. What the text cannot show, such as what happens over several steps and whether an added sentence helps or misleads, is what an evaluation measures, on the Pro and Team plans.

Is your server listed here and you would rather it were not? Email support@forecall.dev, and we will take it off within 7 days.

All scored servers