Forecall
Failure recordsDocs
All scored servers

TestMu AI (formerly LambdaTest): tool descriptions scored io.github.LambdaTest/mcp

tools/list taken
(UTC)
From
Official MCP Registry
Connected to
https://mcp.lambdatest.com/mcp
Homepage
www.testmuai.com/mcp
Repository
github.com/LambdaTest/mcp-server-guide
Scoring rules
v2
Removal
support@forecall.dev
Score this URL as it is today

Scores, issues and names only

This page shows how TestMu AI (formerly LambdaTest) (io.github.LambdaTest/mcp)'s tool descriptions scored, the issues found and the names of its tools and parameters. The descriptions are the server's own: read them where the copy came from.

Forecall asked the URL this server lists in the official MCP Registry for its tools/list once, on the date above, without calling any tool. The server may have changed since.

servers/io.github.LambdaTest/mcp
Average score
52.6 / 100Cloudy
Tools
88
Near-identical descriptions
18

Across the server

  • Major
    88 tools. Above 40, models choose less accurately.too_many_tools
  • Minor
    18 pairs with nearly the same description in all; the top 12 are shown.confusable_pair_total

Tools whose descriptions are nearly the same

12 of 18 pairs shown, highest description similarity first.
ToolToolDescription similarityName similarity
getHyperExecuteStageLogsgetHyperExecuteStageTasks0.800.67
getHyperExecuteStageLogsgetHyperExecuteTaskLogs0.800.67
getHyperExecuteTaskgetHyperExecuteTaskLogs0.800.80
deletePrerunFiledeleteUserFile0.750.50
getSessionV2SeleniumLogsgetLiveSessionLogs0.720.60
getAutomationTestCommandLogsgetAutomationTestNetworkLogs0.710.67
getSessionVideogetSessionV2SeleniumLogs0.700.40
tm_link_jira_issuetm_link_ado_issue0.700.60
getSessionScreenshotsgetSessionVideo0.660.50
getSessionVideogetLiveSessionLogs0.660.40
getSessionV2CommandLogsgetSessionV2SeleniumLogs0.650.60
postSessionExceptionspostTestExceptions0.650.50

Tools

stopSession

33 / 100Rain

Purpose
6 / 20
When to use
0 / 20
Arguments
20 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    The description only restates the name (9 words).restates_name
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    Required identifiers whose description does not say where the value comes from: sessionId. Name the tool or the place that returns it, or models look it up first.id_source_missing

analyzeAppViaTunnel

37 / 100Rain

Purpose
10 / 20
When to use
0 / 20
Arguments
20 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    String arguments with no constraint or example: tunnelName, tunnelId.loose_string_param
  • Minor
    The description mentions none of its 3 or more arguments.params_not_in_description
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    Required identifiers whose description does not say where the value comes from: tunnelId. Name the tool or the place that returns it, or models look it up first.id_source_missing

deletePrerunFile

37 / 100Rain

Purpose
13 / 20
When to use
0 / 20
Arguments
17 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    Its description is nearly the same as deleteUserFile's (similarity 0.75); only the names and schemas tell them apart. Say in this description when to use deleteUserFile instead.confusable_pair
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    Says nothing about what it returns.no_return_info

deleteUserFile

37 / 100Rain

Purpose
13 / 20
When to use
0 / 20
Arguments
17 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    Its description is nearly the same as deletePrerunFile's (similarity 0.75); only the names and schemas tell them apart. Say in this description when to use deletePrerunFile instead.confusable_pair
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    Says nothing about what it returns.no_return_info

getHyperExecuteJobSessions

37 / 100Rain

Purpose
10 / 20
When to use
0 / 20
Arguments
20 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    Required identifiers whose description does not say where the value comes from: jobId. Name the tool or the place that returns it, or models look it up first.id_source_missing

tm_get_milestone

38 / 100Rain

Purpose
14 / 20
When to use
0 / 20
Arguments
17 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    Says nothing about what it returns.no_return_info

getHyperExecuteStageLogs

40 / 100Cloudy

Purpose
13 / 20
When to use
0 / 20
Arguments
20 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    Its description is nearly the same as getHyperExecuteStageTasks's (similarity 0.80); only the names and schemas tell them apart. Say in this description when to use getHyperExecuteStageTasks instead.confusable_pair
  • Minor
    Its description is nearly the same as getHyperExecuteTaskLogs's (similarity 0.80); only the names and schemas tell them apart. Say in this description when to use getHyperExecuteTaskLogs instead.confusable_pair
  • Minor
    String arguments with no constraint or example: stageId.loose_string_param
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    Required identifiers whose description does not say where the value comes from: stageId. Name the tool or the place that returns it, or models look it up first.id_source_missing

getHyperExecuteStageTasks

40 / 100Cloudy

Purpose
13 / 20
When to use
0 / 20
Arguments
20 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    Its description is nearly the same as getHyperExecuteStageLogs's (similarity 0.80); only the names and schemas tell them apart. Say in this description when to use getHyperExecuteStageLogs instead.confusable_pair
  • Minor
    String arguments with no constraint or example: stageId.loose_string_param
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    Required identifiers whose description does not say where the value comes from: stageId. Name the tool or the place that returns it, or models look it up first.id_source_missing

getHyperExecuteTaskLogs

40 / 100Cloudy

Purpose
13 / 20
When to use
0 / 20
Arguments
20 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    Its description is nearly the same as getHyperExecuteStageLogs's (similarity 0.80); only the names and schemas tell them apart. Say in this description when to use getHyperExecuteStageLogs instead.confusable_pair
  • Minor
    Its description is nearly the same as getHyperExecuteTask's (similarity 0.80); only the names and schemas tell them apart. Say in this description when to use getHyperExecuteTask instead.confusable_pair
  • Minor
    String arguments with no constraint or example: taskId.loose_string_param
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    Required identifiers whose description does not say where the value comes from: taskId. Name the tool or the place that returns it, or models look it up first.id_source_missing

getJobArtifactDetail

40 / 100Cloudy

Purpose
13 / 20
When to use
0 / 20
Arguments
20 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    String arguments with no constraint or example: artifactId.loose_string_param
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    Required identifiers whose description does not say where the value comes from: jobId, artifactId. Name the tool or the place that returns it, or models look it up first.id_source_missing

answerHyperExecuteQuery

41 / 100Cloudy

Purpose
14 / 20
When to use
0 / 20
Arguments
20 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    String arguments with no constraint or example: query.loose_string_param
  • Minor
    Says nothing about what it returns.no_return_info

deleteSession

41 / 100Cloudy

Purpose
14 / 20
When to use
0 / 20
Arguments
20 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    Required identifiers whose description does not say where the value comes from: sessionId. Name the tool or the place that returns it, or models look it up first.id_source_missing

getAnalyticsErrors

41 / 100Cloudy

Purpose
17 / 20
When to use
0 / 20
Arguments
17 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    The description mentions none of its 3 or more arguments.params_not_in_description
  • Minor
    Says nothing about what it returns.no_return_info

getHyperExecuteJobInfo

41 / 100Cloudy

Purpose
14 / 20
When to use
0 / 20
Arguments
20 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    Required identifiers whose description does not say where the value comes from: jobId. Name the tool or the place that returns it, or models look it up first.id_source_missing

getTestTrends

41 / 100Cloudy

Purpose
17 / 20
When to use
0 / 20
Arguments
17 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    Says nothing about what it returns.no_return_info

updateBuild

41 / 100Cloudy

Purpose
14 / 20
When to use
0 / 20
Arguments
20 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    String arguments with no constraint or example: name.loose_string_param
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    Required identifiers whose description does not say where the value comes from: buildId. Name the tool or the place that returns it, or models look it up first.id_source_missing

getAutomationTestCommandLogs

44 / 100Cloudy

Purpose
10 / 20
When to use
0 / 20
Arguments
22 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    Its description is nearly the same as getAutomationTestNetworkLogs's (similarity 0.71); only the names and schemas tell them apart. Say in this description when to use getAutomationTestNetworkLogs instead.confusable_pair
  • Minor
    The description mentions none of its 3 or more arguments.params_not_in_description
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    Required identifiers whose description does not say where the value comes from: testId. Name the tool or the place that returns it, or models look it up first.id_source_missing

getAutomationTestDetails

44 / 100Cloudy

Purpose
10 / 20
When to use
0 / 20
Arguments
22 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    Required identifiers whose description does not say where the value comes from: testId. Name the tool or the place that returns it, or models look it up first.id_source_missing

getAutomationTestNetworkLogs

44 / 100Cloudy

Purpose
10 / 20
When to use
0 / 20
Arguments
22 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    Its description is nearly the same as getAutomationTestCommandLogs's (similarity 0.71); only the names and schemas tell them apart. Say in this description when to use getAutomationTestCommandLogs instead.confusable_pair
  • Minor
    The description mentions none of its 3 or more arguments.params_not_in_description
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    Required identifiers whose description does not say where the value comes from: testId. Name the tool or the place that returns it, or models look it up first.id_source_missing

getHyperExecuteJobArtifacts

44 / 100Cloudy

Purpose
17 / 20
When to use
0 / 20
Arguments
20 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    Required identifiers whose description does not say where the value comes from: jobId. Name the tool or the place that returns it, or models look it up first.id_source_missing

getHyperExecuteTask

44 / 100Cloudy

Purpose
17 / 20
When to use
0 / 20
Arguments
20 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    Its description is nearly the same as getHyperExecuteTaskLogs's (similarity 0.80); only the names and schemas tell them apart. Say in this description when to use getHyperExecuteTaskLogs instead.confusable_pair
  • Minor
    String arguments with no constraint or example: taskId.loose_string_param
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    Required identifiers whose description does not say where the value comes from: taskId. Name the tool or the place that returns it, or models look it up first.id_source_missing

tm_create_milestone

44 / 100Cloudy

Purpose
17 / 20
When to use
0 / 20
Arguments
20 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    String arguments with no constraint or example: project_id, title, start_at, end_at.loose_string_param
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    Required identifiers whose description does not say where the value comes from: project_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

tm_create_project

44 / 100Cloudy

Purpose
17 / 20
When to use
0 / 20
Arguments
20 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    String arguments with no constraint or example: name.loose_string_param
  • Minor
    The description mentions none of its 3 or more arguments.params_not_in_description
  • Minor
    Says nothing about what it returns.no_return_info

tm_list_projects

44 / 100Cloudy

Purpose
17 / 20
When to use
0 / 20
Arguments
17 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    Says nothing about what it returns.no_return_info

tm_update_project

44 / 100Cloudy

Purpose
17 / 20
When to use
0 / 20
Arguments
20 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    String arguments with no constraint or example: project_id, name, description.loose_string_param
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    Required identifiers whose description does not say where the value comes from: project_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

getMobileCapabilityGenerator

45 / 100Cloudy

Purpose
13 / 20
When to use
0 / 20
Arguments
25 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    Says nothing about what it returns.no_return_info

listUploadedApps

46 / 100Cloudy

Purpose
17 / 20
When to use
0 / 20
Arguments
22 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    Says nothing about what it returns.no_return_info

stopBuild

46 / 100Cloudy

Purpose
14 / 20
When to use
0 / 20
Arguments
25 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    Required identifiers whose description does not say where the value comes from: buildId. Name the tool or the place that returns it, or models look it up first.id_source_missing

uploadAppVirtualDevice

46 / 100Cloudy

Purpose
17 / 20
When to use
0 / 20
Arguments
22 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    The description mentions none of its 3 or more arguments.params_not_in_description
  • Minor
    Says nothing about what it returns.no_return_info

getAnalyticsData

48 / 100Cloudy

Purpose
17 / 20
When to use
5 / 20
Arguments
19 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    The description mentions none of its 3 or more arguments.params_not_in_description
  • Minor
    Says nothing about what it returns.no_return_info

getAutomationTestBrowserConsoleLogs

48 / 100Cloudy

Purpose
14 / 20
When to use
0 / 20
Arguments
22 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    Required identifiers whose description does not say where the value comes from: testId. Name the tool or the place that returns it, or models look it up first.id_source_missing

getFlakyTests

48 / 100Cloudy

Purpose
17 / 20
When to use
0 / 20
Arguments
17 / 25
Return value
7 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    The description mentions none of its 3 or more arguments.params_not_in_description

smartui_baseline_manage

48 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
21 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    String arguments with no constraint or example: project_id.loose_string_param
  • Minor
    Says nothing about what it returns.no_return_info

deleteBuild

49 / 100Cloudy

Purpose
14 / 20
When to use
0 / 20
Arguments
25 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    Required identifiers whose description does not say where the value comes from: buildId. Name the tool or the place that returns it, or models look it up first.id_source_missing

deleteUploadedApps

49 / 100Cloudy

Purpose
17 / 20
When to use
0 / 20
Arguments
25 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    Required identifiers whose description does not say where the value comes from: appIds. Name the tool or the place that returns it, or models look it up first.id_source_missing

getMobileConcurrency

49 / 100Cloudy

Purpose
17 / 20
When to use
0 / 20
Arguments
25 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    Says nothing about what it returns.no_return_info

getOrgConcurrency

49 / 100Cloudy

Purpose
17 / 20
When to use
0 / 20
Arguments
25 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    Says nothing about what it returns.no_return_info

getSuiteOverview

49 / 100Cloudy

Purpose
14 / 20
When to use
0 / 20
Arguments
20 / 25
Return value
8 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    Required identifiers whose description does not say where the value comes from: projectId. Name the tool or the place that returns it, or models look it up first.id_source_missing

stopTunnel

49 / 100Cloudy

Purpose
17 / 20
When to use
5 / 20
Arguments
20 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    Required identifiers whose description does not say where the value comes from: tunnelId. Name the tool or the place that returns it, or models look it up first.id_source_missing

triggerSuiteRun

49 / 100Cloudy

Purpose
14 / 20
When to use
0 / 20
Arguments
20 / 25
Return value
8 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    Required identifiers whose description does not say where the value comes from: projectId. Name the tool or the place that returns it, or models look it up first.id_source_missing

updateSession

49 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
22 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    Says nothing about what it returns.no_return_info

upload_app

50 / 100Cloudy

Purpose
14 / 20
When to use
0 / 20
Arguments
21 / 25
Return value
8 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    The description mentions none of its 3 or more arguments.params_not_in_description

getAutomationTestSeleniumLogs

51 / 100Cloudy

Purpose
17 / 20
When to use
0 / 20
Arguments
22 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    The description mentions none of its 3 or more arguments.params_not_in_description
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    Required identifiers whose description does not say where the value comes from: testId. Name the tool or the place that returns it, or models look it up first.id_source_missing

getHyperExecuteJobLiveStream

51 / 100Cloudy

Purpose
17 / 20
When to use
0 / 20
Arguments
20 / 25
Return value
7 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    Required identifiers whose description does not say where the value comes from: jobId. Name the tool or the place that returns it, or models look it up first.id_source_missing

listDevicesForTesting

51 / 100Cloudy

Purpose
17 / 20
When to use
0 / 20
Arguments
19 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    Says nothing about what it returns.no_return_info

tm_list_folders

51 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
19 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    Says nothing about what it returns.no_return_info

listHyperExecuteJobs

52 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
17 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    Says nothing about what it returns.no_return_info

listTunnels

52 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
25 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    Says nothing about what it returns.no_return_info

tm_create_folder

53 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
21 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    String arguments with no constraint or example: name, description.loose_string_param
  • Minor
    Says nothing about what it returns.no_return_info

generateHyperExecuteYAML

54 / 100Cloudy

Purpose
17 / 20
When to use
5 / 20
Arguments
20 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
  • Minor
    String arguments with no constraint or example: setup.cacheKey, sourcePayload.link, sourcePayload.ref.loose_string_param
  • Minor
    The meaning of the boolean argument execution.retryOnFailure is unclear.vague_boolean
  • Minor
    The meaning of the boolean argument execution.tunnel is unclear.vague_boolean
  • Minor
    The meaning of the boolean argument appTesting.deviceLog is unclear.vague_boolean
  • Minor
    The meaning of the boolean argument appTesting.networkLog is unclear.vague_boolean
  • Minor
    Says nothing about what it returns.no_return_info

getHyperExecuteStage

54 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
20 / 25
Return value
7 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    Required identifiers whose description does not say where the value comes from: taskId. Name the tool or the place that returns it, or models look it up first.id_source_missing

tm_update_milestone

54 / 100Cloudy

Purpose
17 / 20
When to use
0 / 20
Arguments
20 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
10 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    String arguments with no constraint or example: milestone_id, project_id, title, description, start_at, end_at.loose_string_param
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    Required identifiers whose description does not say where the value comes from: milestone_id, project_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

getSupportedPlatforms

55 / 100Cloudy

Purpose
17 / 20
When to use
0 / 20
Arguments
19 / 25
Return value
7 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    No `required` list, so every argument is optional.no_required

smartui_screenshot_upload

55 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
21 / 25
Return value
7 / 15
Constraints and side effects
7 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context

listMobileBuilds

56 / 100Cloudy

Purpose
17 / 20
When to use
0 / 20
Arguments
17 / 25
Return value
7 / 15
Constraints and side effects
10 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    No `required` list, so every argument is optional.no_required

listMobileSessions

56 / 100Cloudy

Purpose
17 / 20
When to use
0 / 20
Arguments
17 / 25
Return value
7 / 15
Constraints and side effects
10 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    No `required` list, so every argument is optional.no_required

tm_update_test_case

57 / 100Cloudy

Purpose
20 / 20
When to use
5 / 20
Arguments
20 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
  • Minor
    String arguments with no constraint or example: project_id, title, description, type, preconditions, test_steps[].action.loose_string_param
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    Required identifiers whose description does not say where the value comes from: case_id, project_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

tm_get_test_runs

58 / 100Cloudy

Purpose
17 / 20
When to use
0 / 20
Arguments
17 / 25
Return value
7 / 15
Constraints and side effects
7 / 10
Examples
10 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    No `required` list, so every argument is optional.no_required

tm_update_folder

58 / 100Cloudy

Purpose
20 / 20
When to use
5 / 20
Arguments
21 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
  • Minor
    String arguments with no constraint or example: folder_id, name, description.loose_string_param
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    Required identifiers whose description does not say where the value comes from: folder_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

getSessionScreenshots

59 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
20 / 25
Return value
7 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    Its description is nearly the same as getSessionVideo's (similarity 0.66); only the names and schemas tell them apart. Say in this description when to use getSessionVideo instead.confusable_pair
  • Minor
    Required identifiers whose description does not say where the value comes from: sessionId. Name the tool or the place that returns it, or models look it up first.id_source_missing

getSessionV2CommandLogs

59 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
20 / 25
Return value
7 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    Its description is nearly the same as getSessionV2SeleniumLogs's (similarity 0.65); only the names and schemas tell them apart. Say in this description when to use getSessionV2SeleniumLogs instead.confusable_pair
  • Minor
    Required identifiers whose description does not say where the value comes from: sessionId. Name the tool or the place that returns it, or models look it up first.id_source_missing

getSessionV2SeleniumLogs

59 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
20 / 25
Return value
7 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    Its description is nearly the same as getLiveSessionLogs's (similarity 0.72); only the names and schemas tell them apart. Say in this description when to use getLiveSessionLogs instead.confusable_pair
  • Minor
    Its description is nearly the same as getSessionVideo's (similarity 0.70); only the names and schemas tell them apart. Say in this description when to use getSessionVideo instead.confusable_pair
  • Minor
    Its description is nearly the same as getSessionV2CommandLogs's (similarity 0.65); only the names and schemas tell them apart. Say in this description when to use getSessionV2CommandLogs instead.confusable_pair
  • Minor
    Required identifiers whose description does not say where the value comes from: sessionId. Name the tool or the place that returns it, or models look it up first.id_source_missing

getSessionVideo

59 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
20 / 25
Return value
7 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    Its description is nearly the same as getSessionV2SeleniumLogs's (similarity 0.70); only the names and schemas tell them apart. Say in this description when to use getSessionV2SeleniumLogs instead.confusable_pair
  • Minor
    Its description is nearly the same as getSessionScreenshots's (similarity 0.66); only the names and schemas tell them apart. Say in this description when to use getSessionScreenshots instead.confusable_pair
  • Minor
    Its description is nearly the same as getLiveSessionLogs's (similarity 0.66); only the names and schemas tell them apart. Say in this description when to use getLiveSessionLogs instead.confusable_pair
  • Minor
    Required identifiers whose description does not say where the value comes from: sessionId. Name the tool or the place that returns it, or models look it up first.id_source_missing

tm_generate_test_cases

59 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
17 / 25
Return value
7 / 15
Constraints and side effects
10 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    String arguments with no constraint or example: files[].content_base64.loose_string_param
  • Minor
    No `required` list, so every argument is optional.no_required

tm_list_configurations

59 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
22 / 25
Return value
7 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    No `required` list, so every argument is optional.no_required

smartui_screenshot_review

60 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
21 / 25
Return value
7 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    String arguments with no constraint or example: project_id.loose_string_param
  • Minor
    Required identifiers whose description does not say where the value comes from: project_id, build_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

analyzeHyperExecuteJob

61 / 100Cloudy

Purpose
17 / 20
When to use
5 / 20
Arguments
20 / 25
Return value
7 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
  • Minor
    Required identifiers whose description does not say where the value comes from: jobId. Name the tool or the place that returns it, or models look it up first.id_source_missing

buildLocalAppForAnalysis

61 / 100Cloudy

Purpose
17 / 20
When to use
5 / 20
Arguments
20 / 25
Return value
7 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
  • Minor
    The description mentions none of its 3 or more arguments.params_not_in_description

checkAppProcessingStatus

62 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
20 / 25
Return value
7 / 15
Constraints and side effects
10 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    The description mentions none of its 3 or more arguments.params_not_in_description
  • Minor
    Required identifiers whose description does not say where the value comes from: appId. Name the tool or the place that returns it, or models look it up first.id_source_missing

tm_create_test_case

62 / 100Cloudy

Purpose
20 / 20
When to use
10 / 20
Arguments
20 / 25
Return value
0 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
  • Minor
    String arguments with no constraint or example: project_id, title, test_steps[].action.loose_string_param
  • Minor
    The description mentions none of its 3 or more arguments.params_not_in_description
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    Required identifiers whose description does not say where the value comes from: project_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

tm_list_modules

62 / 100Cloudy

Purpose
20 / 20
When to use
10 / 20
Arguments
17 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
5 / 10
  • Minor
    No `required` list, so every argument is optional.no_required
  • Minor
    Says nothing about what it returns.no_return_info

getAccessibilityReport

63 / 100Cloudy

Purpose
17 / 20
When to use
10 / 20
Arguments
19 / 25
Return value
7 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
  • Minor
    No `required` list, so every argument is optional.no_required

smartui_build_query

63 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
21 / 25
Return value
7 / 15
Constraints and side effects
10 / 10
Examples
5 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    String arguments with no constraint or example: project_id.loose_string_param
  • Minor
    Required identifiers whose description does not say where the value comes from: project_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

getLiveSessionLogs

64 / 100Cloudy

Purpose
20 / 20
When to use
5 / 20
Arguments
20 / 25
Return value
7 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
  • Minor
    Its description is nearly the same as getSessionV2SeleniumLogs's (similarity 0.72); only the names and schemas tell them apart. Say in this description when to use getSessionV2SeleniumLogs instead.confusable_pair
  • Minor
    Its description is nearly the same as getSessionVideo's (similarity 0.66); only the names and schemas tell them apart. Say in this description when to use getSessionVideo instead.confusable_pair
  • Minor
    Required identifiers whose description does not say where the value comes from: sessionId. Name the tool or the place that returns it, or models look it up first.id_source_missing

tm_get_coverage_summary

64 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
20 / 25
Return value
7 / 15
Constraints and side effects
7 / 10
Examples
10 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    String arguments with no constraint or example: project_id, folder_id.loose_string_param
  • Minor
    Required identifiers whose description does not say where the value comes from: project_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

tm_create_test_run

66 / 100Cloudy

Purpose
20 / 20
When to use
5 / 20
Arguments
21 / 25
Return value
0 / 15
Constraints and side effects
10 / 10
Examples
10 / 10
  • Minor
    String arguments with no constraint or example: project_id, title.loose_string_param
  • Minor
    Says nothing about what it returns.no_return_info
  • Minor
    Required identifiers whose description does not say where the value comes from: project_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

downloadJobArtifact

67 / 100Cloudy

Purpose
20 / 20
When to use
10 / 20
Arguments
20 / 25
Return value
7 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
  • Minor
    Required identifiers whose description does not say where the value comes from: jobId. Name the tool or the place that returns it, or models look it up first.id_source_missing

smartui_comparison_analyze

67 / 100Cloudy

Purpose
17 / 20
When to use
10 / 20
Arguments
23 / 25
Return value
7 / 15
Constraints and side effects
10 / 10
Examples
0 / 10
  • Minor
    Required identifiers whose description does not say where the value comes from: comparison_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

tm_record_test_results

67 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
20 / 25
Return value
7 / 15
Constraints and side effects
10 / 10
Examples
10 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context
  • Minor
    String arguments with no constraint or example: results[].steps[].remarks.loose_string_param

smartui_comparison_query

68 / 100Cloudy

Purpose
20 / 20
When to use
5 / 20
Arguments
21 / 25
Return value
7 / 15
Constraints and side effects
10 / 10
Examples
5 / 10

No issues.

automationQuery

69 / 100Cloudy

Purpose
20 / 20
When to use
0 / 20
Arguments
22 / 25
Return value
7 / 15
Constraints and side effects
10 / 10
Examples
10 / 10
  • Major
    Says nothing about when to use it, or when not to.no_usage_context

postSessionExceptions

69 / 100Cloudy

Purpose
20 / 20
When to use
10 / 20
Arguments
20 / 25
Return value
7 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
  • Minor
    Its description is nearly the same as postTestExceptions's (similarity 0.65); only the names and schemas tell them apart. Say in this description when to use postTestExceptions instead.confusable_pair
  • Minor
    String arguments with no constraint or example: sessionId.loose_string_param
  • Minor
    The description mentions none of its 3 or more arguments.params_not_in_description
  • Minor
    Required identifiers whose description does not say where the value comes from: sessionId. Name the tool or the place that returns it, or models look it up first.id_source_missing

postTestExceptions

69 / 100Cloudy

Purpose
20 / 20
When to use
10 / 20
Arguments
20 / 25
Return value
7 / 15
Constraints and side effects
7 / 10
Examples
5 / 10
  • Minor
    Its description is nearly the same as postSessionExceptions's (similarity 0.65); only the names and schemas tell them apart. Say in this description when to use postSessionExceptions instead.confusable_pair
  • Minor
    String arguments with no constraint or example: testId.loose_string_param
  • Minor
    The description mentions none of its 3 or more arguments.params_not_in_description
  • Minor
    Required identifiers whose description does not say where the value comes from: testId. Name the tool or the place that returns it, or models look it up first.id_source_missing

smartui_project_query

69 / 100Cloudy

Purpose
20 / 20
When to use
10 / 20
Arguments
22 / 25
Return value
7 / 15
Constraints and side effects
10 / 10
Examples
0 / 10

No issues.

tm_get_test_cases

69 / 100Cloudy

Purpose
20 / 20
When to use
5 / 20
Arguments
17 / 25
Return value
7 / 15
Constraints and side effects
10 / 10
Examples
10 / 10
  • Minor
    No `required` list, so every argument is optional.no_required

tm_link_ado_issue

70 / 100Clear

Purpose
20 / 20
When to use
5 / 20
Arguments
21 / 25
Return value
7 / 15
Constraints and side effects
7 / 10
Examples
10 / 10
  • Minor
    Its description is nearly the same as tm_link_jira_issue's (similarity 0.70); only the names and schemas tell them apart. Say in this description when to use tm_link_jira_issue instead.confusable_pair
  • Minor
    The description mentions none of its 3 or more arguments.params_not_in_description
  • Minor
    Required identifiers whose description does not say where the value comes from: entity_id, project_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

tm_link_jira_issue

71 / 100Clear

Purpose
20 / 20
When to use
5 / 20
Arguments
22 / 25
Return value
7 / 15
Constraints and side effects
7 / 10
Examples
10 / 10
  • Minor
    Its description is nearly the same as tm_link_ado_issue's (similarity 0.70); only the names and schemas tell them apart. Say in this description when to use tm_link_ado_issue instead.confusable_pair
  • Minor
    The description mentions none of its 3 or more arguments.params_not_in_description
  • Minor
    Required identifiers whose description does not say where the value comes from: entity_id, issue_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

tm_update_test_run

75 / 100Clear

Purpose
20 / 20
When to use
10 / 20
Arguments
21 / 25
Return value
7 / 15
Constraints and side effects
7 / 10
Examples
10 / 10
  • Minor
    String arguments with no constraint or example: title, objective.loose_string_param
  • Minor
    Required identifiers whose description does not say where the value comes from: run_id. Name the tool or the place that returns it, or models look it up first.id_source_missing

What static scoring cannot tell

This score reads only the text of each description and schema: it says what is written, not what a model will do. Short tools whose names already say what they do, such as browser_close, score low here even when models use them well, and in our measurements current models chose the right tool in one step even from one-line descriptions, as long as the names and schemas differed. What the text cannot show, such as what happens over several steps and whether an added sentence helps or misleads, is what an evaluation measures, on the Pro and Team plans.

Is your server listed here and you would rather it were not? Email support@forecall.dev, and we will take it off within 7 days.

All scored servers