QASE MCP Server
The QASE MCP Server is a TypeScript-based server that enables integration with the Qase test management platform API. With this server, you can:
Manage Projects: List, get, create, and delete projects.
Manage Test Cases: Get (all/specific), create, and update test cases within a project.
Manage Test Runs: Get (all/specific) test runs within a project.
Manage Test Results: Get (all/specific), create (single or bulk), and update test results.
Manage Test Plans: Get (all/specific), create, update, and delete test plans.
Manage Test Suites: Get (all/specific), create, update, and delete test suites.
Manage Shared Steps: Get (all/specific), create, update, and delete shared steps.
Provides tools for interacting with the Qase test management platform, enabling management of projects, test cases, test runs, test results, test plans, test suites, and shared steps through the Qase API.
Click on "Install Server".
Wait a few minutes for the server to deploy. Once ready, it will show a "Started" state.
In the chat, type
@followed by the MCP server name and your instructions, e.g., "@QASE MCP Serverlist test cases for project DEMO"
That's it! The server will respond to your query, and you can continue using it as needed.
Here is a step-by-step guide with screenshots.
Note: An official Qase MCP server is now available at qase-tms/qase-mcp-server. Consider using the official server for production use.
QASE MCP Server
MCP server implementation for Qase API
This is a TypeScript-based MCP server that provides integration with the Qase test management platform. It implements core MCP concepts by providing tools for interacting with various Qase entities.
Features
Tools
The server provides tools for interacting with the Qase API, allowing you to manage the following entities:
Projects
list_projects- Get all projectsget_project- Get project by codecreate_project- Create new projectdelete_project- Delete project by code
Test Cases
get_cases- Get all test cases in a projectget_case- Get a specific test casecreate_case- Create a new test caseupdate_case- Update an existing test case
Test Runs
get_runs- Get all test runs in a projectget_run- Get a specific test run
Test Results
get_results- Get all test run results for a projectget_result- Get test run result by code and hashcreate_result- Create test run resultcreate_result_bulk- Create multiple test run results in bulkupdate_result- Update an existing test run result
Test Plans
get_plans- Get all test plans in a projectget_plan- Get a specific test plancreate_plan- Create a new test planupdate_plan- Update an existing test plandelete_plan- Delete a test plan
Test Suites
get_suites- Get all test suites in a projectget_suite- Get a specific test suitecreate_suite- Create a new test suiteupdate_suite- Update an existing test suitedelete_suite- Delete a test suite
Shared Steps
get_shared_steps- Get all shared steps in a projectget_shared_step- Get a specific shared stepcreate_shared_step- Create a new shared stepupdate_shared_step- Update an existing shared stepdelete_shared_step- Delete a shared step
Related MCP server: MCP Server TypeScript Template
Development
Install dependencies:
npm installBuild the server:
npm run buildFor development with auto-rebuild:
npm run watchInstallation
Claude Desktop
To use with Claude Desktop, add the server config:
On MacOS:
~/Library/Application Support/Claude/claude_desktop_config.jsonOn Windows:
%APPDATA%/Claude/claude_desktop_config.json
{
"mcpServers": {
"mcp-qase": {
"command": "/path/to/mcp-qase/build/index.js",
"env": {
"QASE_API_TOKEN": "<YOUR_TOKEN>"
}
}
}
}Cursor
To use with Cursor, register the command as follows:
env QASE_API_TOKEN=<YOUR_TOKEN> /path/to/mcp-qase/build/index.jsDebugging
Since MCP servers communicate over stdio, debugging can be challenging. We recommend using the MCP Inspector:
npx -y @modelcontextprotocol/inspector -e QASE_API_TOKEN=<YOUR_TOKEN> ./build/index.jsAvailable Tools
26 toolscreate_caseC
Create a new test case
| Name | Required | Description | Default |
|---|---|---|---|
| code | Yes | ||
| testCase | Yes |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations provided, the description carries the full burden of behavioral disclosure. 'Create' implies a write/mutation operation, but the description doesn't disclose permissions needed, whether creation is idempotent, error handling, or what happens on success (e.g., returns a case ID). It lacks critical behavioral context for a creation tool.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is extremely concise with a single sentence, 'Create a new test case', which is front-loaded and wastes no words. It efficiently states the core action, though this brevity contributes to gaps in other dimensions.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the tool's complexity (a creation operation with 2 parameters, including a nested object), no annotations, and no output schema, the description is incomplete. It doesn't explain what 'code' and 'testCase' represent, what the tool returns, or any behavioral traits, making it inadequate for safe and effective use.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 0%, so the schema provides no parameter descriptions. The tool description doesn't mention any parameters, failing to compensate for the coverage gap. Parameters 'code' and 'testCase' (a nested object) are entirely undocumented, leaving their purpose and format ambiguous.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description 'Create a new test case' clearly states the verb ('Create') and resource ('test case'), but it's vague about what a 'test case' entails in this context. It distinguishes from siblings like 'create_plan' or 'create_suite' by specifying the resource type, but lacks specificity about the domain or system involved.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance is provided on when to use this tool versus alternatives like 'update_case' or 'get_case'. The description doesn't mention prerequisites, context, or exclusions, leaving the agent to infer usage from the tool name alone.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
create_planC
Create a new test plan
| Name | Required | Description | Default |
|---|---|---|---|
| code | Yes | ||
| title | Yes | ||
| description | No | ||
| cases | Yes |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description carries the full burden of behavioral disclosure. 'Create a new test plan' implies a write operation, but it doesn't disclose permissions needed, whether creation is idempotent, error handling, or response format. It lacks details on behavioral traits beyond the basic action.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single, efficient sentence with zero waste. It's front-loaded and appropriately sized for a basic tool definition, though it may be too concise given the lack of detail in other dimensions.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the complexity (a creation tool with 4 parameters, no annotations, and no output schema), the description is incomplete. It doesn't explain return values, error conditions, or how parameters interact. For a tool that likely mutates data, more context is needed to guide an AI agent effectively.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 0%, so the description must compensate for undocumented parameters. It doesn't add any meaning beyond the input schema—no explanation of what 'code', 'title', 'description', or 'cases' represent, their formats, or constraints. With 4 parameters and low coverage, this is inadequate.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description 'Create a new test plan' states a clear verb ('Create') and resource ('test plan'), but it's vague about what a 'test plan' entails and doesn't distinguish it from sibling tools like 'create_project', 'create_suite', or 'create_case'. It provides a basic purpose but lacks specificity about the domain or scope.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
There is no guidance on when to use this tool versus alternatives. Sibling tools include other creation tools (e.g., 'create_case', 'create_suite') and update tools (e.g., 'update_plan'), but the description doesn't mention prerequisites, context, or exclusions. Usage is implied only by the tool name.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
create_projectC
Create new project
| Name | Required | Description | Default |
|---|---|---|---|
| code | Yes | ||
| title | Yes | ||
| description | No | ||
| access | No | ||
| group | No |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations provided, the description carries the full burden of behavioral disclosure but offers none. It doesn't indicate whether this is a safe operation, what permissions are required, if it's idempotent, or what happens on success/failure. For a creation tool with zero annotation coverage, this is a critical gap in transparency.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is extremely concise with just three words, front-loading the essential action and resource. There is no wasted language or unnecessary elaboration, making it efficient for quick comprehension.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the tool's complexity (5 parameters, creation operation), lack of annotations, and no output schema, the description is severely incomplete. It doesn't cover parameter meanings, behavioral traits, usage context, or expected outcomes, failing to provide the necessary context for effective tool invocation.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The description adds no parameter information beyond what the input schema provides. With 0% schema description coverage and 5 parameters (code, title, description, access, group), the description fails to explain what these parameters mean, their formats, or constraints. This leaves key inputs like 'access' enum values unexplained.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description 'Create new project' clearly states the action (create) and resource (project), making the purpose immediately understandable. It distinguishes from sibling tools like 'list_projects' or 'get_project' by specifying creation rather than retrieval. However, it doesn't specify what kind of project or domain (e.g., software, construction), which prevents a perfect score.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description provides no guidance on when to use this tool versus alternatives. It doesn't mention prerequisites (e.g., authentication), when not to use it, or how it differs from similar creation tools like 'create_case' or 'create_suite'. This leaves the agent with minimal context for tool selection.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
create_resultD
Create test run result
| Name | Required | Description | Default |
|---|---|---|---|
| code | Yes | ||
| id | Yes | ||
| result | Yes |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description carries the full burden of behavioral disclosure. The description only states the action ('Create') without any details on permissions, side effects, response format, error handling, or rate limits. For a mutation tool with zero annotation coverage, this is a critical gap in transparency.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is extremely concise with a single phrase, 'Create test run result', which is front-loaded and wastes no words. However, this brevity comes at the cost of under-specification, as it lacks necessary details for effective tool use.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the complexity (mutation tool with 3 parameters, nested objects, no output schema, and 0% schema coverage), the description is severely incomplete. It does not explain what the tool returns, how parameters interact, or behavioral aspects, making it inadequate for the agent to use the tool correctly without additional context.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 0%, meaning none of the three parameters (code, id, result) are documented in the schema. The description does not add any meaning or explanation for these parameters, failing to compensate for the lack of schema documentation. This leaves the agent guessing about parameter purposes and formats.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description 'Create test run result' is essentially a tautology of the tool name 'create_result'. While it indicates the action (create) and resource (test run result), it doesn't specify what constitutes a 'test run result' or how this differs from sibling tools like 'create_result_bulk' or 'update_result'. The purpose is stated but lacks differentiation and specificity.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance is provided on when to use this tool versus alternatives. The description does not mention prerequisites, context, or comparisons to sibling tools such as 'create_result_bulk' for bulk operations or 'update_result' for modifications. This leaves the agent without direction on appropriate usage scenarios.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
create_result_bulkC
Create multiple test run results in bulk
| Name | Required | Description | Default |
|---|---|---|---|
| code | Yes | ||
| id | Yes | ||
| results | Yes |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations provided, the description carries full burden but offers minimal behavioral insight. It states 'Create' (implying a write/mutation operation) but doesn't disclose permissions needed, whether creation is atomic/transactional, rate limits, error handling for partial failures, or what happens on success. This is inadequate for a mutation tool with zero annotation coverage.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single, efficient sentence with no wasted words. It's appropriately sized for a basic tool description, though the brevity contributes to gaps in other dimensions.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a mutation tool with 3 required parameters (including a nested object), 0% schema coverage, no annotations, and no output schema, the description is severely incomplete. It doesn't explain what the tool returns, how to interpret parameters, or critical behavioral aspects like error handling.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 0%, and the description provides no information about the three required parameters (code, id, results). The term 'results' in the description refers to the resource being created, not the parameter named 'results', creating potential confusion. No parameter meanings, formats, or examples are given.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the action ('Create multiple test run results') and resource ('in bulk'), distinguishing it from the singular 'create_result' sibling tool. However, it doesn't specify what 'test run results' are in this context or how they differ from other test entities like cases or suites.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance is provided on when to use this tool versus alternatives like 'create_result' (singular) or other creation tools. The description implies bulk creation but doesn't specify thresholds, performance considerations, or prerequisites for using bulk operations.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
create_suiteC
Create a new test suite
| Name | Required | Description | Default |
|---|---|---|---|
| code | Yes | ||
| title | Yes | ||
| description | No | ||
| preconditions | No | ||
| parent_id | No |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description carries full burden. 'Create a new test suite' implies a write/mutation operation, but there's no information about permissions required, whether creation is idempotent, what happens on failure, or what the response contains. For a creation tool with zero annotation coverage, this is a significant gap in behavioral disclosure.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is extremely concise - just 4 words. It's front-loaded with the essential action and resource. There's zero wasted language or redundancy. While it may be too brief for completeness, as a standalone statement it's perfectly structured and efficient.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a creation tool with 5 parameters, 0% schema description coverage, no annotations, and no output schema, the description is severely incomplete. It doesn't explain what a test suite is in this context, what parameters mean, what the creation entails, or what to expect as a result. The agent would struggle to use this tool correctly without additional context.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 0%, meaning none of the 5 parameters have descriptions in the schema. The tool description provides no information about parameters whatsoever - not what 'code', 'title', 'description', 'preconditions', or 'parent_id' mean or how they should be used. The description fails to compensate for the complete lack of schema documentation.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description 'Create a new test suite' clearly states the verb ('create') and resource ('test suite'), which is better than a tautology. However, it doesn't differentiate from siblings like 'create_project' or 'create_plan' - all could be creating different types of test artifacts. The purpose is clear but lacks sibling differentiation.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description provides no guidance on when to use this tool versus alternatives. With siblings like 'create_project', 'create_plan', and 'create_case', there's no indication of when a test suite is appropriate versus other test artifacts. No prerequisites, constraints, or alternatives are mentioned.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
get_caseC
Get a specific test case
| Name | Required | Description | Default |
|---|---|---|---|
| code | Yes | ||
| id | Yes |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description carries full burden. It states 'Get' which implies a read operation, but doesn't disclose behavioral traits such as authentication needs, error handling, rate limits, or what happens if the case doesn't exist. For a retrieval tool with zero annotation coverage, this is a significant gap in transparency.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single, efficient sentence with no wasted words. It's appropriately sized for a simple tool and front-loaded with the core action, though it could benefit from more detail given the lack of other documentation.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the complexity (2 required parameters, 0% schema coverage, no output schema, no annotations), the description is incomplete. It doesn't explain parameter semantics, return values, or behavioral context, making it inadequate for an agent to use the tool effectively without additional information.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 0%, so the description must compensate. It provides no information about the parameters 'code' and 'id', leaving their meaning, format, or relationship undocumented. The description adds no value beyond the schema, failing to explain what these identifiers represent or how to use them.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description 'Get a specific test case' clearly states the action (get) and resource (test case), but it's vague about what 'specific' means and doesn't distinguish this tool from sibling 'get_cases' which likely retrieves multiple cases. It provides basic purpose but lacks specificity about scope or differentiation.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance is provided on when to use this tool versus alternatives like 'get_cases' or other retrieval tools. The description implies retrieval of a single case but doesn't specify prerequisites, context, or exclusions, leaving usage unclear relative to siblings.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
get_casesC
Get all test cases in a project
| Name | Required | Description | Default |
|---|---|---|---|
| code | Yes | ||
| search | No | ||
| milestoneId | No | ||
| suiteId | No | ||
| severity | No | ||
| priority | No | ||
| type | No | ||
| behavior | No | ||
| automation | No | ||
| status | No | ||
| externalIssuesType | No | ||
| externalIssuesIds | No | ||
| include | No | ||
| limit | No | ||
| offset | No |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations provided, the description carries full burden but offers minimal behavioral insight. It implies a read operation ('Get') but doesn't disclose critical traits like pagination behavior (hinted by 'limit' and 'offset' parameters), rate limits, authentication needs, or whether results are sorted. This leaves significant gaps for agent decision-making.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single, clear sentence that efficiently conveys the core purpose without unnecessary words. It's front-loaded and wastes no space, making it easy for an agent to parse quickly.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the complexity (15 parameters, no output schema, no annotations), the description is severely incomplete. It doesn't address parameter usage, return values, error conditions, or behavioral constraints, leaving the agent with insufficient context to use the tool effectively beyond basic intent.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 0%, so the description must compensate but fails to do so. It mentions 'all test cases in a project' but doesn't explain any of the 15 parameters, including the required 'code' parameter or filtering options like 'search' or 'severity'. This leaves parameters largely undocumented.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the action ('Get') and resource ('test cases in a project'), making the purpose immediately understandable. However, it doesn't differentiate from sibling tools like 'get_case' (singular) or explain the scope of 'all' versus filtered results, which prevents a perfect score.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description provides no guidance on when to use this tool versus alternatives like 'get_case' (singular) or 'get_suites' (for related resources). It lacks context about prerequisites, such as needing a project code, or when filtering might be preferred over retrieving all cases.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
get_planC
Get a specific test plan
| Name | Required | Description | Default |
|---|---|---|---|
| code | Yes | ||
| id | Yes |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description carries the full burden of behavioral disclosure. It only states the action ('Get') without any information about permissions, rate limits, error handling, or what the return value includes (e.g., plan details). This is inadequate for a tool with no annotation coverage.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single, efficient sentence that directly states the tool's purpose without unnecessary words. It is appropriately sized and front-loaded, making it easy to parse quickly.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the complexity (a retrieval tool with 2 required parameters), no annotations, no output schema, and 0% schema description coverage, the description is incomplete. It doesn't explain parameters, return values, or behavioral traits, leaving significant gaps for an AI agent to use the tool correctly.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 0%, meaning the two required parameters ('code' and 'id') are undocumented in the schema. The description adds no meaning about these parameters—it doesn't explain what 'code' or 'id' represent, their formats, or how they relate to retrieving a test plan. This fails to compensate for the lack of schema documentation.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description 'Get a specific test plan' states a clear verb ('Get') and resource ('test plan'), but it lacks specificity about what distinguishes this from sibling tools like 'get_plans' (which likely lists multiple plans) or 'get_project' (which might retrieve project-level information). It's not tautological but remains somewhat vague about scope.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description provides no guidance on when to use this tool versus alternatives. With siblings like 'get_plans' (likely for listing plans) and 'get_project' (for project-level data), there's no indication of prerequisites, context, or exclusions for selecting 'get_plan' over these other retrieval tools.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
get_plansC
Get all test plans in a project
| Name | Required | Description | Default |
|---|---|---|---|
| code | Yes | ||
| limit | No | ||
| offset | No |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations provided, the description carries full burden but only states the basic action. It doesn't disclose behavioral traits such as pagination behavior (implied by 'limit' and 'offset' parameters), authentication needs, rate limits, or what 'all' means in practice (e.g., completeness of results).
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single, efficient sentence with no wasted words. It's appropriately sized and front-loaded with the core purpose, making it easy to scan.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the complexity (3 parameters, no annotations, no output schema), the description is incomplete. It lacks details on parameter usage, return values, and behavioral context, making it inadequate for reliable tool invocation without additional assumptions.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 0%, so the description must compensate but adds no parameter information. It doesn't explain what 'code' refers to (likely a project identifier), or how 'limit' and 'offset' affect pagination. This leaves key parameters undocumented.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the action ('Get') and resource ('all test plans in a project'), making the purpose understandable. However, it doesn't differentiate from sibling tools like 'get_plan' (singular) or 'list_projects', which could cause confusion about scope or alternatives.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance is provided on when to use this tool versus alternatives like 'get_plan' (for a single plan) or 'list_projects' (for projects). The description implies usage for retrieving multiple plans but lacks explicit context or exclusions.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
get_projectC
Get project by code
| Name | Required | Description | Default |
|---|---|---|---|
| code | Yes |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations provided, the description carries the full burden of behavioral disclosure. It states the action ('Get') but doesn't clarify if this is a read-only operation, what happens on failure (e.g., if the code doesn't exist), or any rate limits or authentication needs. For a retrieval tool, this minimal description misses key operational details.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is extremely concise—a single phrase with no wasted words—and front-loaded with the core action. It efficiently communicates the essential purpose without unnecessary elaboration, making it easy for an agent to parse quickly.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the lack of annotations, no output schema, and minimal parameter details, the description is incomplete for effective tool use. It doesn't explain what 'Get' entails (e.g., returns project details or just metadata), error handling, or how it fits within the broader context of sibling tools, leaving significant gaps for the agent.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The description adds minimal semantics by implying that 'code' is used to identify a project, but with 0% schema description coverage and one required parameter, it doesn't elaborate on the format or constraints of 'code' (e.g., whether it's a numeric ID, string identifier, or case-sensitive). This provides some value over the bare schema but doesn't fully compensate for the coverage gap.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description 'Get project by code' clearly states the verb ('Get') and resource ('project'), and specifies the lookup mechanism ('by code'), making the purpose unambiguous. However, it doesn't explicitly differentiate from sibling tools like 'list_projects' or other 'get_' tools that might retrieve projects differently, which prevents a perfect score.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description provides no guidance on when to use this tool versus alternatives. For example, it doesn't mention when to choose 'get_project' over 'list_projects' or other retrieval tools, nor does it specify prerequisites or contextual constraints. This lack of usage direction leaves the agent to infer based on tool names alone.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
get_resultC
Get test run result by code and hash
| Name | Required | Description | Default |
|---|---|---|---|
| code | Yes | ||
| hash | Yes |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description carries full burden. It states it's a read operation ('Get'), but doesn't disclose behavioral traits like error handling (e.g., what happens if code/hash is invalid), authentication needs, rate limits, or response format. The description is minimal and lacks critical operational context.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is extremely concise (one short sentence) and front-loaded with the core purpose. There is no wasted verbiage, making it efficient for quick scanning.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the tool has 2 required parameters, no annotations, and no output schema, the description is incomplete. It doesn't explain what a 'test run result' entails, how to obtain the code/hash, or what the return value looks like. For a retrieval tool with no structured support, more context is needed.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 0%, so the description must compensate. It mentions parameters 'code and hash' but provides no semantic meaning (e.g., what these identifiers represent, their format, or examples). This adds minimal value beyond the schema's structural definition.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the action ('Get') and the resource ('test run result'), specifying it's retrieved by 'code and hash'. This distinguishes it from sibling tools like 'get_results' (plural) which likely returns multiple results. However, it doesn't explicitly contrast with other 'get_' tools like 'get_case' or 'get_run'.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance is provided on when to use this tool versus alternatives. It doesn't mention prerequisites (e.g., needing a valid code/hash), exclusions, or comparisons to similar tools like 'get_results' or 'get_run'. The description implies usage only when you have both identifiers.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
get_resultsC
Get all test run results for a project
| Name | Required | Description | Default |
|---|---|---|---|
| code | Yes | ||
| limit | No | ||
| offset | No | ||
| status | No | ||
| from | No | ||
| to | No |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description carries full burden. It mentions 'Get all test run results' but doesn't disclose behavioral traits like pagination (implied by limit/offset params), authentication needs, rate limits, or return format. This is inadequate for a tool with 6 parameters and no output schema.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single, efficient sentence with no wasted words. It's front-loaded and appropriately sized for its content, though it could benefit from more detail given the tool's complexity.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the tool's complexity (6 parameters, no annotations, no output schema), the description is incomplete. It lacks details on parameter usage, behavioral context, and output, making it insufficient for an AI agent to use the tool effectively without guesswork.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 0%, so the description must compensate. It mentions 'for a project' which hints at the 'code' parameter, but doesn't explain the other 5 parameters (limit, offset, status, from, to) or their semantics. This leaves most parameters undocumented.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the verb ('Get') and resource ('all test run results for a project'), making the purpose understandable. However, it doesn't differentiate from sibling tools like 'get_result' (singular) or 'get_runs', leaving some ambiguity about scope.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance is provided on when to use this tool versus alternatives like 'get_result' (singular) or 'get_runs'. The description implies it retrieves all results, but without context on filtering or comparison to siblings, usage is unclear.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
get_runC
Get a specific test run
| Name | Required | Description | Default |
|---|---|---|---|
| code | Yes | ||
| id | Yes | ||
| include | No |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description carries the full burden of behavioral disclosure. It only states 'Get a specific test run', which implies a read-only operation but does not clarify permissions, rate limits, error handling, or what data is returned (e.g., run details, status). For a tool with zero annotation coverage, this lack of behavioral information is a significant gap, making it inadequate for safe and effective use.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single sentence, 'Get a specific test run', which is appropriately sized and front-loaded with the core action. There is no wasted text or unnecessary elaboration, making it efficient for quick understanding, though it lacks depth.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the tool's complexity (3 parameters, no annotations, no output schema), the description is incomplete. It does not explain the return values, parameter usage, or behavioral traits, leaving gaps that could hinder the agent's ability to invoke the tool correctly. For a retrieval tool with undocumented inputs and outputs, more context is needed to ensure reliable operation.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The input schema has 3 parameters (code, id, include) with 0% description coverage, meaning no parameter details are documented in the schema. The description does not add any meaning beyond the schema—it does not explain what 'code' and 'id' represent (e.g., project code and run ID) or how 'include' works (e.g., to embed cases). Since the schema coverage is low and the description fails to compensate, the score reflects this deficiency.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description states the tool's purpose as 'Get a specific test run', which includes a verb ('Get') and resource ('test run'), making it clear what it does. However, it lacks specificity about what 'specific' means (e.g., by ID/code) and does not distinguish it from sibling tools like 'get_runs' (which likely lists multiple runs) or 'get_result' (which might retrieve results within runs). This vagueness prevents a higher score.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description provides no guidance on when to use this tool versus alternatives. It does not mention prerequisites (e.g., needing a run ID), exclusions, or comparisons to siblings like 'get_runs' for listing runs or 'get_result' for run results. Without such context, the agent must infer usage from the tool name and schema alone, which is insufficient for effective selection.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
get_runsC
Get all test runs in a project
| Name | Required | Description | Default |
|---|---|---|---|
| code | Yes | ||
| search | No | ||
| status | No | ||
| milestone | No | ||
| environment | No | ||
| fromStartTime | No | ||
| toStartTime | No | ||
| limit | No | ||
| offset | No | ||
| include | No |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations provided, the description carries full burden but offers minimal behavioral insight. 'Get all' implies a read operation, but doesn't disclose pagination behavior (despite limit/offset parameters), authentication needs, rate limits, or what 'all' means in practice (e.g., completeness guarantees).
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Extremely concise with a single, front-loaded sentence that states the core purpose without waste. Every word earns its place, though this brevity contributes to gaps in other dimensions.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Incomplete for a tool with 10 parameters, 0% schema coverage, and no output schema. The description lacks parameter explanations, behavioral context, and output details, making it inadequate for an agent to use the tool effectively without guessing.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 0%, so the description must compensate but fails to do so. It mentions no parameters, leaving all 10 parameters (like 'search', 'status', 'milestone') undocumented. The phrase 'in a project' hints at the 'code' parameter but doesn't explain its role or format.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description 'Get all test runs in a project' clearly states the action (get) and resource (test runs), with scope (in a project). It distinguishes from siblings like 'get_run' (singular) by specifying 'all' runs, but doesn't explicitly differentiate from other list-like tools like 'get_cases' or 'get_results' beyond resource type.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance on when to use this tool versus alternatives. The description doesn't mention when to choose 'get_runs' over 'get_run' (singular) or other filtering tools, nor does it provide context about prerequisites or typical use cases.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
get_suiteC
Get a specific test suite
| Name | Required | Description | Default |
|---|---|---|---|
| code | Yes | ||
| id | Yes |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations provided, the description carries the full burden of behavioral disclosure. It states 'Get' implying a read operation, but doesn't clarify if this requires authentication, returns error conditions, or has any side effects like caching. This leaves gaps in understanding the tool's behavior.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single, clear sentence with no wasted words, making it easy to parse. However, it could be more front-loaded with additional context to improve utility without sacrificing brevity.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the tool's complexity (2 required parameters, no annotations, no output schema), the description is insufficient. It doesn't explain what a 'test suite' entails, how parameters are used, or what the return value looks like, leaving the agent with significant gaps in understanding.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The input schema has 2 parameters (code and id) with 0% description coverage, so the schema provides no semantic information. The description adds no details about what these parameters mean (e.g., code could be a project code, id a numeric identifier), failing to compensate for the schema's lack of documentation.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description 'Get a specific test suite' clearly states the verb ('Get') and resource ('test suite'), making the purpose understandable. However, it doesn't differentiate from sibling tools like 'get_suites' (plural) or 'get_case'/'get_plan' which retrieve different resources, leaving some ambiguity about scope.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance is provided on when to use this tool versus alternatives. For example, it doesn't specify if this is for retrieving a single suite by identifier versus using 'get_suites' for listing multiple suites, nor does it mention prerequisites or context for usage.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
get_suitesC
Get all test suites in a project
| Name | Required | Description | Default |
|---|---|---|---|
| code | Yes | ||
| search | No | ||
| limit | No | ||
| offset | No |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description carries the full burden of behavioral disclosure. It states it 'gets' data, implying a read operation, but doesn't cover aspects like pagination behavior (suggested by 'limit' and 'offset' parameters), error handling, authentication needs, or rate limits. This is a significant gap for a tool with multiple parameters.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single, efficient sentence that directly states the tool's purpose without unnecessary words. It's appropriately sized and front-loaded, making it easy to parse quickly.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the complexity (4 parameters, 1 required), lack of annotations, and no output schema, the description is incomplete. It doesn't address parameter meanings, behavioral traits, or return values, leaving the agent with insufficient context to use the tool effectively beyond its basic purpose.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 0%, so the description must compensate but adds no parameter information. It doesn't explain what 'code', 'search', 'limit', or 'offset' mean, their formats, or how they affect the operation. With 4 parameters and no schema descriptions, this leaves key semantics undocumented.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the action ('Get') and resource ('all test suites in a project'), making the purpose understandable. It doesn't explicitly differentiate from sibling tools like 'get_suite' (singular) or 'list_projects', but it's specific enough to convey its scope.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description provides no guidance on when to use this tool versus alternatives like 'get_suite' (singular) or 'list_projects'. It lacks context about use cases, prerequisites, or exclusions, leaving the agent to infer usage from the tool name alone.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
list_projectsD
Get All Projects
| Name | Required | Description | Default |
|---|---|---|---|
| limit | No | ||
| offset | No |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description carries the full burden of behavioral disclosure, but it offers no information about the tool's behavior. It doesn't mention whether this is a read-only operation, what permissions might be required, how results are returned (e.g., pagination, sorting), potential rate limits, or error conditions. The description is too minimal to provide any useful behavioral context.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is extremely concise at just three words, which could be appropriate if it were more informative. However, it's under-specified rather than efficiently structured—it doesn't front-load critical information or use its brevity to convey essential details. While not verbose, it wastes its minimal word count on a tautological phrase that adds little value.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the tool's complexity (2 parameters with no schema descriptions, no annotations, no output schema), the description is completely inadequate. It doesn't explain what the tool returns, how to use the parameters, behavioral traits, or differentiation from siblings. For a list operation with pagination parameters, this level of documentation leaves critical gaps that would hinder an AI agent's ability to use the tool correctly.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The input schema has 2 parameters (limit, offset) with 0% description coverage, meaning the schema provides no semantic information about these parameters. The description 'Get All Projects' doesn't mention any parameters at all, failing to compensate for the schema's lack of documentation. Users would have no idea what limit and offset do or how to use them effectively.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description 'Get All Projects' is a tautology that essentially restates the tool name 'list_projects' without adding meaningful specificity. It uses a generic verb 'Get' rather than a more precise action like 'List' or 'Retrieve', and doesn't distinguish this tool from sibling tools like 'get_project' (singular) or other list operations like 'get_cases' or 'get_plans'. The description fails to clarify what 'All Projects' means in context.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description provides no guidance on when to use this tool versus alternatives. There are multiple sibling tools with similar naming patterns (e.g., 'get_project' for a single project, 'get_cases' for cases), but the description doesn't indicate that this tool retrieves multiple projects or explain when to choose it over other retrieval tools. No context, prerequisites, or exclusions are mentioned.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
update_caseC
Update an existing test case
| Name | Required | Description | Default |
|---|---|---|---|
| code | Yes | ||
| id | Yes | ||
| title | No | ||
| description | No | ||
| preconditions | No | ||
| postconditions | No | ||
| severity | No | ||
| priority | No | ||
| type | No | ||
| behavior | No | ||
| automation | No | ||
| status | No | ||
| suite_id | No | ||
| milestone_id | No | ||
| layer | No | ||
| is_flaky | No | ||
| params | No | ||
| tags | No | ||
| steps | No | ||
| custom_fields | No |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations provided, the description carries full burden but offers no behavioral details. It doesn't disclose that this is a mutation operation (implied by 'update'), what permissions are required, whether updates are reversible, rate limits, or what happens to unspecified fields (e.g., partial vs. full updates). This leaves critical gaps for safe tool invocation.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is extremely concise—a single sentence with no wasted words. It's front-loaded with the core action, though this brevity comes at the cost of completeness. For conciseness alone, it's optimal.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the high complexity (20 parameters, 0% schema coverage, no annotations, no output schema), the description is severely incomplete. It doesn't explain the tool's behavior, parameter meanings, return values, or usage context. This is inadequate for a mutation tool with many undocumented inputs.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 0%, so the schema provides no parameter documentation. The description adds no parameter semantics—it doesn't explain what 'code', 'id', or any of the 20 parameters mean, their formats, or constraints. This forces the agent to guess parameter purposes, which is inadequate for such a complex tool.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description 'Update an existing test case' clearly states the action (update) and resource (test case), which is adequate. However, it doesn't differentiate this tool from sibling update tools like update_plan or update_suite, nor does it specify what aspects of a test case can be updated beyond the generic term.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance is provided on when to use this tool versus alternatives. It doesn't mention prerequisites (e.g., needing an existing test case ID), compare with create_case for new cases, or explain when to use update_case versus other update tools in the sibling list. The agent must infer usage from context alone.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
update_planC
Update an existing test plan
| Name | Required | Description | Default |
|---|---|---|---|
| code | Yes | ||
| id | Yes | ||
| title | No | ||
| description | No | ||
| cases | No |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations provided, the description carries full burden but only states it's an update operation. It doesn't disclose behavioral traits like permission requirements, whether updates are reversible, rate limits, or what happens to unspecified fields. 'Update' implies mutation, but lacks critical details for safe usage.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single, efficient sentence with no wasted words. It's front-loaded with the core purpose and appropriately sized for the minimal information it conveys.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a mutation tool with 5 parameters, 0% schema coverage, no annotations, and no output schema, the description is insufficient. It doesn't explain what the tool returns, error conditions, or provide enough context for reliable use. The gap between complexity and documentation is significant.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 0%, so the description must compensate but adds no parameter information. It doesn't explain what 'code', 'id', 'title', 'description', or 'cases' represent, their formats, or how they affect the update. With 5 parameters and no schema descriptions, this is inadequate.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description 'Update an existing test plan' clearly states the action (update) and resource (test plan), but it's generic and doesn't differentiate from sibling update tools like update_case or update_suite. It specifies 'existing' which distinguishes from create_plan, but lacks detail about what aspects can be updated.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No explicit guidance on when to use this tool versus alternatives is provided. The description implies it's for modifying existing plans, but doesn't mention prerequisites, when to choose create_plan instead, or how it relates to other update tools. The context is minimal.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
update_resultC
Update an existing test run result
| Name | Required | Description | Default |
|---|---|---|---|
| code | Yes | ||
| id | Yes | ||
| hash | Yes | ||
| result | Yes |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description carries the full burden of behavioral disclosure. While 'update' implies a mutation operation, the description doesn't specify permissions required, whether the update is reversible, rate limits, or what happens to unspecified fields. This leaves significant gaps in understanding the tool's behavior beyond the basic action.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single, straightforward sentence with no wasted words. It's appropriately sized for a basic tool description and front-loaded with the essential action, making it easy to parse quickly.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the complexity (4 required parameters including a nested object, no output schema, and no annotations), the description is insufficient. It doesn't explain parameter meanings, return values, error conditions, or behavioral nuances, leaving the AI agent with inadequate information to use the tool correctly in context.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 0%, meaning none of the 4 parameters (code, id, hash, result) are documented in the schema. The description adds no information about what these parameters mean, their formats, or how they interact (e.g., whether 'id' identifies the result to update, what 'hash' is for, or what 'result' object should contain). This fails to compensate for the lack of schema documentation.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description 'Update an existing test run result' clearly states the action (update) and target resource (test run result), which is adequate. However, it doesn't distinguish this tool from similar sibling tools like 'update_case', 'update_plan', or 'update_suite', leaving ambiguity about when to use this specific update operation versus others.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description provides no guidance on when to use this tool versus alternatives. With multiple 'update_' sibling tools available (e.g., update_case, update_plan, update_suite), there's no indication of context, prerequisites, or exclusions to help an AI agent choose appropriately among them.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
update_suiteC
Update an existing test suite
| Name | Required | Description | Default |
|---|---|---|---|
| code | Yes | ||
| id | Yes | ||
| title | No | ||
| description | No | ||
| preconditions | No | ||
| parent_id | No |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations provided, the description carries full burden for behavioral disclosure. 'Update' implies a mutation operation, but the description doesn't specify what happens during update (partial vs full updates, validation rules, error conditions), whether it requires specific permissions, or what the response contains. This leaves significant behavioral gaps for a mutation tool.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is maximally concise at 4 words, front-loading the essential action and resource. There's zero wasted language, though this conciseness comes at the cost of completeness. Every word earns its place in conveying the core purpose.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a mutation tool with 6 parameters, 0% schema coverage, no annotations, and no output schema, the description is severely incomplete. It states what the tool does at a high level but provides none of the necessary context about how to use it effectively, what parameters mean, what behaviors to expect, or what results will be returned.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
With 0% schema description coverage for all 6 parameters, the description provides no information about parameter meanings beyond what's inferable from names. It doesn't explain what 'code', 'id', 'title', 'description', 'preconditions', or 'parent_id' represent in the context of updating a test suite, leaving the agent to guess parameter purposes and formats.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the verb ('Update') and resource ('an existing test suite'), making the purpose immediately understandable. It distinguishes from sibling 'create_suite' by specifying 'existing', but doesn't differentiate from other update tools like 'update_case' or 'update_plan' beyond the resource type.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description provides no guidance on when to use this tool versus alternatives. It doesn't mention prerequisites (like needing an existing suite ID), when to choose update_suite over create_suite, or how it differs from other update operations in the sibling list. The agent must infer usage from the name alone.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
Tool Schema Changelog
Recent tool additions, removals, and schema changes observed during successful MCP inspections. Dates show when Glama detected each change.
26 tool updates
- First observed
create_case - First observed
create_plan - First observed
create_project - First observed
create_result - First observed
create_result_bulk - First observed
create_shared_step - First observed
create_suite - First observed
get_case - First observed
get_cases - First observed
get_plan - First observed
get_plans - First observed
get_project - First observed
get_result - First observed
get_results - First observed
get_run - First observed
get_runs - First observed
get_shared_step - First observed
get_shared_steps - First observed
get_suite - First observed
get_suites - First observed
list_projects - First observed
update_case - First observed
update_plan - First observed
update_result - First observed
update_shared_step - First observed
update_suite
TDQS
Each tool has a clearly distinct purpose targeting specific resources (cases, plans, projects, results, shared steps, suites, runs) with unambiguous actions (create, get, update, list). No overlapping functionality exists between tools, making selection straightforward for an agent.
All tools follow a consistent verb_noun pattern with perfect uniformity (e.g., create_case, get_cases, update_suite). The naming convention is predictable across all 26 tools, using snake_case consistently without any deviations or mixed styles.
With 26 tools, the count is borderline high for typical MCP servers, which often have 3-15 tools. While the tools are well-organized, the number may feel heavy and could overwhelm agents, though it aligns with comprehensive test management coverage.
The tool set provides complete CRUD/lifecycle coverage for test management, including create, get, update, and list operations for all core resources (cases, plans, projects, results, shared steps, suites, runs). No obvious gaps exist, ensuring agents can handle full workflows without dead ends.
Maintenance
Resources
Unclaimed servers have limited discoverability.
Looking for Admin?
If you are the server author, to access and configure the admin panel.
Related MCP Connectors
An MCP server that provides access to Testiny projects, test cases and test runs
Official MCP server for Qase — manage test cases, runs, suites, defects via AI tools.
A TypeScript MCP server for Home Assistant, enabling programmatic management of entities, automati…
A MCP server built for developers enabling Git based project management with project and personal…
Related MCP Servers
- FlicenseNot gradedqualityDmaintenanceA Model Context Protocol server that integrates with the Qase test management platform, allowing users to create and retrieve test cases, manage test runs, and interact with Qase projects.301-
- FlicenseNot gradedqualityDmaintenanceA demonstration MCP server built in TypeScript that shows how to implement stdio-based communication for integration with MCP clients. Serves as a template for building custom MCP servers with strong typing and maintainability.-

Qase MCP Serverofficial
AlicenseAqualityAmaintenanceOfficial MCP server for Qase Test Management Platform. Enables AI assistants to manage test cases, test runs, defects, and other Qase entities through natural language.144,21031MIT- AlicenseAqualityCmaintenanceMCP server for QTM4J (QMetry Test Management for Jira) Open API, enabling test case and cycle management via natural language.2155MIT
Appeared in Searches
Latest Blog Posts
- Who's Calling? MCP Hosts Are an Identity Blind Spot (And the Spec Knows It)By Om-Shree-0709 on .mcpAgent IdentityOAuth 2.1
- Your AI Chatbot Just Exposed Your CEO's Salary to an InternBy Om-Shree-0709 on .Agent IdentityMCP SecurityOAuth Delegation
- Why MCP Servers Need Execution Sandboxing (And Why Your Current Stack Isn't Enough)By Om-Shree-0709 on .Agentic AiPrompt InjectionWebAssembly
MCP directory API
We provide all the information about MCP servers via our MCP API.
curl -X GET 'https://glama.ai/api/mcp/v1/servers/rikuson/mcp-qase'
If you have feedback or need assistance with the MCP directory API, please join our Discord server