Skip to main content
Glama
us-all

datadog-mcp-server

by us-all

Datadog MCP Server

The Datadog MCP that answers "why is this happening?" — not just "what's the value?"

Aggregation tools that fold 5–7 sequential API calls into one structured response. Full SLO CRUD. Fleet automation. The widest Datadog API coverage in any MCP — 163 tools built on the @us-all MCP standard.

npm downloads tools @us-all standard Glama MCP server

What it does that others don't

  • Aggregation toolsanalyze-monitor-state and slo-compliance-snapshot collapse 5–7 sequential API calls into one structured response with a caveats array for partial failures. No other Datadog MCP ships this pattern.

  • Full SLO CRUD — create, update, delete SLOs (and their corrections). The official Bits AI MCP and community alternatives are read-only on SLOs.

  • Fleet Automation — 15 tools across deployments and schedules. Only this server.

  • Status Pages — 21 tools for full status-page lifecycle (components, degradations, maintenances). Only this server.

  • Token-efficient by designextractFields projection, DD_TOOLS/DD_DISABLE 16-category toggles, and a search-tools meta-tool keep LLM context low across 163 tools.

  • Apps SDK cardslo-compliance-snapshot renders as a visual card on ChatGPT clients via _meta["openai/outputTemplate"]. Claude clients receive the same JSON content (non-breaking).

  • stdio + Streamable HTTP — defaults to stdio (Claude Desktop / Code). Set MCP_TRANSPORT=http for ChatGPT Apps SDK or remote clients (Bearer auth via MCP_HTTP_TOKEN).

Related MCP server: MCP Datadog Server

Try this — 5 prompts

Connect the server to Claude Desktop or Claude Code, then paste any of these:

  1. SLO health"List my SLOs and their error budget remaining this month. Group by status: compliant, at-risk, breached."

  2. Incident triage"There's an active incident on checkout-service. Pull the linked monitors, the recent error spikes from APM, and which deployments touched the service in the last 24h."

  3. Monitor noise audit"Find monitors that alerted more than 10 times in the last 7 days but had MTTR under 5 minutes — these are probably flapping."

  4. RUM error spike"RUM error rate jumped on the checkout funnel between 14:00 and 14:30 today. Show me the top error groups, affected sessions, and the user actions before the errors."

  5. Fleet rollout"Schedule the datadog-agent 7.55.0 rollout to the staging cluster, weekends only, starting next Saturday."

When to use this vs Datadog's official MCP

Datadog's official MCP (Bits AI MCP, GA 2026-03-09) is complementary, not a replacement:

Official Datadog MCP

@us-all/datadog-mcp (this)

Tool count

16+ core toolsets

163 tools across full API surface

Deployment

Remote (managed by Datadog)

Self-host stdio (npx / Docker / npm)

Auth

Datadog SSO

API + APP key

Sites

Public Datadog sites

Any site, incl. internal/sovereign; US5 default

SLO writes

✅ create/update/delete SLOs + corrections

Fleet automation

✅ 15 tools

Status pages

✅ 21 tools

Aggregation tools

analyze-monitor-state, slo-compliance-snapshot

MCP Prompts

✅ 4 (triage-incident, audit-monitor-noise, analyze-rum-error-spike, investigate-slow-trace)

MCP Resources

dd://service/{serviceName}, dd://team/{teamId}, dd://synthetics/{testId}, etc.

Use the official Bits AI MCP for fast managed onboarding and SSO. Use this when you need full API coverage, SLO/fleet/status-page write parity, or self-hosting (internal sites, isolated networks, dev/CI sandboxes).

Install

Claude Desktop

Add to ~/Library/Application Support/Claude/claude_desktop_config.json:

{
  "mcpServers": {
    "datadog": {
      "command": "npx",
      "args": ["-y", "@us-all/datadog-mcp"],
      "env": {
        "DD_API_KEY": "<your-api-key>",
        "DD_APP_KEY": "<your-app-key>",
        "DD_SITE": "datadoghq.com"
      }
    }
  }
}

Claude Code

claude mcp add datadog -s user \
  -e DD_API_KEY=<your-api-key> -e DD_APP_KEY=<your-app-key> -e DD_SITE=datadoghq.com \
  -- npx -y @us-all/datadog-mcp

Docker

docker run -e DD_API_KEY=... -e DD_APP_KEY=... -e DD_SITE=datadoghq.com \
  ghcr.io/us-all/datadog-mcp-server:latest

Build from source

git clone https://github.com/us-all/datadog-mcp-server.git
cd datadog-mcp-server && pnpm install && pnpm build
node dist/index.js

Configuration

Variable

Required

Default

Description

DD_API_KEY

Datadog API key

DD_APP_KEY

Datadog Application key

DD_SITE

us5.datadoghq.com

Datadog site (see table below)

DD_ALLOW_WRITE

false

Set true to enable mutations (create/update/delete)

DD_TOOLS

Comma-sep allowlist of categories. Only these load — biggest token saver.

DD_DISABLE

Comma-sep denylist. Ignored when DD_TOOLS is set.

MCP_TRANSPORT

stdio

http to enable Streamable HTTP transport

MCP_HTTP_TOKEN

conditional

Bearer token. Required when MCP_TRANSPORT=http

MCP_HTTP_PORT

3000

HTTP listen port

MCP_HTTP_HOST

127.0.0.1

HTTP bind host (DNS rebinding protection auto-enabled for localhost)

MCP_HTTP_SKIP_AUTH

false

Skip Bearer auth — e.g. behind a reverse proxy that handles it

Categories (16): metrics, monitors, dashboards, logs, apm, rum, incidents, security, synthetics, ci, infra, fleet, status-pages, oncall, teams, account.

When MCP_TRANSPORT=http: POST /mcp (Bearer-auth JSON-RPC) + GET /health (public liveness).

Sites:

Site

Value

Region

US1

datadoghq.com

US (Virginia)

US3

us3.datadoghq.com

US (Virginia)

US5

us5.datadoghq.com

US (Oregon)

EU1

datadoghq.eu

EU (Frankfurt)

AP1

ap1.datadoghq.com

Asia-Pacific (Tokyo)

Token efficiency

Naive setup loads ~25K tokens of tool schema before any conversation. Three knobs mitigate:

Scenario

Tools

Schema tokens

vs default

default (all categories)

163

25,200

typical (DD_TOOLS=metrics,monitors,logs,apm,dashboards)

55

9,300

−63%

narrow (DD_TOOLS=metrics,monitors)

24

3,800

−85%

  1. Category togglesDD_TOOLS=metrics,monitors,logs,apm (biggest win).

  2. extractFields response projectionget-dashboard { dashboardId: "abc", extractFields: "id,title,widgets.*.definition.type" }.

  3. search-tools meta-tool — always enabled; lets the LLM discover tools at runtime instead of preloading all schemas.

Read-only mode

By default, all writes are blocked to prevent accidental mutations by AI agents. The following require DD_ALLOW_WRITE=true:

create-monitor, update-monitor, delete-monitor, mute-monitor, create-dashboard, update-dashboard, delete-dashboard, send-logs, post-event, trigger-synthetics, create-synthetics-test, update-synthetics-test, delete-synthetics-test, create-downtime, cancel-downtime, create-case, update-case-status, send-dora-deployment, send-dora-incident, create-slo, update-slo, delete-slo, plus all fleet/status-page/security writes.

MCP Prompts (4)

Workflow templates the model can invoke directly:

  • triage-incident — given an incident ID, walks linked monitors, recent error spikes, and recent deploys.

  • audit-monitor-noise — flag flapping monitors via alert frequency × MTTR.

  • analyze-rum-error-spike — diff RUM error rates across two windows, attribute to top error groups.

  • investigate-slow-trace — given a slow trace ID, traverse the span tree and surface bottleneck spans.

MCP Resources

Read-only entities by URI: dd://monitor/{id}, dd://dashboard/{id}, dd://slo/{id}, dd://incident/{id}, dd://service/{serviceName}, dd://team/{teamId} (team + members), dd://synthetics/{testId}, dd://host/{name}.

Tool reference

163 tools across 16 categories. Use the search-tools meta-tool to discover at runtime; the full list is collapsed below.

Domain

Tools

Status Pages

21

RUM (events + apps + metrics + retention)

27

Metrics, Hosts, SLOs, Downtimes, Containers, Processes

19

Fleet Automation

15

Synthetics, Logs/Spans Metrics, SLO Corrections

16

Monitors, Dashboards, Notebooks, Events

16

Incidents, Cases, Error Tracking, Audit

13

OnCall, Teams, Users, Services, Bots

11

Security signals + rules + suppressions

9

APM, CI Visibility, DORA, Network Devices

9

+ aggregations

analyze-monitor-state, slo-compliance-snapshot

+ meta

search-tools

Metrics (5)

query-metrics, get-metrics, get-metric-metadata, list-active-metrics, list-metric-tags

Monitors (7)

get-monitors, get-monitor, create-monitor, update-monitor, delete-monitor, mute-monitor, validate-monitor, analyze-monitor-state (aggregation)

Dashboards (5)

get-dashboards, get-dashboard, create-dashboard, update-dashboard, delete-dashboard

Logs (3)

search-logs, aggregate-logs, send-logs

Events (2)

get-events, post-event

Incidents (6)

get-incidents, get-incident, search-incidents, create-incident, update-incident, delete-incident

APM (1)

search-spans

RUM (17)

search-rum-events, aggregate-rum, list-rum-applications, get-rum-application, create-rum-application, update-rum-application, delete-rum-application, list-rum-metrics, get-rum-metric, create-rum-metric, update-rum-metric, delete-rum-metric, list-rum-retention-filters, get-rum-retention-filter, create-rum-retention-filter, update-rum-retention-filter, delete-rum-retention-filter

SLOs (6)

list-slos, get-slo, get-slo-history, create-slo, update-slo, delete-slo, slo-compliance-snapshot (aggregation), plus 5 SLO-correction tools

Synthetics (6)

list-synthetics, get-synthetics-result, trigger-synthetics, create-synthetics-test, update-synthetics-test, delete-synthetics-test

Hosts / Containers / Processes (4)

list-hosts, get-host-totals, list-containers, list-processes

Downtimes (3)

list-downtimes, create-downtime, cancel-downtime

Security (9)

search-security-signals, get-security-signal, list-security-rules, get-security-rule, delete-security-rule, list-security-suppressions, get-security-suppression, create-security-suppression, delete-security-suppression

CI Visibility (4)

search-ci-pipelines, aggregate-ci-pipelines, search-ci-tests, aggregate-ci-tests

Cases (4)

list-cases, get-case, create-case, update-case-status

Error Tracking (2)

list-error-tracking-issues, get-error-tracking-issue

DORA (2)

send-dora-deployment, send-dora-incident

Network Devices (2)

list-network-devices, get-network-device

Notebooks (2)

list-notebooks, get-notebook

OnCall (2)

get-team-oncall, get-oncall-schedule

Services & Software Catalog (2)

list-services, get-service-definition

Teams (6)

list-teams, get-team, create-team, update-team, delete-team, get-team-members

Account & Users (2)

get-usage-summary, list-users

Logs/Spans/APM Retention metrics (15)

5 each for logs-metrics, spans-metrics, apm-retention-filters (list/get/create/update/delete)

Status Pages (21)

Full lifecycle: pages, components, degradations, maintenances. See src/tools/status-pages.ts.

Fleet Automation (15)

Agents, deployments, schedules. See src/tools/fleet.ts.

Audit (1)

search-audit-logs

Meta (1)

search-tools — query other tools by keyword; always enabled regardless of DD_TOOLS.

Architecture

Claude → MCP stdio → index.ts → tools/*.ts → @datadog/datadog-api-client → Datadog API

Built on @us-all/mcp-toolkit:

  • extractFields — token-efficient response projections

  • aggregate(fetchers, caveats) — fan-out helper for aggregation tools

  • createWrapToolHandler — domain-specific redaction (DD_API_KEY/DD_APP_KEY) + Datadog ApiException error extraction

  • search-tools meta-tool

Tech stack

Node.js 22+ • TypeScript strict ESM • pnpm • @modelcontextprotocol/sdk@datadog/datadog-api-client (official) • zod • dotenv • vitest + dd-trace.

Contributing

See CONTRIBUTING.md. New shared patterns belong in @us-all/mcp-toolkit — single source of truth for the 7-server suite.

License

MIT

Available Tools

166 tools
aggregate-ci-pipelinesA
Read-only

Aggregate CI/CD pipeline data with statistical computations and grouping

ParametersJSON Schema
NameRequiredDescriptionDefault
queryNoCI pipeline search query for aggregation*
fromYesStart time (ISO 8601 or relative)
toYesEnd time (ISO 8601 or relative)
aggregationYesAggregation type
metricNoMetric to aggregate on (required for avg/sum/min/max/percentiles). Example: @duration
groupByNoField to group results by. Example: @ci.pipeline.name, @ci.status

TDQS

A3.7/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true and openWorldHint=true, indicating a safe, read-only operation. The description adds 'statistical computations and grouping', which provides some behavioral context beyond annotations, but does not detail what is modified or returned.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, front-loaded sentence that conveys the core purpose without any extraneous words. Every word earns its place.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the schema covers all parameters, the description omits what the tool returns—there's no output schema mentioned. The agent would benefit from knowing the response format. The description partially compensates with the schema, but output behavior is missing.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so the description adds no new meaning beyond the schema. The description's mention of 'statistical computations and grouping' aligns with the aggregation and groupBy parameters but doesn't enhance understanding of them.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'aggregate' and the resource 'CI/CD pipeline data', specifying 'statistical computations and grouping'. This distinguishes it from sibling tools like aggregate-ci-tests or aggregate-logs, which target different data types.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description does not explicitly state when to use this tool versus alternatives. The context of sibling names implies it's for pipeline aggregations, but no when-not or alternative guidance is provided.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

aggregate-ci-testsB
Read-only

Aggregate CI test data with statistical computations and grouping

ParametersJSON Schema
NameRequiredDescriptionDefault
queryNoCI test search query for aggregation*
fromYesStart time (ISO 8601 or relative)
toYesEnd time (ISO 8601 or relative)
aggregationYesAggregation type
metricNoMetric to aggregate on. Example: @duration
groupByNoField to group results by. Example: @test.service, @test.status

TDQS

B3.3/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true and openWorldHint=true, so the description adds minimal behavioral context beyond 'statistical computations and grouping'. It does not contradict annotations, but fails to elaborate on behaviors like required time constraints or result format.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, concise sentence with no unnecessary words. It is front-loaded and efficient.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool's moderate complexity (6 parameters, aggregation logic) and lack of output schema, the description feels incomplete. It does not explain what the aggregated result looks like or how groups are returned. However, schema descriptions for parameters are thorough, partially compensating.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The input schema has 100% description coverage for all parameters, so the description adds no additional meaning beyond what is already documented in the schema. Baseline score of 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool aggregates CI test data with statistical computations and grouping, which is specific and distinguishes it from other tools like search-ci-tests. However, it does not explicitly differentiate from sibling aggregate tools like aggregate-ci-pipelines, relying on the resource name 'CI test' for distinction.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides no guidance on when to use this tool versus alternatives such as search-ci-tests for non-aggregated data or aggregate-ci-pipelines for pipeline data. No when-not or context is given.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

aggregate-logsA
Read-only

Aggregate Datadog logs with statistical computations (count, avg, sum, percentiles) and grouping

ParametersJSON Schema
NameRequiredDescriptionDefault
queryYesLog filter query. Example: service:api-server status:error
fromYesStart time (ISO 8601). Example: 2026-02-26T00:00:00Z
toYesEnd time (ISO 8601). Example: 2026-02-26T23:59:59Z
aggregationYesAggregation function. Example: count
metricNoMetric field for non-count aggregations. Example: @duration or @http.response_time
groupByNoField to group by. Example: service or status or @http.status_code

TDQS

A3.7/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

The description aligns with the readOnlyHint and openWorldHint annotations by describing aggregation, which is a read operation. However, it does not disclose any behavioral traits beyond what the annotations already provide, such as query limits or data freshness.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, well-structured sentence that front-loads the key verb and resource. Every word contributes to conveying the tool's purpose without unnecessary detail.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The description covers the aggregation types and grouping, but lacks any mention of the return format (e.g., time series or table) or pagination behavior. Given the absence of an output schema, this information would be valuable for agent understanding.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The input schema has 100% description coverage for all parameters. The description's mention of 'count, avg, sum, percentiles and grouping' provides a high-level summary of the aggregation enum and groupBy parameter but does not add substantial new meaning beyond the schema.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description explicitly states the verb 'Aggregate', the resource 'Datadog logs', and the types of computations ('count, avg, sum, percentiles') and grouping. It clearly distinguishes from sibling tools like 'search-logs' and 'aggregate-ci-pipelines'.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage for aggregated statistical queries via the words 'statistical computations' and 'grouping', but it does not explicitly state when to use this tool over alternatives like 'search-logs' or when not to use it.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

aggregate-rumA
Read-only

Aggregate RUM data with statistical computations (count, avg, percentiles) and grouping by fields

ParametersJSON Schema
NameRequiredDescriptionDefault
queryYesRUM filter query. Example: service:my-app @type:view
fromYesStart time (ISO 8601). Example: 2026-02-26T00:00:00Z
toYesEnd time (ISO 8601). Example: 2026-02-26T23:59:59Z
aggregationYesAggregation function. Example: count or avg
metricNoMetric field for non-count aggregations (e.g. @view.loading_time)
groupByNoField to group by (e.g. @application.id, @view.url_path)

TDQS

A3.9/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true and openWorldHint=true. The description adds behavioral context by detailing the types of statistical computations and grouping operations performed, without contradicting the annotations. It does not describe potential side effects or advanced behaviors like result limits or pagination.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence that is clear and free of unnecessary words. It effectively conveys the core functionality without redundancy.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the absence of an output schema, the description does not explain the return format (e.g., a list of grouped results or a single aggregate). It also omits details like pagination or time range limitations, making it adequate but not fully complete for complex use cases.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so the baseline is 3. The tool description mentions 'count, avg, percentiles' and 'grouping by fields', which map to the 'aggregation' enum and 'groupBy' parameter, but it does not add significant new semantic meaning beyond what the parameter descriptions provide.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'aggregate', the resource 'RUM data', and the type of operations (statistical computations like count, avg, percentiles, and grouping by fields). This effectively distinguishes it from siblings such as 'search-rum-events' (raw event retrieval) and 'create-rum-metric' (metric creation).

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description does not explicitly specify when to use this tool versus alternatives, nor does it provide when-not-to-use guidance. While it implicitly suggests aggregation of RUM data, it lacks direct references to sibling tools or exclusion criteria.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

analyze-monitor-stateA
Read-only

Aggregated monitor view: config + current state + recent triggered events + active downtimes in one call. Replaces 3 round-trips of get-monitor + get-events + list-downtimes.

ParametersJSON Schema
NameRequiredDescriptionDefault
monitorIdYesMonitor ID
hoursBackNoHours to look back for triggered events (default 24)
includeDowntimesNoInclude active downtimes for this monitor (default true)
extractFieldsNoComma-separated dotted paths to project from response (e.g. 'id,name,owner.name,columns.*.name'). Use `*` as wildcard for arrays/objects. Wrap field names with dots in backticks. Reduces response tokens dramatically on large entities.

TDQS

A4.4/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint and openWorldHint. The description adds that the tool aggregates multiple data types into one response, but doesn't detail behavioral aspects like pagination or error handling. Provides useful context beyond annotations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Two sentences with no extraneous content. The first sentence states the primary functionality, and the second provides a clear use-case comparison. Very concise and well-structured.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the read-only nature and good annotations, the description is mostly complete. However, since there is no output schema, a brief note on the structure or format of the aggregated response would improve completeness.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, so parameters are well-defined in the schema. The description does not add additional meaning beyond what the schema provides, but the schema itself is clear. Baseline 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description explicitly states it provides an 'aggregated monitor view' including config, current state, triggered events, and active downtimes, clearly differentiating from sibling tools like get-monitor, get-events, and list-downtimes.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines5/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description says it 'replaces 3 round-trips of get-monitor + get-events + list-downtimes', effectively telling the agent when to use this tool over making separate calls.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

cancel-downtimeA
Destructive

Cancel an active downtime by ID

ParametersJSON Schema
NameRequiredDescriptionDefault
downtimeIdYesDowntime ID to cancel. Example: abc123def456

TDQS

A3.5/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already indicate destructiveHint=true and readOnlyHint=false, signaling a mutating operation. The description confirms cancellation but adds no further behavioral context, such as what happens to associated resources or permission requirements. For a destructive tool, this is adequate but not enhanced beyond annotations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence of 6 words, front-loaded with the action 'Cancel', and contains zero superfluous information. Every word is necessary, achieving maximum conciseness.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool's simplicity (one parameter, no output schema, clear annotations), the description is mostly complete. However, it omits what happens upon success or failure (e.g., confirmation, errors for non-active downtimes), which could be important for the agent. Since no output schema exists, the description should at least hint at the outcome.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% with a single parameter 'downtimeId' fully described in the schema (type, required, example). The description simply says 'by ID', adding no extra semantic value beyond what the schema provides. Baseline 3 is appropriate for high schema coverage.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description 'Cancel an active downtime by ID' uses a specific verb 'cancel' and clearly identifies the resource 'active downtime' and the identifier 'ID'. It effectively distinguishes this tool from sibling tools like 'create-downtime' and 'list-downtimes', which perform different operations.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides no guidance on when to use this tool versus other cancel tools (e.g., cancel-fleet-deployment) or what prerequisites are needed (e.g., obtaining the downtime ID via list-downtimes). It lacks any when-not-to-use or alternative suggestions, leaving the agent without contextual usage cues.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

cancel-fleet-deploymentA
Destructive

Cancel an active fleet deployment and stop pending operations

ParametersJSON Schema
NameRequiredDescriptionDefault
deploymentIdYesThe deployment ID to cancel

TDQS

A4/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

The description adds behavioral context beyond annotations by specifying that it cancels an 'active' deployment and 'stop[s] pending operations', which is useful for understanding side effects.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single concise sentence that conveys the tool's purpose efficiently with no wasted words.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a cancellation tool with one parameter and no output schema, the description covers the core action adequately, though it could mention that the deployment must be active.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, so the description's parameter info adds no extra meaning beyond the schema; baseline 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the action ('Cancel') and the target ('active fleet deployment'), and distinguishes it from sibling tools like 'create-fleet-deployment-*' and 'get-fleet-deployment'.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage for cancelling deployments but does not explicitly state when to use versus alternatives, nor does it mention any exclusions or prerequisites.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

create-apm-retention-filterB

Create an APM retention filter with query, sample rate, and enable/disable

ParametersJSON Schema
NameRequiredDescriptionDefault
nameYesName of the retention filter
filterQueryYesSpan search query. Example: service:web-app AND @duration:>1s
rateYesSample rate (0.0 to 1.0). Example: 1.0 for 100%, 0.5 for 50%
enabledNoWhether the filter is enabled (default true)

TDQS

B3.3/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations are minimal (readOnlyHint=false, openWorldHint=true). The description adds no behavioral details beyond stating it creates the filter. It doesn't mention idempotency, immediate effect, limits, or dependencies, leaving the agent with insufficient info.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence, no redundancy, efficiently conveys the core purpose and key parameters. The entire description earns its place.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple creation tool, the description covers the basic purpose and parameters. However, it omits usage guidelines and behavioral nuances. Given the sibling tools and lack of output schema, it's minimally adequate but not comprehensive.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Input schema has 100% coverage with descriptions for all 4 properties. The description merely paraphrases the parameters ('with query, sample rate, and enable/disable'), adding no new semantic value. Baseline 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the action ('Create'), the resource ('APM retention filter'), and the key properties (query, sample rate, enable/disable). It effectively distinguishes from sibling tools like update and delete filters.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides no guidance on when to use this tool versus alternatives, no prerequisites, no when-not-to-use advice. Siblings like update-apm-retention-filter exist but no comparative context is given.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

create-caseB

Create a new case in Datadog Case Management

ParametersJSON Schema
NameRequiredDescriptionDefault
titleYesCase title
descriptionNoDetailed description of the case
priorityNoCase priorityNOT_DEFINED
typeIdYesCase type ID. Use list-cases to find valid type IDs

TDQS

B3.3/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already indicate write operation (readOnlyHint=false) and potential external effects (openWorldHint=true). The description adds no additional behavioral context beyond the annotations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence, front-loaded with the key purpose, and contains no fluff. It could be slightly more detailed while remaining concise.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The description fails to mention what the tool returns (e.g., case ID), and given the lack of output schema, this is a gap. It also doesn't provide additional context like prerequisites or side effects.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

All parameters are described in the input schema, so the description adds no extra semantic meaning. Baseline 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the action ('Create'), the resource ('new case'), and the domain ('Datadog Case Management'), distinguishing it from sibling tools that create other resources.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides no guidance on when to use this tool vs alternatives like create-incident or create-downtime. There is a hint in the param description for typeId, but no overall usage context.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

create-dashboardA

Create a new Datadog dashboard with widgets

ParametersJSON Schema
NameRequiredDescriptionDefault
titleYesDashboard title. Example: Production Overview
layoutTypeYesLayout type: ordered (auto-arranged) or free (manual placement)
descriptionNoDashboard description
widgetsYesArray of widget definitions (each with a 'definition' key)
tagsNoTags for the dashboard. Example: ["env:prod"]
templateVariablesNoTemplate variables for dynamic filtering

TDQS

A3.5/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already indicate mutation (readOnlyHint=false). The description confirms creation but adds no extra behavioral details such as permissions or side effects beyond what annotations suggest.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence that is concise and front-loaded, containing no unnecessary words.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Lacks information about return values or confirmation, which would be helpful given no output schema. Adequate for a simple creation tool but incomplete for full context.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, so parameters are well-documented. The description adds no additional meaning or examples beyond the schema's property descriptions.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description 'Create a new Datadog dashboard with widgets' uses a specific verb and resource, clearly distinguishing it from sibling tools like update-dashboard and other create tools for different resources.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance provided on when to use this tool versus alternatives like update-dashboard. Missing context for prerequisites or conditions.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

create-downtimeA

Create a downtime to mute monitors by scope, monitor ID, or monitor tags

ParametersJSON Schema
NameRequiredDescriptionDefault
scopeYesDowntime scope. Example: env:prod or host:web-01 or * (all)
startYesStart time as Unix epoch seconds. Example: 1740000000
endNoEnd time as Unix epoch seconds (omit for indefinite). Example: 1740003600
messageNoNotification message. Example: Scheduled maintenance window
monitorIdNoSpecific monitor ID to mute. Example: 12345678
monitorTagsNoMute monitors matching these tags. Example: ["service:api"]
timezoneNoIANA timezone. Example: UTC or America/New_YorkUTC
notifyEndStatesNoStates to notify on end. Example: ["alert", "warn"]

TDQS

A3.6/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations indicate a write operation (readOnlyHint=false), consistent with description. However, description adds no behavioral details beyond creating a downtime, such as side effects, idempotency, or rate limits. No contradiction with annotations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

One sentence, front-loaded with action, no wasted words. Could be slightly more structured to include usage context, but highly concise.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Lacks mention of scheduling (start/end), indefinite downtimes, and return behavior (no output schema). Adequate for basic understanding but incomplete for nuanced use.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% with parameter descriptions. The tool description summarizes the three mute approaches (scope, ID, tags) but adds no new meaning beyond what the schema provides. Baseline 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the action (create a downtime), the resource (downtime), and mechanism (mute monitors by scope, monitor ID, or tags). It distinguishes from siblings like cancel-downtime, list-downtimes, and mute-monitor.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Implied usage from description but no explicit when-to-use, when-not-to-use, or comparisons with alternatives (e.g., mute-monitor). No exclusions or prerequisites mentioned.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

create-fleet-deployment-configureA

Create a deployment to apply configuration changes to hosts matching a filter

ParametersJSON Schema
NameRequiredDescriptionDefault
filterQueryNoDatadog query to target specific hosts
configOperationsYesList of configuration operations to apply

TDQS

A3.8/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already indicate mutation (readOnlyHint=false) and that it creates something in the external system (openWorldHint=true). The description confirms mutation but adds no additional behavioral traits such as asynchronicity, idempotency, or rate limits.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, efficient sentence with no extraneous information. It is front-loaded and every word adds value.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a mutation tool with no output schema and 100% schema coverage, the description is mostly complete. However, it could be improved by briefly mentioning the expected output or any asynchronous behavior, but it adequately conveys the core functionality.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, meaning all parameters are already described in the schema. The description does not add any extra meaning or context beyond what the schema provides, so the baseline score of 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the action 'Create a deployment' and specifies the resource 'fleet deployment' and the purpose 'to apply configuration changes to hosts matching a filter'. It distinguishes this tool from its sibling 'create-fleet-deployment-upgrade' by focusing on configuration changes rather than upgrades.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies the tool is for applying configuration changes to filtered hosts, but does not explicitly state when to use it versus alternatives like 'create-fleet-deployment-upgrade'. No when-not or exclusion criteria are provided.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

create-fleet-deployment-upgradeA

Create a deployment to upgrade Datadog Agent packages on matching hosts

ParametersJSON Schema
NameRequiredDescriptionDefault
filterQueryNoDatadog query to target specific hosts
targetPackagesYesPackages to upgrade with target versions

TDQS

A3.8/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

The description adds context that this is a write operation creating a deployment for upgrades, which aligns with the 'readOnlyHint' of false. However, it does not elaborate on side effects (e.g., whether it triggers immediately, if it can be rolled back, or if it affects existing deployments). The 'openWorldHint' is true, but the description provides no additional behavioral insight beyond the tool's purpose.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence that is direct and free of redundancy. Every word contributes to understanding the tool's function, making it highly concise and well-structured.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given that the tool has only two parameters, no output schema, and annotations are provided, the description covers the essential purpose and scope. It lacks details about return values or asynchronous behavior, but for a create action, the context is largely sufficient for an agent to understand when and how to use it.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The input schema already describes both parameters (filterQuery and targetPackages) thoroughly, achieving 100% coverage. The tool-level description does not add any new meaning or constraints beyond summarizing that the deployment targets 'matching hosts', which is already captured in the schema descriptions.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description explicitly states the verb 'Create', the resource 'deployment', and the specific intent 'to upgrade Datadog Agent packages on matching hosts'. This clearly distinguishes it from the sibling tool 'create-fleet-deployment-configure', which presumably handles configuration changes rather than upgrades.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies the tool should be used when upgrading agent packages on specific hosts, but it does not explicitly state when to use it versus alternatives like 'create-fleet-deployment-configure'. There is no mention of prerequisites, when not to use it, or how it differs from other create tools.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

create-fleet-scheduleB

Create an automated schedule for fleet agent upgrades with maintenance windows

ParametersJSON Schema
NameRequiredDescriptionDefault
nameYesName of the schedule
queryYesFilter query to select target hosts
ruleYesRecurrence rule for the schedule
statusNoSchedule status
versionToLatestNoNumber of versions behind latest to target (0 = latest)

TDQS

B3.1/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations indicate a write operation (readOnlyHint=false) with possible side effects (openWorldHint=true), but the description adds no behavioral traits like authentication needs, resource limits, or what happens to existing schedules.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

A single, front-loaded sentence of 10 words is concise, but it omits important information that could be added without becoming verbose.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the complexity (5 parameters, nested object, no output schema), the description is too minimal. It fails to explain the return value or the purpose of key parameters like query and rule beyond the schema.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100% with detailed parameter descriptions. The tool description adds no extra meaning beyond the schema, so baseline score of 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'create' and resource 'fleet schedule', specifying it is for automated upgrades with maintenance windows. This distinguishes it from sibling tools like create-fleet-deployment-upgrade.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool vs alternatives such as create-fleet-deployment-upgrade or trigger-fleet-schedule. No prerequisites or when-not-to-use information.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

create-incidentA

Create a new Datadog incident with title and customer impact info

ParametersJSON Schema
NameRequiredDescriptionDefault
titleYesThe title of the incident, summarizing what happened
customerImpactedYesWhether the incident caused customer impact
customerImpactScopeNoImpact summary (required if customerImpacted is true)

TDQS

A3.6/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already indicate this is a write operation (readOnlyHint=false) and partially open (openWorldHint=true). The description adds no further behavioral traits such as required permissions, rate limits, or what happens on failure. For a mutation tool without output schema, more disclosure is expected.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, front-loaded sentence with no wasted words. It efficiently conveys the core purpose and key inputs.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool's simplicity (3 params, no output schema, no nested objects), the description is mostly complete. It covers the creation action and required inputs, though it does not mention return value or side effects. Still, it is sufficient for basic guidance.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so the schema already documents all parameters with descriptions. The description's mention of 'title and customer impact info' adds no new meaning beyond what the schema provides. Baseline 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states 'Create a new Datadog incident' specifying the verb and resource. It also mentions key inputs (title, customer impact info), which differentiates it from sibling tools like update-incident or delete-incident.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage for creating incidents but does not provide explicit guidance on when to use this tool versus alternatives like search-incidents or incident-triage-snapshot. No exclusions or context for selection given.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

create-logs-metricB

Create a metric based on log data (count or distribution, with filters and group-by)

ParametersJSON Schema
NameRequiredDescriptionDefault
idYesThe name of the log-based metric. Example: logs.status_code_count
aggregationTypeYesAggregation type. 'count' counts log events, 'distribution' creates a distribution metric
pathNoPath to the metric value. Required for distribution metrics. Example: @duration
includePercentilesNoWhether to include percentile aggregations. Only for distribution metrics
filterQueryNoLog search query to filter events. Example: service:web-app status:error
groupByNoFields to group the metric by

TDQS

B3.2/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations indicate write operation (readOnlyHint=false) but description does not disclose potential side effects, idempotency, or concurrency behavior. No mention of authorization needs or resource limits.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence that is front-loaded with key information. No unnecessary words, though could be slightly more structured with line breaks.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Missing output schema, so description does not explain return values. While description covers aggregation types and filtering, it does not mention that 'path' is required for distribution metrics or detail groupBy structure. Adequate but not complete for a 6-parameter tool.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema covers all 6 parameters with descriptions. Description adds a high-level summary ('count or distribution, with filters and group-by') but does not provide additional meaning beyond the schema. Baseline score for high coverage.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'create', resource 'metric based on log data', and specifies the type (count or distribution) with filters and group-by, distinguishing it from sibling tools like create-rum-metric.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool versus alternatives like create-rum-metric or create-spans-metric. Does not mention prerequisites or when not to use.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

create-monitorB

Create a new Datadog monitor (metric alert, log alert, etc.)

ParametersJSON Schema
NameRequiredDescriptionDefault
nameYesMonitor name
typeYesMonitor type (e.g. metric alert, log alert, query alert, service check)
queryYesMonitor query. Example: avg(last_5m):avg:system.cpu.user{env:prod} > 90
messageNoNotification message (supports @mentions)
tagsNoTags for the monitor
priorityNoPriority 1-5 (1=highest)
optionsNoAdvanced monitor options (thresholds, etc.)

TDQS

B3.3/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already indicate mutation (readOnlyHint=false) and open world (openWorldHint=true). The description confirms creation but adds no extra behavioral context such as idempotency, rate limits, or result. It is adequate but not enriched beyond annotations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

One sentence with front-loaded purpose. The examples in parentheses provide efficient context. Could be slightly more structured but is appropriately concise.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Despite high schema coverage, the description lacks explanation of return values (no output schema), fails to address the complex 'options' nested object, and provides no behavioral context for a 7-parameter tool. Incomplete for effective use.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so the baseline is 3. The description adds no additional meaning to parameters beyond the schema descriptions. It does not compensate for any gaps.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description explicitly states the verb 'Create' and resource 'Datadog monitor', and provides examples of monitor types (metric alert, log alert, etc.). This clearly differentiates it from sibling tools like update-monitor or delete-monitor.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides no guidance on when to use this tool versus alternatives like create-dashboard or create-slo. No prerequisites, exclusions, or context for selection are mentioned.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

create-rum-applicationB

Create a new RUM application (browser, ios, android, react-native, flutter, etc.)

ParametersJSON Schema
NameRequiredDescriptionDefault
nameYesName of the RUM application
typeNoType of the RUM application. Default: browserbrowser

TDQS

B3.3/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already indicate readOnlyHint=false and openWorldHint=true. The description adds no additional behavioral context beyond the action itself, such as side effects, quota implications, or naming constraints. It does not contradict annotations but fails to leverage the openWorldHint to provide deeper insight.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence, front-loading the purpose with no extraneous text. Every word earns its place, making it highly efficient for an agent to quickly understand the tool's function.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given no output schema, the description does not indicate what the tool returns (e.g., the created application ID or metadata). The openWorldHint suggests side effects but none are described. For a simple creation tool, the description is minimal but lacks completeness for agents needing post-creation guidance.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% with both parameters described. The description lists types in parentheses but this is redundant with the enum defined in the schema. No additional semantic meaning is provided beyond what the schema already offers, resulting in a baseline score.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description explicitly states 'Create a new RUM application' followed by a list of supported types, clearly indicating the action and resource. This distinguishes it from related tools like update-rum-application, delete-rum-application, and list-rum-applications, providing specific verb+resource differentiation.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance is provided on when to use this tool vs. alternatives such as update-rum-application or delete-rum-application. There is no mention of prerequisites, idempotency, or that listing existing apps should be done with list-rum-applications.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

create-rum-metricA

Create a metric based on RUM data (count or distribution, with filters and group-by)

ParametersJSON Schema
NameRequiredDescriptionDefault
idYesThe name of the rum-based metric. Example: rum.page_view_count
eventTypeYesThe RUM event type to use. Example: view
aggregationTypeYesAggregation type. 'count' counts events, 'distribution' creates a distribution metric
pathNoPath to the metric value. Required for distribution metrics. Example: @view.loading_time
includePercentilesNoWhether to include percentile aggregations. Only for distribution metrics
filterQueryNoRUM search query to filter events. Example: @service:my-app @view.url_path:/checkout
groupByNoFields to group the metric by
uniquenessWhenNoWhen to count uniqueness. Only for session/view event types. 'match' = when event matches, 'end' = when session/view ends

TDQS

A3.6/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations indicate readOnlyHint=false (mutates) and openWorldHint=true. The description adds operational context (filters, group-by) but does not detail side effects, permissions, or lifecycle. Consistent with annotations, no contradiction.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single concise sentence that is front-loaded with key action and resource. No wasted words, appropriate length.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

No output schema, and the description does not explain what the created metric does, where it appears, or how to use it later. Lacks completeness for a creation tool, especially with 8 parameters.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, so the description adds little beyond summarizing parameter options (e.g., 'count or distribution'). It does not provide additional semantics not already in the schema. Baseline 3 applies.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'create', the resource 'metric based on RUM data', and specifies the capabilities (count or distribution, with filters and group-by). This distinguishes it from siblings like 'create-logs-metric'.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage for creating RUM metrics but lacks explicit guidance on when to use this tool versus other metric creation tools or when to choose count vs distribution. No when-not-to-use or alternative suggestions.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

create-rum-retention-filterB

Create a RUM retention filter with event type, sample rate, and query

ParametersJSON Schema
NameRequiredDescriptionDefault
appIdYesRUM application ID
nameYesName of the retention filter. Example: Keep all errors
eventTypeYesRUM event type to filter on. Example: error
sampleRateYesSample rate between 0 and 100. Example: 100
queryNoRUM search query to filter events. Example: @error.source:network
enabledNoWhether the filter is enabled. Default: true

TDQS

B3.1/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already indicate write operation (readOnlyHint: false) and open-world side effects. The description adds no extra behavioral details, such as permissions required, idempotency, or immediate application of the filter. It does not disclose any traits beyond the basic action.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single concise sentence, front-loaded with the core purpose. It is efficient, but could include slightly more context without becoming verbose, such as mentioning the return value or the purpose of retention filters.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Despite having 6 parameters and no output schema, the description does not explain what the tool returns or how the creation affects the system. It lacks information about retention filter semantics, error conditions, or confirmation of success. More detail is needed for full contextual completeness.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, with each parameter described in the input schema. The tool description only mentions three parameters (event type, sample rate, query) and does not add meaning beyond the schema. It neither clarifies relationships nor constraints, so it meets the baseline for high coverage but does not exceed it.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states 'Create a RUM retention filter', specifying the verb (create) and the resource (RUM retention filter). It distinguishes itself from sibling tools like 'create-apm-retention-filter' and other create tools for different resources, making it unambiguous.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides no guidance on when to use this tool versus alternatives, such as when to create vs. update a filter, or any prerequisites. There are no contextual hints for usage decisions.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

create-security-suppressionB

Create a security monitoring suppression rule to suppress signals matching a query

ParametersJSON Schema
NameRequiredDescriptionDefault
nameYesName of the suppression rule
ruleQueryYesRule query — detection rules matching this query will have signals suppressed. Same syntax as search bar
descriptionNoDescription of the suppression rule
enabledNoWhether the suppression rule is enabled (default true)
suppressionQueryNoSuppression query — signals matching this query are suppressed
dataExclusionQueryNoData exclusion query — input events matching this are excluded from detection
expirationDateNoISO 8601 expiration date — after this date, suppression stops

TDQS

B3.4/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations show readOnlyHint=false (mutation) and openWorldHint=true. The description does not add behavioral details beyond creation; no mention of side effects, permissions, or lifecycle.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence with front-loaded verb and resource. No unnecessary words.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a 7-parameter tool with full schema descriptions and no output schema, the description adequately captures the core function. Could expand on subtle distinctions between query fields, but not required.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so parameter meanings are already explicit. The description adds no additional context beyond what the schema provides, earning a baseline of 3.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'Create' and the resource 'security monitoring suppression rule', with the specific purpose 'to suppress signals matching a query'. This distinguishes it from sibling tools like delete-security-suppression and list-security-suppressions.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool versus alternatives (e.g., other create tools). It does not specify prerequisites, when not to use, or trade-offs.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

create-sloB

Create a new Service Level Objective (monitor-based, metric-based, or time-slice). Write-gated.

ParametersJSON Schema
NameRequiredDescriptionDefault
nameYesSLO name
typeYesSLO type. 'monitor' uses linked monitors; 'metric' uses a numerator/denominator query; 'time_slice' uses time-slice SLI
thresholdsYesOne or more {target, timeframe, warning?} entries
descriptionNoSLO description
monitorIdsNoRequired if type='monitor'. List of linked monitor IDs
queryNoRequired if type='metric'
tagsNoTags. Example: ['env:prod', 'team:backend']
targetThresholdNoConvenience: target % (e.g. 99.9)
warningThresholdNoConvenience: warning %

TDQS

B3.4/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Description adds 'Write-gated' which reinforces readOnlyHint=false annotation. However, it lacks details on permissions, side effects, or error behavior. Annotations already cover write nature, so description adds marginal value.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence, front-loaded with key action and types. 'Write-gated' adds relevant behavioral note. No wasted words.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Tool has 9 parameters with nested objects, no output schema. Description does not mention return value (e.g., created SLO ID) or common prerequisites/errors. Incomplete for a create operation with high complexity.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% with detailed parameter descriptions. The description does not add any parameter information beyond what the schema provides. Baseline 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Description clearly states 'Create a new Service Level Objective' with explicit types (monitor-based, metric-based, time-slice). Distinguishes from siblings like update-slo and create-slo-correction. Verb+resource+scope is specific.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool versus alternatives (e.g., update-slo for modifications). Only mentions 'Write-gated' which is behavioral, not usage context.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

create-slo-correctionB

Create an SLO correction to exclude a time period from SLO calculations (maintenance, deployments)

ParametersJSON Schema
NameRequiredDescriptionDefault
sloIdYesThe SLO ID to apply the correction to
categoryYesCategory of the correction
startYesISO 8601 start time of the correction period
endNoISO 8601 end time. Required if duration is not provided
durationNoDuration in seconds. Required if end is not provided
descriptionNoDescription of the correction
timezoneNoTimezone for display (defaults to UTC). Example: Asia/Seoul
rruleNoRecurrence rule (RFC 5545 RRULE). Example: FREQ=WEEKLY;INTERVAL=1;BYDAY=SA,SU

TDQS

B3.4/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations indicate a write operation (readOnlyHint=false) but the description lacks details on side effects, required permissions, or state changes. The openWorldHint=true is not explained. Minimal behavioral context beyond the basic purpose.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence front-loads purpose and examples, with no unnecessary words. Could possibly include a usage hint, but remains efficient.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For an 8-parameter tool with no output schema, the description and schema together cover the essential information. Missing guidance on recurrence handling, duration vs end relationship, and potential error cases, but sufficient for basic use.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so each parameter has a documented description. The description adds no additional meaning beyond what the schema already provides, meeting the baseline for high coverage.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Description clearly states the verb ('Create'), resource ('SLO correction'), and purpose ('to exclude a time period from SLO calculations') with specific examples (maintenance, deployments). It distinguishes from sibling tools like 'create-slo' and 'delete-slo-correction'.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Description implies usage for maintenance and deployments but does not explicitly state when to use this tool versus alternatives like 'create-downtime' or other exclusion mechanisms. No guidance on prerequisites or when not to use.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

create-spans-metricA

Create a metric based on APM span data (count or distribution, with filters and group-by)

ParametersJSON Schema
NameRequiredDescriptionDefault
idYesThe name of the span-based metric. Example: spans.request_duration
aggregationTypeYesAggregation type. 'count' counts span events, 'distribution' creates a distribution metric
pathNoPath to the metric value. Required for distribution metrics. Example: @duration
includePercentilesNoWhether to include percentile aggregations. Only for distribution metrics
filterQueryNoAPM search query to filter spans. Example: service:web-app resource_name:GET_/api/users
groupByNoFields to group the metric by

TDQS

A3.8/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations provide basic safety profile (non-read-only, open world). The description adds no further behavioral details such as side effects, permissions, or whether the metric persists. With openWorldHint=true, more context would be helpful.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single 12-word sentence that front-loads the key purpose. Every word earns its place; no wasted content.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool's complexity (6 parameters, nested groupBy) and absence of output schema, the description covers the core function. It could mention persistence or querying, but it is adequate for a creation tool with a clear schema.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, so the description does not need to add much. It restates the aggregation types but adds no new meaning beyond the schema. Baseline 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool creates a metric from APM span data, specifying aggregation types (count/distribution) and mentioning filters and group-by. It effectively distinguishes from sibling tools like create-logs-metric and create-rum-metric.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage for APM span data, which is sufficient context. However, it does not explicitly state when not to use it or list alternatives, but the domain is clear.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

create-status-pageA

Create a new status page with name, domain prefix, and type (public/internal)

ParametersJSON Schema
NameRequiredDescriptionDefault
nameYesName of the status page
domainPrefixYesUnique domain prefix for the status page URL
typeYesPage type: public (internet-accessible) or internal (org-only)
visualizationTypeYesVisualization type (currently only 'component_list')
subscriptionsEnabledNoWhether email subscriptions are enabled

TDQS

A3.5/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already indicate this is a write operation (readOnlyHint=false). The description does not add behavioral traits beyond creating, such as permissions required, side effects, or reversibility. For a mutation tool, more transparency would be helpful.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence that effectively front-loads the action and key parameters. Every word is purposeful, with no unnecessary information.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The description covers the main purpose of creating a status page but does not mention the optional parameter (subscriptionsEnabled) or provide details on the response or post-creation behavior. Given the tool has 5 parameters and no output schema, slightly more context would be beneficial.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%. The description merely repeats 'name, domain prefix, and type' which are already documented in the schema. It adds no new semantic meaning beyond what the schema provides, so baseline score of 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description specifies the action 'Create' and the resource 'status page', and mentions key attributes (name, domain prefix, type). It clearly distinguishes from sibling tools like 'create-status-page-component' or 'update-status-page'.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description does not provide explicit guidance on when to use this tool versus alternatives, such as when to choose between public/internal type or prerequisites. It is implied for creating a new status page but lacks contextual instructions.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

create-status-page-componentB

Create a component or group on a status page

ParametersJSON Schema
NameRequiredDescriptionDefault
pageIdYesThe status page ID
nameYesName of the component
positionYesDisplay position (0-based)
typeYesType: 'component' for a single item, 'group' for a group of components

TDQS

B3.3/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations indicate this is a write operation (readOnlyHint=false) and open world (openWorldHint=true). The description only restates the core purpose without revealing behavioral traits like idempotency, side effects, or what happens on duplicate names. Minimal value added beyond annotations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single concise sentence with no filler. It efficiently conveys the core purpose, though it could benefit from structured bullet points for complex use cases.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

No output schema is provided, and the description does not mention the return value or response format. For a tool with 4 required parameters, this leaves uncertainty about what happens after creation, making it less complete for decision-making.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so the schema already documents all parameters. The description adds no extra meaning beyond mentioning 'component or group', which aligns with the 'type' enum. Baseline score is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the action ('Create') and the resource ('component or group on a status page'). It distinguishes from sibling tools like 'create-status-page' and 'create-status-page-degradation' by specifying the exact entity being created.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No explicit guidance on when to use this tool vs alternatives. Usage is implied by the name and description, but there is no mention of prerequisites, context, or conditions that would help an agent decide.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

create-status-page-degradationB

Create a degradation incident on a status page with affected components

ParametersJSON Schema
NameRequiredDescriptionDefault
pageIdYesThe status page ID
titleYesTitle of the degradation incident
statusYesCurrent status of the degradation
descriptionNoDescription of the degradation
componentsAffectedYesList of affected components with their status
notifySubscribersNoWhether to notify page subscribers

TDQS

B3.4/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations indicate readOnlyHint=false (write operation) and openWorldHint=true. Description aligns with creation, but lacks additional behavioral details such as whether notifications are sent, lifecycle management, or what happens after creation. Adequate but not enriched beyond annotations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence, front-loaded with key action and resource. No unnecessary words or repetition.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Despite 6 parameters and nested objects, description provides no context about creation effects, follow-up actions, or relationship to other status page tools (e.g., update-status-page-degradation). Incomplete for a complex write operation.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so the schema already documents all parameters. Description adds no new semantic meaning beyond restating 'with affected components'. Baseline of 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Description clearly states 'Create a degradation incident on a status page with affected components', specifying the action, resource, and key constraint (with affected components). This distinguishes it from sibling tools like create-status-page or create-status-page-maintenance.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool versus alternatives (e.g., create-incident, create-status-page-maintenance). No exclusions, prerequisites, or context provided about appropriate use cases.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

create-status-page-maintenanceA

Schedule a maintenance window on a status page with affected components

ParametersJSON Schema
NameRequiredDescriptionDefault
pageIdYesThe status page ID
titleYesTitle of the maintenance window
startDateNoScheduled start date (ISO 8601 format)
scheduledDescriptionNoDescription shown when maintenance is scheduled
inProgressDescriptionNoDescription shown when maintenance is in progress
completedDescriptionNoDescription shown when maintenance is completed
componentsAffectedYesList of affected components
notifySubscribersNoWhether to notify page subscribers

TDQS

A3.5/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations indicate this is a write operation (readOnlyHint=false) with potential side effects (openWorldHint=true). The description mentions scheduling but doesn't elaborate on impacts like display changes or subscriber notifications. It doesn't contradict annotations, but provides only basic behavioral context.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, clear sentence that conveys the core function. While concise, it could benefit from a brief note on when to use it. Still, it avoids unnecessary verbosity.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool has 8 parameters and no output schema, the description is too minimal. It doesn't mention what the tool returns (e.g., the created maintenance object ID) or provide behavioral context like notification behavior. This leaves gaps for the agent.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

All 8 parameters are fully described in the input schema (100% coverage), so the description need not repeat them. The description adds no new information beyond the schema; it only notes 'affected components' which is already covered. Baseline score of 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool's action ('schedule a maintenance window on a status page') and specifies it involves affected components. This distinguishes it from sibling tools like create-status-page-degradation (for incidents) and update-status-page-maintenance (for updates).

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description does not provide explicit guidance on when to use this tool versus alternatives. For instance, it doesn't clarify that this is for planned maintenance as opposed to unplanned incidents handled by create-status-page-degradation. Usage is implied but not clearly differentiated.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

create-synthetics-testA

Create a new Synthetics API test (HTTP, SSL, TCP, DNS, etc.)

ParametersJSON Schema
NameRequiredDescriptionDefault
nameYesTest name. Example: API Health Check - Production
typeYesTest type (api)
subtypeNoTest subtype. Example: httphttp
urlYesURL to test. Example: https://api.example.com/health
methodNoHTTP method. Example: GET, POST, PUTGET
locationsYesTest locations. Example: ["aws:us-east-1", "aws:eu-west-1"]
messageNoNotification message. Example: API is down @slack-alerts
tagsNoTags for the test. Example: ["env:prod", "team:platform"]
statusNoInitial test statuspaused
assertionsNoResponse assertions. Example: [{"type":"statusCode","operator":"is","target":200}]

TDQS

A3.5/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations indicate readOnlyHint=false (write operation) and openWorldHint=true (may create resources beyond input). The description says 'create', which aligns with write, but does not add context about side effects, permissions, or state changes. Since annotations already cover the basic behavioral profile, the description adds minimal value.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence that is concise and front-loaded with the key information. However, it could be slightly expanded to include usage context without becoming verbose. It is efficient but borderline too brief for a complex tool.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a creation tool with 10 parameters, 4 required, and no output schema, the description is incomplete. It does not mention what happens after creation (e.g., return value like test ID), how to reference the created test, or any follow-up steps. The sibling tools include delete and update, so users would benefit from knowing about the returned identifier.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so the baseline is 3. The description mentions subtypes (HTTP, SSL, etc.) but does not add meaning beyond what the schema provides. Each parameter already has descriptive examples in the schema, so the description adds no additional semantic value.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the action (create), the resource (Synthetics API test), and includes examples of subtypes like HTTP, SSL, TCP, etc. This distinguishes it from sibling tools like create-monitor or create-dashboard.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage when creating a synthetics test, but it does not provide explicit guidance on when to use this tool over alternatives like create-monitor, nor does it mention any prerequisites or exclusions. The sibling list includes many creation tools, but no differentiation is given.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

create-teamB

Create a new Datadog team with name, handle, and description

ParametersJSON Schema
NameRequiredDescriptionDefault
nameYesThe name of the team
handleYesThe team's unique identifier/handle (lowercase, hyphens allowed)
descriptionNoFree-form markdown description for the team's homepage

TDQS

B3.3/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations show readOnlyHint=false and openWorldHint=true, indicating a write operation that may create resources beyond specified. The description only confirms creation but adds no additional behavioral context like permissions, side effects, or constraints.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence with no redundancy, front-loaded with purpose and key parameters.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Adequate for a simple creation tool but lacks usage guidelines and behavioral details. With no output schema, the description does not explain return value, which is a minor gap.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema covers all 3 parameters with descriptions (100% coverage). The description merely lists them, adding no extra meaning beyond the schema.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'create' and resource 'Datadog team', specifying required fields (name, handle, description). This distinguishes it from sibling tools like update-team or delete-team.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use create-team versus alternatives like update-team or delete-team. Does not mention prerequisites, context, or when not to use.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

delete-apm-retention-filterB
Destructive

Delete an APM retention filter by ID

ParametersJSON Schema
NameRequiredDescriptionDefault
filterIdYesThe retention filter ID to delete

TDQS

B3.1/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already indicate destructiveHint=true, so description adds no new behavioral context. It doesn't mention irreversibility, cascading effects, or lack of return value.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Extremely concise single sentence. However, given the destructive nature, a brief warning or note on irreversibility would improve without sacrificing conciseness.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a destructive operation with no output schema and simple input, the description is too minimal. It could mention the operation has no return value or confirm deletion, which is critical context.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% with a clear parameter description. The description's 'by ID' repeats the schema. No additional meaning about ID format, source, or validation is provided.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb (delete), resource (APM retention filter), and method (by ID). It distinguishes from sibling tools like delete-rum-retention-filter by specifying the resource type.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool versus alternatives, no mention of prerequisites such as filter existence or permissions. The description provides no context for the agent to decide between this and other delete tools.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

delete-dashboardB
Destructive

Delete a Datadog dashboard by ID

ParametersJSON Schema
NameRequiredDescriptionDefault
dashboardIdYesDashboard ID to delete. Example: abc-def-ghi

TDQS

B3.2/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Description does not add behavioral details beyond annotations. Annotations already indicate destructiveHint=true, but no info on reversibility, permissions, or side effects.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence with no wasted words. Could be improved by front-loading key info, but adequate.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a delete tool with one parameter, description is mostly adequate but missing details like whether response is empty or includes deleted object. No output schema.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% with a clear description and example. Description adds no extra meaning; baseline 3 applies.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Clearly states verb 'Delete', resource 'Datadog dashboard', and method 'by ID'. Distinguishes from sibling delete-* tools for other resources.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool vs alternatives like update-dashboard or get-dashboard. No prerequisites or when-not-to-use information.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

delete-fleet-scheduleA
Destructive

Delete a fleet upgrade schedule permanently

ParametersJSON Schema
NameRequiredDescriptionDefault
idYesThe schedule ID to delete

TDQS

A3.5/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already include destructiveHint=true and readOnlyHint=false. The description adds value by specifying that the deletion is 'permanent', reinforcing the destructive nature. No contradictions.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, efficient sentence with no clutter or repetition.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple deletion tool with one parameter and no output schema, the description is adequate. However, it lacks usage guidelines and does not explain return values or side effects beyond what annotations already indicate.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% with a single parameter 'id' documented. The description does not add any extra meaning beyond the schema, so baseline score applies.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the action 'Delete' and the resource 'fleet upgrade schedule', distinguishing it from sibling tools like 'cancel-fleet-deployment' and 'update-fleet-schedule'.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines1/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool versus alternatives, prerequisites, or when not to use it. Sibling tools include other delete operations, but no differentiation is provided.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

delete-incidentA
Destructive

Delete a Datadog incident by ID

ParametersJSON Schema
NameRequiredDescriptionDefault
incidentIdYesThe incident ID to delete

TDQS

A3.5/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already indicate destructiveHint=true, so the agent knows it's a destructive action. The description adds 'by ID' but does not disclose if deletion is permanent, cascading effects, or error conditions. Minimal added value beyond annotations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Extremely concise: one sentence, front-loaded with key action. No wasted words, exactly as needed for a simple tool.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple delete tool with no output schema, the description could mention expected outcome (e.g., success response, no content) or missing ID behavior. It lacks these details, making it slightly incomplete.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema covers 100% of parameters (incidentId) with description. The tool description merely restates 'by ID', adding no new semantics beyond the schema's field description.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Description clearly states the verb 'Delete', resource 'Datadog incident', and method 'by ID'. It is specific and distinguishes from sibling tools like update-incident or get-incident.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool versus alternatives, such as the related incident tools (e.g., update-incident, incident-triage-snapshot). No preconditions or when-not-to-use information provided.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

delete-logs-metricB
Destructive

Delete a log-based metric by name

ParametersJSON Schema
NameRequiredDescriptionDefault
metricIdYesThe name of the log-based metric to delete

TDQS

B3.3/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

The annotations already declare destructiveHint=true, so the description's 'Delete' is consistent. However, it adds no additional behavioral context like irreversibility, permission requirements, or side effects. The description neither contradicts nor enriches the annotations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

A single sentence that is front-loaded with the action and resource. No redundant words; every word is functional.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple deletion tool with one required parameter and no output schema, the description is minimally adequate. It could be improved with a note about permanence or confirmation, but given the destructiveHint annotation, the current state is acceptable.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, and the parameter description explains what metricId is. The tool description reinforces 'by name', but adds no new semantic detail beyond the schema.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

Clearly states the action 'Delete' and the resource 'log-based metric', and specifies the key parameter 'by name'. While it doesn't explicitly differentiate from other delete tools, the resource specificity is clear enough to avoid confusion with most sibling tools.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance is provided on when to use this tool versus alternatives (e.g., update-logs-metric, get-logs-metric). It does not mention prerequisites, such as whether the metric must exist first, or any consequences.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

delete-monitorB
Destructive

Delete a Datadog monitor by ID

ParametersJSON Schema
NameRequiredDescriptionDefault
monitorIdYesMonitor ID to delete
forceNoForce delete even if referenced by other resources

TDQS

B3.4/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

The annotation destructiveHint already signals destructive behavior. The description adds no further behavioral context (e.g., irreversibility, side effects on associated resources, required permissions).

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

A single sentence that is concise, front-loaded with the action, and contains no waste. Every word serves a purpose.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple tool with 2 parameters and no output schema, the description combined with annotations is largely adequate. It could improve by noting the force parameter's effect on deletion behavior.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% and includes descriptions for both parameters. The description does not add additional meaning beyond what the schema already provides, meeting the baseline.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the action (delete), the resource (Datadog monitor), and the identifier method (by ID). It distinguishes from sibling tools like update-monitor, mute-monitor, and validate-monitor.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool versus alternatives, nor any prerequisites or conditions. The description lacks context for proper selection among siblings.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

delete-rum-applicationA
Destructive

Delete a RUM application by ID

ParametersJSON Schema
NameRequiredDescriptionDefault
idYesRUM application ID to delete

TDQS

A3.6/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

The description matches the annotations (destructiveHint=true, readOnlyHint=false) by stating 'Delete'. However, it adds no additional behavioral details such as whether deletion is irreversible, requires special permissions, or triggers side effects. With annotations already providing the destructive nature, a score of 3 is appropriate.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence of 6 words, perfectly front-loaded with the action and resource. Every word serves a purpose with no redundancy.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple destructive action with one parameter and no output schema, the description is nearly complete. It could optionally note that deletion is irreversible, but the destructiveHint annotation already conveys that. The description does not repeat what's in structured fields, making it efficiently complete.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The single parameter 'id' is fully described in the schema as 'RUM application ID to delete'. The description's phrase 'by ID' adds no new meaning beyond the schema, which already achieves 100% coverage. Baseline 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb (delete), resource (RUM application), and identifier method (by ID). It effectively distinguishes from sibling tools like create-rum-application, update-rum-application, and get-rum-application, as well as other delete tools for different resources.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description gives no guidance on when to use this tool versus alternatives, nor does it warn about destructive consequences or prerequisites beyond the schema. Despite the destructiveHint annotation, the description does not explicitly state 'only use if you are sure' or compare with update-rum-application.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

delete-rum-metricA
Destructive

Delete a rum-based metric by name

ParametersJSON Schema
NameRequiredDescriptionDefault
metricIdYesThe name of the rum-based metric to delete

TDQS

A3.7/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare destructiveHint: true, indicating the destructive nature. The description adds 'by name' but does not elaborate on behavioral traits beyond what annotations provide. No contradictions.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, concise sentence with no unnecessary words. It is front-loaded and efficient.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple delete operation with one parameter and annotations providing destructive hint, the description, schema, and annotations together are complete. No additional context is needed.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100% (metricId has a description). The main description does not add meaning beyond the schema, so baseline 3 applies.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the action (delete) and the resource (rum-based metric), using a specific verb and noun. It distinguishes from sibling delete tools by specifying 'rum-based', making the purpose unambiguous.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance is provided on when to use this tool versus alternatives like delete-logs-metric or delete-spans-metric. The agent must infer based on resource type without explicit when/when-not instructions.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

delete-rum-retention-filterA
Destructive

Delete a RUM retention filter by ID

ParametersJSON Schema
NameRequiredDescriptionDefault
appIdYesRUM application ID
filterIdYesRetention filter ID (UUID) to delete

TDQS

A3.6/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

The annotations already indicate destructiveHint=true and readOnlyHint=false. The description adds no additional behavioral context beyond the identifier method. It does not contradict annotations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence of 6 words, conveying the essential information without any fluff. It is perfectly concise.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the annotations (destructiveHint=true) and simple param schema, the description is nearly complete. However, adding a note about irreversibility or required permissions would strengthen it.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, and both parameters have clear descriptions in the schema. The description 'by ID' adds no extra meaning beyond what the schema already provides.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states 'Delete a RUM retention filter by ID', specifying the action (delete), resource (RUM retention filter), and identifier (ID). This distinguishes it from sibling tools like create, update, get, and list.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides no guidance on when to use this tool versus alternatives, such as prerequisites, irreversibility, or when not to use it. It fails to aid the agent in decision-making.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

delete-security-ruleA
Destructive

Delete a security monitoring detection rule by ID

ParametersJSON Schema
NameRequiredDescriptionDefault
ruleIdYesThe security monitoring rule ID to delete

TDQS

A3.7/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already indicate destructiveHint=true and readOnlyHint=false, so the description's 'delete' is consistent. However, the description adds no extra behavioral context beyond what annotations provide, such as what happens if the rule doesn't exist or if there are dependencies.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence of 9 words, efficiently conveying the tool's purpose without any redundancy. It is front-loaded with the key action and resource.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple delete operation with one required parameter and no output schema, the description is sufficient. It tells the agent exactly what the tool does and what input is needed.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% with parameter 'ruleId' already described as 'The security monitoring rule ID to delete'. The description adds no further detail or guidance on the parameter's format or constraints.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the action 'delete' and the resource 'security monitoring detection rule' with the method 'by ID'. It is specific and distinguishes from sibling delete tools like delete-dashboard and delete-monitor.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance is provided on when to use this tool versus alternatives such as delete-security-suppression. There is no mention of prerequisites, potential side effects, or when not to use it.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

delete-security-suppressionA
Destructive

Delete a security monitoring suppression rule by ID

ParametersJSON Schema
NameRequiredDescriptionDefault
suppressionIdYesThe suppression rule ID to delete

TDQS

A3.6/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already indicate destructiveHint=true and readOnlyHint=false. The description adds 'delete' which aligns with the destructive nature, but does not provide additional behavioral context like irreversibility or required permissions beyond what annotations offer.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence that is concise and front-loaded. No extraneous information or fluff.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the simplicity of the tool (one parameter, no nested schemas, destructive annotations), the description adequately covers the action. However, it could mention effects or success/failure behavior for completeness.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The single parameter 'suppressionId' is fully described in the schema (100% coverage). The description only repeats 'by ID' without adding new meaning or usage details beyond the schema.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description 'Delete a security monitoring suppression rule by ID' uses a specific verb ('Delete') and a specific resource ('security monitoring suppression rule'), and clearly distinguishes it from sibling tools like create, get, and list security suppressions.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides no guidance on when to use this tool versus alternatives, such as conditions for deletion or prerequisites. It only states the action, missing context for proper usage.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

delete-sloA
Destructive

Delete an SLO by ID. Pass force='true' to delete even if linked to dashboards. Write-gated.

ParametersJSON Schema
NameRequiredDescriptionDefault
sloIdYesSLO ID to delete
forceNo'true' to force delete even if linked dashboards exist

TDQS

A4.4/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Adds context beyond annotations: mentions 'Write-gated' and force behavior. Annotations already indicate destructiveHint=true. No contradictions.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Two sentences, no fluff, front-loaded key information.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Covers main behavior, force parameter, and key edge case (linked dashboards). No output schema, so return info not required. Adequate for a simple delete tool.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, but description adds meaningful context for force parameter beyond schema description. For sloId, schema is sufficient.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Clearly states the verb 'Delete' and resource 'SLO by ID', with additional behavior for force deletion. Distinct from sibling tools like create-slo, update-slo, etc.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Provides guidance on when to use the force parameter ('to delete even if linked to dashboards'). Implies caution when dashboards are linked. Lacks explicit when-not-to-use or comparison to other delete tools, but sufficient for this context.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

delete-slo-correctionA
Destructive

Delete an SLO correction by ID

ParametersJSON Schema
NameRequiredDescriptionDefault
sloCorrectionIdYesThe SLO correction ID to delete

TDQS

A3.8/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already mark this as destructive and open-world. The description adds no extra behavioral context beyond the word 'delete', which is minimal. It does not mention irreversibility or side effects.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

One short sentence that front-loads the action. No unnecessary words, and every word adds value.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple tool with one parameter, annotations, and no output schema, the description is functionally complete. It could mention irreversibility for completeness, but it's not required.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, and the parameter description 'The SLO correction ID to delete' provides clear meaning beyond the field name. It explains exactly what the ID is for.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the action (delete), the resource (SLO correction), and the identifier (by ID). It distinguishes from sibling tools like create, update, get, and list.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool versus alternatives (e.g., updating to deactivate) or prerequisites like knowing the ID. The description does not mention best practices or when not to delete.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

delete-spans-metricA
Destructive

Delete a span-based metric by name

ParametersJSON Schema
NameRequiredDescriptionDefault
metricIdYesThe name of the span-based metric to delete

TDQS

A3.5/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

The annotations already indicate destructiveHint=true, so the description's 'Delete' is consistent but adds no further behavioral details such as irreversibility, permissions needed, or side effects. The description does not go beyond what the annotations provide.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, concise sentence that immediately conveys the tool's purpose. There is no redundant or extraneous text.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple delete tool with one parameter, annotations covering destructiveness, and no output schema, the description is sufficiently complete. No additional information is needed.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

With 100% schema description coverage, the schema already documents the metricId parameter. The description's mention of 'by name' adds minimal additional meaning beyond what the parameter description provides, so a baseline score of 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the action (delete), the resource (span-based metric), and the identifier method (by name). It effectively distinguishes this tool from siblings like delete-logs-metric or delete-rum-metric.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance is provided on when to use this tool versus alternatives, nor any prerequisites or contexts that would make it appropriate or inappropriate. The description only states what it does.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

delete-status-pageB
Destructive

Delete a status page by ID

ParametersJSON Schema
NameRequiredDescriptionDefault
pageIdYesThe status page ID to delete

TDQS

B3.2/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already indicate destructiveHint: true and readOnlyHint: false, so the description adds minimal value. It does not disclose any additional behavioral traits like cascading effects, reversibility, or permissions required beyond what annotations imply.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, efficient sentence without extraneous words. It is appropriately front-loaded and concise, though marginally brief.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple deletion tool with one parameter, the description is adequate but could benefit from mentioning prerequisites or consequences. Given the annotations cover destructive nature, it is minimally complete.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% with the parameter pageId described as 'The status page ID to delete'. The description adds no new meaning beyond 'by ID', so it meets the baseline but does not enhance understanding.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'delete' and resource 'status page', and specifies deletion by ID. It effectively distinguishes from sibling tools like create-status-page, update-status-page, and get-status-page.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides no guidance on when to use this tool versus alternatives, such as other delete tools or conditions under which deletion is appropriate. No exclusions or prerequisites are mentioned.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

delete-status-page-componentA
Destructive

Delete a component from a status page

ParametersJSON Schema
NameRequiredDescriptionDefault
pageIdYesThe status page ID
componentIdYesThe component ID to delete

TDQS

A3.5/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already label this tool as destructive (destructiveHint=true). The description adds no further behavioral context (e.g., irreversibility, authorization needs, or effects on related data).

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence, no redundancy, front-loaded with the essential action and resource.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple deletion tool, the description is adequate but omits important context like permanence, prerequisites (e.g., pageId must exist), or error conditions. Annotations partially compensate but don't cover all completeness needs.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% and the description adds no additional meaning beyond what is already in the schema parameter descriptions.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Description clearly states the action (delete) and the resource (component from a status page), distinguishing it from sibling delete tools for other entities.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No explicit guidance on when to use this tool versus alternatives like update or get. Sibling tools are not referenced, leaving some ambiguity.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

delete-status-page-degradationA
Destructive

Delete a degradation incident from a status page

ParametersJSON Schema
NameRequiredDescriptionDefault
pageIdYesThe status page ID
degradationIdYesThe degradation ID to delete

TDQS

A3.5/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already indicate destructiveHint=true, so the description doesn't need to repeat that. However, it adds minimal behavioral context (e.g., that it deletes an incident). It does not mention irreversibility, cascading effects, or required permissions. Given annotations, this is adequate but not exceptional.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, concise sentence with no unnecessary words. It conveys the core purpose efficiently.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple deletion tool with two parameters and no output schema, the description is minimally adequate. However, it omits details like whether the deletion is permanent or reversible, and any side effects (e.g., cascading to related entities). The description could be more complete without being verbose.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, with clear parameter descriptions ('The status page ID', 'The degradation ID to delete'). The description adds no additional meaning beyond the schema, so baseline score of 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description 'Delete a degradation incident from a status page' uses a specific verb (Delete) and resource (degradation incident), clearly distinguishing it from sibling tools like create-status-page-degradation, get-status-page-degradation, and other delete tools.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides no guidance on when to use this tool versus alternatives (e.g., update-status-page-degradation for modifications) or any prerequisites like ensuring the degradation exists. A simple one-liner does not help an agent decide when to invoke it.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

delete-synthetics-testA
Destructive

Delete one or more Synthetics tests by public ID

ParametersJSON Schema
NameRequiredDescriptionDefault
publicIdsYesArray of test public IDs to delete. Example: ["abc-def-ghi"]
forceDeleteDependenciesNoForce delete even if referenced by other resources

TDQS

A3.8/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already indicate this is destructive (destructiveHint=true) and a mutation (readOnlyHint=false). The description confirms deletion but adds no additional behavioral context, such as irreversibility or permission requirements.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence with no wasted words, front-loading the action and resource.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The description is sufficient for a simple delete operation, especially given the detailed parameter descriptions in the schema. It could mention the consequence of force deletion, but overall it is complete enough for an AI agent to understand usage.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The input schema has 100% description coverage, clearly explaining the publicIds and forceDeleteDependencies parameters. The tool description does not add any further meaning beyond what the schema already provides.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the action (Delete), the resource (Synthetics tests), and the method (by public ID). This distinguishes it from sibling tools that delete other resources.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description does not provide explicit guidance on when to use this tool versus alternatives, such as delete-monitor for monitors. It relies on the tool name and context to imply usage.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

delete-teamA
Destructive

Delete a Datadog team by ID

ParametersJSON Schema
NameRequiredDescriptionDefault
teamIdYesThe team ID to delete

TDQS

A3.7/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already provide destructiveHint=true and readOnlyHint=false, so the description need only add context. However, it adds no behavioral insight beyond what annotations state (e.g., irreversible deletion, permission requirements).

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single short sentence that efficiently conveys the tool's core purpose with no unnecessary words. It is front-loaded and concise.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple delete tool with one parameter and annotations, the description is adequate but could be more complete by noting permanence, permissions, or response format. The lack of output schema is acceptable for a delete operation.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema covers the single parameter (teamId) with description. The tool description does not add any meaning beyond the schema, so baseline 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the action ('Delete') and the resource ('a Datadog team by ID'), making the tool's purpose specific and distinct from sibling tools that create or update teams.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use or avoid this tool. The description implies usage for deleting a team by ID but lacks context about prerequisites or alternatives, such as checking team existence or handling dependencies.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-apm-retention-filterA
Read-only

Get detailed information about a specific APM retention filter

ParametersJSON Schema
NameRequiredDescriptionDefault
filterIdYesThe retention filter ID

TDQS

A3.6/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

The description only restates the read nature of the tool, which is already indicated by the readOnlyHint annotation. It adds no additional behavioral context beyond what annotations provide.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, concise sentence with no unnecessary information. It is well-structured and front-loaded.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The description is brief but sufficient for a simple get operation. It does not specify what 'detailed information' includes, but the output schema is not required, and the annotations provide safety context. Slightly incomplete but adequate.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, so the schema already describes the filterId parameter. The description does not add any additional meaning or context about the parameter.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Description clearly states 'Get detailed information about a specific APM retention filter', using a specific verb and resource. It distinguishes from sibling tools like create, delete, update, and list variants.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No when-to-use or when-not-to-use guidance is provided. The description does not mention alternatives such as 'list-apm-retention-filters' for retrieving all filters.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-caseA
Read-only

Get detailed information about a specific case by ID

ParametersJSON Schema
NameRequiredDescriptionDefault
caseIdYesThe case ID (UUID)

TDQS

A3.6/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already indicate readOnlyHint=true and openWorldHint=true, so the description does not need to restate safety. It adds limited context by saying 'detailed information', but does not specify what fields are returned or any other behavioral traits beyond the annotations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, clear sentence with no unnecessary words. It is appropriately sized and front-loaded with the key action and resource.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool's simplicity (one parameter, read-only, annotations present), the description is mostly adequate. However, it does not mention that the response is a full case object, which would be helpful since there is no output schema. Sibling tools provide context, so the gap is minor.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The input schema already describes caseId as a UUID with 100% coverage. The description adds no new meaning beyond 'by ID', so it meets the baseline of 3 for a fully documented schema.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool retrieves detailed information for a specific case by ID. It uses a specific verb ('Get'), resource ('case'), and identifier ('by ID'), distinguishing it from siblings like list-cases (which returns multiple cases) and create-case (which creates).

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance is provided on when to use this tool versus alternatives such as list-cases or update-case-status. The agent must infer usage from the tool name and context, which may lead to incorrect selection.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-dashboardA
Read-only

Get a specific Datadog dashboard with all widgets and configuration

ParametersJSON Schema
NameRequiredDescriptionDefault
dashboardIdYesDashboard ID. Example: abc-def-ghi
extractFieldsNoComma-separated dotted paths to project from response (e.g. 'id,name,owner.name,columns.*.name'). Use `*` as wildcard for arrays/objects. Wrap field names with dots in backticks. Reduces response tokens dramatically on large entities.

TDQS

A3.8/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true, making the read-only nature clear. The description adds that the tool returns 'all widgets and configuration', which is useful context but does not disclose additional behavioral traits like error handling or permissions.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence with no wasted words, front-loaded with the key action. Every word earns its place.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the simple nature of the tool (read, 2 params, no output schema, annotations present), the description adequately covers the purpose and returns a specific dashboard's full configuration. Minor omission: no mention of error handling or scenarios, but acceptable for a lightweight tool.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so the schema already defines both parameters. The description does not add further meaning beyond that baseline, such as clarifying parameter usage or relationships.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states 'Get a specific Datadog dashboard' with the verb 'Get' and the specific resource. It distinguishes from sibling tools like 'get-dashboards' (list) and create/update/delete operations.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage for retrieving a single dashboard but does not explicitly state when to use it over alternatives like 'get-dashboards' for listing or when to use create/update/delete. No exclusions are provided.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-dashboardsA
Read-only

List all Datadog dashboards

ParametersJSON Schema
NameRequiredDescriptionDefault
filterSharedNoFilter shared dashboards only
countNoNumber of dashboards to return
startNoPagination offset
extractFieldsNoComma-separated dotted paths to project from response (e.g. 'id,name,owner.name,columns.*.name'). Use `*` as wildcard for arrays/objects. Wrap field names with dots in backticks. Reduces response tokens dramatically on large entities.

TDQS

A3.6/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true and openWorldHint=true, so the description does not need to restate safety. It adds no behavioral context beyond the schema, but does not contradict annotations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description consists of a single, essential sentence that conveys the core purpose without any redundant information. It is optimally concise and front-loaded.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple list tool with no output schema, the description and parameter schema together are largely complete. Pagination is handled by parameters, and the description implies all dashboards are returned. Minor gap: no mention of default ordering or what happens with large result sets.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, with each parameter already described in the input schema. The tool description adds no additional meaning beyond what the schema provides, meriting a baseline score of 3.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description 'List all Datadog dashboards' uses a specific verb ('List') and resource ('Datadog dashboards'), clearly distinguishing it from sibling tools like 'get-dashboard' (singular) which retrieves a specific dashboard.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides no guidance on when to use this tool versus alternatives, such as 'get-dashboard' for a single dashboard or 'search-audit-logs' for historical access. No prerequisites or exclusions are mentioned.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-error-tracking-issueC
Read-only

Get detailed information about a specific error tracking issue

ParametersJSON Schema
NameRequiredDescriptionDefault
issueIdYesThe error tracking issue ID

TDQS

C2.9/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true and openWorldHint=true, so the description is consistent. However, the description adds no extra behavioral details beyond 'Get', such as output structure, potential errors, or whether it requires authentication. With annotations present, minimal extra context is needed, but none is provided.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence, 8 words, front-loaded with action. Zero wasted words. Every part is essential and immediately conveys the tool's purpose.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The description lacks details about return values ('detailed information' is vague). With no output schema, the agent needs hints about the response structure. No mention of expected outcomes or error handling. Incomplete for a tool with no output schema.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema has 100% coverage with a clear description for the only parameter ('issueId'). The tool description does not add any additional meaning beyond the schema. Baseline 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb and resource: 'Get detailed information about a specific error tracking issue.' It distinguishes from the sibling 'list-error-tracking-issues' by implying a single item retrieval, but does not explicitly contrast. Overall clear but could be more specific about what 'detailed information' includes.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool vs alternatives like 'list-error-tracking-issues'. There is no mention of prerequisites, typical workflows, or cases where this tool is preferred. The description provides no usage context.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-eventsA
Read-only

Get Datadog events within a time range, optionally filtered by priority, source, or tags

ParametersJSON Schema
NameRequiredDescriptionDefault
startYesStart time as Unix epoch seconds. Example: 1740000000
endYesEnd time as Unix epoch seconds. Example: 1740003600
priorityNoEvent priority filter
sourcesNoComma-separated event sources. Example: datadog,nginx
tagsNoComma-separated tags to filter. Example: env:prod,service:api
unaggregatedNoReturn unaggregated events
pageNoPage number for pagination

TDQS

A3.6/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true, so the description's statement 'Get' aligns with read-only behavior. The description adds context about filtering but does not disclose additional behavioral traits such as pagination (though a page parameter exists) or rate limits. With annotations covering the core behavior, the description adds minor value.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, concise sentence that front-loads the main purpose and optional filters. Every word is necessary, and there is no redundancy.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool has 7 parameters, no output schema, and annotations present, the description covers the main retrieval purpose. However, it does not mention pagination behavior, return format, or limits, which would improve completeness for an agent. It is adequate but not thorough.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so the baseline is 3. The description highlights filters (priority, source, tags) that map to parameters, but does not add meaning beyond what the schema already provides for each parameter.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'Get', the resource 'Datadog events', and the scope 'within a time range', with optional filters. Among sibling tools, there is no competing event retrieval tool, and it distinguishes from 'post-event' which creates events.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage for retrieving events within a time range with optional filters, but it does not explicitly state when to use this tool versus alternatives like 'post-event' for creation or other search tools. The context is clear enough for an AI agent to infer, but lacks explicit guidance.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-fleet-agent-infoA
Read-only

Get detailed info about a specific Datadog Agent including integrations and config

ParametersJSON Schema
NameRequiredDescriptionDefault
agentKeyYesAgent key (unique Datadog Agent identifier)

TDQS

A4/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true, so description adds value by specifying what kind of details are included (integrations, config). No contradictions.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence, front-loaded with verb and resource, no redundant words. Efficiently communicates purpose.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Tool is simple with one parameter, no output schema. Description covers what it returns (detailed info, integrations, config). Minor gap: no mention of response format, but sufficient for this complexity.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, and the description does not add additional meaning beyond the schema's parameter description. Baseline score appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Description clearly states verb 'Get', resource 'specific Datadog Agent', and scope 'detailed info including integrations and config'. Distinguishes from sibling tools like list-fleet-agents.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No explicit when-to-use or when-not-to-use guidance. Implied context: use this for detailed info about a single agent vs list-fleet-agents for an overview. Lacks alternative mentions.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-fleet-deploymentA
Read-only

Get detailed deployment info including per-host status and package versions

ParametersJSON Schema
NameRequiredDescriptionDefault
deploymentIdYesDeployment ID
limitNoMax number of hosts per page (max 100)
pageNoPage index for host pagination (0-based)

TDQS

A3.7/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations declare readOnlyHint=true and openWorldHint=true. The description adds value by specifying the type of detail returned (per-host status, package versions), which is consistent with read-only behavior and enriches the annotations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, well-structured sentence that conveys the core purpose without extraneous words.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Although the description touches on key aspects, the lack of an output schema means the description could elaborate on return format or fields. It mentions per-host status and package versions but remains vague.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

All three parameters are fully described in the schema (100% coverage). The description does not add significant meaning beyond the schema, so baseline 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states that the tool retrieves detailed deployment information including per-host status and package versions, distinguishing it from sibling tools like list-fleet-deployments and cancel-fleet-deployment.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides no guidance on when to use this tool versus alternatives, nor does it mention prerequisites or context. Siblings like list-fleet-deployments and get-fleet-agent-info exist, but no differentiation is offered.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-fleet-scheduleB
Read-only

Get detailed information about a specific fleet schedule

ParametersJSON Schema
NameRequiredDescriptionDefault
idYesThe schedule ID to retrieve

TDQS

B3.3/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint and openWorldHint, indicating a safe read operation. The description adds 'detailed information' but no additional behavioral traits beyond what annotations imply.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence with clear verb and object, no unnecessary words, effectively front-loaded.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Adequate for a simple read operation with one parameter and no output schema. Could mention the nature of 'detailed information' but not essential.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% and the description does not add further meaning to the single parameter 'id'. Baseline 3 applies as per the rubric.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool retrieves detailed information about a specific fleet schedule. The verb 'get' and resource are specific, and it distinguishes from siblings like list-fleet-schedules and trigger-fleet-schedule.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool versus alternatives such as list-fleet-schedules or trigger-fleet-schedule. No prerequisites or context provided.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-host-totalsA
Read-only

Get total number of active and up hosts

ParametersJSON Schema
NameRequiredDescriptionDefault
fromNoUnix epoch seconds — get totals from this time. Example: 1740000000

TDQS

A3.6/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already indicate readOnlyHint and openWorldHint. The description adds that it returns totals and can be filtered by 'from' time. However, it does not disclose output format, behavior with no hosts, or error conditions. Some behavioral context is added but not in depth.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

One sentence, nine words, no redundancy. Information is front-loaded. Could be slightly more structured but is appropriately concise for a simple tool.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple tool with one optional parameter and no output schema, the description is adequate but incomplete. It does not specify the return format (e.g., single number or object), which the agent would need to interpret results. With no output schema, the description should clarify output structure.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% with the 'from' parameter described. The description mentions time-based totals but does not add meaning beyond the schema's parameter description. Baseline of 3 applies.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Description clearly states the function: 'Get total number of active and up hosts'. It uses a specific verb and resource, distinguishing it from sibling tools like 'list-hosts' which likely return detailed host lists.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Usage context is implied (aggregate vs. list), but no explicit when-to-use or when-not-to-use guidance is provided. The description does not contrast with sibling tools like 'list-hosts' or 'get-metrics'.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-incidentA
Read-only

Get detailed information about a specific Datadog incident by ID

ParametersJSON Schema
NameRequiredDescriptionDefault
incidentIdYesThe incident ID to retrieve
extractFieldsNoComma-separated dotted paths to project from response (e.g. 'id,name,owner.name,columns.*.name'). Use `*` as wildcard for arrays/objects. Wrap field names with dots in backticks. Reduces response tokens dramatically on large entities.

TDQS

A3.5/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already provide readOnlyHint=true and openWorldHint=true. The description adds no extra behavioral context beyond 'get detailed information', such as rate limits, authentication requirements, or what 'detailed' entails. With annotations present, the description should still add value but fails to do so.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence of 10 words, extremely concise and front-loaded with the core purpose. Every word earns its place with no redundancy or filler.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple read tool with 2 parameters (one required) and no output schema, the description is adequate but minimal. It does not explain what information is returned (e.g., full incident object) or that extractFields can reduce response size. With sibling tools like get-incidents and search-incidents, the context is sufficient but could be more complete.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% with detailed descriptions for both parameters (incidentId and extractFields). The tool description only mentions 'by ID', adding minimal value beyond the schema. Baseline is 3 due to high coverage, and the description does not improve parameter understanding.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description uses the specific verb 'Get' and resource 'detailed information about a specific Datadog incident by ID'. It clearly differentiates from sibling tools like get-incidents (which lists incidents) and search-incidents (which searches), as it focuses on a single incident retrieved by ID.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies that this tool should be used when you have an incident ID and need detailed information, but it does not explicitly state when to avoid using it or mention alternatives like search-incidents for finding incidents by other criteria. The guidance is adequate but minimal.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-incidentsB
Read-only

List Datadog incidents with pagination

ParametersJSON Schema
NameRequiredDescriptionDefault
pageSizeNoNumber of results per page (default 25, max 100)
pageOffsetNoPagination offset
extractFieldsNoComma-separated dotted paths to project from response (e.g. 'id,name,owner.name,columns.*.name'). Use `*` as wildcard for arrays/objects. Wrap field names with dots in backticks. Reduces response tokens dramatically on large entities.

TDQS

B3.1/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true and openWorldHint=true, so the description adds only pagination detail. No contradiction, but lacks additional behavioral context such as default ordering or rate limits.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence, no wasted words. Could be expanded slightly with more context, but remains concise and front-loaded.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

No output schema exists, so the description should compensate by describing return values or structure. It only says 'List ...', which is insufficient for an agent to understand what fields or format to expect.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Input schema covers 100% of parameters with descriptions. The description does not add extra meaning beyond the schema, so baseline 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

Clearly states verb (List) and resource (Datadog incidents), and mentions pagination. However, it does not differentiate from sibling tool 'search-incidents', which may also list incidents but with filtering capabilities.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool versus alternatives like 'search-incidents' or 'get-incident'. Does not specify prerequisites or context for use.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-logs-metricA
Read-only

Get a specific log-based metric definition by name

ParametersJSON Schema
NameRequiredDescriptionDefault
metricIdYesThe name of the log-based metric. Example: logs.my_custom_count

TDQS

A4/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true and openWorldHint=true, so the description's 'get' aligns. No additional behavioral details (e.g., permissions, return format) are provided beyond what annotations convey.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence with no extraneous words, directly conveying the tool's purpose. It is efficient and well-structured.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple read operation with one parameter, the description is mostly complete. However, since there is no output schema, the description does not explain what the returned definition contains, which is a minor gap.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% with a clear description and example for metricId. The description adds no additional meaning beyond what the schema already provides, meeting the baseline for full coverage.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the action ('Get') and the resource ('specific log-based metric definition by name'). It effectively distinguishes from sibling tools like 'list-logs-metrics' (which retrieves all) and 'create/delete/update-logs-metric'.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implicitly indicates use when you have a metric name and need its definition. While it does not explicitly state when not to use it or provide alternatives, the context of sibling tools and the 'get' verb make usage clear.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-metric-metadataA
Read-only

Get metadata for a specific Datadog metric (type, unit, description)

ParametersJSON Schema
NameRequiredDescriptionDefault
metricNameYesFull metric name. Example: system.cpu.user

TDQS

A3.6/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true and openWorldHint=true, covering safety and result variability. The description adds that it returns type, unit, and description, providing context about the output. However, it does not disclose potential issues like missing metadata for some metrics or authentication requirements. With annotations handling basic traits, the description adds moderate value beyond structured fields.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence, 10 words, front-loaded with verb and resource. No filler words. Perfectly concise.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Simple tool with one parameter and no output schema. Description lists the three key metadata fields, which is sufficient for most use cases. Could optionally mention that the metadata might be empty or contain additional fields, but not necessary for typical usage. Completeness is high for this complexity.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema has 100% coverage: metricName is described as 'Full metric name. Example: system.cpu.user'. The description does not add new semantic meaning beyond the schema. Baseline 3 per guidelines for high schema coverage.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Description clearly states verb 'get', resource 'metadata for a specific Datadog metric', and specifies what metadata is included (type, unit, description). It distinguishes from sibling tools like get-metrics which list metrics, and list-active-metrics.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No explicit guidance on when to use this tool vs alternatives like get-metrics or list-active-metrics. The description does not mention prerequisites (e.g., knowing the metric name) or scenarios where this tool is preferred. Sibling tools provide similar functionality but no comparative advice is given.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-metricsB
Read-only

Search for available Datadog metrics by name pattern

ParametersJSON Schema
NameRequiredDescriptionDefault
qYesSearch query to filter metrics by name (e.g. system.cpu)

TDQS

B3.3/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

The description adds minimal behavioral context beyond annotations. Annotations already declare readOnlyHint=true and openWorldHint=true, so the description correctly implies read-only search but misses details like pagination, response format, or rate limits. No contradiction with annotations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

A single, front-loaded sentence with no wasted words. Every word contributes to the purpose, making it easy to parse quickly.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool's simplicity (one parameter, no output schema), the description is adequate for basic understanding. However, without an output schema, it would benefit from briefly describing the return value (e.g., list of metric names, metadata).

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

With 100% schema description coverage, the baseline is 3. The description provides an example ('e.g. system.cpu') which adds practical guidance beyond the schema. However, it does not elaborate on formatting, wildcards, or query syntax.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'Search' and the resource 'Datadog metrics' with the qualifier 'by name pattern'. This effectively distinguishes it from generic 'get-metrics' and from siblings like 'list-active-metrics' or 'query-metrics', though it doesn't explicitly contrast them.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance is provided on when to use this tool versus other metric-related tools such as 'list-active-metrics' or 'query-metrics'. There are no prerequisites, exclusions, or alternative recommendations mentioned.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-monitorA
Read-only

Get detailed information about a specific Datadog monitor by ID

ParametersJSON Schema
NameRequiredDescriptionDefault
monitorIdYesMonitor ID
groupStatesNoFilter by group states (e.g. alert,warn)
extractFieldsNoComma-separated dotted paths to project from response (e.g. 'id,name,owner.name,columns.*.name'). Use `*` as wildcard for arrays/objects. Wrap field names with dots in backticks. Reduces response tokens dramatically on large entities.

TDQS

A3.6/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true, so the description does not need to restate safety. However, it adds no behavioral context beyond stating 'detailed information', such as what fields are included, potential rate limits, or any side effects (openWorldHint suggests external influences). The description adds limited value over annotations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence that efficiently conveys the tool's primary function without unnecessary words or repetition.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a straightforward fetch-by-ID tool with fully described parameters, the description is fairly complete. It could mention expected response structure or error codes, but given no output schema, it is sufficient to guide the agent.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, with each parameter having a description. The tool description adds no additional meaning beyond the schema. Baseline score of 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description uses the specific verb 'Get' and resource 'detailed information about a specific Datadog monitor by ID', clearly indicating that this tool retrieves details for a single monitor. It is distinct from sibling tools like get-monitors (list) and other get-* tools.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides no guidance on when to use this tool versus alternatives such as get-monitors for listing, update-monitor for modifications, or delete-monitor for removal. No when-not-to-use or explicit context is given.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-monitorsB
Read-only

List Datadog monitors with optional filtering by name, tags, or state

ParametersJSON Schema
NameRequiredDescriptionDefault
nameNoFilter monitors by name substring
tagsNoComma-separated tags. Example: env:prod,team:backend
monitorTagsNoComma-separated service/custom tags
groupStatesNoFilter by group states: all, alert, warn, no data
pageSizeNoNumber of results per page (default 50)
pageNoPage number (0-based)
extractFieldsNoComma-separated dotted paths to project from response (e.g. 'id,name,owner.name,columns.*.name'). Use `*` as wildcard for arrays/objects. Wrap field names with dots in backticks. Reduces response tokens dramatically on large entities.

TDQS

B3.3/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true and openWorldHint=true, so the description only needs to add behavioral context. It correctly notes the listing nature and optional filtering, but fails to mention pagination behavior (page, pageSize) or that the result may be large. It does not contradict annotations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, efficient sentence that front-loads the action and resource. No unnecessary words or repetition. Every part earns its place.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given no output schema and a parameter count of 7, the description is somewhat brief. It does not specify what the returned list contains (e.g., monitor IDs, names, statuses) or any sorting/ordering. However, the tool name and filtering hints provide enough context for an AI agent to infer common behavior. More detail on pagination would improve completeness.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so the baseline is 3. The description adds minimal value beyond the schema by summarizing filters as 'name, tags, or state', but does not elaborate on 'extractFields', 'pageSize', or 'page'. It does not enhance understanding of the more complex parameters.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the action ('List') and resource ('Datadog monitors') with optional filtering. It distinguishes from the sibling 'get-monitor' (which retrieves a single monitor) by implying a list operation. However, it only mentions three filtering dimensions (name, tags, state) while the schema includes seven parameters, including pagination and field extraction, so the purpose is clear but slightly under-specified.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No explicit guidance is given on when to use this tool versus alternatives. While the sibling list tools (e.g., 'list-hosts') differ by resource, there is no mention of when listing monitors is appropriate, what prerequisites exist, or when to prefer 'get-monitor' instead. The description relies entirely on implicit understanding.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-network-deviceA
Read-only

Get detailed information about a specific network device by ID

ParametersJSON Schema
NameRequiredDescriptionDefault
deviceIdYesThe device ID

TDQS

A3.5/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true and openWorldHint=true, so the description adds minimal behavioral context beyond stating 'detailed information'. No contradictions, but no additional transparency about response structure or edge cases.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence with no wasted words, front-loaded with the action and target. Efficient for a simple retrieval tool.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

With no output schema, the description does not elaborate on what 'detailed information' includes or any error handling. Partially complete but sufficient for a straightforward get-by-ID operation.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% with parameter description 'The device ID'. The description only restates 'by ID', adding no new meaning. Baseline 3 applies.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states it retrieves detailed information for a specific network device by ID, distinguishing it from sibling tools like list-network-devices which list devices.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance is provided on when to use this tool versus alternatives (e.g., list-network-devices) or exclusion criteria. The agent must infer usage from the name and schema.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-notebookA
Read-only

Get a specific Datadog notebook with all cells and content

ParametersJSON Schema
NameRequiredDescriptionDefault
notebookIdYesNotebook ID. Example: 1234567

TDQS

A4.1/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already indicate readOnlyHint=true and openWorldHint=true, so the safety profile is clear. The description adds value by specifying that the tool returns 'all cells and content', providing concrete behavioral detail beyond annotations. No contradictions.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, front-loaded sentence of 9 words with no filler. Every word is essential: verb, resource, and scope ('with all cells and content'). Appropriate for the tool's simplicity.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool has only one required parameter, no output schema, and annotations cover read-only and open-world behavior, the description fully explains what the tool does and what it returns. No missing critical information for an agent to invoke it correctly.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100% with the parameter already documented as 'Notebook ID. Example: 1234567'. The tool description does not add additional meaning to the parameter beyond referencing a 'specific' notebook, which is inherent from the parameter role.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'Get' and the resource 'a specific Datadog notebook with all cells and content'. This distinguishes it from sibling tools like 'list-notebooks' which lists notebooks without full content, and from other 'get' tools for different resources.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage when needing a specific notebook's full content, but it does not explicitly state when to use this tool versus alternatives (e.g., 'list-notebooks' for browsing). No exclusions or conditions are mentioned.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-oncall-scheduleA
Read-only

Get an on-call schedule by ID with layers and team information

ParametersJSON Schema
NameRequiredDescriptionDefault
scheduleIdYesThe on-call schedule ID. Example: abc123-def456-ghi789
includeNoComma-separated included relationships. Example: teams,layers,layers.members,layers.members.user

TDQS

A3.6/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true and openWorldHint=true, so the description does not need to repeat read-only behavior. However, it adds limited behavioral context beyond annotations, only mentioning that results include layers and team information. No disclosure of auth requirements, rate limits, or handling of invalid IDs.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, clear sentence with no unnecessary words. It efficiently conveys the core purpose and scope.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple read operation with two parameters and comprehensive annotations, the description is fairly complete. It mentions key return elements (layers and team info). However, it lacks details on error states or the structure of the returned object, which is partially mitigated by the lack of output schema.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% with descriptions for both parameters. The description hints at what 'include' may do ('with layers and team information') but does not add significant meaning beyond what the schema provides (e.g., comma-separated relationships and example). Baseline score of 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the action (Get), the resource (on-call schedule by ID), and the included details (layers and team information). It differentiates from sibling tools like get-team-oncall which gets on-call for a team rather than by schedule ID.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool versus alternatives (e.g., get-team-oncall or other schedule-related tools). The description does not specify prerequisites, when not to use it, or provide examples of appropriate context.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-rum-applicationA
Read-only

Get detailed information about a specific RUM application by ID

ParametersJSON Schema
NameRequiredDescriptionDefault
idYesRUM application ID

TDQS

A4/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

The description adds the phrase 'detailed information' beyond the annotations 'readOnlyHint' and 'openWorldHint', but does not provide additional behavioral traits like response structure or pagination. Annotations already cover the safety profile.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, front-loaded sentence with no redundant words. It is appropriately concise.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple read tool with one parameter and no output schema, the description adequately covers the basics. It could expand on what 'detailed information' includes, but the simplicity limits the need.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% and the schema already describes the 'id' parameter as 'RUM application ID'. The description adds no new semantic detail beyond restating that the tool retrieves by ID.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly specifies the action 'Get', the resource 'RUM application', and the identifier 'by ID'. It distinguishes from sibling tools like 'list-rum-applications' which retrieves all applications.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage when you have a specific ID, but does not explicitly mention alternatives like 'list-rum-applications' for when you need all applications.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-rum-metricB
Read-only

Get a specific rum-based metric definition by name

ParametersJSON Schema
NameRequiredDescriptionDefault
metricIdYesThe name of the rum-based metric. Example: rum.my_custom_count

TDQS

B3.3/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true and openWorldHint=true, covering safety and scope. The description adds no further behavioral insights (e.g., side effects, rate limits) beyond restating 'by name'. Given annotation coverage, the description meets minimum transparency but does not enhance it.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single 8-word sentence, front-loaded with the verb and resource. No extraneous information; every word is necessary.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

With no output schema, the description could provide more context about what a 'definition' includes (e.g., properties, metadata). However, given the tool's simplicity (1 param, read-only), the description is minimally sufficient but leaves the agent guessing about the response structure.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, with a clear description and example for the 'metricId' parameter. The description merely restates 'by name', adding no semantic value beyond the schema. Baseline score of 3 applies.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'Get' and the resource 'rum-based metric definition', specifying retrieval by name. It differentiates from sibling tools like 'list-rum-metrics' (which returns multiple) and 'get-metrics' (more general), though it does not explicitly distinguish from 'get-metric-metadata'.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No explicit guidance on when to use this tool versus alternatives like 'list-rum-metrics' or 'get-metrics'. The description implies use when the metric name is known, but provides no context about prerequisites or scenarios where other tools are preferable.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-rum-retention-filterA
Read-only

Get a specific RUM retention filter by ID

ParametersJSON Schema
NameRequiredDescriptionDefault
appIdYesRUM application ID
filterIdYesRetention filter ID (UUID)

TDQS

A3.7/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

The description aligns with the readOnlyHint annotation by using the verb 'Get'. However, it adds no additional behavioral context beyond what the annotation already provides. No contradictions.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, short sentence with no unnecessary words. It is maximally concise while still conveying the essential purpose.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The description explains the tool's basic function but does not mention what the response contains (e.g., fields of the retention filter). Since there is no output schema, additional context about the return value would be helpful for completeness.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Both parameters are described in the input schema with clear descriptions. The tool description adds no extra meaning about the parameters, but the schema coverage is 100%, so this is adequate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'Get' and the resource 'RUM retention filter', and specifies the retrieval mechanism 'by ID'. This uniquely identifies the tool's purpose and distinguishes it from sibling tools like list-rum-retention-filters and create-rum-retention-filter.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description does not explicitly guide when to use this tool versus alternatives. It implies that it is for retrieving a single filter by ID, but fails to mention that list-rum-retention-filters is more appropriate for fetching all filters. Usage context is only implicitly understood.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-security-ruleA
Read-only

Get detailed information about a specific security monitoring detection rule

ParametersJSON Schema
NameRequiredDescriptionDefault
ruleIdYesThe security monitoring rule ID

TDQS

A3.6/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint and openWorldHint, so the description's 'Get detailed information' is consistent but adds no behavioral insight beyond what is already provided.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, efficient sentence with no wasted words.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

There is no output schema, and the description does not specify what 'detailed information' includes, leaving the agent uncertain about the tool's return structure.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% for the single parameter 'ruleId', which the schema already documents. The description does not add any additional meaning or constraints.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'Get' and the resource 'specific security monitoring detection rule', distinguishing it from sibling tools like 'list-security-rules' which lists all rules.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage for retrieving a single rule but does not provide explicit when-to-use or when-not-to-use guidance, nor does it mention alternatives.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-security-signalA
Read-only

Get detailed information about a specific security signal by ID

ParametersJSON Schema
NameRequiredDescriptionDefault
signalIdYesThe security signal ID to retrieve

TDQS

A3.6/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true and openWorldHint=true. The description adds no further behavioral context (e.g., error handling, permissions). No contradiction, but minimal added value.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence, front-loaded with key action. No unnecessary words.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple get-by-ID tool with one required parameter and no output schema, the description is adequate. It covers the core purpose but lacks hints about return format.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, so baseline is 3. The description simply says 'by ID' without adding meaning beyond the schema's parameter description.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'get', the resource 'security signal', and the scope 'by ID'. It distinguishes from sibling 'search-security-signals' which lists signals.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool versus alternatives like 'search-security-signals'. Lacks context for when to use this specific get operation.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-security-suppressionA
Read-only

Get detailed information about a specific security monitoring suppression rule

ParametersJSON Schema
NameRequiredDescriptionDefault
suppressionIdYesThe suppression rule ID

TDQS

A3.8/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already provide readOnlyHint: true and openWorldHint: true, so the description's claim of 'getting detailed information' is consistent but adds no extra behavioral context beyond what annotations convey.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence of 13 words, front-loading the purpose with 'Get detailed information' and leaving no superfluous content.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple read operation with one parameter and no output schema, the description sufficiently covers the tool's purpose. It could mention expected return fields, but the context is complete enough for this basic tool.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

With 100% schema description coverage, the single parameter 'suppressionId' is fully described in the schema. The tool description does not add any additional semantic meaning beyond the schema.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description 'Get detailed information about a specific security monitoring suppression rule' clearly states the verb ('get') and the resource ('security monitoring suppression rule'), distinguishing it from sibling tools like 'list-security-suppressions' and 'delete-security-suppression'.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage when needing details of a specific suppression rule, but does not explicitly state when to use or avoid this tool, nor reference alternatives like 'list-security-suppressions' for listing.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-service-definitionA
Read-only

Get a service definition from Datadog Software Catalog by entity ID

ParametersJSON Schema
NameRequiredDescriptionDefault
entityIdYesThe entity ID (UUID) from the software catalog

TDQS

A3.5/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true and openWorldHint=true, so the description adds little beyond stating it's a get operation. It does not contradict annotations, but it does not enrich behavioral understanding.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, front-loaded sentence with no unnecessary words. It efficiently conveys the tool's purpose.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The description is adequate for a simple read tool with annotations, but it does not explain what a service definition contains or provide guidance on obtaining the entity ID, which could be helpful.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% and already includes a description for 'entityId'. The description merely references 'by entity ID' without adding new meaning, so baseline 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'Get', the resource 'service definition', and the lookup method 'by entity ID'. It is specific and distinguishes this tool from other get tools in the sibling list.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance is provided on when to use this tool versus alternatives. There is no mention of prerequisites, context, or exclusions, which is a significant gap.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-sloA
Read-only

Get detailed information about a specific SLO

ParametersJSON Schema
NameRequiredDescriptionDefault
sloIdYesSLO ID. Example: abc123def456abc123def456abc123de

TDQS

A3.6/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already provide readOnlyHint=true and openWorldHint=true. The description adds no additional behavioral traits beyond stating it returns detailed information, which is minimally helpful.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence, no extraneous words, and front-loaded with the key purpose.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the simplicity (1 param, no output schema), the description is sufficient. However, it could clarify what 'detailed information' includes compared to get-slo-history.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100% with an example for sloId. The description adds no further meaning beyond what the schema provides, meeting the baseline for high coverage.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool's action ('Get') and resource ('detailed information about a specific SLO'). It distinguishes from sibling tools like get-slo-history and list-slos.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool versus alternatives (e.g., list-slos or get-slo-history). The agent is left to infer context from the tool name alone.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-slo-correctionA
Read-only

Get detailed information about a specific SLO correction by ID

ParametersJSON Schema
NameRequiredDescriptionDefault
sloCorrectionIdYesThe SLO correction ID

TDQS

A3.9/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint and openWorldHint, so the description does not need to reiterate these. However, it adds no extra behavioral context such as idempotency, rate limits, or what 'detailed information' entails.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, front-loaded sentence of 9 words with no redundant content, earning its place efficiently.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple one-parameter read tool with no output schema and with annotations covering safety and open-world aspects, the description is complete enough for an agent to understand its basic purpose and usage.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The input schema has 100% description coverage for the single parameter, so the baseline is 3. The description adds no additional meaning beyond the schema's 'The SLO correction ID'.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool retrieves detailed information for a specific SLO correction by its ID, distinguishing it from sibling tools like list-slo-corrections (which lists all) and create/update/delete operations.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage when you have a specific ID, but does not explicitly state when to use this tool over alternatives like list-slo-corrections (for browsing) or provide any when-not-to-use guidance.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-slo-historyA
Read-only

Get SLO performance history over a time range (status, error budget, compliance)

ParametersJSON Schema
NameRequiredDescriptionDefault
sloIdYesSLO ID. Example: abc123def456abc123def456abc123de
fromTsYesStart time as Unix epoch seconds. Example: 1740000000
toTsYesEnd time as Unix epoch seconds. Example: 1740086400
targetNoTarget SLO value. Example: 99.9

TDQS

A4/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Description adds that the tool returns status, error budget, and compliance beyond the readOnlyHint and openWorldHint annotations. Does not contradict annotations and provides useful behavioral context.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence that efficiently conveys the tool's purpose and return value. No wasted words, well front-loaded.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Describes return fields (status, error budget, compliance) but lacks details on response structure, default ranges, or error handling. Adequate for a read-only tool with no output schema.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema covers all 4 parameters with examples; description adds no additional semantic value beyond the schema. Baseline 3 as schema coverage is 100%.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Clearly states it retrieves SLO performance history over a time range, specifying key aspects (status, error budget, compliance). Distinguishes from sibling tools like get-slo (single SLO) and list-slos.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Implies usage for historical performance data but does not explicitly state when to use vs alternatives like slo-compliance-snapshot. No when-not-to-use guidance.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-spans-metricA
Read-only

Get a specific span-based metric definition by name

ParametersJSON Schema
NameRequiredDescriptionDefault
metricIdYesThe name of the span-based metric. Example: spans.my_custom_count

TDQS

A3.6/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true and openWorldHint=true, so the description adds no extra behavioral context. It does not contradict annotations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence with no wasted words; front-loaded with verb and resource.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple read operation with good annotations and schema, the description is adequate. Could mention return format but not essential.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% and includes a description and example. The tool description adds no additional parameter meaning beyond the schema.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'Get' and the resource 'span-based metric definition' with the identifier 'by name', distinguishing it from siblings like create, delete, update, and list.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool versus alternatives; no exclusions or context provided beyond the basic purpose.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-status-pageA
Read-only

Get a specific status page by ID

ParametersJSON Schema
NameRequiredDescriptionDefault
pageIdYesThe status page ID

TDQS

A3.7/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already indicate readOnlyHint and openWorldHint. The description adds no additional behavioral context such as authentication, rate limits, or return format.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single, clear sentence with no unnecessary words. Front-loaded and efficient.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple get-by-ID tool with one parameter and no output schema, the description is mostly adequate but lacks mention of return value or any additional context.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% with clear parameter description. The description adds no extra meaning beyond 'by ID' which is already in the schema.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'get' and resource 'status page', and specifies retrieval by ID. It is distinct from siblings like 'list-status-pages' and 'create-status-page'.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage when an ID is known, but does not explicitly state when to use this tool versus alternatives like 'list-status-pages' for browsing.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-status-page-componentA
Read-only

Get a specific component by ID from a status page

ParametersJSON Schema
NameRequiredDescriptionDefault
pageIdYesThe status page ID
componentIdYesThe component ID

TDQS

A3.9/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true and openWorldHint=true. Description does not add behavioral context beyond what annotations provide, such as error handling or authorization needs. No contradiction.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence, concise, no waste. Front-loaded with purpose.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple get-by-ID tool with full schema coverage and annotations indicating read-only and open world, the description is complete enough. No output schema needed for this type of operation.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% with clear descriptions for pageId and componentId. The description adds no extra meaning beyond the schema, so baseline 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Description clearly states 'Get a specific component by ID from a status page', specifying the verb (Get), resource (component), and identifier (by ID). It distinguishes from sibling tools like list-status-page-components (list all) and get-status-page (get page).

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No explicit guidance on when to use this tool vs alternatives (e.g., list-status-page-components). Usage is implied (when you have a component ID), but no when-not-to-use or comparison provided.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-status-page-degradationA
Read-only

Get detailed information about a specific degradation incident

ParametersJSON Schema
NameRequiredDescriptionDefault
pageIdYesThe status page ID
degradationIdYesThe degradation ID

TDQS

A3.5/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already provide readOnlyHint=true and openWorldHint=true, so the safety profile is clear. The description adds no further behavioral context beyond stating it gets 'detailed information'. With annotations covering the core behavioral traits, the description is adequate but not enriched.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, clear sentence with 8 words. It is front-loaded, contains no filler, and every word contributes to understanding the tool's purpose.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

While the tool is simple (get by two IDs), the description does not explain what 'detailed information' entails, and there is no output schema. For a read tool, lack of return structure hints reduces completeness. It is minimally complete but could be improved by describing the output fields or format.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The input schema already describes both parameters fully (pageId: 'The status page ID', degradationId: 'The degradation ID') with 100% coverage. The description adds no additional meaning beyond the schema, meeting the baseline for coverage.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool's function: 'Get detailed information about a specific degradation incident'. It uses a specific verb ('get') and resource ('degradation incident'), which distinguishes it from sibling tools like 'list-status-page-degradations' (list vs. specific) and 'get-status-page' (different resource).

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides no guidance on when to use this tool versus alternatives, nor does it mention prerequisites, limitations, or when not to use it. It simply states what the tool does without contextualizing its use case among siblings.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-status-page-maintenanceB
Read-only

Get detailed information about a specific maintenance window

ParametersJSON Schema
NameRequiredDescriptionDefault
pageIdYesThe status page ID
maintenanceIdYesThe maintenance ID

TDQS

B3.3/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true, so the description does not need to state read-only behavior. The description adds 'detailed' but does not specify what details are included (e.g., status, times, components). No contradiction with annotations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, concise sentence (10 words) that conveys the tool's purpose without any superfluous content.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple read operation with two well-described parameters and read-only annotations, the description is mostly adequate. However, it lacks details about response structure or error behavior, which would improve completeness.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The input schema has 100% coverage with descriptions for both parameters. The description adds no additional parameter meaning beyond what the schema provides, so baseline score of 3 applies.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool gets detailed information about a specific maintenance window, distinguishing it from list operations. However, it does not explicitly differentiate from sibling tools like get-status-page or get-status-page-degradation.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance is provided on when to use this tool versus alternatives (e.g., list-status-page-maintenances). There is no mention of prerequisites or context for usage.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-synthetics-resultB
Read-only

Get latest results for a Synthetics API test by public ID

ParametersJSON Schema
NameRequiredDescriptionDefault
publicIdYesSynthetics test public ID. Example: abc-def-ghi
fromTsNoStart time in milliseconds. Example: 1740000000000
toTsNoEnd time in milliseconds. Example: 1740003600000
probeDcNoFilter by probe locations. Example: ["aws:us-east-1"]

TDQS

B3.4/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already indicate readOnly and openWorld. Description adds minimal: 'latest' conflicts with time range parameters, no mention of pagination or result ordering.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence of 12 words, no filler, directly states action and subject.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

No output schema, yet description doesn't explain response format, number of results, or conflict between 'latest' and optional time range parameters. Incomplete for a 4-parameter tool.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, so description adds no extra meaning to parameters. Baseline of 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Clearly states verb 'Get', resource 'latest results for Synthetics API test', and key parameter 'by public ID'. Distinct from siblings like trigger-synthetics or list-synthetics.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Implies retrieval of latest results, but no explicit when-to-use or alternatives. No guidance on edge cases like time ranges vs 'latest'.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-teamA
Read-only

Get detailed information about a specific Datadog team by ID

ParametersJSON Schema
NameRequiredDescriptionDefault
teamIdYesThe team ID to retrieve

TDQS

A3.8/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true and openWorldHint=true, which cover the behavioral profile. The description adds no new behavioral context beyond what annotations provide.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, concise sentence with no unnecessary words, effectively front-loading the purpose.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple retrieval with one parameter and no output schema, the description is adequate. It could be slightly more specific about what 'detailed information' includes, but the low complexity and annotations make it sufficient.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

With 100% schema description coverage and a single parameter (teamId) already described in the schema as 'The team ID to retrieve', the description adds no additional meaning beyond the schema.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the action ('Get detailed information') and the resource ('a specific Datadog team by ID'), distinguishing it from sibling tools like get-team-members, get-team-oncall, and list-teams.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage when you have a team ID and need details, but provides no explicit guidance on when to use this tool versus alternatives, nor any exclusions or prerequisites.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-team-membersA
Read-only

Get members of a Datadog team with their roles

ParametersJSON Schema
NameRequiredDescriptionDefault
teamIdYesThe team ID to get members for
pageSizeNoNumber of results per page (default 50)
pageNumberNoPage number (0-based)

TDQS

A3.8/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true and openWorldHint=true, so the description does not need to repeat that. It adds 'with their roles' as return context but does not describe pagination, rate limits, or potential empty results. The description provides some additional context beyond annotations but is not rich.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, concise sentence that conveys the tool's purpose without any wasted words. It is front-loaded and efficient.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool's simplicity (get members with pagination) and the schema covering parameters fully, the description is nearly complete. It could mention pagination behavior or response format, but for a straightforward retrieval operation, it suffices.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% with descriptions for all three parameters. The tool description does not add any extra meaning beyond what the schema provides, meeting the baseline of 3.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool retrieves members of a Datadog team and includes their roles. It uses a specific verb ('Get') and resource ('members of a team'), distinguishing it from sibling tools like 'get-team' (which gets team info) and 'list-teams' (which lists all teams).

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage for fetching team members, but it does not explicitly state when to use this tool versus alternatives, nor does it mention any prerequisites or when not to use it. The context is clear but lacks explicit guidance.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-team-oncallA
Read-only

Get current on-call responders for a Datadog team

ParametersJSON Schema
NameRequiredDescriptionDefault
teamIdYesThe Datadog team ID. Example: abc123-def456-ghi789
includeNoComma-separated included relationships. Example: responders,escalations,escalations.responders

TDQS

A3.6/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true and openWorldHint=true, so the description's primary behavioral addition is 'current' and 'responders'. It does not disclose further traits like rate limits or what happens with no responders. The description adds some context but is not rich.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, concise sentence that immediately conveys the purpose. No filler or redundant information.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple retrieval tool with 2 parameters and annotations covering read-only and open-world, the description is mostly complete. It could mention the structure of returned data, but that is not essential given the straightforward purpose.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% with descriptions for both parameters (teamId and include). The tool description does not add any extra semantics beyond what is already in the schema, so baseline 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'Get', the resource 'current on-call responders', and the scope 'for a Datadog team'. It distinguishes from the sibling tool 'get-oncall-schedule' which likely deals with schedules rather than current responders.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides no guidance on when to use this tool versus alternatives like 'get-oncall-schedule'. No explicit context, exclusions, or when-not-to-use information is given.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-usage-summaryB
Read-only

Get Datadog account usage summary for a billing period (hosts, logs, APM, RUM, etc.)

ParametersJSON Schema
NameRequiredDescriptionDefault
startMonthYesStart month (ISO 8601). Example: 2026-01-01T00:00:00Z
endMonthNoEnd month (ISO 8601). Example: 2026-02-01T00:00:00Z
includeOrgDetailsNoInclude organization details breakdown

TDQS

B3.4/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true and openWorldHint=true. The description adds no new behavioral traits beyond stating the billing period context, which is already defined by parameters. No contradictions.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

A single sentence of 14 words that is front-loaded with the action and efficiently conveys the tool's purpose. No redundant information.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The tool has 3 parameters (all documented) but no output schema. The description does not mention pagination, response format, or other behavioral details relevant given the openWorldHint annotation. For a billing summary tool, more context is needed.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% with all three parameters having descriptions. The description does not add additional meaning beyond the schema, so baseline 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'Get', the resource 'Datadog account usage summary', and the scope 'for a billing period'. It lists example metrics (hosts, logs, APM, RUM), distinguishing it from sibling tools like get-host-totals.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage for retrieving billing-related usage but provides no explicit guidance on when to use this tool versus alternatives (e.g., get-host-totals for host counts). No exclusions or context are given.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-workflowA
Read-only

Get a Datadog workflow definition by ID (steps, triggers, conditions). The workflow UUID is in the UI URL at /workflow/.

ParametersJSON Schema
NameRequiredDescriptionDefault
workflowIdYesWorkflow UUID. Find it in the Datadog UI at /workflow/<UUID>. Example: 12345678-1234-1234-1234-123456789abc

TDQS

A4/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already indicate readOnlyHint=true and openWorldHint=true, so description adds minimal extra behavior. It lists what the definition contains but no side effects or access considerations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Two short sentences, each carrying useful information. No wasted words.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Simple tool with one parameter. Description covers purpose and parameter location adequately. Lacks output format details, but output schema is absent so agent relies on description. Could be more explicit about return structure.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% with clear parameter description. Description adds context about UUID location in UI, which is helpful but not necessary. Baseline 3.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Description clearly states 'Get a Datadog workflow definition by ID' with parenthetical listing contents (steps, triggers, conditions). Distinguishes from sibling 'get-workflow-instance'.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Explains where to find the workflow ID (UI URL). Implicitly guides when to use by specifying resource type, but lacks explicit comparison to alternatives.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get-workflow-instanceA
Read-only

Get full run details for a single workflow instance — step-by-step input, output, status, and error. Use this to debug failed runs (e.g., a Slack alert says 'Workflow X failed at step Y').

ParametersJSON Schema
NameRequiredDescriptionDefault
workflowIdYesWorkflow UUID
instanceIdYesWorkflow instance (run) ID

TDQS

A4.3/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations indicate readOnlyHint=true and openWorldHint=true. The description adds behavioral detail by specifying the return content (step-by-step input, output, status, error), which is beyond what annotations provide. No contradictions.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description consists of two sentences: the first states the purpose and content, the second provides usage guidance. It is concise with no unnecessary words.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple retrieval tool with no output schema, the description covers the purpose, return content (step-by-step details), and a concrete use case (debugging). It is complete enough for an agent to select and invoke correctly.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The input schema already describes both parameters clearly ('Workflow UUID' and 'Workflow instance (run) ID') with 100% coverage. The description does not add additional parameter semantics, but the baseline score is 3 due to full schema coverage.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states it retrieves 'full run details for a single workflow instance' with explicit content (input, output, status, error). It distinguishes from siblings like 'list-workflow-instances' (which lists multiple) and 'get-workflow' (which gets the workflow definition).

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides a specific use case: 'debug failed runs' with a concrete example (Slack alert). While it doesn't explicitly state when not to use it or list alternatives, the context and sibling names imply alternatives exist, so the guidance is strong but not exhaustive.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

incident-triage-snapshotA
Read-only

Aggregated incident triage: get-incident + get-events (lookback window) + search-incidents (similar on same service, last 14d) + aggregate-logs (error spike on incident's service) in one call. Replaces the 5-step triage-incident Prompt orchestration with a single structured response (incident metadata, related events, similar past incidents, log-spike heuristic, and a summary block with severity/duration/spike flag). Uses Promise.allSettled — per-fetcher failures populate caveats[].

ParametersJSON Schema
NameRequiredDescriptionDefault
incidentIdYesIncident ID. Use list-incidents or search-incidents to find one.
lookbackMinutesNoMinutes before incident creation to scan for related signals (default 60, max 720)
serviceNoOverride the service tag scan. By default, derived from incident.fields.services[0].
includeLogSpikeNoRun an aggregate-logs spike detection over the window for the incident's service
includeSimilarNoSearch for incidents on the same service in the last 14 days
extractFieldsNoComma-separated dotted paths to project from response (e.g. 'id,name,owner.name,columns.*.name'). Use `*` as wildcard for arrays/objects. Wrap field names with dots in backticks. Reduces response tokens dramatically on large entities.

TDQS

A4.6/5.0
Behavior5/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

The description goes beyond annotations by disclosing use of Promise.allSettled and caveats[] array for per-fetcher failures. Annotations (readOnlyHint=true, openWorldHint=true) are consistent with read-only aggregate behavior, and the description adds valuable implementation detail.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single paragraph but packs all essential information without redundancy. It is front-loaded with purpose and lists components. Could benefit from slight structuring (e.g., bullet points), but it is concise and every sentence earns its place.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool's complexity and no output schema, the description provides adequate information: response structure includes incident metadata, related events, similar incidents, log-spike heuristic, and summary block with severity/duration/spike flag. It also explains fallback behavior. Slightly more detail on exact fields would improve completeness.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters5/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

All 6 parameters have schema descriptions, but the tool description adds critical context: derivation of service from incident fields, default values for booleans, max for lookback, and suggestion for finding incidentId. This adds significant meaning beyond the schema.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool aggregates multiple operations into one call, listing specific components (incident metadata, related events, similar incidents, log spike) and naming the underlying operations. It distinguishes from siblings like get-incident or search-incidents by being a composite.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description explicitly states it replaces the 5-step `triage-incident` orchestration, giving clear context for when to use it. However, it does not provide explicit when-not-to-use scenarios or alternative sibling tools for specific needs.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list-active-metricsB
Read-only

List active metrics from a given time, optionally filtered by host or tag

ParametersJSON Schema
NameRequiredDescriptionDefault
fromYesUnix epoch seconds — metrics active since this time
hostNoFilter by hostname
tagFilterNoFilter by tag (e.g. env:prod)

TDQS

B3.3/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations provide readOnlyHint and openWorldHint. The description adds that it lists metrics from a given time with optional filters but does not disclose additional behavioral traits like pagination, definition of 'active', or rate limits. No contradiction with annotations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence, 15 words, front-loaded with action and resource. Every part is relevant and concise with no redundancy.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Adequate for a simple read tool with three parameters and no nested objects, but lacks details on what 'active' means, return format, or pagination. Without an output schema, the description could provide more context about the response structure.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, with descriptions for 'from', 'host', and 'tagFilter' already present. The description merely restates these parameters ('from a given time, optionally filtered by host or tag') without adding new meaning or constraints.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

Description clearly states 'List active metrics' with a specific verb and resource. It specifies the temporal scope ('from a given time') and optional filters. While distinct from siblings like 'list-metric-tags' and 'get-metrics', it could more explicitly differentiate the concept of 'active' metrics from listing all metrics.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use or not use this tool versus alternatives. Sibling tools include 'list-metric-tags', 'list-hosts', 'query-metrics', etc., but the description does not indicate when this tool is preferred or any prerequisites.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list-apm-retention-filtersA
Read-only

List APM retention filters that control which traces are retained for search

ParametersJSON Schema
NameRequiredDescriptionDefault

No parameters

TDQS

A3.8/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already provide readOnlyHint=true, indicating no state modification. The description adds no further behavioral details (e.g., returns all filters, no pagination). It does not contradict annotations, but misses an opportunity to disclose traits like list format or ordering.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence, no fluff. Every word adds value. Front-loaded with action and resource.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple list tool with no parameters and no output schema, the description is mostly complete. It could mention that the output is a list of filter objects, but the purpose is clear enough.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Input schema has zero parameters, so schema coverage is 100%. Baseline for 0 params is 4. Description adds no parameter info, but none is needed.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'List' and the resource 'APM retention filters', and explains their purpose ('control which traces are retained for search'). This distinguishes it from sibling tools like create/get/delete/update variants.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance is provided on when to use this tool versus alternatives (e.g., get-apm-retention-filter for a single filter, or search-based tools). There is no mention of context, prerequisites, or exclusions.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list-casesA
Read-only

List Datadog Case Management cases with search and filtering

ParametersJSON Schema
NameRequiredDescriptionDefault
queryNoSearch query to filter cases. Example: status:open priority:P1
pageSizeNoNumber of results per page (default 25)
pageNumberNoPage number (1-based, minimum 1)
sortFieldNoField to sort bycreated_at

TDQS

A3.7/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

The description aligns with the readOnlyHint annotation (listing is read-only) and openWorldHint (system-wide data). However, it does not add significant behavioral context beyond the annotations and schema. For a read-only tool with annotation coverage, this is adequate but not exceptional.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence of 8 words, front-loading the action and resource. It is concise and efficient, with no unnecessary words or repetition.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool's complexity (4 parameters, no output schema) and the coverage from schema and annotations, the description is minimally adequate. It could be improved by mentioning the return format (list of cases) or pagination behavior, but it conveys the core functionality.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The input schema covers all parameters with descriptions, providing 100% coverage. The tool description does not add additional parameter-level information beyond what the schema already provides, so it meets the baseline for high schema coverage.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the action 'List' and the resource 'Datadog Case Management cases', with additional details about search and filtering. This distinguishes it from sibling tools like 'get-case' (single case) and other list tools, making the purpose specific and unambiguous.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage for listing cases but does not explicitly state when to use this tool versus alternatives like 'get-case' for a single case or 'create-case' for creation. No exclusions or when-not-to-use guidance is provided, so the agent must infer from context.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list-containersA
Read-only

List infrastructure containers with filtering and pagination

ParametersJSON Schema
NameRequiredDescriptionDefault
filterTagsNoComma-separated tags to filter. Example: short_image:nginx,env:production
groupByNoGroup containers by attribute. Example: short_image, container_name
sortNoSort field. Example: container_name, -cpu_percent
pageSizeNoNumber of results per page (default 20, max 1000)
pageCursorNoPagination cursor from previous response

TDQS

A3.8/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already indicate readOnlyHint=true (safe) and openWorldHint=true (varying results). The description adds context about filtering and pagination, which aligns with annotations and provides useful behavioral detail.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence, front-loaded with the primary purpose, no extraneous words. Every word is necessary.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple list operation with well-documented parameters, the description covers the core functionality adequately. Could mention openWorldHint implications, but not essential given annotations.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Parameter schema coverage is 100% and descriptions are clear. The description adds no extra semantic value beyond stating 'filtering and pagination', which is already evident from parameter names and descriptions.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'list', the resource 'infrastructure containers', and key features 'filtering and pagination'. It effectively distinguishes from other list-* sibling tools.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance is provided on when to use this tool versus alternatives like list-hosts or list-processes. The description does not mention any prerequisites or when not to use it.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list-downtimesA
Read-only

List scheduled downtimes (monitor mute periods)

ParametersJSON Schema
NameRequiredDescriptionDefault
currentOnlyNoReturn only currently active downtimes
includeNoComma-separated related resources to include. Example: created_by,monitor
pageLimitNoMax results per page (default 50)
pageOffsetNoPagination offset

TDQS

A3.5/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Description adds clarification 'monitor mute periods' but does not elaborate on behavioral traits beyond annotations (readOnlyHint, openWorldHint). No contradictions.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single concise sentence with front-loaded key information. No superfluous content.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

No output schema and description lacks details about return format, pagination, or example usage. Adequate but minimal for a simple list tool.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema covers all 4 parameters with descriptions (100% coverage). Tool description adds no extra information about parameters; baseline score applies.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Description clearly states 'List scheduled downtimes (monitor mute periods)' with specific verb and resource, distinguishing from sibling tools like create-downtime or cancel-downtime.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance provided on when to use this tool vs alternatives (e.g., get-monitor, list-slos). Missing context for selection among many list tools.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list-error-tracking-issuesA
Read-only

List error tracking issues with search, filtering, and sorting

ParametersJSON Schema
NameRequiredDescriptionDefault
queryNoSearch query to filter error tracking issues. Example: service:api-server error_type:TypeError*
fromYesStart time (ISO 8601 or relative). Example: 2026-03-01T00:00:00Z or now-1h
toYesEnd time (ISO 8601 or relative). Example: 2026-03-02T00:00:00Z or now
trackNoTrack to search errors in: trace (APM), logs, or rumtrace
pageSizeNoNumber of results per page (default 25, max 100)

TDQS

A3.7/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint and openWorldHint. The description adds no behavioral details beyond what the schema and annotations provide, such as pagination behavior or result size limits.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence that is concise, front-loaded, and contains no unnecessary words.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The description covers the basic purpose but lacks details on response format, pagination, or edge cases. Given no output schema, additional context would be beneficial, but the description is minimally adequate.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so each parameter is documented in the schema. The tool description does not add additional parameter information, but the baseline is 3 for high coverage.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'list' and the resource 'error tracking issues', and lists capabilities like search, filtering, and sorting. It distinguishes from sibling 'get-error-tracking-issue' which retrieves a single issue.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage for listing error tracking issues with search, filtering, and sorting capabilities. While it does not explicitly state when not to use or mention alternatives, the context is clear for a listing operation.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list-fleet-agentsA
Read-only

List Datadog Agents in the fleet with filtering, sorting, and pagination

ParametersJSON Schema
NameRequiredDescriptionDefault
pageNumberNoPage number (0-based)
pageSizeNoNumber of results per page (max 100)
filterNoFilter string using Datadog query syntax
tagsNoComma-separated list of tags to filter agents
sortAttributeNoAttribute to sort by
sortDescendingNoSort descending if true

TDQS

A3.6/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint and openWorldHint, so the description's job is lighter. The description adds that the tool supports filtering, sorting, and pagination, which is useful but lacks specifics (e.g., default page size, sorting defaults). It adequately supplements annotations without contradicting them.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, well-structured sentence that front-loads the action and resource, then enumerates capabilities. No fluff or repetition, earning the highest score.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a list tool with a well-described schema and annotations, the description provides adequate high-level context. It covers the main operations (filter, sort, paginate) without needing to detail output (no output schema). Slight gap: no mention of what the response contains, but still functional.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% and each parameter already has a clear description (e.g., pageNumber is 0-based, pageSize max 100). The description adds no additional meaning beyond restating these capabilities, so baseline 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly specifies the verb 'List' and the resource 'Datadog Agents in the fleet', distinguishing it from sibling tools like list-fleet-deployments or list-hosts. It also mentions key capabilities (filtering, sorting, pagination), making the purpose immediately clear.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

There is no explicit guidance on when to use this tool vs alternatives. While the resource is clear, the description does not state when not to use it or provide context about alternatives among the many list-* siblings.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list-fleet-agent-versionsA
Read-only

List all available Datadog Agent versions for deployment

ParametersJSON Schema
NameRequiredDescriptionDefault

No parameters

TDQS

A4/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint and openWorldHint, so the description only adds 'for deployment' context. It does not disclose pagination, filtering, or result set behavior beyond what annotations imply.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

A single front-loaded sentence with no unnecessary words. Perfectly concise.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple zero-parameter list tool with annotations covering safety, the description is mostly adequate. However, it lacks any hint about the output structure (e.g., returns a list of version strings) which would be helpful since no output schema exists.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

There are zero parameters, so schema coverage is 100%. Baseline for no parameters is 4, and the description adds no parameter-related value, but none is needed.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description 'List all available Datadog Agent versions for deployment' clearly states the verb (list), resource (Datadog Agent versions), and context (for deployment). It distinguishes from sibling tools like list-fleet-agents (lists agents) and list-fleet-deployments (lists deployments).

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage for deployment planning but does not explicitly state when to use this tool versus alternatives like list-fleet-agents or list-fleet-deployments. No exclusions or prerequisites are mentioned.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list-fleet-deploymentsA
Read-only

List fleet automation deployments with pagination

ParametersJSON Schema
NameRequiredDescriptionDefault
pageSizeNoNumber of deployments per page (max 100)
pageOffsetNoIndex of first deployment to return

TDQS

A3.6/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

The description aligns with readOnlyHint=true and openWorldHint=true. It adds minimal extra context (paginated behavior), but does not disclose potential thresholds or default sorting, which is acceptable given the simplicity.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, concise sentence that front-loads the action without waste. Every word contributes to the purpose.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the simple nature of the tool (2 optional params, no output schema), the description is adequate. It covers the essential information an agent needs to invoke it correctly.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, so parameters are fully described in the schema. The description mentions pagination but does not add meaning beyond what the schema provides; baseline 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool lists fleet automation deployments and includes pagination. It distinguishes from sibling list tools (e.g., list-fleet-agents) by specifying the resource.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool versus alternatives like get-fleet-deployment or other list tools. The openWorldHint suggests unrestricted use, but no explicit usage context is provided.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list-fleet-schedulesB
Read-only

List automated fleet upgrade schedules

ParametersJSON Schema
NameRequiredDescriptionDefault

No parameters

TDQS

B3.2/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

The annotations already declare readOnlyHint=true and openWorldHint=true. The description adds no additional behavioral context beyond stating the purpose. It does not mention pagination, ordering, or what constitutes an 'automated fleet upgrade schedule', so the agent has no extra insight into behavior.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single short sentence that conveys the core purpose without any extraneous words. It is efficient and front-loaded, making it easy to scan.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given no output schema, the description does not explain what the response contains (e.g., schedule IDs, details, statuses). While the tool is simple and annotations provide some context (read-only, open world), an agent would benefit from knowing what information is returned to use with sibling tools like get-fleet-schedule or trigger-fleet-schedule.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

There are zero parameters, so the baseline is 4. The description does not need to explain parameters because none exist. It correctly implies no inputs are required.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description 'List automated fleet upgrade schedules' clearly states the action (list) and the resource (automated fleet upgrade schedules). It distinguishes from sibling list tools like list-fleet-agents and list-fleet-deployments by specifying 'upgrade schedules', but does not differentiate from get-fleet-schedule (single schedule) or trigger-fleet-schedule (action on schedule).

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool versus alternatives. There is no mention of when to list schedules versus create, update, delete, get, or trigger them. The description lacks context for the agent to decide between this and other fleet schedule tools or other list tools.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list-fleet-tracersA
Read-only

List fleet tracers (telemetry-derived service names) with filtering

ParametersJSON Schema
NameRequiredDescriptionDefault
pageNumberNoPage number (0-based)
pageSizeNoNumber of results per page (max 100)
filterNoFilter string for narrowing tracer results

TDQS

A3.8/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already indicate readOnlyHint=true and openWorldHint=true. The description adds minimal behavioral context beyond that, such as no mention of pagination or result limits.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

A single, front-loaded sentence that conveys the core purpose and filtering capability without waste.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple read-only list tool with no output schema, the description is adequate, though it could hint at return format or pagination behavior.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% with clear parameter descriptions. The description adds no extra meaning beyond the schema, so baseline 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the action (list) and resource (fleet tracers), adds helpful context (telemetry-derived service names), and distinguishes from sibling tools like list-services or list-hosts.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage for listing fleet tracers with filtering, but provides no explicit guidance on when to use this tool vs. alternatives like list-services or list-fleet-agents.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list-hostsB
Read-only

List infrastructure hosts with filtering, sorting, and metadata

ParametersJSON Schema
NameRequiredDescriptionDefault
filterNoFilter string for search results. Example: web-server or env:prod
sortFieldNoField to sort by. Example: apps, cpu, iowait, load
sortDirNoSort direction: asc or desc
countNoNumber of hosts to return (max 1000)
startNoPagination offset
fromNoUnix epoch seconds — hosts active since this time. Example: 1740000000
includeMutedHostsDataNoInclude mute status info
includeHostsMetadataNoInclude agent_version, machine, platform, processor

TDQS

B3.4/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true and openWorldHint=true. The description adds that the tool supports filtering, sorting, and metadata, but does not reveal pagination behavior, rate limits, or return format beyond the schema.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

A single sentence that is front-loaded with the core purpose. No wasted words; every word is informative.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Despite having 8 parameters and no output schema, the description does not explain return values, pagination behavior, or how the filtering/sorting parameters interact. An agent would need more context to use the tool effectively.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so the schema already documents all parameters. The description adds no new parameter meaning beyond restating 'filtering, sorting, and metadata'.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states 'List infrastructure hosts with filtering, sorting, and metadata', using a specific verb ('list') and resource ('infrastructure hosts'), and distinguishes it from sibling tools that list other resources (e.g., list-services, list-users).

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool versus alternatives. It does not mention prerequisites, exclusions, or differentiate from similar list tools like get-host-totals.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list-logs-metricsA
Read-only

List all configured log-based metrics with their definitions

ParametersJSON Schema
NameRequiredDescriptionDefault

No parameters

TDQS

A3.9/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already state readOnlyHint=true and openWorldHint=true, covering safety and result volatility. The description adds that each metric includes its definition, which is useful behavior context. No contradictions.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence of 8 words, directly stating the purpose. No unnecessary information, front-loaded verb and resource.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple list tool with no parameters and no output schema, the description is complete: it specifies the resource type (log-based metrics) and what is returned (definitions). Annotations handle safety and open-world behavior.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The input schema has no parameters, so schema description coverage is trivially 100%. The description correctly adds no parameter info, as none exist. Baseline 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool lists all configured log-based metrics with their definitions. It uses a specific verb 'list' and resource 'log-based metrics', distinguishing it from sibling tools like 'get-logs-metric' (single) and 'list-active-metrics' (all metrics).

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies the tool is used to retrieve log-based metrics but provides no explicit guidance on when to use it vs alternatives like 'list-metric-tags' or 'get-logs-metric'. No when-not-to-use or prerequisite information is given.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list-metric-tagsA
Read-only

List tags for a specific metric (useful for understanding available groupings and filters)

ParametersJSON Schema
NameRequiredDescriptionDefault
metricNameYesFull metric name. Example: system.cpu.user
windowSecondsNoLook-back window in seconds (default/min 14400 = 4h)

TDQS

A3.8/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true and openWorldHint=true. The description adds context about output purpose (groupings/filters) but no additional behavioral details beyond the annotations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence with 15 words, no unnecessary text. Front-loaded with action and resource.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple read-only list operation, the description provides enough context (purpose and usage hint). No output schema, but the purpose implies returning tag keys/values. Lacks explicit output format details, but adequate given simplicity.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so the description adds little beyond the schema's parameter descriptions. The overall purpose is mentioned, but no new per-parameter details.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the action ('List tags'), the resource ('for a specific metric'), and provides context ('useful for understanding available groupings and filters'). It distinguishes this tool from siblings like 'list-active-metrics' or 'list-metrics' by specifying tags.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage for understanding groupings and filters but does not explicitly state when to use or avoid this tool, nor does it mention alternatives like 'list-active-metrics' or 'query-metrics'.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list-network-devicesA
Read-only

List network devices (routers, switches, firewalls) monitored by Datadog NDM

ParametersJSON Schema
NameRequiredDescriptionDefault
filterTagNoFilter devices by tag. Example: env:production, datacenter:us-east
sortNoSort field. Example: name, -name, model
pageSizeNoNumber of results per page (default 25, max 100)
pageNumberNoPage number (0-based)

TDQS

A3.6/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true and openWorldHint=true, covering safety and openness. The description adds no further behavioral details (e.g., pagination behavior, result format). With annotations present, the burden is partially lifted, but more context would be beneficial.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence that is concise, front-loaded with key information (verb, resource, scope). No unnecessary words.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a list tool with pagination parameters described in the schema, the description is mostly complete. It could mention that results are paginated or what the output contains, but it's not critical since the schema covers pagination and the tool is straightforward.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100% with each parameter documented. The description adds no additional parameter context beyond the schema, so baseline 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Description clearly states the verb (list) and resource (network devices including routers, switches, firewalls) monitored by Datadog NDM. It differentiates from siblings like get-network-device (single device) and list-hosts/list-containers (other resource types).

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No explicit guidance on when to use this tool versus alternatives like get-network-device for details or other list tools. The resource name implies the use case, but no conditional advice is provided.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list-notebooksA
Read-only

List Datadog notebooks with search and filtering

ParametersJSON Schema
NameRequiredDescriptionDefault
queryNoSearch query to filter notebooks by name. Example: incident postmortem
authorHandleNoFilter by author handle (email). Example: user@example.com
countNoNumber of results to return (default 50)
startNoPagination offset
sortFieldNoSort field: modified, name, createdmodified
sortDirNoSort direction: asc or descdesc
includeCellsNoInclude notebook cell contents in response

TDQS

A3.8/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true and openWorldHint=true, so the description's mention of 'search and filtering' adds minimal behavioral context. No contradictions, but no additional depth beyond what annotations provide.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence, directly to the point, no unnecessary words. Efficient and front-loaded.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given that all parameters are well-described in the schema and annotations are present, the description is nearly complete. It could mention pagination or response format, but the parameters (start, count, sort) cover pagination usage.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% with detailed parameter descriptions. The description does not add any meaning beyond what the schema already provides, so baseline score of 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description 'List Datadog notebooks with search and filtering' clearly states the action (list), resource (notebooks), and capabilities (search and filtering). It distinguishes from siblings like 'get-notebook' which retrieves a single notebook.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No explicit when-to-use or alternatives guidance. It is implied that this tool is for listing notebooks, but no mention of when to prefer this over other list tools or what scenarios it's best for.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list-processesA
Read-only

List running processes across infrastructure with search and tag filtering

ParametersJSON Schema
NameRequiredDescriptionDefault
searchNoSearch query string to filter processes. Example: nginx, python
tagsNoComma-separated list of tags to filter by. Example: env:production,service:api
fromNoUnix timestamp (seconds) for start of data collection window
toNoUnix timestamp (seconds) for end of data collection window
pageSizeNoNumber of results per page (default 50, max 1000)
pageCursorNoPagination cursor from previous response

TDQS

A3.9/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint and openWorldHint, so the description need not repeat. It adds the behavioral trait of search/tag filtering, but does not detail pagination or data scope, which is acceptable given annotation coverage.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence that efficiently conveys the core function and key features without extraneous information.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Without an output schema, the description does not clarify what the response contains (e.g., process details). It covers input parameters but omits output structure, which is needed for a complete understanding.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, so description adds minimal value beyond the schema. It references search and tags but does not elaborate on other parameters like from, to, pageSize, or pageCursor.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool lists running processes across infrastructure with search and tag filtering, differentiating from sibling tools like list-hosts or list-containers.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No explicit guidance on when to use this tool versus alternatives. The description implies usage for listing processes with filters, but does not mention when not to use it or compare to other list tools.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list-rum-applicationsA
Read-only

List all RUM applications in your Datadog organization

ParametersJSON Schema
NameRequiredDescriptionDefault

No parameters

TDQS

A4.3/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already contain readOnlyHint: true and openWorldHint: true, which indicate the tool is safe to use and returns all available items. The description adds no new behavioral context beyond confirming 'List all', so it does not exceed what annotations provide.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, well-structured sentence that immediately conveys the tool's purpose. There is no unnecessary information.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple list tool with no parameters and no output schema, the description is adequate. It states the action and scope. However, some details about what information is returned per application would improve completeness, especially since output schema is absent.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters5/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The tool has no parameters (empty input schema), so there is nothing to document. The description accurately reflects this by not mentioning parameters. Schema coverage is complete at 100%.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'List', the resource 'RUM applications', and the scope 'in your Datadog organization'. It distinguishes from sibling tools like create-rum-application, get-rum-application, and others that deal with different RUM entities.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description is straightforward, indicating that this tool lists all RUM applications. It does not explicitly mention when to use this versus get-rum-application, but the purpose is clear enough that an agent would understand to use this for a complete list.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list-rum-metricsA
Read-only

List all configured rum-based metrics with their definitions

ParametersJSON Schema
NameRequiredDescriptionDefault

No parameters

TDQS

A3.8/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true and openWorldHint=true, indicating a safe read operation returning a complete set. The description adds 'with their definitions', clarifying the return content beyond just names. However, it does not disclose pagination, limits, or whether metrics are returned in a particular order. The description adds some value but is not rich.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single concise sentence of 8 words that efficiently conveys the purpose. No redundant or extraneous information is present.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool has no parameters and no output schema, the description adequately states that it returns definitions for all configured RUM metrics. It is complete enough for a simple list operation, though it could explicitly mention the output format or that no pagination is needed. Given the simplicity, it is well-suited.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The input schema has 0 parameters, so schema coverage is 100% by default. The description does not need to add parameter details. Per guidelines, 0 parameters yields a baseline score of 4. The description adds no extra parameter info, but none is needed.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description 'List all configured rum-based metrics with their definitions' clearly specifies the action (list) and resource (rum-based metrics). It effectively distinguishes this tool from siblings like 'get-rum-metric' (single metric) and 'create-rum-metric' (mutation), as it indicates a listing of all items with definitions.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides no guidance on when to use this tool over alternatives. It does not mention that 'get-rum-metric' should be used for a specific metric, nor does it indicate any prerequisites or filtering options. The agent must infer usage from the tool name alone.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list-rum-retention-filtersA
Read-only

List RUM retention filters for a RUM application

ParametersJSON Schema
NameRequiredDescriptionDefault
appIdYesRUM application ID

TDQS

A3.7/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true and openWorldHint=true. The description adds no further behavioral context (e.g., pagination, rate limits, response format), thus only meets the baseline.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

One concise sentence, front-loads the key information ('List'), no fluff—every word earns its place.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple list tool with no output schema, the description covers the basic operation but lacks details on return format or pagination, leaving some uncertainty.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% with appId's own description. The tool description adds no extra meaning beyond what the schema provides, so baseline 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'List' and resource 'RUM retention filters' with scope 'for a RUM application', distinguishing it from create, get, delete, update, and list siblings.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No explicit when/when-not/alternatives are provided, but the name and description imply use for listing all filters per app, contrasting with get-rum-retention-filter for specific IDs.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list-security-rulesA
Read-only

List security monitoring detection rules with optional search filtering

ParametersJSON Schema
NameRequiredDescriptionDefault
queryNoSearch query to filter rules by name or tag
pageSizeNoNumber of results per page (default 25, max 100)
pageNumberNoPage number (0-based)

TDQS

A3.6/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint and openWorldHint. Description adds 'with optional search filtering' but does not disclose pagination behavior or rate limits, which are relevant given no output schema.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence that is front-loaded and efficient, covering the core functionality without redundancy.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple list tool with pagination, the description lacks mention of paging behavior and return format, but is otherwise sufficient given annotations and schema coverage.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema covers 100% of parameters with descriptions; the description only reiterates the query parameter without adding new meaning or constraints beyond schema.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool lists security monitoring detection rules with optional search filtering, distinguishing it from siblings like list-security-suppressions or list-teams.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool versus alternatives (e.g., get-security-rule for a single rule, search-security-signals for events). No when-not-to-use or context provided.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list-security-suppressionsA
Read-only

List security monitoring suppression rules

ParametersJSON Schema
NameRequiredDescriptionDefault
queryNoSearch query to filter suppressions
pageSizeNoNumber of results per page (default 25)
pageNumberNoPage number (0-based)

TDQS

A3.6/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already provide readOnlyHint and openWorldHint. The description adds no behavioral context beyond what annotations state, missing opportunities to mention pagination or filtering behavior.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

A single concise sentence that front-loads the purpose with no wasted words.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a list operation with good schema and annotations, the description is largely complete. Minor gap: no mention of return format, but output schema is absent.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% and describes all three parameters adequately. The description does not add extra meaning beyond the schema, so baseline score of 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description 'List security monitoring suppression rules' uses a specific verb and resource, clearly distinguishing it from sibling tools like get-security-suppression and create-security-suppression.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No explicit guidance on when to use this tool vs alternatives; usage is implied by the name and description but lacks explicit context or exclusions.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list-servicesA
Read-only

List services from Datadog Software Catalog with filtering

ParametersJSON Schema
NameRequiredDescriptionDefault
pageSizeNoNumber of results per page (default 20, max 100)
pageNumberNoPage number (0-based)
filterNameNoFilter by entity name. Example: my-service
filterKindNoFilter by entity kind. Example: service, datastore, queue
filterOwnerNoFilter by owner. Example: team-backend

TDQS

A3.7/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint and openWorldHint, describing the tool's read-only and open-world nature. The description adds no further behavioral context (e.g., pagination, result limits, or state changes). Since it does not contradict annotations, a 3 is appropriate—neutral with no added value.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

A single, front-loaded sentence that concisely states the tool's action and key feature. No redundant information. Perfect length and clarity.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the absence of an output schema, the description should clarify what the tool returns (e.g., list of service objects). It only mentions 'list services with filtering,' leaving return format, pagination behavior, and filter combinations underdefined. Adequate but incomplete for operational use.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Input schema has 100% description coverage for all five parameters. The description adds 'with filtering' but does not elaborate on parameter usage beyond what schema already documents. Baseline 3 applies when schema does the heavy lifting.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool lists services from Datadog Software Catalog, with filtering capability. It distinguishes from sibling list tools which target different resources (e.g., list-hosts, list-containers). Verb and resource are specific, earning a 5.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description lacks explicit guidance on when to use this tool versus alternatives. While context suggests it's for listing services, no when-not statements or alternative mentions are provided. A slightly below average score due to missing usage context.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list-slo-correctionsA
Read-only

List SLO status corrections (maintenance windows, deployments excluded from SLO calculations)

ParametersJSON Schema
NameRequiredDescriptionDefault
offsetNoPagination offset
limitNoNumber of results per page

TDQS

A4/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true and openWorldHint=true, so the safety profile is clear. The description adds context about the content (exclusions from SLO calculations) but does not elaborate on pagination, ordering, or potential side effects. It adds some value beyond annotations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

A single, front-loaded sentence with a parenthetical explanation. Every word serves a purpose; no redundant information.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple list tool with pagination parameters and annotations covering safety, the description is mostly adequate. It could be improved by mentioning what fields are in each correction object, but the absence of an output schema and the tool's simplicity make it sufficient.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The input schema has 100% coverage for both parameters (offset and limit) with clear descriptions. The tool description adds no additional meaning or constraints beyond what the schema provides.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool lists SLO status corrections and explains what those are (maintenance windows, deployments excluded from SLO calculations). It distinguishes from siblings like list-slos (SLOs, not corrections) and get-slo-correction (single item).

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies use when you need a list of SLO corrections rather than a single correction (get-slo-correction) or a list of SLOs (list-slos). However, it does not explicitly state when to use or when to avoid using this tool.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list-slosA
Read-only

List Service Level Objectives with optional filtering by query, tags, or IDs

ParametersJSON Schema
NameRequiredDescriptionDefault
idsNoComma-separated list of SLO IDs to filter. Example: abc123,def456
queryNoSearch query for SLO names. Example: api-latency
tagsQueryNoFilter by tags. Example: env:prod,team:backend
limitNoMax results (default 100)
offsetNoPagination offset

TDQS

A3.7/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true and openWorldHint=true, so the description's burden is reduced. However, the description does not add behavioral details beyond listing, such as pagination behavior or the fact that it returns a list. It is adequate but not enriched.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence, concise and directly to the point. No unnecessary words or repetition. It is appropriately front-loaded.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the simplicity of the tool and the presence of annotations, the description is minimally complete. However, it lacks details about the return format or pagination behavior, which would be helpful since there is no output schema.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Parameter descriptions in the schema are already clear and cover 100% of parameters. The description summarizes the filtering options ('query, tags, or IDs') but does not add significant new meaning beyond what is in the schema. Baseline 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the action 'List' and the resource 'Service Level Objectives', with filtering options mentioned. It distinguishes from sibling tools like 'get-slo' (single) and 'list-slo-corrections' (different resource).

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies when to use (to list SLOs with optional filtering) but offers no explicit guidance on when not to use or alternatives. For example, it does not mention that 'get-slo' is for a single SLO or that 'list-slo-corrections' is for corrections.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list-spans-metricsA
Read-only

List all configured span-based metrics with their definitions

ParametersJSON Schema
NameRequiredDescriptionDefault

No parameters

TDQS

A3.9/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true and openWorldHint=true, indicating safe, read-only behavior with potentially dynamic results. The description adds no additional behavioral context beyond restating the purpose, which is acceptable but not enhancing.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence, directly stating the tool's purpose without any extraneous information. It is perfectly concise and front-loaded.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool has no parameters and no output schema, the description fully explains its functionality. The context (listing all configured span-based metrics with definitions) is complete for an agent to understand what the tool does.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The input schema has zero parameters, and schema description coverage is 100% (trivially). With no parameters, the description does not need to explain parameter semantics; baseline 4 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description 'List all configured span-based metrics with their definitions' clearly states a specific verb ('List') and resource ('span-based metrics'), and it distinguishes from sibling tools like 'get-spans-metric' (which retrieves a single metric) and 'create-spans-metric' (which creates a metric).

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides no guidance on when to use this tool versus alternatives (e.g., get-spans-metric for a specific metric). It only states what the tool does, not the context for its use.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list-status-page-componentsA
Read-only

List all components for a status page

ParametersJSON Schema
NameRequiredDescriptionDefault
pageIdYesThe status page ID

TDQS

A3.8/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true and openWorldHint=true. The description does not add any behavioral context beyond that, such as pagination, ordering, or filtering behavior. It does not contradict annotations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence front-loading the action and resource with no unnecessary words. It is highly concise.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple list tool with one required parameter and no output schema, the description is mostly complete. However, it does not mention whether the list is paginated or ordered, but this is a minor gap given the tool's simplicity.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% (only 'pageId' with description 'The status page ID'). The description adds no additional meaning beyond what the schema already provides, so baseline 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description 'List all components for a status page' clearly states the action (list) and the resource (components for a specific status page), and it distinguishes from sibling tools like 'get-status-page-component' which fetches a single component.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No explicit when-to-use or when-not-to-use guidance is provided. While the purpose is clear, there is no mention of alternatives or context that would help decide between this and other list tools for status pages.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list-status-page-degradationsA
Read-only

List degradation incidents across status pages with optional status/page filtering

ParametersJSON Schema
NameRequiredDescriptionDefault
filterPageIdNoFilter by status page ID
filterStatusNoFilter by degradation status
pageOffsetNoOffset for pagination
pageLimitNoNumber of results per page
sortNoSort order

TDQS

A4/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already provide readOnlyHint and openWorldHint. Description adds no extra behavioral context beyond listing; adequate but not enhanced.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence, no wasted words, directly states purpose and key features.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Covers core purpose and filtering but omits explicit mention of pagination and sorting, though these are in schema. Adequate for a read-only list tool with well-described parameters.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% with descriptions for each parameter. Description only mentions type of filtering, not adding meaning beyond schema.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Description clearly states it lists degradation incidents across status pages with optional filtering, distinguishing it from singular 'get-status-page-degradation' and creation tools.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Explicitly mentions optional status/page filtering, implying use case. Lacks explicit when-not-to-use but is clear enough given context.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list-status-page-maintenancesA
Read-only

List maintenance windows across status pages with optional status/page filtering

ParametersJSON Schema
NameRequiredDescriptionDefault
filterPageIdNoFilter by status page ID
filterStatusNoFilter by maintenance status
pageOffsetNoOffset for pagination
pageLimitNoNumber of results per page
sortNoSort order

TDQS

A3.8/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already provide readOnlyHint and openWorldHint. The description adds 'maintenance windows across status pages with filtering' but no additional behavioral details like auth requirements or rate limits. Adequate but not enhanced.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single, front-loaded sentence that efficiently captures the tool's purpose without waste.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a read-only list tool with good annotations and full schema coverage, the description is mostly complete. Could mention return format but not required.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, so the schema already describes all parameters. The description summarizes filtering options but adds no extra meaning beyond what's in the schema.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states it lists maintenance windows with optional filtering, distinguishing it from sibling tools like get-status-page-maintenance (single) and list-status-page-components (different entity).

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage for listing but does not explicitly state when not to use it or mention alternatives like get-status-page-maintenance for single items. Guidance is clear but lacks exclusions.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list-status-pagesA
Read-only

List all Datadog status pages for the organization

ParametersJSON Schema
NameRequiredDescriptionDefault
pageOffsetNoOffset for pagination
pageLimitNoNumber of status pages per page (default 25)

TDQS

A3.9/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true and openWorldHint=true. The description confirms read-only listing but adds no further behavioral context (e.g., rate limits, output format). With annotations present, the description provides minimal added value.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

A single, front-loaded sentence with no unnecessary words. Every word earns its place.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given no output schema, the description does not explain the response structure (e.g., an array of status pages). This is a minor gap for an agent needing to parse results. However, many list tools follow a consistent pattern.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% with clear parameter descriptions. The tool description does not add any semantic information beyond what the schema already provides, meeting the baseline.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description specifies the verb 'List' and the resource 'all Datadog status pages for the organization', clearly distinguishing it from sibling tools like 'get-status-page' (single retrieval) or create/delete variants.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage is for fetching the full list of status pages, but lacks explicit guidance on when to use this vs alternatives such as 'get-status-page' or pagination handling. Still, the context is clear given sibling tools.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list-syntheticsA
Read-only

List all Synthetics monitoring tests (API, Browser, Mobile)

ParametersJSON Schema
NameRequiredDescriptionDefault
pageSizeNoNumber of tests per page
pageNumberNoPage number (0-based)

TDQS

A3.7/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true and openWorldHint=true, which the description does not contradict. The description adds the scope ('all') and test types, which is useful but minimal. No additional behavioral traits like pagination behavior or rate limits are disclosed.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, clear sentence that is front-loaded with the main action and resource. Every word adds value, with no wasted space.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool's simplicity, the description is adequate but lacks details on return values or result structure (no output schema). With pagination parameters, some guidance on result ordering or empty results would improve completeness.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% for the two parameters (pageSize, pageNumber), and their descriptions are already in the schema. The description adds no further meaning beyond the schema, so a baseline score of 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'List' and the resource 'all Synthetics monitoring tests' with specific types (API, Browser, Mobile), distinguishing it from sibling tools like get-synthetics-result or list-slos.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage for listing synthetics tests but does not explicitly state when to use this tool versus alternatives or provide exclusions. No guidance on pagination or default ordering is given.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list-teamsA
Read-only

List Datadog teams with optional search filtering and pagination

ParametersJSON Schema
NameRequiredDescriptionDefault
filterKeywordNoSearch keyword to filter teams by name or handle
pageSizeNoNumber of results per page (default 25, max 100)
pageNumberNoPage number (0-based)
sortNoSort ordername

TDQS

A4/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

The description adds behavioral context about search filtering and pagination beyond the readOnlyHint annotation, confirming it is a safe read operation.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, front-loaded sentence of 10 words with no wasted content, efficiently conveying the tool's purpose.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The description covers the tool's behavior and parameters well, but lacks information about the output format. Given the tool's simplicity and annotations, this is a minor gap.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, so the description only provides a high-level summary of filtering and pagination, adding minimal value beyond the schema descriptions.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description uses the specific verb 'List' and resource 'Datadog teams', clearly distinguishing it from sibling tools like list-users or list-hosts which list different resources.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies when to use (listing teams with optional filtering), but does not provide explicit guidance on when to prefer this tool over alternatives like get-team or search-tools.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list-usersB
Read-only

List Datadog organization users with filtering and pagination

ParametersJSON Schema
NameRequiredDescriptionDefault
pageSizeNoNumber of results per page (default 50)
pageNumberNoPage number (0-based)
filterNoSearch filter string. Example: john
filterStatusNoFilter by user status. Example: Active, Pending, Disabled
sortNoSort field. Example: name, email, created_at
sortDirNoSort direction: asc or desc

TDQS

B3.4/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already indicate readOnlyHint and openWorldHint. The description adds no additional behavioral context beyond what is already in the schema, such as rate limits, default ordering, or response handling.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single concise sentence that front-loads the purpose, but it is slightly under-specified for a tool with 6 parameters.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

With no output schema and 6 optional parameters, the description could be more complete. It does not explain default behavior or what the response contains.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, so the description's mention of 'filtering and pagination' adds no new parameter meaning beyond what the schema already provides.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool lists Datadog organization users with filtering and pagination, with a specific verb and resource. It distinguishes from sibling tools that list other entities.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage for listing users with filters and pagination but provides no explicit guidance on when to use it over alternative tools or when not to use it.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list-workflow-instancesA
Read-only

List run instances (executions) for a workflow. Returns instance IDs to drill into with get-workflow-instance for step-level state and errors.

ParametersJSON Schema
NameRequiredDescriptionDefault
workflowIdYesWorkflow UUID whose runs to list
pageSizeNoResults per page (default 20, max 100)
pageNumberNoPage number (0-based)

TDQS

A4.2/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint and openWorldHint. The description adds that it returns instance IDs, which is useful behavioral context beyond annotations. It does not mention pagination or result format, but the core behavior is transparent.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Two sentences: first states purpose clearly, second provides context for further action. No wasted words. Efficient and well-structured.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a listing tool with good annotations and known parameters, the description covers purpose, return value (instance IDs), and next steps. It lacks mention of pagination behavior, but overall it is complete enough for correct invocation.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so baseline is 3. The description adds no additional parameter semantics beyond what the schema already provides (e.g., workflowId, pageSize with default and max, pageNumber 0-based). Thus, no extra value.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool lists run instances (executions) for a workflow. It distinguishes from siblings like get-workflow (definition) and get-workflow-instance (step-level detail), and from other list-* tools by specifying the resource type.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description advises using get-workflow-instance for deeper step-level state and errors, indicating a follow-up action. It implies this tool is for initial listing. However, it does not explicitly state when not to use this tool or compare with other list tools.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

mute-monitorA

Mute a Datadog monitor (silence notifications) for a scope and optional duration

ParametersJSON Schema
NameRequiredDescriptionDefault
monitorIdYesMonitor ID to mute
scopeNoScope to mute (e.g. host:myhost or env:staging)
endNoUnix epoch seconds when mute should end

TDQS

A3.7/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already indicate readOnlyHint=false (write operation), which the description aligns with by stating 'mute'. No additional behavioral context is provided, such as side effects, reversibility, or required permissions.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence (12 words) with no fluff. Front-loaded with key action and resource. Efficiently communicates the core functionality.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

With no output schema and minimal annotations, the description does not explain the return value, side effects (e.g., notifications suppressed), or how to unmute. Useful but leaves gaps for an agent.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% and each parameter has a description. The description adds minimal value beyond summarizing that scope is for filtering and end is optional, but does not add new semantic meaning.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'mute', the resource 'Datadog monitor', and adds clarifying context 'silence notifications for a scope and optional duration'. This distinguishes it from sibling tools like create-downtime or cancel-downtime.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage for silencing monitor notifications with scope/duration, but does not explicitly state when to use this tool vs alternatives like create-downtime or how to revert. No when-not-to-use guidance.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

post-eventA

Post a custom event to Datadog (supports markdown, @mentions)

ParametersJSON Schema
NameRequiredDescriptionDefault
titleYesEvent title. Example: Deployment completed
textYesEvent body (supports markdown, max 4000 chars). Example: Deployed v1.2.3 to production
tagsNoTags for the event. Example: ["env:prod", "deploy"]
alertTypeNoAlert type
priorityNoEvent priority
hostNoAssociated host name
aggregationKeyNoAggregation key for grouping events
sourceTypeNameNoSource type name. Example: my_app

TDQS

A4/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already indicate the tool is a mutation (readOnlyHint=false). The description confirms this by saying 'Post', and adds useful behavioral details about supporting markdown and @mentions. No contradictions. However, it does not mention potential side effects, rate limits, or required permissions, but the annotations cover the basic behavior sufficiently.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence that is concise and front-loaded with the core purpose. Every word adds value—no fluff. It efficiently communicates the tool's function and key features.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool's simplicity and the comprehensive schema descriptions, the description is mostly complete. However, it does not mention the return value or response format, which could be helpful as there is no output schema. Other than that, the context for using the tool is sufficient.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, with all 8 parameters having descriptions in the input schema. The description adds no additional semantic information beyond what is already in the schema, which is adequate but not exceptional. Baseline score of 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states 'Post a custom event to Datadog', specifying the verb 'post' and the resource 'custom event'. It further distinguishes the tool's capability by noting support for markdown and @mentions. This clarity sets it apart from sibling tools like get-events or other creation tools for different resources.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description does not provide explicit guidance on when to use this tool versus alternatives. While the context of 'custom event' implies it's for arbitrary event creation, there is no mention of when not to use it or what alternatives exist (e.g., for system events). The guidance is only implicit.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

publish-status-pageA

Publish a status page to make it accessible (public internet or internal org)

ParametersJSON Schema
NameRequiredDescriptionDefault
pageIdYesThe status page ID to publish

TDQS

A3.5/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already indicate readOnlyHint=false and openWorldHint=true. Description adds context about accessibility scope (public internet or internal org), which is useful. However, it does not disclose other traits like idempotency, required permissions, or side effects beyond what annotations imply.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence, no superfluous words. Every part earns its place, conveying the core action and scope efficiently.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple one-parameter tool with no output schema, the description covers the basic purpose and accessibility scope. However, it lacks context on prerequisites (e.g., page must exist) and expected behavior after publishing. Minimal but adequate given low complexity.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100% with a clear description for pageId. The tool description does not add any additional meaning beyond what the schema already provides, so baseline of 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Description clearly states the verb 'Publish' and resource 'status page', and specifies the outcome: make it accessible to public internet or internal org. This distinguishes it from sibling tools like 'unpublish-status-page' or 'update-status-page'.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No explicit guidance on when to use this tool versus alternatives. It does not mention prerequisites (e.g., page must exist), nor does it indicate that it should be used after creation or to make a page live. Lack of when-to-use and when-not-to-use information.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

query-metricsB
Read-only

Query time-series metric data from Datadog. Supports any Datadog metric query syntax (e.g., avg:system.cpu.user{host:myhost} by {env})

ParametersJSON Schema
NameRequiredDescriptionDefault
queryYesDatadog metric query. Example: avg:system.cpu.user{host:myhost} by {env}
fromYesStart time as Unix epoch seconds
toYesEnd time as Unix epoch seconds

TDQS

B3.3/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true and openWorldHint=true, so the description does not need to repeat that. However, it adds no additional behavioral context (e.g., rate limits, cost, or data volume implications) that would help the agent assess risk.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, front-loaded sentence that efficiently conveys the tool's purpose. It could include more detail without becoming verbose, but it is already clear.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given no output schema and the complexity of query tools that may return large datasets, the description lacks information on pagination, response format, timeouts, or data limits, making it incomplete for a realistic use case.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% with clear descriptions for all parameters. The description adds an example query string but no other semantics beyond the schema, so it meets the baseline without exceeding.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the action 'Query time-series metric data from Datadog' and specifies it supports any Datadog metric query syntax with an example, distinguishing it from sibling tools like get-metrics that likely list available metrics.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description does not provide any guidance on when to use this tool versus alternatives like get-metrics or get-metric-metadata, nor does it mention prerequisites or limitations.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

search-audit-logsB
Read-only

Search Datadog audit logs for organization activity tracking (user actions, resource changes)

ParametersJSON Schema
NameRequiredDescriptionDefault
queryNoAudit log search query. Example: @action:created @resource_type:dashboard*
fromYesStart time (ISO 8601 or relative). Example: 2026-03-01T00:00:00Z or now-24h
toYesEnd time (ISO 8601 or relative). Example: 2026-03-02T00:00:00Z or now
limitNoMax results (default 50, max 1000)
sortNoSort order: -timestamp (newest first) or timestamp (oldest first)-timestamp

TDQS

B3.4/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already indicate readOnlyHint=true and openWorldHint=true, which convey the tool is read-only and may have variable results. The description adds little beyond stating the domain, lacking details on rate limits, permissions, pagination, or potential changes to query results.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, concise sentence of 11 words that front-loads the core purpose. It is efficient but could be slightly more informative without becoming verbose.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the rich input schema and clear annotations, the description is adequate but lacks any mention of output format or additional behaviors (e.g., result limits beyond the limit parameter). The tool is simple, but completeness could be improved.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% with detailed descriptions for each parameter (e.g., query example, time format, limit bounds, sort enum). The tool description does not add additional meaning beyond the schema, so baseline score of 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'Search', the resource 'Datadog audit logs', and the purpose 'for organization activity tracking (user actions, resource changes)'. This distinguishes it from similar sibling tools like search-logs or search-security-signals.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage for tracking user actions and resource changes, but it does not explicitly state when to use this tool versus alternatives like search-logs or search-security-signals. No 'when to use' or 'when not to use' guidance is provided.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

search-ci-pipelinesA
Read-only

Search CI/CD pipeline events (builds, deploys) with query filtering

ParametersJSON Schema
NameRequiredDescriptionDefault
queryNoCI pipeline search query. Example: @ci.pipeline.name:deploy @ci.status:error*
fromYesStart time (ISO 8601 or relative). Example: 2026-03-01T00:00:00Z or now-24h
toYesEnd time (ISO 8601 or relative). Example: 2026-03-02T00:00:00Z or now
limitNoMax results (default 50, max 1000)
sortNoSort order-timestamp

TDQS

A3.6/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

The description is consistent with annotations (readOnlyHint: true, openWorldHint: true) and does not contradict them. However, it adds no behavioral context beyond what annotations already provide, such as authentication needs or rate limits. The bar is lower due to annotations, but the description could offer more.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, efficient sentence that covers the key elements: action, resource, and method. It is front-loaded and contains no wasteful words, though it could be slightly more descriptive about return format.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The description provides minimal context for a search tool with no output schema. It mentions the type of events (builds, deploys), but does not explain expected return format, typical use cases, or behavior with empty results. Given the tool's simplicity, it is adequate but could be more complete.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so the baseline is 3. The description adds no additional meaning beyond the schema's parameter descriptions. The schema already provides good detail for each parameter, so the description is not needed to compensate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the action (search), the resource (CI/CD pipeline events), and the method (query filtering). It distinguishes this tool from sibling tools like search-ci-tests and search-logs by specifying pipeline events.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage for searching CI/CD pipeline events with query filtering, but it does not explicitly state when to use this tool vs alternatives like search-ci-tests or search-logs. No exclusions or context for when not to use are provided.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

search-ci-testsA
Read-only

Search CI test events (unit tests, integration tests) with query filtering

ParametersJSON Schema
NameRequiredDescriptionDefault
queryNoCI test search query. Example: @test.service:my-app @test.status:fail*
fromYesStart time (ISO 8601 or relative). Example: now-24h
toYesEnd time (ISO 8601 or relative). Example: now
limitNoMax results (default 50, max 1000)
sortNoSort order-timestamp

TDQS

A3.7/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

The description mentions 'query filtering' but does not add significant behavioral details beyond what annotations (readOnlyHint, openWorldHint) already provide. It does not contradict annotations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence of 10 words, efficiently conveying the tool's core action and resource without unnecessary words.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the absence of an output schema, the description is minimal. It does not mention return format or pagination, but the well-documented parameters and annotations partially compensate. Still, more context would be helpful.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

With 100% schema description coverage, the schema already documents all 5 parameters. The description adds no additional parameter meaning beyond the schema.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'Search' and the resource 'CI test events (unit tests, integration tests)', making the purpose unambiguous. It distinguishes from sibling tools like 'search-ci-pipelines' which target a different resource.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description does not provide explicit guidance on when to use this tool versus alternatives like 'aggregate-ci-tests'. It implies usage for searching, but lacks exclusions or context for selection.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

search-incidentsB
Read-only

Search Datadog incidents by query (state, severity, title keywords)

ParametersJSON Schema
NameRequiredDescriptionDefault
queryYesSearch query for incidents. Example: state:active, severity:SEV-1, title keywords
pageSizeNoNumber of results per page (default 25, max 100)
pageOffsetNoPagination offset
sortNoSort order: -created (newest first) or created (oldest first)-created

TDQS

B3.3/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true and openWorldHint=true, indicating safe read behavior. The description adds minimal extra context (e.g., query fields) but does not contradict annotations. For a read-only search tool, the description is adequate but does not elaborate on pagination behavior or result limits beyond schema.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

A single, front-loaded sentence that directly conveys the tool's purpose. No unnecessary words or fluff. Maximally concise.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a search tool with 4 parameters and no output schema, the description is minimal. It does not explain return format (e.g., list of incident objects) or how to combine query terms. However, annotations and schema cover safety and pagination, so it is minimally adequate.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, so the description adds little value beyond the schema. It mentions query fields (state, severity, title keywords) which align with the schema's query description. No additional parameter semantics are provided.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'Search' and the resource 'Datadog incidents', and specifies searchable fields (state, severity, title keywords). However, it does not explicitly differentiate from sibling tools like 'get-incidents' which may also list incidents, but the intent is clear.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides no guidance on when to use this tool vs. alternatives such as 'get-incident' or 'get-incidents'. It lacks any 'when to use' or 'when not to use' context, leaving the agent to infer usage from the name alone.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

search-logsA
Read-only

Search Datadog logs by query with time range filtering

ParametersJSON Schema
NameRequiredDescriptionDefault
queryYesDatadog log query. Example: service:web-api status:error @http.status_code:[500 TO 599]
fromYesStart time (ISO 8601). Example: 2026-02-26T00:00:00Z
toYesEnd time (ISO 8601). Example: 2026-02-26T23:59:59Z
limitNoMax results (default 50, max 1000)
sortNoSort order: -timestamp (newest first) or timestamp (oldest first)-timestamp
indexesNoLog indexes to search. Example: ["main"]
extractFieldsNoComma-separated dotted paths to project from response (e.g. 'id,name,owner.name,columns.*.name'). Use `*` as wildcard for arrays/objects. Wrap field names with dots in backticks. Reduces response tokens dramatically on large entities.

TDQS

A3.6/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already indicate readOnlyHint=true, so safety is clear. The description adds context about query and time range but does not disclose pagination, error handling, or response format. With annotations, this is adequate but not rich.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence, front-loaded with key action and resource. Efficient but could be slightly more descriptive (e.g., including optional parameters). No waste.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

No output schema, but the description covers the core function. Missing details on return format and pagination behavior. For a search tool with 7 parameters and high schema coverage, it is minimally complete.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so the schema already documents all parameters. The description does not add further meaning beyond the schema's parameter descriptions.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'Search' and the resource 'Datadog logs' with specific filtering options. It distinguishes from siblings like 'search-audit-logs' and 'aggregate-logs'.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No explicit guidance on when to use this tool versus alternatives like 'aggregate-logs' or 'search-security-signals'. The context is implied but not stated.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

search-rum-eventsA
Read-only

Search Real User Monitoring events (sessions, views, errors, actions) from mobile/web apps

ParametersJSON Schema
NameRequiredDescriptionDefault
queryYesRUM search query. Example: service:my-app @type:error @session.type:user
fromYesStart time (ISO 8601). Example: 2026-02-26T00:00:00Z
toYesEnd time (ISO 8601). Example: 2026-02-26T23:59:59Z
limitNoMax results (default 50, max 1000)
sortNoSort order: -timestamp (newest first) or timestamp (oldest first)-timestamp
extractFieldsNoComma-separated dotted paths to project from response (e.g. 'id,name,owner.name,columns.*.name'). Use `*` as wildcard for arrays/objects. Wrap field names with dots in backticks. Reduces response tokens dramatically on large entities.

TDQS

A3.5/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint and openWorldHint, which cover key behavioral aspects. The description adds minimal context (mobile/web app source) but does not disclose additional traits like query syntax details, pagination, or rate limits. With annotations present, the description contributes moderately.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, front-loaded sentence that efficiently conveys the purpose and scope. Every word is necessary, and there is no redundancy or filler.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool has 6 well-documented parameters and annotations, the description is adequate but not fully complete. It lacks details on result format, pagination, or query syntax, and does not situate itself among similar search tools.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so the baseline is 3. The tool description does not add any parameter-specific information beyond what is in the schema. The schema already provides detailed examples and constraints for each parameter.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description explicitly states the verb 'Search', the resource 'Real User Monitoring events', and specifies event types (sessions, views, errors, actions) and source (mobile/web apps). This clearly differentiates from sibling tools like search-logs or list-rum-applications.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides no guidance on when to use this tool versus alternatives. It does not mention when not to use it or point to sibling tools for related tasks like searching logs or aggregating RUM data.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

search-security-signalsB
Read-only

Search Datadog security monitoring signals with query filtering

ParametersJSON Schema
NameRequiredDescriptionDefault
queryNoSecurity signal search query. Example: type:log_detection status:high or **
fromYesStart time (ISO 8601). Example: 2026-02-26T00:00:00Z
toYesEnd time (ISO 8601). Example: 2026-02-26T23:59:59Z
limitNoMax results (default 50, max 1000)
sortNoSort order: -timestamp (newest first) or timestamp (oldest first)-timestamp
extractFieldsNoComma-separated dotted paths to project from response (e.g. 'id,name,owner.name,columns.*.name'). Use `*` as wildcard for arrays/objects. Wrap field names with dots in backticks. Reduces response tokens dramatically on large entities.

TDQS

B3.1/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true and openWorldHint=true, covering the safety and variability profile. The description adds no further behavioral details (e.g., pagination, rate limits), but does not contradict annotations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence, front-loaded with verb and resource. Efficient and to the point, though could benefit from minor elaboration.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Despite 6 parameters and no output schema, the description omits what a security signal is, the return format, or any context beyond 'searching'. Annotations help but additional behavioral details would improve completeness.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100% (all 6 parameters have descriptions). The tool description adds no additional meaning beyond the schema, meeting the baseline for high coverage.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'search' and resource 'Datadog security monitoring signals', indicating a query-based retrieval tool. It distinguishes from siblings like 'get-security-signal' (single) and 'list-security-rules' (different resource), but does not explicitly differentiate from other search tools.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool versus alternatives such as 'get-security-signal' or other search tools. The description implies usage but provides no explicit context or exclusions.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

search-spansB
Read-only

Search APM spans/traces for performance analysis. Filter by service, resource, status, duration

ParametersJSON Schema
NameRequiredDescriptionDefault
queryYesSpan search query. Example: service:api-server resource_name:GET_/users @duration:>5s
fromYesStart time (ISO 8601 or relative). Example: 2026-02-26T00:00:00Z or now-1h
toYesEnd time (ISO 8601 or relative). Example: 2026-02-26T23:59:59Z or now
limitNoMax results (default 50, max 1000)
sortNoSort order: -timestamp (newest first) or timestamp (oldest first)-timestamp
extractFieldsNoComma-separated dotted paths to project from response (e.g. 'id,name,owner.name,columns.*.name'). Use `*` as wildcard for arrays/objects. Wrap field names with dots in backticks. Reduces response tokens dramatically on large entities.

TDQS

B3.4/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint and openWorldHint, so the agent knows it's a safe, read-only operation. The description adds no additional behavioral traits (e.g., rate limits, authentication needs, or result structure). The description repeats filter capabilities that are already in the schema, adding minimal value beyond annotations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, concise sentence that conveys the purpose and key filtering capabilities without redundancy. It is front-loaded with the main action and domain, making it efficient for agent scanning.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a search tool with good parameter documentation, the description covers the essential purpose and filter dimensions. However, it lacks information about return values, pagination (limit parameter exists but no explanation of result format), or any behavioral details like sorting default. With no output schema, more context on result structure would improve completeness.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so baseline is 3. The description adds value by listing example filter fields (service, resource, status, duration) that likely correspond to the query syntax, providing practical guidance beyond the schema. This helps agents construct effective queries.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool searches APM spans/traces for performance analysis, specifying the domain (APM) and the action (search). It differentiates from sibling search tools like search-logs or search-ci-pipelines by focusing on spans/traces. However, it could be more explicit about the resource type (spans/traces) to avoid ambiguity.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage for APM performance analysis and filtering by common fields, but it does not explicitly state when to use this tool versus alternatives (e.g., search-logs for logs, list-services for services). No guidance on when not to use it is provided, but the domain specificity gives some context.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

search-toolsA
Read-only

Discover available tools by natural language query. Returns matching tool names + descriptions across all 158+ tools. Use this first to navigate the surface efficiently — call this, then call the specific tool you need.

ParametersJSON Schema
NameRequiredDescriptionDefault
queryYesNatural language query. Discover tools across the 158-tool Datadog MCP surface — call this first to find the right tool.
categoryNoRestrict search to a specific category
limitNoMax results (default 20)

TDQS

A4.5/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already indicate readOnlyHint=true and openWorldHint=true. The description adds that it returns tool names and descriptions covering all 158+ tools, which is useful behavioral context.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Two concise sentences: first states purpose and output, second gives usage guidance. No wasted words, front-loaded with action.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Without an output schema, the description adequately explains return value (matching tool names + descriptions). Given low complexity and annotations covering safety, this is complete for agent decision-making.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, so all parameters already have descriptions. The description does not add extra parameter-level details beyond what is in the schema.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states it discovers available tools via natural language query and returns tool names and descriptions. It distinguishes itself from sibling tools by being the tool to find the right tool before calling specific ones.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines5/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Explicitly advises 'Use this first to navigate the surface efficiently — call this, then call the specific tool you need.' This provides clear when-to-use guidance and implies not to use when already knowing the target tool.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

send-dora-deploymentB

Send a DORA deployment event for tracking deployment frequency and lead time

ParametersJSON Schema
NameRequiredDescriptionDefault
serviceYesService name for the deployment. Example: my-api-service
versionNoVersion or git SHA of the deployment. Example: v1.2.3 or abc123
environmentNoEnvironment name. Example: production, staging
startedAtYesUnix timestamp (seconds) when deployment started
finishedAtYesUnix timestamp (seconds) when deployment finished

TDQS

B3.3/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations indicate readOnlyHint=false (write operation) but description adds no additional behavioral traits (e.g., idempotency, persistence, response). Does not disclose what the event includes or if there are side effects beyond 'send'.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single, concise sentence front-loading the action and purpose. No unnecessary words; every part contributes to understanding.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Adequate for a straightforward event sender with well-documented schema, but lacks information about return behavior or acknowledgment. openWorldHint suggests potential effects beyond described, which could be elaborated.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema covers all 5 parameters with descriptions and examples (100% coverage). Description provides context that the event is for tracking deployment frequency and lead time, but does not add per-parameter semantics beyond what schema already provides.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Description clearly states the verb ('Send a DORA deployment event') and the resource/purpose ('for tracking deployment frequency and lead time'). It distinguishes from sibling 'send-dora-incident' by specifying 'deployment'.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No when-to-use or when-not-to-use guidance. Sibling 'send-dora-incident' exists but description does not differentiate usage contexts, nor does it mention prerequisites or alternatives.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

send-dora-incidentC

Send a DORA incident event for tracking change failure rate and MTTR

ParametersJSON Schema
NameRequiredDescriptionDefault
serviceYesService name affected by the incident. Example: my-api-service
nameNoIncident name or title
severityNoIncident severity. Example: SEV-1, SEV-2
environmentNoEnvironment name. Example: production
startedAtYesUnix timestamp (seconds) when incident started
finishedAtNoUnix timestamp (seconds) when incident was resolved
versionNoVersion that caused the incident

TDQS

C2.9/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations indicate write operation (readOnlyHint=false) and open world (openWorldHint=true), but description adds no further behavioral insights like idempotency, permissions, or side effects beyond 'Send'.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence, 12 words, no unnecessary text. Front-loaded with the key action and purpose.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Minimal description given 7 parameters, no output schema, and many siblings. Lacks details on return values, impact, or how this event integrates with DORA tracking.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema covers 100% of parameter descriptions, so baseline 3 applies. Description adds no extra parameter meaning beyond what's already in the schema.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

Clearly states sending a DORA incident event for tracking change failure rate and MTTR. However, fails to differentiate from similar sibling tool 'create-incident', which also likely creates incidents.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool versus alternatives like 'create-incident' or 'send-dora-deployment'. Lacks context on prerequisites or scenarios.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

send-logsB

Send log entries to Datadog

ParametersJSON Schema
NameRequiredDescriptionDefault
logsYesArray of log entries to send

TDQS

B3.3/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations indicate a write operation (readOnlyHint=false) and open world hint. Description adds no extra behavioral context (e.g., error handling, rate limits, idempotency).

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence, no extraneous text. Highly concise and efficient.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

No output schema and no description of return values or error states. For a simple send operation, this is somewhat acceptable but could be more helpful.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema covers 100% of parameter descriptions; description adds no additional semantic value beyond what's in the schema.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Description clearly states the action 'send' and resource 'log entries', distinguishing it from read/aggregate tools like search-logs and aggregate-logs.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool versus alternatives (e.g., search-logs, aggregate-logs). The description is purely functional.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

slo-compliance-snapshotA
Read-only

Aggregated SLO health: config + history-window SLI + active corrections + each linked monitor's current state in one call. Computes errorBudgetRemainingPct and status (compliant | at-risk | breached). Replaces 3-5 round-trips of get-slo + get-slo-history + list-slo-corrections + get-monitor (per linked monitor). Uses Promise.allSettled — partial failures populate caveats[] instead of crashing. Renders an Apps SDK card on ChatGPT clients (Claude clients receive the same JSON text).

ParametersJSON Schema
NameRequiredDescriptionDefault
sloIdYesSLO ID. Example: abc123def456abc123def456abc123de
historyDaysNoDays of history to evaluate SLI against target (default 7, max 90)
extractFieldsNoComma-separated dotted paths to project from response (e.g. 'id,name,owner.name,columns.*.name'). Use `*` as wildcard for arrays/objects. Wrap field names with dots in backticks. Reduces response tokens dramatically on large entities.

TDQS

A4.4/5.0
Behavior5/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Beyond annotations (readOnlyHint, openWorldHint), the description adds critical behavior: use of Promise.allSettled to handle partial failures via caveats[], rendering an Apps SDK card on ChatGPT clients, and computing specific fields. This significantly aids agent understanding of side effects.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Four sentences, front-loaded with key purpose, followed by efficiency gains, technical behavior, and output format. No fluff or redundancy.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The description covers purpose, behavior, and output format (card/JSON). Without an output schema, it could detail response structure more, but it sufficiently informs an agent about what to expect.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% with parameter descriptions. The description adds no extra semantic value beyond the schema, such as elaborating on extractFields usage or historyDays default. Baseline of 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool aggregates SLO health data, including config, history, corrections, and linked monitor states, computing errorBudgetRemainingPct and status. It distinguishes from siblings like get-slo, get-slo-history, and list-slo-corrections by noting it replaces 3-5 round-trips.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description explicitly compares to individual tools, stating it replaces multiple round-trips and uses Promise.allSettled for partial failures. It implies when to use (for a comprehensive snapshot) but does not explicitly state when not to use or provide alternative tools.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

trigger-fleet-scheduleA

Manually trigger a fleet schedule to immediately create a deployment

ParametersJSON Schema
NameRequiredDescriptionDefault
idYesThe schedule ID to trigger manually

TDQS

A3.9/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations indicate non-read-only and open-world, so description consistency is fine. Adds that it creates a deployment, but doesn't mention side effects, authorization needs, or error conditions. Adequate with annotations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

One sentence of 10 words, front-loaded with action and resource, no wasted text. Exceptionally concise for the information provided.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool's simplicity (1 param, no output schema, annotations present), the description fully covers purpose and outcome, making it complete for its complexity.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Single parameter 'id' with schema description 'The schedule ID to trigger manually'. Schema coverage is 100%, and description doesn't add extra meaning beyond the schema, resulting in baseline score.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Description clearly states the verb 'trigger', the resource 'fleet schedule', and the outcome 'immediately create a deployment'. It distinguishes from siblings like 'create-fleet-schedule' (creates a schedule) and 'get-fleet-schedule' (retrieves).

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Implies usage when you want to manually trigger a schedule to create a deployment, but no explicit when-not or alternatives mentioned. Context from siblings helps somewhat, but lacks direct guidance.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

trigger-syntheticsA

Trigger one or more Synthetics tests on demand

ParametersJSON Schema
NameRequiredDescriptionDefault
testsYesList of tests to trigger

TDQS

A3.6/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations indicate readOnlyHint=false and openWorldHint=true, which are disclosed. The description adds the phrase 'on demand', implying immediate execution, but does not elaborate on state changes, resource consumption, or side effects. With annotations, the description provides minimal extra value.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

A single, concise sentence that is front-loaded and immediately informative. No wasted words.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool's low complexity (single parameter, no output schema), the description is nearly sufficient. However, it could mention the outcome (e.g., returns execution IDs) or whether the trigger is synchronous.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The input schema already describes the parameter 'publicId' with an example. The description adds no further meaning beyond what the schema provides, achieving the baseline score for 100% schema coverage.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the action ('Trigger') and the resource ('Synthetics tests'), and it distinguishes from sibling tools like create-synthetics-test (create new test) and get-synthetics-result (get results). The verb 'trigger' is specific and informative.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool versus alternatives like 'create-synthetics-test' or 'get-synthetics-result'. No prerequisites, exclusions, or usage context are provided.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

unpublish-status-pageA
Destructive

Unpublish a status page to remove public/internal access

ParametersJSON Schema
NameRequiredDescriptionDefault
pageIdYesThe status page ID to unpublish

TDQS

A3.9/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already mark this as destructive (destructiveHint=true). The description adds behavioral context by stating the specific outcome: removing public/internal access. It does not contradict annotations and provides useful beyond-annotation detail about what gets affected.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, concise sentence with no unnecessary words. It is front-loaded with the key action and resource. Every word earned its place.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple one-parameter tool with annotations, the description is adequate but could be more complete by clarifying the state after unpublishing (e.g., page remains but inaccessible) or mentioning reversibility (it can be republished). Lacks these details.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100% for the single parameter 'pageId'. The tool description adds no additional parameter information beyond what the schema already provides, so baseline 3 applies.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the action 'Unpublish', the resource 'status page', and the effect 'to remove public/internal access'. It distinguishes from sibling tools like 'publish-status-page' (opposite) and 'delete-status-page' (permanent deletion).

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage (when you want to remove access), but lacks explicit guidance on when to use vs alternatives (e.g., 'delete-status-page' for permanent deletion) or prerequisites (page must be published). It does not mention when not to use.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

update-apm-retention-filterB

Update an APM retention filter's name, query, rate, or enabled state

ParametersJSON Schema
NameRequiredDescriptionDefault
filterIdYesThe retention filter ID to update
nameYesUpdated name of the retention filter
filterQueryYesUpdated span search query
rateYesUpdated sample rate (0.0 to 1.0)
enabledYesWhether the filter is enabled

TDQS

B3.1/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already indicate this is a write operation (readOnlyHint=false) and dynamic (openWorldHint=true). The description only repeats 'Update', adding no additional behavioral context such as side effects, permissions, or reversibility.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, concise sentence with no extraneous words. It effectively communicates the core action and updatable fields, though it could be slightly more informative.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

No output schema exists, and the description does not mention return values or confirm whether the update is successful. It also lacks constraints like requiring an existing filterId. For a mutation tool with 5 required parameters, more context is needed.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% with descriptions for all 5 parameters. The description lists the fields but does not add meaning beyond what the schema already provides, hence baseline score of 3.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the action 'Update' and the resource 'APM retention filter', and lists the specific fields that can be updated (name, query, rate, enabled state). This differentiates it from sibling tools like create, delete, get, and list.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance is provided on when to use this tool vs alternatives such as create or delete. There is no mention of prerequisites, context, or exclusions.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

update-case-statusB

Update the status of a Datadog case (OPEN, IN_PROGRESS, CLOSED)

ParametersJSON Schema
NameRequiredDescriptionDefault
caseIdYesThe case ID (UUID)
statusYesNew status for the case

TDQS

B3.3/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

The description confirms a write operation (consistent with readOnlyHint=false) but does not disclose side effects (e.g., notifications, state transitions) beyond what annotations imply (openWorldHint=true). No contradiction with annotations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence, no unnecessary words, immediately conveys the tool's purpose. Ideal conciseness.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Simple tool with complete schema and annotations; the description is minimally sufficient. However, it lacks usage context and behavioral details, making it adequate but not exceptional.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% with adequate descriptions for both parameters (caseId and status). The description reiterates the enum values already in the schema, adding no new semantics beyond the schema.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the action ('Update'), the resource ('status of a Datadog case'), and the allowed values ('OPEN, IN_PROGRESS, CLOSED'). This distinguishes it from sibling tools like create-case or get-case.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool versus alternatives (e.g., update-incident, create-case). No mention of prerequisites or context such as whether the case must already exist.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

update-dashboardB

Update an existing Datadog dashboard

ParametersJSON Schema
NameRequiredDescriptionDefault
dashboardIdYesDashboard ID to update. Example: abc-def-ghi
titleYesDashboard title
layoutTypeYesLayout type
descriptionNoDashboard description
widgetsYesArray of widget definitions
tagsNoTags
templateVariablesNoTemplate variables

TDQS

B3.1/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

The description only says 'Update,' but does not clarify whether it replaces all fields or merges, nor does it mention side effects, error handling, or authentication needs. Annotations (readOnlyHint=false, openWorldHint=true) partially cover mutation but the description should add more behavioral context.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is extremely concise (5 words, one sentence), but it sacrifices meaningful detail. Still, it is efficiently short and front-loaded.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

With 7 parameters, 4 required, no output schema, and moderate complexity, the description is insufficient. It does not explain the update semantics (e.g., partial vs full replacement) or return value, leaving agents underinformed.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so the schema already documents all parameters. The description adds no extra parameter-specific details, earning the baseline score of 3.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb (update) and resource (existing Datadog dashboard), distinguishing it from related tools like create-dashboard and delete-dashboard.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides no guidance on when to use this tool versus alternatives, no prerequisites (like the dashboard must exist), and no exclusions.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

update-fleet-scheduleB

Update a fleet schedule's name, query, recurrence rule, or status

ParametersJSON Schema
NameRequiredDescriptionDefault
idYesThe schedule ID to update
nameNoUpdated schedule name
queryNoUpdated filter query
ruleNoUpdated recurrence rule
statusNoUpdated status
versionToLatestNoUpdated version offset

TDQS

B3.3/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

The description only states 'Update', which implies mutation, consistent with annotations (readOnlyHint false). However, it does not disclose any additional behavioral traits (e.g., whether the update is atomic, if there are side effects, permission requirements, or how partial updates work).

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, well-formed sentence that immediately communicates the tool's purpose. Every word is necessary; no fluff or redundancy.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the complexity (6 parameters, nested object) and the presence of siblings, the description is minimally adequate. It lists updatable fields but does not clarify if the update is partial or full, or mention that the 'id' is required. No output schema is expected, but the behavioral context is thin.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, so parameter descriptions already exist. The description adds a summary of updatable fields but does not explain the 'rule' nested object or the 'versionToLatest' parameter beyond what the schema provides. No meaningful extra semantics.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description uses a specific verb (update) and resource (fleet schedule), listing the exact fields that can be modified (name, query, recurrence rule, or status). This clearly distinguishes the tool from sibling tools like create-fleet-schedule, delete-fleet-schedule, etc.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance is provided on when to use this tool versus alternatives (e.g., create, delete, trigger). It does not mention prerequisites, such as the schedule must exist, nor does it indicate whether the update is partial or requires all fields.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

update-incidentA

Update a Datadog incident's title, customer impact, or timestamps

ParametersJSON Schema
NameRequiredDescriptionDefault
incidentIdYesThe incident ID to update
titleNoUpdated title of the incident
customerImpactedNoWhether the incident caused customer impact
customerImpactScopeNoUpdated summary of customer impact
customerImpactStartNoISO 8601 timestamp when customer impact began
customerImpactEndNoISO 8601 timestamp when customer impact ended
detectedNoISO 8601 timestamp when the incident was detected

TDQS

A3.8/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already indicate mutability (readOnlyHint: false) and potential side effects (openWorldHint: true). Description confirms write operation but adds no behavioral specifics beyond that.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence front-loads action and resource, no wasted words. Efficient and clear.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple update tool with 7 parameters and no output schema, the description covers the essentials. Could mention behavior of partial updates or success/failure, but not strictly required given tool simplicity.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema covers all parameters with descriptions (100% coverage). The tool description lists a subset of fields but does not add extra meaning or clarify usage beyond what the schema already provides.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Clearly states the verb 'Update' and the resource 'Datadog incident', listing specific fields (title, customer impact, timestamps). Distinguishes from sibling tools like create-incident and delete-incident.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Implied usage as an update tool, but no explicit guidance on when to use vs alternatives like update-slo or update-monitor. No when-not or exclusion criteria provided.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

update-logs-metricB

Update a log-based metric's filter, group-by, or percentile settings

ParametersJSON Schema
NameRequiredDescriptionDefault
metricIdYesThe name of the log-based metric to update
includePercentilesNoWhether to include percentile aggregations. Only for distribution metrics
filterQueryNoUpdated log search query to filter events
groupByNoUpdated fields to group the metric by

TDQS

B3.3/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations indicate write operation (readOnlyHint=false) and potential side effects (openWorldHint=true). The description confirms 'update' but adds no additional behavioral traits, such as whether changes are incremental or full replacement, or what happens if the metric doesn't exist.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence, front-loaded with key information. No unnecessary words or repetition. Efficient.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Minimally adequate for a simple mutation tool with full schema coverage, but lacks details about response, partial updates, or validation. No output schema increases need for behavioral context, which is missing.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

All parameters have descriptions in the schema (100% coverage), so the description's mention of 'filter, group-by, or percentile settings' adds no new meaning. It serves as a summary but not extra semantics.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'update', the resource 'log-based metric', and specifies the settings to update: 'filter, group-by, or percentile settings'. This distinguishes it from sibling tools like create- or delete- variants.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides no guidance on when to use this tool versus alternatives, nor does it mention any prerequisites or scenarios to avoid. It simply describes the action without context.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

update-monitorA

Update an existing Datadog monitor's configuration

ParametersJSON Schema
NameRequiredDescriptionDefault
monitorIdYesMonitor ID to update
nameNoNew monitor name
queryNoNew query string
messageNoNew notification message
tagsNoNew tags
priorityNoNew priority 1-5
optionsNoNew monitor options

TDQS

A3.5/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations indicate readOnlyHint=false and openWorldHint=true, but the description does not elaborate on side effects, partial updates, or required permissions. It adds basic context beyond annotations but is not thorough.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, efficient sentence that conveys the tool's purpose with no wasted words.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a mutation tool with no output schema and rich sibling set, the description is adequate but lacks details on return values or update behavior, making it merely functional.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so the description adds no additional meaning beyond the schema. Baseline 3 is appropriate as per guidelines.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'Update' and the resource 'existing Datadog monitor's configuration', which distinguishes it from sibling tools like create-monitor, delete-monitor, and get-monitor.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance is provided on when to use this tool versus alternatives, such as mute-monitor for toggling monitor state. The description lacks context about prerequisites or exclusions.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

update-rum-applicationA

Update an existing RUM application's name or type

ParametersJSON Schema
NameRequiredDescriptionDefault
idYesRUM application ID to update
nameNoNew name for the RUM application
typeNoNew type for the RUM application

TDQS

A3.5/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations correctly indicate a non-read-only operation, and the description's 'update' aligns. The term 'existing' implies the application must exist, but no details on side effects, permissions, or idempotency are provided. Beyond the schema, no additional behavioral context.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

A single 8-word sentence that is perfectly front-loaded with the action and resource. No redundant or extraneous information.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The description sufficiently covers the action and inputs (with schema support), but lacks any mention of return values or error behavior. Given no output schema, the agent is left to infer typical update response patterns.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% with adequate per-parameter descriptions. The description's mention of 'name or type' summarizes the optional fields but adds no new semantic meaning beyond what the schema already provides.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the action ('Update'), the resource ('existing RUM application'), and the specific fields that can be modified ('name or type'). It directly distinguishes from sibling tools like create-rum-application and delete-rum-application.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool versus alternatives (e.g., create vs update). No mention of prerequisites or context where this should not be used. The description is purely functional.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

update-rum-metricA

Update a rum-based metric's filter, group-by, or percentile settings

ParametersJSON Schema
NameRequiredDescriptionDefault
metricIdYesThe name of the rum-based metric to update
includePercentilesNoWhether to include percentile aggregations. Only for distribution metrics
filterQueryNoUpdated RUM search query to filter events
groupByNoUpdated fields to group the metric by

TDQS

A3.7/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

The description mentions updating specific fields, which implies a write operation (consistent with readOnlyHint=false and openWorldHint=true). However, it does not disclose additional behavioral traits such as idempotency, error handling, or effects on existing data beyond listing the updateable fields.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence of 14 words, front-loaded with action and resource, with no unnecessary words. It is highly concise and well-structured.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a moderate-complexity update tool with no output schema, the description covers the basic purpose but lacks details about return values, error conditions, or the overall effect on the metric. It is adequate but not comprehensive.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

All four parameters have schema descriptions, resulting in 100% schema coverage. The description lists the same fields (filter, group-by, percentile) without adding new meaning or context beyond what the schema provides, so the baseline score of 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'update', the resource 'rum-based metric', and the specific settings that can be changed: filter, group-by, or percentile. This distinguishes it from sibling tools like create-rum-metric or delete-rum-metric.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage for modifying an existing metric's configuration, but does not explicitly state when to use this tool versus alternatives, nor does it provide prerequisites or conditions for use.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

update-rum-retention-filterB

Update a RUM retention filter's name, event type, sample rate, or query

ParametersJSON Schema
NameRequiredDescriptionDefault
appIdYesRUM application ID
filterIdYesRetention filter ID (UUID) to update
nameNoNew name for the retention filter
eventTypeNoUpdated RUM event type
sampleRateNoUpdated sample rate between 0 and 100
queryNoUpdated RUM search query
enabledNoWhether the filter is enabled

TDQS

B3.4/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already indicate this is a mutation (readOnlyHint=false). The description confirms the update behavior but adds no additional context about side effects, partial updates, or response format. It is adequate but not enriched beyond the annotations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, front-loaded sentence of 14 words. It is maximally concise with no wasted words, directly communicating the tool's purpose.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Despite high schema coverage, the description lacks completeness: it does not mention the expected response, error conditions, or that the update is partial. With no output schema, agents have insufficient context for proper invocation.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, so the baseline is 3. The description adds a concise summary of updatable fields, but omits 'enabled' which is in the schema. It does not provide deeper semantics or constraints beyond what the schema already offers.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'Update' and the resource 'RUM retention filter', listing specific fields (name, event type, sample rate, query) that can be updated. This distinguishes it well from sibling tools like create-rum-retention-filter or delete-rum-retention-filter.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides no guidance on when to use this tool versus alternatives, nor does it mention prerequisites or exclusions. Agents must infer usage from the tool name and sibling context.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

update-sloA

Update an existing SLO's name, description, thresholds, monitorIds, or tags. Fetches current SLO first to merge unspecified fields. Write-gated.

ParametersJSON Schema
NameRequiredDescriptionDefault
sloIdYesSLO ID to update
nameNoNew SLO name (unchanged if omitted)
descriptionNoNew description (unchanged if omitted)
thresholdsNoReplace thresholds (unchanged if omitted)
monitorIdsNoReplace linked monitor IDs (monitor-type SLOs only)
tagsNoReplace tags (unchanged if omitted)

TDQS

A4/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Explicitly states 'Fetches current SLO first to merge unspecified fields' and 'Write-gated', which are not in annotations. Annotations show readOnlyHint=false (consistent). Adds significant behavioral context.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Two concise sentences: first states purpose, second adds key behavioral details. Front-loaded, no redundant information.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Covers purpose, merge behavior, and write-gating. No output schema, so return values not needed. Could mention that it is a partial update (PATCH semantics), but overall complete for a 6-param tool with full schema.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, so baseline is 3. Description only lists parameter names, adding little beyond schema descriptions. Does not explain constraints like thresholds structure or monitorIds applicability.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Description states specific verb 'Update' and resource 'existing SLO', lists exact fields (name, description, thresholds, monitorIds, tags). Clearly distinguishes from siblings like create-slo, delete-slo, and update-slo-correction.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Implies use for modifying existing SLOs, but lacks explicit when-to-use vs alternatives (e.g., create-slo for new, delete-slo for removal). Does not mention when not to use or provide exclusion criteria.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

update-slo-correctionB

Update an existing SLO correction's category, time range, or description

ParametersJSON Schema
NameRequiredDescriptionDefault
sloCorrectionIdYesThe SLO correction ID to update
categoryNoUpdated category
startNoUpdated ISO 8601 start time
endNoUpdated ISO 8601 end time
durationNoUpdated duration in seconds
descriptionNoUpdated description
timezoneNoUpdated timezone
rruleNoUpdated recurrence rule

TDQS

B3.2/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already indicate a write operation (readOnlyHint=false) and potential side effects (openWorldHint=true). The description adds no additional behavioral context, such as permissions or idempotency, but doesn't contradict annotations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence, front-loaded with action and resource, no extraneous words. Efficient and clear.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a tool with 8 parameters and no output schema, the description is minimal. It doesn't explain partial update semantics, the effect on existing SLO corrections, or the role of the required sloCorrectionId. Missing details for safe usage.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, so parameters are documented. The description adds meaning by grouping 'time range' as a conceptual field, but it doesn't map to the actual schema parameters (start, end, duration) precisely. Some parameters like rrule are not mentioned.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the action 'update' and the resource 'SLO correction', and lists which fields can be updated (category, time range, description). This provides a specific purpose, though it could be more distinct from other update tools.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool versus alternatives like create-slo-correction or delete-slo-correction. No prerequisites or context for when an update is appropriate.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

update-spans-metricA

Update a span-based metric's filter, group-by, or percentile settings

ParametersJSON Schema
NameRequiredDescriptionDefault
metricIdYesThe name of the span-based metric to update
includePercentilesNoWhether to include percentile aggregations. Only for distribution metrics
filterQueryNoUpdated APM search query to filter spans
groupByNoUpdated fields to group the metric by

TDQS

A3.5/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already indicate write operation (readOnlyHint=false) and open world (openWorldHint=true). The description adds the specific fields that can be updated, offering some behavioral context, but does not disclose error handling, idempotency, or side effects implied by openWorldHint.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single concise sentence with no wasted words, front-loading the verb and resource. It efficiently conveys the core action.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a tool with 4 parameters, no output schema, and annotations provided, the description adequately states the action. However, it does not address the openWorldHint implications or mention that percentile updates are only for distribution metrics (though covered in the parameter description). It is sufficient but not enhanced.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% with informative parameter descriptions. The tool description summarizes the parameter categories (filter, group-by, percentile) but adds no new meaning beyond what the schema already provides. Baseline 3 applies.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'Update' and the resource 'span-based metric', and lists the specific updatable settings (filter, group-by, percentile). This distinguishes it from sibling tools like create-spans-metric, delete-spans-metric, and get-spans-metric.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides no guidance on when to use this tool versus alternatives. It does not mention when to use create-spans-metric for new metrics or delete-spans-metric for removal, nor does it specify prerequisites or context.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

update-status-pageB

Update a status page's name, domain prefix, or subscription settings

ParametersJSON Schema
NameRequiredDescriptionDefault
pageIdYesThe status page ID to update
nameNoUpdated name
domainPrefixNoUpdated domain prefix
subscriptionsEnabledNoWhether email subscriptions are enabled

TDQS

B3.4/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already indicate the tool is not read-only (readOnlyHint=false) and may have side effects (openWorldHint=true). The description adds no further behavioral context, such as authorization requirements or impact on subscribers.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, well-structured sentence of 12 words, front-loaded with the verb 'Update' and no extraneous information.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The description covers the core purpose but lacks context on partial update behavior (e.g., whether omitted fields remain unchanged) and the return value. Given the annotations and schema, it is adequate but not comprehensive.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The schema provides clear descriptions for all parameters (100% coverage). The description merely echoes the fields without adding constraints, formats, or examples.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool updates a status page and lists the specific fields (name, domain prefix, subscription settings). It differentiates from sibling tools like update-status-page-component by specifying the top-level resource.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies when to use the tool (when needing to update those fields) but does not explicitly state when not to use it or provide alternatives, such as using update-status-page-component for component-specific changes.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

update-status-page-componentB

Update a status page component's name or position

ParametersJSON Schema
NameRequiredDescriptionDefault
pageIdYesThe status page ID
componentIdYesThe component ID to update
nameNoUpdated name
positionNoUpdated display position

TDQS

B3.4/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already indicate readOnlyHint=false and openWorldHint=true. The description adds no further behavioral context beyond stating it updates, such as authorization needs, idempotency, or side effects.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, concise sentence that is front-loaded with the key information. It contains no fluff, though it could benefit from slightly more structure (e.g., listing parameters).

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple update tool with 4 parameters and no output schema, the description is adequate but lacks details on return values, error conditions, or what happens if the component does not exist.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, and the description repeats 'name' and 'position' from the schema. It adds no additional semantic meaning or format details beyond what the schema already provides.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description uses a specific verb ('Update') and resource ('status page component'), and lists the updatable fields ('name or position'). It clearly distinguishes from sibling tools like create-status-page-component and delete-status-page-component.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage for updating name or position of a component but provides no explicit guidance on when to use this tool versus alternatives, nor any prerequisites or conditions for use.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

update-status-page-degradationA

Update a degradation incident's status, title, or affected components

ParametersJSON Schema
NameRequiredDescriptionDefault
pageIdYesThe status page ID
degradationIdYesThe degradation ID to update
titleNoUpdated title
statusNoUpdated status
descriptionNoUpdated description
componentsAffectedNoUpdated affected components
notifySubscribersNoWhether to notify page subscribers

TDQS

A3.7/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations indicate a write operation (readOnlyHint: false). The description confirms this by stating 'Update'. However, it does not disclose additional behavioral traits such as side effects, required permissions, or rate limits. With annotations present, the bar is lower, but the description adds no extra context beyond the schema fields.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, front-loaded sentence of 10 words. It efficiently conveys the tool's purpose with no redundant or filler content, earning top marks for conciseness.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given 7 parameters and no output schema, the description covers the key action (updating fields) but does not explain the effect of notifySubscribers or the overall result of the update. It is adequate but lacks details on return values or side effects.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% with all parameters described. The description merely lists the updatable fields without adding deeper meaning or examples. Baseline 3 is appropriate as the schema already documents parameter semantics adequately.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'Update' and the resource 'a degradation incident', listing the updatable fields (status, title, affected components). It distinguishes from sibling tools like create and delete by focusing on modification.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implicitly conveys that this tool is for updating an existing degradation, but it does not explicitly state when to use it versus alternatives (e.g., when to use create or delete). No exclusions or prerequisites are mentioned.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

update-status-page-maintenanceB

Update a maintenance window's status, schedule, or affected components

ParametersJSON Schema
NameRequiredDescriptionDefault
pageIdYesThe status page ID
maintenanceIdYesThe maintenance ID to update
titleNoUpdated title
statusNoUpdated status
startDateNoUpdated start date (ISO 8601)
scheduledDescriptionNoUpdated scheduled description
inProgressDescriptionNoUpdated in-progress description
completedDescriptionNoUpdated completed description
componentsAffectedNoUpdated affected components
notifySubscribersNoWhether to notify page subscribers

TDQS

B3.3/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations indicate readOnlyHint=false (write operation) and openWorldHint=true (possible side effects), but the description adds minimal behavioral context. It does not disclose reversibility, notification behavior, or constraints on status transitions.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, front-loaded sentence that conveys the core purpose efficiently. Minor room for improvement by including key constraints, but no wasted words.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

With 10 parameters, no output schema, and rich sibling tools, the description overlooks important behavioral details such as return value, status transition rules, and whether updates trigger notifications. More context is needed for full understanding.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so the schema already documents each parameter. The description enumerates some parameter groups (status, schedule, components) but adds no new meaning beyond what the schema provides. Baseline 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the action (update), the resource (maintenance window), and the updatable aspects (status, schedule, affected components). It effectively distinguishes from sibling tools like create-, get-, and delete-status-page-maintenance.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage when updating a maintenance window but provides no explicit guidance on when to use alternatives, prerequisites, or limitations. It lacks when-not-to-use or exclusions.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

update-synthetics-testB

Update an existing Synthetics API test

ParametersJSON Schema
NameRequiredDescriptionDefault
publicIdYesTest public ID to update. Example: abc-def-ghi
nameNoNew test name
urlNoNew URL to test
methodNoNew HTTP method
locationsNoNew test locations
messageNoNew notification message
tagsNoNew tags
statusNoNew test status
assertionsNoNew assertions

TDQS

B3.1/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=false and openWorldHint=true, but the description adds no additional behavioral context, such as whether it performs a partial update or full replacement, or any side effects.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single concise sentence with no wasted words, but it lacks structure that could be improved with bullet points or additional context.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the complexity (9 parameters, no output schema), the description is too minimal. It fails to explain the return value or any impacts of updating a test, making it incomplete for an agent to use correctly.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so the baseline is 3. The description does not add any meaning beyond what the schema already provides for each parameter.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'Update' and the resource 'existing Synthetics API test', distinguishing it from sibling tools like 'create-synthetics-test' and 'delete-synthetics-test'.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides no guidance on when to use this tool versus alternatives, such as when to create vs update, or prerequisites like having the publicId.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

update-teamC

Update a Datadog team's name, handle, or description

ParametersJSON Schema
NameRequiredDescriptionDefault
teamIdYesThe team ID to update
nameNoUpdated name of the team
handleNoUpdated handle of the team
descriptionNoUpdated description

TDQS

C2.9/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already indicate mutation (readOnlyHint=false) and openWorldHint=true. Description adds no behavioral traits like feedback on missing team, idempotency, or required permissions beyond stating the update action.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence, 10 words, front-loaded with action. Efficient, but could mention the required teamId parameter for clarity.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

No output schema and description does not explain response format, error cases, or prerequisites (e.g., team must exist). Minimal completeness for a mutation tool.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% with parameter descriptions. Tool description merely restates the parameter fields (name, handle, description) without adding new meaning like format constraints or behavior of handle uniqueness.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Description clearly states verb 'Update' and resource 'Datadog team' with specific fields (name, handle, description), distinguishing it from siblings like create-team, delete-team, get-team.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool versus alternatives like create-team or get-team. The description only states what it does without context on prerequisites or exclusions.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

validate-monitorA
Read-only

Validate a monitor definition without creating it (check query syntax, thresholds, etc.)

ParametersJSON Schema
NameRequiredDescriptionDefault
nameYesMonitor name to validate
typeYesMonitor type (e.g. metric alert, log alert, query alert)
queryYesMonitor query to validate
messageNoNotification message
tagsNoTags for the monitor
priorityNoPriority 1-5
optionsNoMonitor options (thresholds, etc.)

TDQS

A4.1/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true. Description adds value by specifying what is checked (query syntax, thresholds), but could detail more actions like validation of other parameters.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence is concise, front-loaded with purpose, and contains no fluff. Efficiently communicates tool function.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a validation tool with 7 parameters and no output schema, the description does not specify what is validated beyond query/options, nor the return format (success/error details), leaving gaps.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% with descriptions for all parameters. The description adds no new parameter information beyond the schema, so baseline score applies.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Description clearly states the tool validates a monitor definition without creating it, using specific verb and resource. It distinguishes from create-monitor and update-monitor by focusing on validation only.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies use before creation by stating 'without creating it', providing context. However, it lacks explicit guidance on when not to use or specific alternatives.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Tool Schema Changelog

Recent tool additions, removals, and schema changes observed during successful MCP inspections. Dates show when Glama detected each change.

  1. 3 tool updatesv1.21.1
    • Changedcreate-status-page1 field changed
      • removedInput schema / properties / enabled
        Removed value: -{
        -  "default": false,
        -  "description": "Whether the page is enabled on creation",
        -  "type": "boolean"
        -}
    • Removedlist-fleet-clusters
    • Removedlist-fleet-instrumented-pods
  2. 68 tool updatesv1.20.3
    • Addedanalyze-monitor-state
    • Addedcancel-fleet-deployment
    • Addedcreate-apm-retention-filter
    • Addedcreate-fleet-deployment-configure
    • Addedcreate-fleet-deployment-upgrade
    • Addedcreate-fleet-schedule
    • Addedcreate-logs-metric
    • Addedcreate-slo-correction
    • Addedcreate-spans-metric
    • Addedcreate-status-page
    • Addedcreate-status-page-component
    • Addedcreate-status-page-degradation
    • Addedcreate-status-page-maintenance
    • Addeddelete-apm-retention-filter
    • Addeddelete-fleet-schedule
    • Addeddelete-logs-metric
    • Addeddelete-slo-correction
    • Addeddelete-spans-metric
    • Addeddelete-status-page
    • Addeddelete-status-page-component
    • Addeddelete-status-page-degradation
    • Addeddelete-team
    • Addedget-apm-retention-filter
    • Addedget-fleet-agent-info
    • Addedget-fleet-deployment
    • Addedget-fleet-schedule
    • Addedget-logs-metric
    • Addedget-slo-correction
    • Addedget-spans-metric
    • Addedget-status-page
    • Addedget-status-page-component
    • Addedget-status-page-degradation
    • Addedget-status-page-maintenance
    • Addedget-team-members
    • Addedget-workflow
    • Addedget-workflow-instance
    • Addedincident-triage-snapshot
    • Addedlist-apm-retention-filters
    • Addedlist-fleet-agent-versions
    • Addedlist-fleet-agents
    • Addedlist-fleet-clusters
    • Addedlist-fleet-deployments
    • Addedlist-fleet-instrumented-pods
    • Addedlist-fleet-schedules
    • Addedlist-fleet-tracers
    • Addedlist-logs-metrics
    • Addedlist-slo-corrections
    • Addedlist-spans-metrics
    • Addedlist-status-page-components
    • Addedlist-status-page-degradations
    • Addedlist-status-page-maintenances
    • Addedlist-status-pages
    • Addedlist-workflow-instances
    • Addedpublish-status-page
    • Addedsearch-tools
    • Addedslo-compliance-snapshot
    • Addedtrigger-fleet-schedule
    • Addedunpublish-status-page
    • Addedupdate-apm-retention-filter
    • Addedupdate-fleet-schedule
    • Addedupdate-logs-metric
    • Addedupdate-slo-correction
    • Addedupdate-spans-metric
    • Addedupdate-status-page
    • Addedupdate-status-page-component
    • Addedupdate-status-page-degradation
    • Addedupdate-status-page-maintenance
    • Addedvalidate-monitor
  3. 68 tool updatesv1.20.1
    • Removedanalyze-monitor-state
    • Removedcancel-fleet-deployment
    • Removedcreate-apm-retention-filter
    • Removedcreate-fleet-deployment-configure
    • Removedcreate-fleet-deployment-upgrade
    • Removedcreate-fleet-schedule
    • Removedcreate-logs-metric
    • Removedcreate-slo-correction
    • Removedcreate-spans-metric
    • Removedcreate-status-page
    • Removedcreate-status-page-component
    • Removedcreate-status-page-degradation
    • Removedcreate-status-page-maintenance
    • Removeddelete-apm-retention-filter
    • Removeddelete-fleet-schedule
    • Removeddelete-logs-metric
    • Removeddelete-slo-correction
    • Removeddelete-spans-metric
    • Removeddelete-status-page
    • Removeddelete-status-page-component
    • Removeddelete-status-page-degradation
    • Removeddelete-team
    • Removedget-apm-retention-filter
    • Removedget-fleet-agent-info
    • Removedget-fleet-deployment
    • Removedget-fleet-schedule
    • Removedget-logs-metric
    • Removedget-slo-correction
    • Removedget-spans-metric
    • Removedget-status-page
    • Removedget-status-page-component
    • Removedget-status-page-degradation
    • Removedget-status-page-maintenance
    • Removedget-team-members
    • Removedget-workflow
    • Removedget-workflow-instance
    • Removedincident-triage-snapshot
    • Removedlist-apm-retention-filters
    • Removedlist-fleet-agent-versions
    • Removedlist-fleet-agents
    • Removedlist-fleet-clusters
    • Removedlist-fleet-deployments
    • Removedlist-fleet-instrumented-pods
    • Removedlist-fleet-schedules
    • Removedlist-fleet-tracers
    • Removedlist-logs-metrics
    • Removedlist-slo-corrections
    • Removedlist-spans-metrics
    • Removedlist-status-page-components
    • Removedlist-status-page-degradations
    • Removedlist-status-page-maintenances
    • Removedlist-status-pages
    • Removedlist-workflow-instances
    • Removedpublish-status-page
    • Removedsearch-tools
    • Removedslo-compliance-snapshot
    • Removedtrigger-fleet-schedule
    • Removedunpublish-status-page
    • Removedupdate-apm-retention-filter
    • Removedupdate-fleet-schedule
    • Removedupdate-logs-metric
    • Removedupdate-slo-correction
    • Removedupdate-spans-metric
    • Removedupdate-status-page
    • Removedupdate-status-page-component
    • Removedupdate-status-page-degradation
    • Removedupdate-status-page-maintenance
    • Removedvalidate-monitor
  4. 168 tool updatesv1.20.0
    • Addedaggregate-ci-pipelines
    • Addedaggregate-ci-tests
    • Addedaggregate-logs
    • Addedaggregate-rum
    • Addedanalyze-monitor-state
    • Addedcancel-downtime
    • Addedcancel-fleet-deployment
    • Addedcreate-apm-retention-filter
    • Addedcreate-case
    • Addedcreate-dashboard
    • Addedcreate-downtime
    • Addedcreate-fleet-deployment-configure
    • Addedcreate-fleet-deployment-upgrade
    • Addedcreate-fleet-schedule
    • Addedcreate-incident
    • Addedcreate-logs-metric
    • Addedcreate-monitor
    • Addedcreate-rum-application
    • Addedcreate-rum-metric
    • Addedcreate-rum-retention-filter
    • Addedcreate-security-suppression
    • Addedcreate-slo
    • Addedcreate-slo-correction
    • Addedcreate-spans-metric
    • Addedcreate-status-page
    • Addedcreate-status-page-component
    • Addedcreate-status-page-degradation
    • Addedcreate-status-page-maintenance
    • Addedcreate-synthetics-test
    • Addedcreate-team
    • Addeddelete-apm-retention-filter
    • Addeddelete-dashboard
    • Addeddelete-fleet-schedule
    • Addeddelete-incident
    • Addeddelete-logs-metric
    • Addeddelete-monitor
    • Addeddelete-rum-application
    • Addeddelete-rum-metric
    • Addeddelete-rum-retention-filter
    • Addeddelete-security-rule
    • Addeddelete-security-suppression
    • Addeddelete-slo
    • Addeddelete-slo-correction
    • Addeddelete-spans-metric
    • Addeddelete-status-page
    • Addeddelete-status-page-component
    • Addeddelete-status-page-degradation
    • Addeddelete-synthetics-test
    • Addeddelete-team
    • Addedget-apm-retention-filter
    • Addedget-case
    • Addedget-dashboard
    • Addedget-dashboards
    • Addedget-error-tracking-issue
    • Addedget-events
    • Addedget-fleet-agent-info
    • Addedget-fleet-deployment
    • Addedget-fleet-schedule
    • Addedget-host-totals
    • Addedget-incident
    • Addedget-incidents
    • Addedget-logs-metric
    • Addedget-metric-metadata
    • Addedget-metrics
    • Addedget-monitor
    • Addedget-monitors
    • Addedget-network-device
    • Addedget-notebook
    • Addedget-oncall-schedule
    • Addedget-rum-application
    • Addedget-rum-metric
    • Addedget-rum-retention-filter
    • Addedget-security-rule
    • Addedget-security-signal
    • Addedget-security-suppression
    • Addedget-service-definition
    • Addedget-slo
    • Addedget-slo-correction
    • Addedget-slo-history
    • Addedget-spans-metric
    • Addedget-status-page
    • Addedget-status-page-component
    • Addedget-status-page-degradation
    • Addedget-status-page-maintenance
    • Addedget-synthetics-result
    • Addedget-team
    • Addedget-team-members
    • Addedget-team-oncall
    • Addedget-usage-summary
    • Addedget-workflow
    • Addedget-workflow-instance
    • Addedincident-triage-snapshot
    • Addedlist-active-metrics
    • Addedlist-apm-retention-filters
    • Addedlist-cases
    • Addedlist-containers
    • Addedlist-downtimes
    • Addedlist-error-tracking-issues
    • Addedlist-fleet-agent-versions
    • Addedlist-fleet-agents
    • Addedlist-fleet-clusters
    • Addedlist-fleet-deployments
    • Addedlist-fleet-instrumented-pods
    • Addedlist-fleet-schedules
    • Addedlist-fleet-tracers
    • Addedlist-hosts
    • Addedlist-logs-metrics
    • Addedlist-metric-tags
    • Addedlist-network-devices
    • Addedlist-notebooks
    • Addedlist-processes
    • Addedlist-rum-applications
    • Addedlist-rum-metrics
    • Addedlist-rum-retention-filters
    • Addedlist-security-rules
    • Addedlist-security-suppressions
    • Addedlist-services
    • Addedlist-slo-corrections
    • Addedlist-slos
    • Addedlist-spans-metrics
    • Addedlist-status-page-components
    • Addedlist-status-page-degradations
    • Addedlist-status-page-maintenances
    • Addedlist-status-pages
    • Addedlist-synthetics
    • Addedlist-teams
    • Addedlist-users
    • Addedlist-workflow-instances
    • Addedmute-monitor
    • Addedpost-event
    • Addedpublish-status-page
    • Addedquery-metrics
    • Addedsearch-audit-logs
    • Addedsearch-ci-pipelines
    • Addedsearch-ci-tests
    • Addedsearch-incidents
    • Addedsearch-logs
    • Addedsearch-rum-events
    • Addedsearch-security-signals
    • Addedsearch-spans
    • Addedsearch-tools
    • Addedsend-dora-deployment
    • Addedsend-dora-incident
    • Addedsend-logs
    • Addedslo-compliance-snapshot
    • Addedtrigger-fleet-schedule
    • Addedtrigger-synthetics
    • Addedunpublish-status-page
    • Addedupdate-apm-retention-filter
    • Addedupdate-case-status
    • Addedupdate-dashboard
    • Addedupdate-fleet-schedule
    • Addedupdate-incident
    • Addedupdate-logs-metric
    • Addedupdate-monitor
    • Addedupdate-rum-application
    • Addedupdate-rum-metric
    • Addedupdate-rum-retention-filter
    • Addedupdate-slo
    • Addedupdate-slo-correction
    • Addedupdate-spans-metric
    • Addedupdate-status-page
    • Addedupdate-status-page-component
    • Addedupdate-status-page-degradation
    • Addedupdate-status-page-maintenance
    • Addedupdate-synthetics-test
    • Addedupdate-team
    • Addedvalidate-monitor
  5. 165 tool updatesv1.19.4
    • Removedaggregate-ci-pipelines
    • Removedaggregate-ci-tests
    • Removedaggregate-logs
    • Removedaggregate-rum
    • Removedanalyze-monitor-state
    • Removedcancel-downtime
    • Removedcancel-fleet-deployment
    • Removedcreate-apm-retention-filter
    • Removedcreate-case
    • Removedcreate-dashboard
    • Removedcreate-downtime
    • Removedcreate-fleet-deployment-configure
    • Removedcreate-fleet-deployment-upgrade
    • Removedcreate-fleet-schedule
    • Removedcreate-incident
    • Removedcreate-logs-metric
    • Removedcreate-monitor
    • Removedcreate-rum-application
    • Removedcreate-rum-metric
    • Removedcreate-rum-retention-filter
    • Removedcreate-security-suppression
    • Removedcreate-slo
    • Removedcreate-slo-correction
    • Removedcreate-spans-metric
    • Removedcreate-status-page
    • Removedcreate-status-page-component
    • Removedcreate-status-page-degradation
    • Removedcreate-status-page-maintenance
    • Removedcreate-synthetics-test
    • Removedcreate-team
    • Removeddelete-apm-retention-filter
    • Removeddelete-dashboard
    • Removeddelete-fleet-schedule
    • Removeddelete-incident
    • Removeddelete-logs-metric
    • Removeddelete-monitor
    • Removeddelete-rum-application
    • Removeddelete-rum-metric
    • Removeddelete-rum-retention-filter
    • Removeddelete-security-rule
    • Removeddelete-security-suppression
    • Removeddelete-slo
    • Removeddelete-slo-correction
    • Removeddelete-spans-metric
    • Removeddelete-status-page
    • Removeddelete-status-page-component
    • Removeddelete-status-page-degradation
    • Removeddelete-synthetics-test
    • Removeddelete-team
    • Removedget-apm-retention-filter
    • Removedget-case
    • Removedget-dashboard
    • Removedget-dashboards
    • Removedget-error-tracking-issue
    • Removedget-events
    • Removedget-fleet-agent-info
    • Removedget-fleet-deployment
    • Removedget-fleet-schedule
    • Removedget-host-totals
    • Removedget-incident
    • Removedget-incidents
    • Removedget-logs-metric
    • Removedget-metric-metadata
    • Removedget-metrics
    • Removedget-monitor
    • Removedget-monitors
    • Removedget-network-device
    • Removedget-notebook
    • Removedget-oncall-schedule
    • Removedget-rum-application
    • Removedget-rum-metric
    • Removedget-rum-retention-filter
    • Removedget-security-rule
    • Removedget-security-signal
    • Removedget-security-suppression
    • Removedget-service-definition
    • Removedget-slo
    • Removedget-slo-correction
    • Removedget-slo-history
    • Removedget-spans-metric
    • Removedget-status-page
    • Removedget-status-page-component
    • Removedget-status-page-degradation
    • Removedget-status-page-maintenance
    • Removedget-synthetics-result
    • Removedget-team
    • Removedget-team-members
    • Removedget-team-oncall
    • Removedget-usage-summary
    • Removedincident-triage-snapshot
    • Removedlist-active-metrics
    • Removedlist-apm-retention-filters
    • Removedlist-cases
    • Removedlist-containers
    • Removedlist-downtimes
    • Removedlist-error-tracking-issues
    • Removedlist-fleet-agent-versions
    • Removedlist-fleet-agents
    • Removedlist-fleet-clusters
    • Removedlist-fleet-deployments
    • Removedlist-fleet-instrumented-pods
    • Removedlist-fleet-schedules
    • Removedlist-fleet-tracers
    • Removedlist-hosts
    • Removedlist-logs-metrics
    • Removedlist-metric-tags
    • Removedlist-network-devices
    • Removedlist-notebooks
    • Removedlist-processes
    • Removedlist-rum-applications
    • Removedlist-rum-metrics
    • Removedlist-rum-retention-filters
    • Removedlist-security-rules
    • Removedlist-security-suppressions
    • Removedlist-services
    • Removedlist-slo-corrections
    • Removedlist-slos
    • Removedlist-spans-metrics
    • Removedlist-status-page-components
    • Removedlist-status-page-degradations
    • Removedlist-status-page-maintenances
    • Removedlist-status-pages
    • Removedlist-synthetics
    • Removedlist-teams
    • Removedlist-users
    • Removedmute-monitor
    • Removedpost-event
    • Removedpublish-status-page
    • Removedquery-metrics
    • Removedsearch-audit-logs
    • Removedsearch-ci-pipelines
    • Removedsearch-ci-tests
    • Removedsearch-incidents
    • Removedsearch-logs
    • Removedsearch-rum-events
    • Removedsearch-security-signals
    • Removedsearch-spans
    • Removedsearch-tools
    • Removedsend-dora-deployment
    • Removedsend-dora-incident
    • Removedsend-logs
    • Removedslo-compliance-snapshot
    • Removedtrigger-fleet-schedule
    • Removedtrigger-synthetics
    • Removedunpublish-status-page
    • Removedupdate-apm-retention-filter
    • Removedupdate-case-status
    • Removedupdate-dashboard
    • Removedupdate-fleet-schedule
    • Removedupdate-incident
    • Removedupdate-logs-metric
    • Removedupdate-monitor
    • Removedupdate-rum-application
    • Removedupdate-rum-metric
    • Removedupdate-rum-retention-filter
    • Removedupdate-slo
    • Removedupdate-slo-correction
    • Removedupdate-spans-metric
    • Removedupdate-status-page
    • Removedupdate-status-page-component
    • Removedupdate-status-page-degradation
    • Removedupdate-status-page-maintenance
    • Removedupdate-synthetics-test
    • Removedupdate-team
    • Removedvalidate-monitor
  6. 165 tool updatesv1.19.1
    • First observedaggregate-ci-pipelines
    • First observedaggregate-ci-tests
    • First observedaggregate-logs
    • First observedaggregate-rum
    • First observedanalyze-monitor-state
    • First observedcancel-downtime
    • First observedcancel-fleet-deployment
    • First observedcreate-apm-retention-filter
    • First observedcreate-case
    • First observedcreate-dashboard
    • First observedcreate-downtime
    • First observedcreate-fleet-deployment-configure
    • First observedcreate-fleet-deployment-upgrade
    • First observedcreate-fleet-schedule
    • First observedcreate-incident
    • First observedcreate-logs-metric
    • First observedcreate-monitor
    • First observedcreate-rum-application
    • First observedcreate-rum-metric
    • First observedcreate-rum-retention-filter
    • First observedcreate-security-suppression
    • First observedcreate-slo
    • First observedcreate-slo-correction
    • First observedcreate-spans-metric
    • First observedcreate-status-page
    • First observedcreate-status-page-component
    • First observedcreate-status-page-degradation
    • First observedcreate-status-page-maintenance
    • First observedcreate-synthetics-test
    • First observedcreate-team
    • First observeddelete-apm-retention-filter
    • First observeddelete-dashboard
    • First observeddelete-fleet-schedule
    • First observeddelete-incident
    • First observeddelete-logs-metric
    • First observeddelete-monitor
    • First observeddelete-rum-application
    • First observeddelete-rum-metric
    • First observeddelete-rum-retention-filter
    • First observeddelete-security-rule
    • First observeddelete-security-suppression
    • First observeddelete-slo
    • First observeddelete-slo-correction
    • First observeddelete-spans-metric
    • First observeddelete-status-page
    • First observeddelete-status-page-component
    • First observeddelete-status-page-degradation
    • First observeddelete-synthetics-test
    • First observeddelete-team
    • First observedget-apm-retention-filter
    • First observedget-case
    • First observedget-dashboard
    • First observedget-dashboards
    • First observedget-error-tracking-issue
    • First observedget-events
    • First observedget-fleet-agent-info
    • First observedget-fleet-deployment
    • First observedget-fleet-schedule
    • First observedget-host-totals
    • First observedget-incident
    • First observedget-incidents
    • First observedget-logs-metric
    • First observedget-metric-metadata
    • First observedget-metrics
    • First observedget-monitor
    • First observedget-monitors
    • First observedget-network-device
    • First observedget-notebook
    • First observedget-oncall-schedule
    • First observedget-rum-application
    • First observedget-rum-metric
    • First observedget-rum-retention-filter
    • First observedget-security-rule
    • First observedget-security-signal
    • First observedget-security-suppression
    • First observedget-service-definition
    • First observedget-slo
    • First observedget-slo-correction
    • First observedget-slo-history
    • First observedget-spans-metric
    • First observedget-status-page
    • First observedget-status-page-component
    • First observedget-status-page-degradation
    • First observedget-status-page-maintenance
    • First observedget-synthetics-result
    • First observedget-team
    • First observedget-team-members
    • First observedget-team-oncall
    • First observedget-usage-summary
    • First observedincident-triage-snapshot
    • First observedlist-active-metrics
    • First observedlist-apm-retention-filters
    • First observedlist-cases
    • First observedlist-containers
    • First observedlist-downtimes
    • First observedlist-error-tracking-issues
    • First observedlist-fleet-agent-versions
    • First observedlist-fleet-agents
    • First observedlist-fleet-clusters
    • First observedlist-fleet-deployments
    • First observedlist-fleet-instrumented-pods
    • First observedlist-fleet-schedules
    • First observedlist-fleet-tracers
    • First observedlist-hosts
    • First observedlist-logs-metrics
    • First observedlist-metric-tags
    • First observedlist-network-devices
    • First observedlist-notebooks
    • First observedlist-processes
    • First observedlist-rum-applications
    • First observedlist-rum-metrics
    • First observedlist-rum-retention-filters
    • First observedlist-security-rules
    • First observedlist-security-suppressions
    • First observedlist-services
    • First observedlist-slo-corrections
    • First observedlist-slos
    • First observedlist-spans-metrics
    • First observedlist-status-page-components
    • First observedlist-status-page-degradations
    • First observedlist-status-page-maintenances
    • First observedlist-status-pages
    • First observedlist-synthetics
    • First observedlist-teams
    • First observedlist-users
    • First observedmute-monitor
    • First observedpost-event
    • First observedpublish-status-page
    • First observedquery-metrics
    • First observedsearch-audit-logs
    • First observedsearch-ci-pipelines
    • First observedsearch-ci-tests
    • First observedsearch-incidents
    • First observedsearch-logs
    • First observedsearch-rum-events
    • First observedsearch-security-signals
    • First observedsearch-spans
    • First observedsearch-tools
    • First observedsend-dora-deployment
    • First observedsend-dora-incident
    • First observedsend-logs
    • First observedslo-compliance-snapshot
    • First observedtrigger-fleet-schedule
    • First observedtrigger-synthetics
    • First observedunpublish-status-page
    • First observedupdate-apm-retention-filter
    • First observedupdate-case-status
    • First observedupdate-dashboard
    • First observedupdate-fleet-schedule
    • First observedupdate-incident
    • First observedupdate-logs-metric
    • First observedupdate-monitor
    • First observedupdate-rum-application
    • First observedupdate-rum-metric
    • First observedupdate-rum-retention-filter
    • First observedupdate-slo
    • First observedupdate-slo-correction
    • First observedupdate-spans-metric
    • First observedupdate-status-page
    • First observedupdate-status-page-component
    • First observedupdate-status-page-degradation
    • First observedupdate-status-page-maintenance
    • First observedupdate-synthetics-test
    • First observedupdate-team
    • First observedvalidate-monitor

TDQS

B3.4/5.0
Disambiguation5/5

Each tool targets a specific resource and action (e.g., create-monitor vs update-monitor, search-logs vs aggregate-logs). Even with many similar patterns, descriptions clearly differentiate them. The search-tools tool further aids navigation.

Naming Consistency5/5

All tool names use a consistent snake_case verb-noun pattern (e.g., create-downtime, list-hosts, get-monitor). Verbs like 'aggregate', 'search', 'analyze' are distinct and predictable.

Tool Count2/5

With 166 tools, the count is extremely high for a single MCP server. While Datadog's API surface is broad, this overwhelms agents and makes selection difficult despite the search-tools helper.

Completeness3/5

The server covers CRUD operations for many domains (monitors, SLOs, dashboards, synthetics, security, teams, status pages), but notable gaps exist, such as missing create/update for notebooks, network devices, and hosts beyond listing.

Maintenance

ActivitySlowing
ResponsivenessSyncing

Resources

Unclaimed servers have limited discoverability.

Looking for Admin?

If you are the server author, to access and configure the admin panel.

Related MCP Connectors

Related MCP Servers

  • A
    license
    Not graded
    quality
    D
    maintenance
    Enables AI assistants to interact with DataDog's observability platform through a standardized interface. Supports monitoring infrastructure, managing events, analyzing logs and metrics, and automating operations like alerts and downtimes.
    1
    MIT
  • A
    license
    C
    quality
    A
    maintenance
    Enables interaction with Datadog APIs through automatically generated tools from Postman collections. Supports monitoring operations, log management, metrics submission, and other Datadog functionality through natural language.
    100
    29
    Apache 2.0
  • F
    license
    B
    quality
    F
    maintenance
    Enables comprehensive Datadog monitoring capabilities including CI/CD pipeline management, service logs analysis, metrics querying, monitor and SLO management, service definitions retrieval, and team management through Claude and other MCP clients.
    13
    20
    -
  • A
    license
    B
    quality
    D
    maintenance
    Enables interaction with Datadog's monitoring and observability platform through the MCP protocol. Supports incident management, monitor status checks, log searches, metrics queries, APM traces, dashboard access, RUM analytics, host management, and downtime scheduling.
    13
    18
    Apache 2.0

Latest Blog Posts

MCP directory API

We provide all the information about MCP servers via our MCP API.

curl -X GET 'https://glama.ai/api/mcp/v1/servers/us-all/datadog-mcp-server'

If you have feedback or need assistance with the MCP directory API, please join our Discord server