Skip to main content
Glama

culprit

Why an agent needs this

An agent can dig through git history to find what broke, and it is good at it. What it will not reliably do is spend a dozen tool calls on that every time, or stop and check whether the helper it just changed has three other callers before it commits. culprit turns both into one deterministic call that returns structured JSON it can act on:

The agent asks

culprit answers

"What introduced this bug?"

Ranked suspect commits, the author's intent, the releases it shipped in

"Is my fix complete?"

verify_fix: missed call sites, whether a test shipped, a risk level

"What could this change break?"

Reverse-import dependents, covering tests, high-risk shared modules

  • ⚡️ Instant. No test runs, no bisect. Benchmarked at 41% fewer agent tool calls.

  • 🔒 Read-only and offline. Never writes to your repo or PR. No API key, no network.

  • 🔌 MCP-native. 11 tools over stdio, on the official MCP registry, plus a one-command plugin.

  • 🗣️ Language-agnostic. Suspects work anywhere git does. Blast radius reads 12 language families.

Related MCP server: Task Agent MCP

Does it actually work?

Benchmarked against 50 real regressions, 25 from git and 25 from systemd, where the introducing commit is known from each fix's Fixes: trailer (author-verified ground truth). Given only the fix commit, culprit blames the removed lines to rank the commits that introduced the bug.

Metric

Result

Introducing commit ranked #1

50% (25/50)

Introducing commit in the top-5 suspect set

66% (33/50)

Deterministic and offline, on large C codebases the engine has never seen. Reproduce with python benchmarks/run.py, which clones the repos and scores every case.

But an agent can run git blame itself

It can, and it is good at it. So the honest question is not whether culprit is accurate, but whether it beats or helps an agent that has git and no culprit. Same 10 regressions, three arms, isolated so no arm can read the answer from the fix commit:

culprit alone

agent alone

agent + culprit

Introducing commit ranked #1

80%

90%

90%

Introducing commit in top 5

90%

100%

100%

Mean tool calls to get there

1

14.9

8.8 (-41%)

Mean tokens to get there

~0

55,534

47,616 (-14%)

The agent wins on accuracy, and culprit does not make it more accurate. What culprit does is get it there in roughly half the steps for about 8,000 fewer tokens per investigation. Tool calls dropped in 10 of 10 cases, tokens in 7 of 10. On the hardest case the agent needed 42 tool calls and 124k tokens alone, against 16 calls and 84k with culprit.

Those savings are already net of reading culprit's output, which is counted in the third column. culprit's own run is one deterministic call, no model, under a second.

So culprit is an accelerator for an agent, not a replacement for one, and not a smarter blamer than one. Method, caveats (n=10, and this slice is easier than the full 50), and reproduction: benchmarks/agent/.

Quick start

Claude Code plugin (installs the MCP server plus a skill that tells the agent when to use it):

/plugin marketplace add noordeen123/culprit
/plugin install culprit@culprit

Any MCP client (Cursor, Windsurf, VS Code, Codex CLI, Zed, Continue, Cline, Amazon Q, Goose):

{
  "mcpServers": {
    "culprit": {
      "command": "uvx",
      "args": ["--from", "culprit[mcp]", "culprit-mcp"]
    }
  }
}

CLI, no agent required:

uvx culprit                     # run from PyPI on demand
rca --verify-fix patch.diff     # exit 0 if complete, 1 otherwise

Needs Python 3.10+ and uv for the MCP server. The CLI runs on 3.9+.

The tools

Tool

What it answers

analyze

Full RCA in one call: classify, suspects or blast radius, risk, test impact

verify_fix

Is this diff safe to commit? complete / partial / risky, plus the missed call sites

find_suspects

Rank the commits that introduced the bug

check_completeness

Call sites of the changed symbol the fix did not touch

get_intent

The introducing commit's message, linked PR, referenced issues

get_evolution

Per-commit history of the buggy lines via git log -L

get_risk_score

QA gate score (0 to 100, low/medium/high) with contributing factors

get_blast_radius

Feature impact: dependents, covering tests, high-risk files

get_test_impact

Minimal test set to run for this change

classify_change

Bugfix vs feature, with evidence

from_trace

RCA straight from a stack trace, no diff or PR needed

verify_fix, the pre-commit gate

The agent runs this on its own diff before committing:

  • verdict: complete when no untouched call site is left behind, partial when one was missed, risky when risk is high. The verdict is the completeness axis; test coverage is the separate confidence axis on risk_level.

  • untouched_references: the exact files that still use the changed symbol. This is the list the agent goes and patches.

  • skipped_symbols, adds_test, notes: what was too widely used to check, whether a test shipped, and what to do next.

Loop until complete, then commit. That is the whole idea.

CLI and CI

rca                            # current branch vs the configured base
rca --last                     # the latest commit only
rca --pr 16786                 # a specific PR (uses the PR's own base)
rca --trace crash.txt          # RCA from a stack trace, no fix or PR needed
rca --verify-fix patch.diff    # check a diff before committing
rca --select-tests             # print the tests to run for this change
rca --html report.html --open  # a single self-contained HTML report
rca --pr 16889 --fail-on high  # exit non-zero when QA risk is high
rca serve --repo /path         # local web UI with a base picker

CI gate: risk via exit code only, no PR comments, no writes. Copy examples/github-actions/culprit-pr.yml into .github/workflows/:

- run: pip install "culprit>=0.3.0"
- env: { GH_TOKEN: "${{ github.token }}" }
  run: rca --pr ${{ github.event.pull_request.number }} --fail-on high

HTML report

--html writes one self-contained file. No CDN, opens offline, attaches to CI. It opens with the verdict: a scored QA risk with the factors behind it, and the prime suspect with how long the bug lived.

Then it reconstructs how the bug got there. Every commit that touched the buggy line, from creation through the commit that broke it (red, with the exact diff) to the fix (green):

vs git bisect

git bisect

culprit

Input

A reliable failing test

The fix diff (or a stack trace)

Method

Checks out commits and runs the test

Blames the fix's lines plus git log -L

Speed

Minutes (about log2(N) test runs)

Instant

Output

First bad commit

Suspect set, intent, lifecycle, completeness, risk

Confidence

Proof

Strong heuristic

--bisect "<cmd>" runs a real bisect as an optional confirmation layer, in a throwaway git worktree so your checkout is never touched. When the first failing commit matches the blamed suspect, the report stamps it confirmed by git bisect.

Architecture

One normalized context in, one structured JSON result out. The only non-deterministic step is the optional LLM narrative, isolated behind an adapter so the engine runs with no API key.

Two lanes, one engine. Every module writes one slice of the result, so nothing cares whether the target came from gh, the REST API, local git, or a pasted stack trace. Full module map: docs/ARCHITECTURE.md.

Configuration

The base branch resolves in order: the --base flag, then CULPRIT_BASE, then .culprit.toml (base = "origin/main"), then HEAD~1. --last forces the latest-commit view.

PR titles and labels use the GitHub CLI when present, or the unauthenticated REST API for public repos (set GITHUB_TOKEN or GITLAB_TOKEN to raise limits). Deep links cover GitHub, GitLab, Bitbucket, and Gitea. Blast radius reads imports across JS/TS, Python, Go, Java/Kotlin, Ruby, C/C++, C#, PHP, Rust, Scala, and Swift.

Contributing

pip install -e ".[dev]" && pytest

Module map and data shapes: docs/ARCHITECTURE.md. Publishing the MCP server to the registries: docs/PUBLISHING.md. MIT licensed.

Available Tools

11 tools
analyzeA

Full RCA in one call: classify -> suspects (bugfix) or blast-radius (feature) -> risk score -> test impact.

Returns the complete structured result. Use the individual tools to drill into specific signals.

ParametersJSON Schema
NameRequiredDescriptionDefault
prNo
baseNo
headNo
repoYes

TDQS

A4/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description carries the burden. It reveals a multi-step analytical pipeline and the conditional branching based on bugfix vs feature, plus a 'complete structured result' return. However, it does not disclose whether the operation is read-only, potentially expensive, or what happens when optional params like pr/base/head are absent. These are meaningful gaps.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Two short, dense paragraphs with a front-loaded purpose and no filler; every sentence contributes purpose, pipeline, or routing to siblings. Nothing is wasted.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The tool has 4 params, no output schema, and no annotations. The description communicates the overall workflow and result shape at a high level, but leaves out how the optional parameters combine, what a 'complete structured result' actually contains in detail, and any constraints or prerequisites. Sufficient as a summary, not as full operational guidance.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0% and the description never explains how repo, pr, base, or head are used. The param names are somewhat self-evident in a git context, but the description adds no mapping to its pipeline stages, so it cannot compensate for the lack of schema descriptions.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description opens with 'Full RCA in one call' and maps the internal pipeline (classify -> suspects/blast-radius -> risk score -> test impact), giving a specific verb-resource scope. It clearly differentiates itself from sibling tools by framing them as drill-downs, so an agent can tell this composite tool apart.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines5/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

It explicitly states when to use this tool ('Full RCA in one call') and when not: 'Use the individual tools to drill into specific signals.' That is an explicit alternative and exclusion, even though it does not enumerate each sibling by name.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

check_completenessA

Is the fix complete? Find other references to changed symbols not touched by this fix.

Returns: {symbols: [...], other_call_sites: {...}, untouched_count: int, adds_test: bool, is_revert: bool, notes: [...]}

ParametersJSON Schema
NameRequiredDescriptionDefault
baseNo
headNo
repoYes

TDQS

A3.5/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description carries the burden but does disclose the operation ('find references') and a detailed return shape ('Returns: {symbols: [...], other_call_sites: {...}, untouched_count: int...}'). It does not state side-effects or permissions, though the read-only nature is implicit. This is reasonable transparency for an analysis tool.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Three short, purposeful blocks: a framing question, a one-line action, and a structured return shape. No filler or repetition.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The output format is fully documented, but the input semantics are absent and there is no guidance on how repo/base/head relate to the fix being checked. With no output schema or annotations, the definition is incomplete for a 3-param tool.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters1/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0% and the description does not explain base, head, or repo. The terms 'changed symbols' and 'this fix' are not mapped to parameter values, so an agent cannot know what to supply.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

States a specific action: 'Find other references to changed symbols not touched by this fix.' This clearly conveys it checks completeness by locating untouched references, distinguishing it from siblings like verify_fix or get_test_impact.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Implies use when checking whether a fix is complete, but provides no explicit when-to-use, prerequisites, or alternatives. No exclusions or routing to sibling tools.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

classify_changeC

Classify whether a change is a bugfix or a feature, with evidence.

Returns: {verdict: "bugfix"|"feature"|"unknown", evidence: [...], signals: {...}}

ParametersJSON Schema
NameRequiredDescriptionDefault
baseNo
headNo
repoYes

TDQS

C2.7/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description carries the burden of explaining observable behavior. It does disclose the return shape ('{verdict, evidence, signals}') and the 'unknown' verdict class, which is useful. However, it does not state whether the tool is read-only, what inputs are required semantically, or any failure behavior, so the gap remains non-trivial.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is short, front-loaded with the core purpose, and adds a compact return signature. It earns its two sentences without padding, though it is perhaps too sparse to fully serve the tool.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

There is no output schema and no annotations, so the description must be more complete to support correct invocation. It gives the return shape and verdict options but omits parameter semantics, usage conditions, and relationship to sibling tools. For a classification tool with three unannotated parameters, this is a clear completeness gap.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters1/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0% and the description does not define the three parameters. 'Base' and 'head' are only inferably commit refs from the 'change' wording, and 'repo' is not described at all. The description entirely fails to compensate for the schema's lack of explanations.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description uses a specific verb ('Classify') and a specific resource ('a change'), and clearly states the output categories (bugfix vs feature) with evidence. It does not explicitly contrast with sibling tools like get_intent or analyze, so it misses the top score for sibling differentiation.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description gives no guidance on when to use this tool instead of a sibling, no prerequisites, and no exclusions. The only implied usage is that it classifies changes, which is weak because several sibling tools also analyze changes.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

find_suspectsA

Find the commits most likely to have introduced a bug.

Pass trace_text (a stack trace / crash log) to run RCA from a runtime error with no diff needed. Otherwise diffs base..head to find suspects.

Returns: {suspects: [{hash, short, author, date, subject, pr_number, weight, lines}], origin_on_branch: bool, notes: [...]}

ParametersJSON Schema
NameRequiredDescriptionDefault
baseNo
headNo
repoYes
trace_textNo

TDQS

A4.1/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description carries the full burden and handles it well: it explains the trace-based RCA path, the diff-based path, and the exact return shape. It stops short of explicitly stating side effects or read-only behavior, but this is clearly an analytical/find operation.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is compact and front-loaded with the core purpose, followed by usage modes and return structure. Every line earns its place, with no filler or redundancy.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The description is complete enough for a moderate-complexity tool: it names the required repo, the two input modes, and the output shape. It could be stronger by explicitly contrasting with related siblings such as from_trace and by clarifying how base/head behave when omitted.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, so the description must compensate. It does for trace_text, base, and head by explaining the stack-trace flow and the base..head diff flow. The required repo parameter is left implicit and not explicitly described, which is the main gap.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description opens with a specific verb and resource: 'Find the commits most likely to have introduced a bug.' It also clarifies two distinct modes (trace_text vs diff base..head). It does not explicitly distinguish itself from sibling tools like from_trace, so it falls just short of a 5.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description gives clear conditional usage: pass trace_text for a stack trace/crash log, otherwise diff base..head. This tells the agent when to use each input path, though it does not name alternatives or explicitly state when not to use the tool.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

from_traceA

RCA from a stack trace or crash log; no diff or PR needed.

Parses the stack trace, blames the crashing lines in git history, and returns the suspect set. Works for Python, JavaScript, Java, and Go stack traces.

Returns: {suspects: [...], frames: [{file, line, func}], skipped_frames: [...], notes: [...]}

ParametersJSON Schema
NameRequiredDescriptionDefault
headNo
repoYes
trace_textYes

TDQS

A4.1/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description carries the full burden and does well: it explains the workflow (parse, blame in git history, return suspect set) and discloses the return shape. It does not mention whether any git history access could require permissions or whether the operation is read-only, but the described behavior is clear and non-destructive.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is compact and front-loaded. The first sentence captures the tool's purpose and key differentiator, the second explains the mechanism, the third lists supported languages, and the fourth gives the return shape. Every sentence earns its place.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given there is no output schema, the description provides a useful return shape and gives a solid overall picture of the tool's behavior. However, the unexplained 'head' parameter and lack of any guidance on how to interpret suspects or skipped frames leave small but real gaps for an agent.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, so the description must compensate for parameter meaning. While 'trace_text' is implied by 'stack trace' and 'repo' is implied by 'git history,' the 'head' parameter is completely unexplained. This is a meaningful gap because head likely controls which git ref is blamed but the description gives no hint.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description states a specific verb+resource: it performs RCA from a stack trace or crash log, parses the trace, blames crashing lines in git history, and returns a suspect set. It also distinguishes itself from diff/PR-based analysis with 'no diff or PR needed,' which separates it from sibling tools.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description gives clear context for when to use the tool: when you have a stack trace or crash log and no diff or PR is available. It also scopes applicability to Python, JavaScript, Java, and Go traces. It does not explicitly name alternative tools or exclusion conditions, so it misses a full when-not-to-use statement.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get_blast_radiusB

Map what a feature change affects: who imports the changed modules, covering tests, high-risk areas.

Returns: {dependents: {...}, covering_tests: [...], high_risk: [...], notes: [...]}

ParametersJSON Schema
NameRequiredDescriptionDefault
baseNo
headNo
repoYes

TDQS

B3.1/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

There are no annotations, so the description carries the behavioral transparency burden. It reveals the output shape (dependents, covering_tests, high_risk, notes) and the general analysis scope, which is useful. However, it does not disclose side effects, required permissions, how base/head relate to repository state, or any operational constraints.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is compact, front-loaded with the main purpose, and uses the return block to convey output structure efficiently. Every sentence earns its place and there is no filler.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

With three parameters, no output schema, and no annotations, the description should compensate by explaining the parameters and usage context. It provides the purpose and return keys but leaves base/head semantics, repo interpretation, and sibling differentiation unaddressed, so an agent cannot confidently invoke it beyond a basic repo argument.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters1/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, and the description adds no explanation for base, head, or repo. The parameter names are somewhat self-explanatory, but the description does not clarify that base/head likely represent a comparison range or how repo is used, leaving the agent to guess.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description states a specific verb ('Map') and resource ('what a feature change affects'), and enumerates the key outputs: dependents, covering tests, and high-risk areas. It is clear enough to distinguish it as blast-radius analysis, though it does not explicitly contrast with sibling tools like get_test_impact or get_risk_score.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The phrase 'Map what a feature change affects' implies this tool is for impact analysis after a feature change, which is a usable but implicit usage signal. It provides no exclusions, prerequisites, or guidance on when to choose this tool over the listed sibling tools.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get_evolutionA

git log -L over a line range: every commit that touched those lines, oldest to newest, with per-step diffs.

Returns: {steps: [{hash, short, author, date, subject, diff}], notes: [...]}

ParametersJSON Schema
NameRequiredDescriptionDefault
baseNo
fileYes
repoYes
end_lineYes
start_lineYes

TDQS

A4/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description carries the burden of behavioral disclosure. It reveals the operation (git log -L), ordering (oldest to newest), and the exact return shape including per-step diffs and notes. It does not mention error cases or the optional base parameter behavior, but for a read-only query the essential behavior is disclosed.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is two sentences, starts with the core git log -L analogy, and provides the return structure without any filler. Every sentence earns its place.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The return structure is explicitly documented, which matters since there is no output schema. However, the tool has 5 parameters and 0% schema description coverage, and the description does not explain base, file/repo expectations, or line indexing/inclusivity semantics. This leaves an agent with some guessing about how to invoke it correctly.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, so the description must compensate. It only indirectly covers start_line and end_line via the phrase 'line range'. The repo, file, and base parameters are left entirely unexplained, forcing the agent to infer semantics from parameter names alone.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

States a specific verb and resource: `git log -L` over a line range, returning every commit that touched those lines. This clearly conveys what the tool does and is easily distinguished from sibling tools like get_blast_radius or get_risk_score, which concern impact and risk rather than line history.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description clearly frames when to use it: when you need the commit history and diffs for a specific line range in a file. It does not explicitly name alternatives or exclusions, but the scope is unambiguous enough to guide selection among the siblings.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get_intentB

Commit body + the PR it came from (title, body, url) + linked issues (Fixes/Closes/Resolves #N).

Returns: {body: str, pr: {number, title, body, url} | null, linked_issues: [...]}

ParametersJSON Schema
NameRequiredDescriptionDefault
repoYes
commit_hashYes

TDQS

B3.2/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description must carry the transparency burden. It does disclose that pr can be null and shows the return shape, but it does not address side-effect safety, auth/network assumptions, or what happens when the commit is not found. Nothing contradicts the annotations because none were provided.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is two short lines with no fluff and the return type is front-loaded. The first fragment is telegraphic ('Commit body + ...'), but the information density is high.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple two-parameter read tool, the return shape and nullable PR are useful. Still, with no output schema and no annotations, the absence of parameter formats and error/edge-case behavior leaves an agent with meaningful unknowns.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, so the description must compensate for undocumented parameters. It does not: repo and commit_hash are never explained, and no format is given (e.g., full SHA vs short SHA, owner/repo form for repo). The parameter names are guessable, but the description adds no parameter-specific meaning.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly specifies the resource (commit) and the data returned: commit body, originating PR metadata, and linked issues. It is distinct from sibling analysis tools like get_test_impact or get_risk_score, though it omits an explicit verb like 'retrieve' or 'fetch'.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description makes the intended use obvious—any agent wanting commit body, PR context, or linked issues—but it never states when not to use it or names an alternative. With siblings like analyze and get_blast_radius around, explicit routing guidance would be valuable.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get_risk_scoreB

QA risk score for a change: 0-100 with level (low/medium/high) and contributing factors.

Combines test gap, fix completeness, hotspot recurrence, blast radius, and churn.

Returns: {score: int, level: "low"|"medium"|"high", factors: [{name, detail, points}]}

ParametersJSON Schema
NameRequiredDescriptionDefault
prNo
baseNo
headNo
repoYes

TDQS

B3.1/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description carries the behavioral disclosure burden and does a reasonable job: it states the output range, the level vocabulary, the contributing factors, and the exact return shape. It does not discuss side effects, but 'get' plus the output focus makes read-only behavior reasonably inferable. The main omission is how the tool behaves when optional parameters are omitted.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is compact and well structured: the core purpose and output scale are front-loaded, followed by the combination inputs and then a precise return type. Every sentence adds information, and there is no filler or repetition.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The description is thorough about the output and calculation inputs, but it omits the most critical operational context: how to identify the change being scored. It does not explain whether repo+pr is the intended invocation or whether base/head commits define a range. With no annotations and no output schema, these omissions leave the tool underspecified for correct invocation.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters1/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, and the description provides no explanation of the parameters: repo, pr, base, or head. It never states that pr is a pull request number, what base/head refer to, or how they relate to the required repo parameter. With no schema descriptions and no compensation in the description, an agent cannot confidently populate the parameters.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states that this tool produces a QA risk score (0-100) for a change, including a level and contributing factors. It also lists the combined inputs, which makes it distinct from siblings like get_blast_radius or get_test_impact. However, it does not explicitly name an alternative or contrast itself with a sibling.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

There is no explicit guidance on when to use this tool versus the many siblings such as verify_fix, check_completeness, or classify_change. The phrase 'QA risk score for a change' implies a use case, but the description never states when this aggregate score should be chosen over more specific tools, nor does it mention any exclusions or prerequisites.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get_test_impactA

Which existing tests should be run for this change.

Walks the reverse-import graph from changed files to tests that cover them directly or transitively (up to 2 hops).

Returns: {tests: [...], by_test: {test: [reasons]}, notes: [...]}

ParametersJSON Schema
NameRequiredDescriptionDefault
baseNo
headNo
repoYes

TDQS

A3.5/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description must carry the behavioral burden. It discloses the traversal mechanism, the hop limit, and the return format. It implies a read-only operation consistent with the 'get' prefix, though it does not cover edge cases or prerequisites.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is concise: three sentences covering purpose, method, and output. There is no redundant or filler content, and the most important information is front-loaded.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The return structure is documented, which compensates for the missing output schema. However, with no annotations and no parameter explanations, the agent cannot confidently construct a correct invocation, especially for the optional base and head parameters. The description is sufficient for understanding the tool's purpose but not for reliable parameter usage.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters1/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, and the description provides no meaning for the repo, base, or head parameters. The term 'changed files' hints at a diff, but the role of base and head is not explained, leaving the agent to guess how to specify the change.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool's function as selecting existing tests for a change, and adds algorithmic detail about walking the reverse-import graph up to 2 hops. However, it does not differentiate itself from sibling tools such as get_blast_radius or find_suspects, which would elevate it to a 5.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The phrase 'for this change' gives clear context for when the tool should be used. It does not mention explicit alternatives or exclusions, but the intended scenario is reasonably apparent from the opening question.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

verify_fixA

Check fix completeness against a raw unified diff before committing.

Runs completeness + test-impact analysis on the proposed diff and returns a verdict. Iterate until verdict == "complete" (no untouched call sites). "complete" covers the root cause but does not imply a test exists - a complete but untested fix comes back at risk_level "medium" with a note, so check risk_level/notes and add the test before committing.

Returns: {verdict: "complete"|"partial"|"risky", symbols_fixed: [...], untouched_references: [...], tests_to_run: [...], adds_test: bool, risk_level: "low"|"medium"|"high", notes: [...]}

ParametersJSON Schema
NameRequiredDescriptionDefault
baseNo
repoYes
proposed_diffYes

TDQS

A3.7/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description carries the full burden, and it discloses important behavior: the exact return object, the meaning of 'complete', the risk_level caveat, and the need to inspect notes. It does not explicitly mention side effects or auth needs, but the tool reads as an analysis-only check.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is front-loaded with a one-line purpose and then gives necessary operational detail, including a return schema equivalent. It is slightly dense but every sentence adds value and there is no filler.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The description is strong for an analysis tool: it explains when to invoke it, how to interpret the verdict, what to check before committing, and what the result shape is. The main gap is the undocumented base parameter and the lack of explicit guidance on prepasing proposed_diff beyond calling it a raw unified diff.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, so the description must compensate, but it only clarifies proposed_diff as a raw unified diff. The required repo and optional base parameters receive no explanation, and base is never mentioned, leaving the agent to guess its role.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description names a specific action and resource: checking fix completeness against a raw unified diff and returning a verdict. It is clear and distinct from a generic 'check', but it does not explicitly contrast itself with the sibling check_completeness tool, so sibling differentiation is incomplete.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description gives clear operational context: use this before committing and iterate until verdict is 'complete'. It also explains what to do for a complete-but-untested fix, but it does not state exclusions or name alternatives among siblings.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Tool Schema Changelog

Recent tool additions, removals, and schema changes observed during successful MCP inspections. Dates show when Glama detected each change.

  1. 11 tool updatesv0.4.1
    • First observedanalyze
    • First observedcheck_completeness
    • First observedclassify_change
    • First observedfind_suspects
    • First observedfrom_trace
    • First observedget_blast_radius
    • First observedget_evolution
    • First observedget_intent
    • First observedget_risk_score
    • First observedget_test_impact
    • First observedverify_fix

TDQS

B3.3/5.0
Disambiguation2/5

Several tool pairs have overlapping responsibilities: from_trace and find_suspects both take a stack trace and return suspects, verify_fix and check_completeness both assess fix completeness, and get_test_impact/get_blast_radius both surface covering tests. The descriptions are detailed, but an agent could easily select the wrong tool for the same underlying task.

Naming Consistency3/5

Most names are lowercase snake_case verb_noun, but the verbs are inconsistent across get_, classify_, find_, check_, verify_, and two tools break the pattern entirely: from_trace and analyze. The naming is readable but not predictable enough to be considered a consistent convention.

Tool Count4/5

Eleven tools is within a reasonable range for a change-analysis server, but the set is slightly larger than necessary because some tools duplicate or wrap each other's functionality. It is not bloated, just a bit redundant.

Completeness5/5

The tool surface covers the full RCA workflow: classify, identify suspects, map blast radius, compute test impact, score risk, verify completeness, inspect evolution, and read intent. The analyze tool also provides an orchestrated end-to-end path, while individual tools allow drilling into specific signals without obvious dead ends.

Maintenance

ActivityActive
ResponsivenessNo issues

Related MCP Connectors

Related MCP Servers

  • A
    license
    Not graded
    quality
    A
    maintenance
    A runtime gate for coding agents. Blocks the tool calls that wreck a repo (force-push main, rm -rf, secret exfiltration, CI wipe) and lets normal build and commit work through. Machine-checked git-branch core (z3); the rest is high-precision heuristics. Tested on 3,790 real CI commands, 0 false blocks.
    1
    MIT

Latest Blog Posts

MCP directory API

We provide all the information about MCP servers via our MCP API.

curl -X GET 'https://glama.ai/api/mcp/v1/servers/noordeen123/culprit'

If you have feedback or need assistance with the MCP directory API, please join our Discord server