Skip to main content
Glama

hypothesis_test

Run a significance test and get the statistic, p-value, and a plain-language interpretation with assumptions. test = one-sample-t {data, mu0}, two-sample-t {data1, data2}, one-proportion-z {successes, n, p0}, two-proportion-z {successes1,n1,successes2,n2}, chi2-gof {observed, expected?}, chi2-independence {table}. Optional tail: two-sided (default) | greater | less; alpha default 0.05.

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault
nNo
n1No
n2No
p0No
mu0No
dataNo
tailNo
testYes
alphaNo
data1No
data2No
tableNo
expectedNo
observedNo
successesNo
successes1No
successes2No

Schema Changelog

Changes observed during successful MCP inspections. Dates show when Glama detected each change.

  1. First observed

TDQS

A4.1/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description carries the full behavioral burden and does disclose key behavior: the computed outputs, that interpretations come with assumptions, the optional tail direction, and the alpha default. It does not address edge cases like invalid inputs or missing data, but the core behavior is transparent.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single dense, front-loaded paragraph with no filler; it states the purpose first, then the test menu and defaults. The compact brace syntax is efficient but somewhat dense, requiring careful parsing to map each test to its parameters.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a 17-parameter tool with no output schema and no annotations, the description covers test selection, most parameter groupings, defaults, and expected return content. It is not exhaustive—invalid input handling and exact return structure are absent—but it provides enough for an agent to invoke the common cases correctly.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, so the description must compensate, and it substantially does by binding parameters to specific tests, e.g., one-sample-t {data, mu0}, one-proportion-z {successes, n, p0}, and chi2-independence {table}. The main gaps are the ambiguous 'expected?' optional marker and the unspecified structure of 'table', so a few parameters remain under-specified.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description opens with a specific action ('Run a significance test') and clearly lists the outputs: statistic, p-value, and plain-language interpretation with assumptions. The enumerated test menu (one-sample-t, two-sample-t, one-proportion-z, etc.) makes the tool's scope unmistakable and distinguishes it from estimation or descriptive sibling tools.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description gives practical selection guidance by mapping hypothesis scenarios to concrete test names, and documents defaults for tail and alpha. However, it never explicitly states when to prefer hypothesis_test over siblings like confidence_interval or descriptive_stats, nor does it provide when-not conditions.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Try in Browser

Glama MCP Gateway

Add one secure layer between your agents and this server.

TDQS

A4/5.0
Disambiguation5/5

Each tool targets a distinct statistical operation: descriptive summaries, distribution calculations, hypothesis tests, confidence intervals, Bayesian updating, and linear regression. The only mild adjacency is between confidence intervals and hypothesis tests, but their descriptions clearly separate estimation from significance testing.

Naming Consistency5/5

All six tool names follow the same lowercase snake_case pattern and are straightforward noun phrases describing the statistical concept. There is no mixing of conventions or inconsistent verb styles across the set.

Tool Count5/5

Six tools is well within the ideal range and each one covers a broad, meaningful area of statistics. The count feels appropriately scoped without redundancy or bloat.

Completeness4/5

The set covers core statistical workflows: description, distributions, estimation, tests, Bayesian updates, and regression. Some common additions like ANOVA or nonparametric tests are absent, but they are not necessary for most basic statistics tasks.

Resources