Skip to main content
Glama

Run Strategy Gatekeeper

apex_run_strategy_gatekeeper
Read-only

Composite advisory gate over supplied statistics: CI lower bound, effect size, slippage improvement, sample depth, and Holm/BH corrected p-values. DATA ONLY, read-only, no HMAC required, no orders.

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault
alphaNo
p_valuesYes
sample_daysYes
delta_sharpeYes
metric_ci_lowerYes
min_sample_daysYes
metric_thresholdYes
min_delta_sharpeNo
multiple_testing_modeNo
slippage_reduction_bpsYes
min_slippage_reduction_bpsNo

Schema Changelog

Changes observed during successful MCP inspections. Dates show when Glama detected each change.

  1. Changed2 schema fields changed
    • addedInput schema / properties / min_delta_sharpe
      Added value: +{
      +  "minimum": 0,
      +  "type": "number"
      +}
    • addedInput schema / properties / min_slippage_reduction_bps
      Added value: +{
      +  "minimum": 0,
      +  "type": "number"
      +}
  2. Added

TDQS

B3.2/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true, and the description reinforces this with 'DATA ONLY, read-only'. It adds valuable context beyond the annotation by stating 'no HMAC required, no orders', explicitly ruling out authentication and trading actions. This transparency helps the agent understand the tool's safe, non-mutating nature without contradiction.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is two concise sentences that front-load the core purpose and then list important safety constraints. Every word earns its place; there is no fluff or redundancy. The structure is clear and easy to parse.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

With 11 parameters, 7 required, no output schema, and minimal annotations, the description must explain more about what the tool returns and how the gate works. It only lists input categories and safety guarantees, omitting the decision logic, output format, or how the 'composite' is computed. This is insufficient for a complex gate tool, leaving the agent with significant ambiguity.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, so the description must compensate for 11 parameters. It mentions conceptual inputs like 'CI lower bound', 'effect size', and 'slippage improvement', which roughly map to some parameters, but it does not define thresholds (metric_threshold), minimums (min_delta_sharpe, min_slippage_reduction_bps, min_sample_days), or settings like alpha and multiple_testing_mode. This leaves many parameters semantically unexplained.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states it is a 'Composite advisory gate over supplied statistics' and lists the key inputs (CI lower bound, effect size, slippage improvement, sample depth, Holm/BH p-values). This conveys the tool's purpose as an evaluative gate, distinguishing it from simple single-statistic gates. However, it does not explicitly state the output behavior (e.g., pass/fail or advisory score), so it stops short of full clarity.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description gives no explicit guidance on when to use this tool versus sibling gates like apex_run_deflated_sharpe or apex_run_dynamic_penalty. It implies use when you have all the listed statistics, but there is no mention of alternatives, prerequisites, or when not to use it. This lack of usage context leaves the agent to infer appropriateness.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Try in Browser

Glama MCP Gateway

Add one secure layer between your agents and this server.

TDQS

A3.6/5.0
Disambiguation4/5

Most tools have clearly distinct purposes, and descriptions provide sufficient boundaries. Some run_* analytics tools (e.g., deflated_sharpe vs empyrical_metrics) could be conceptually confused, but their specific inputs and outputs minimize ambiguity.

Naming Consistency4/5

All tools share the apex_ prefix, and the verb_noun pattern is consistent (get, query, run, submit). The 'agent_' subgroup within run tools introduces a minor irregularity, but it remains readily comprehensible.

Tool Count3/5

With 24 tools, the server is on the heavy side, falling into the 16-25 range. Many run_* tools are similar in nature (pure calculations), but each appears to serve a specific purpose, so the count is borderline rather than excessive.

Completeness2/5

The server name implies a card store, yet the tool surface only supports reading and querying cards, with no create, update, or delete operations. This is a significant gap that prevents full lifecycle management, though the analytics side is fairly comprehensive.

Resources