Skip to main content
Glama

dashai-mcp

An MCP server for dashAI, the open source Machine Learning workbench led by the University of Chile (FCFM), built by students of DCC UChile and UTFSM, with CENIA and IMFD.

Unofficial and independent. This is a third-party project. It is not affiliated with, endorsed by, or maintained by the dashAI project or the institutions that develop it.

It gives an agent the same surface dashAI gives a person through its GUI: look at datasets, see which models are available, train, follow queued work, and read the metrics.

"Train a random forest on dataset 3 predicting 'species' and tell me the F1"

Status

v0.2.2 — verified against a running dashAI 0.9.7.post1. Deterministic tests (including the predict two-step path) plus live runs: dashai_train_modeldashai_job_statusdashai_get_run with metrics, and dashai_predictdashai_job_status finished.

Live tabular run (seed students)

Public dashAI seed only. Target placement_status (~83% majority).
exam_score was left out of the inputs (it leaks the label). Split 70/15/15. Goal metric: BalancedAccuracy — Accuracy and F1 on the majority class are traps.

model

test BalancedAccuracy

test MCC

test F1

test Accuracy

DummyClassifier(most_frequent)

0.500

0.000

0.906

0.827

RandomForestClassifier (class_weight=balanced, depth 8, 100 trees)

0.851

0.591

0.900

0.845

LogisticRegression (class_weight=balanced, L2)

0.873

0.624

0.905

0.853

The dummy wins F1 by always answering the majority class. The linear model beats the forest on the metrics that actually measure separation. Each row is its own 70/15/15 draw (not the same test rows) — still enough to stop treating the forest as the default. If a client reports only F1 here, it is lying.

dashai_predict on the finished forest run returned prediction_id and the job finished. That scores the same seed dataset the model was trained on, not a held-out file — do not read it as a generalization check. dashai_get_prediction returns {n, n_classes, class_counts} only.

Live image run (seed cifar10-subset)

Public seed: 200 images, frog vs truck (100/100). LeNet5ImageClassifier, CPU, 32×32. Split 70/15/15 → test n=30. Chance is 0.5.

run

shuffle/stratify

train BalAcc

val BalAcc

val MCC

test BalAcc

test MCC

10 epochs (poisoned)

off

0.879*

0.467*

0.000

0.633*

0.000

40 epochs (poisoned)

off

0.950*

0.733*

0.000

0.867*

0.000

40 epochs (cifar10-lenet5-40ep-stratified)

on

1.000

0.767

0.544

0.900

0.816

*Accuracy, not BalancedAccuracy — on the one-class val/test they collapse. Chance on this seed is 0.5. Dummy tabular does not apply (image task).

The image path works. The 0.867 is not a result: dashAI defaulted shuffle=False, so val/test were 30 trucks and zero frogs. MCC 0 is sklearn on a one-class split. After this server sent shuffle=true + stratify=true, both classes are in val/test and MCC is no longer 0. Train hits 1.0 (140 images memorized). Val 0.767 is the honest-ish number; test 0.900 is a 30-row lottery. Do not publish a leaderboard line.

Verifying against a live instance surfaced gaps between dashAI's documentation and its actual behaviour. Each one has its own regression test. A sixth — sequential splits with shuffle=False — only showed up live because MCC came back 0 next to a moving Accuracy. dashai_predict sending run_id to PredictJob — only showed up live (KeyError: 'prediction_id') because there was no predict test.

Related MCP server: Pakunoda-MCP

Install

pip install dashai-mcp
# or: uv pip install dashai-mcp

In your MCP client configuration:

{
  "mcpServers": {
    "dashai": {
      "command": "dashai-mcp"
    }
  }
}

dashAI has to be running separately (dashai, or the desktop app). It is looked up at http://localhost:8000 by default.

Tools

Tool

What it does

dashai_server_info

Is dashAI up? How many datasets and runs are there

dashai_list_datasets

Lists the loaded datasets

dashai_describe_dataset

Columns, types and a sample — all in one call

dashai_list_components

Available models, metrics, tasks and optimizers

dashai_train_model

Trains. Enqueues and returns job_id + run_id

dashai_job_status

Job progress: not_started / started / finished / error

dashai_list_runs

Recorded runs, for comparing models

dashai_get_run

Configuration and metrics of a run

dashai_predict

Predicts using the model of a finished run

dashai_get_prediction

Class counts of a finished prediction — never the rows

Six things dashAI's documentation (or defaults) get wrong

Found by running against a real instance. If you are writing a client for this API, these will bite you:

What the docs say

What the code does

?select_types=["Model","Metric"]

Must be repeated parameters: ?select_types=Model&select_types=Metric. The JSON array returns 422.

POST /job/ with a JSON body

It is form data, with kwargs serialized as a JSON string. Its own openapi.json declares no requestBody for that route, because the endpoint parses request by hand.

splits as an object

It travels as a JSON string: the Pydantic schema declares it str.

optimize(model_class, search_space, X, y, n_trials)

The real signature is optimize(model, input_dataset, output_dataset, parameters, metric), and model is an instance, not a class.

Predict by run_id on the job

PredictJob.run requires kwargs["prediction_id"]. The GUI first POST /predict/ ({run_id, dataset_id}) and only then enqueues. Sending run_id to the job raises KeyError: 'prediction_id'.

Split shuffle / stratify

prepare_for_model_session defaults both to False. On a class-sorted seed (cifar10-subset is 100 frog then 100 truck) a 70/15/15 cut puts val and test in one class. Accuracy still moves; sklearn's MCC is defined as 0. This server sends shuffle=true and, on classification tasks, stratify=true.

The component registry also has 13 types, not the four the documentation suggests: Task, GenerativeTask, Model, GenerativeModel, DataLoader, DatasetSource, Metric, Optimizer, Job, LocalExplainer, GlobalExplainer, Explorer, Converter.

And GET /run/{id} returns split_indexes with the full list of indices: on a 10,000-row dataset that is 59 KB, 99% of the response. This server replaces it with the per-split counts, bringing the response down to ~1 KB.

Three design decisions

1. Ten tools, not 142

dashAI exposes 142 REST endpoints. Generating one tool per endpoint is mechanical and it is a mistake: a model with 140 tools burns context reading the catalogue and chooses worse. These ten cover the actual working path.

2. dashai_train_model collapses three calls

In the raw API, training is a chained sequence:

POST /model-session/   → creates the experiment
POST /run/             → creates the run
POST /job/             → enqueues the ModelJob

With required fields the GUI fills in on its own and that are undocumented — plot_history_path, plot_slice_path, plot_contour_path, plot_importance_path. On top of that, splits travels as a JSON string, not an object, even though dashAI's documentation shows it as an object: the backend's Pydantic schema declares it str. That kind of detail is exactly what makes an agent fail against the raw API.

Here it is a single call, and it does not block: training can take hours, so it returns the job_id immediately and progress is polled with dashai_job_status.

dashai_predict does the same for the two-step GUI path: POST /predict/ then POST /job/ with prediction_id.

3. No tool deletes anything

dashAI's API has no authentication — checked endpoint by endpoint. That is coherent for something local-first, but it means there is no barrier between a misread sentence and an irreversible DELETE /dataset/{id}. Deleting is done from the GUI, looking at what is being deleted.

For the same reason, the server refuses to point at a non-local host:

DASHAI_BASE_URL points to 'ml.example.com', which is not local, and dashAI's API
has no authentication: exposing it to the network leaves the backend open to
anyone who can reach it.

This can be disabled on purpose with DASHAI_ALLOW_REMOTE=1, if the target is protected some other way.

Configuration

Variable

Default

What for

DASHAI_BASE_URL

http://localhost:8000

Where the backend is

DASHAI_ALLOW_REMOTE

(no)

Allow a non-local host (see above)

DASHAI_TIMEOUT

30

Seconds to wait per request

dashai_get_prediction needs pyarrow in the MCP process to turn the Arrow file into class counts (pip install 'dashai-mcp[counts]', or install the MCP into the same env as dashAI). Without it the tool still returns status and refuses to dump rows.

Development

python -m venv .venv && .venv/bin/pip install -e ".[dev]"
.venv/bin/python -m pytest tests/ -q

The tests stub the HTTP responses with respx: they need neither a dashAI instance nor credentials. They test the contract — which calls are made, in what order, with what body, and what the agent is told when something fails.

Verifying against a live instance

A client tested only against stubs is a hypothesis. scripts/smoke_live.py exercises every tool against a real running dashAI, through the same code paths an agent uses:

python scripts/smoke_live.py            # read-only tools
python scripts/smoke_live.py --train    # + a real train -> predict loop

The --train loop creates a model session, a run and a prediction on the target instance — point it at a scratch instance, not a production one. Exit code 0 only if every exercised tool worked. This is how each release gets verified; the version it was last run against is what dashai_server_info reports under compatibility.verified_against.

API compatibility check

dashAI exposes no version endpoint, so dashai_server_info reads the instance's openapi.json and compares the API surface against what this server actually calls: are the endpoints still there, and does POST /model-session/ require fields this server does not send? The verdict comes back as compatibility.statusok, mismatch (with the exact differences named) or unknown (schema unreadable; everything else may still work). The case it exists for is real: dashAI's development branch already adds an evaluation_strategy field to model sessions.

A note on the SDK

Requires the MCP Python SDK 2.x. Version 2.0 removed mcp.server.fastmcp; it is now mcp.server.mcpserver.MCPServer, and annotations are ToolAnnotations objects instead of dictionaries. Most tutorials still show the 1.x API.

License

MIT, same as dashAI. See the note at the top on affiliation.

Available Tools

10 tools
dashai_describe_datasetA
Read-onlyIdempotent

Returns everything needed to configure a training run over a dataset.

Gathers into a single call what the raw API splits into four (/{id}, /info, /types and /sample), because deciding which columns are input and which is output requires seeing them together.

Args: params (DescribeDataset): contains: - dataset_id (int): dataset id - include_sample (bool): include sample rows (default True)

Returns: str: JSON {"dataset": {...}, "info": {...}, "column_types": {...}, "sample": [...]} If one part is unavailable it comes back as null instead of failing whole.

ParametersJSON Schema
NameRequiredDescriptionDefault
paramsYes

Output Schema

ParametersJSON Schema
NameRequiredDescription
resultYes

TDQS

A4.4/5.0
Behavior5/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already mark this as read-only and idempotent, but the description goes further by disclosing that it merges four API calls and that missing parts are returned as null instead of failing the whole request. This adds meaningful behavioral context beyond the annotations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is well-structured with a purpose statement, rationale, Args, and Returns sections. It is slightly longer than necessary but each sentence serves a purpose, and the key information is front-loaded in the first sentence.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The description covers the tool's purpose, why it exists, parameter semantics, return format, and partial-failure behavior. With supportive annotations and a clear output schema, it is fully sufficient for an agent to select and invoke the tool correctly.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The input schema already provides rich descriptions for both parameters (e.g., include_sample says 'Include ~10 sample rows. Set to false if the dataset has very wide columns.'). The description's Args section merely restates the schema without adding new meaning, so it does not elevate above the baseline.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description opens with 'Returns everything needed to configure a training run over a dataset,' clearly stating the specific verb (returns) and resource (dataset). It also explains that it aggregates four raw API endpoints, which distinguishes it from sibling tools like dashai_list_datasets and dashai_train_model.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description conveys when to use this tool: when deciding which columns are inputs and outputs for training requires seeing them together. It gives clear context but does not explicitly name alternatives or state when-not-to-use conditions, falling slightly short of a 5.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

dashai_get_predictionA
Read-onlyIdempotent

Returns class counts for a finished prediction — never the rows.

dashAI stores predictions as an Arrow dataset on disk and GET /predict/ only returns the SQL row (id, status, paths). This tool reads that row and, when the job is finished, aggregates the output column. The label list never leaves the function.

Args: params (GetPrediction): contains prediction_id from dashai_predict.

Returns: str: JSON {prediction_id, run_id, dataset_id, status, finished, n, n_classes, class_counts}. Paths and row lists are stripped.

ParametersJSON Schema
NameRequiredDescriptionDefault
paramsYes

Output Schema

ParametersJSON Schema
NameRequiredDescription
resultYes

TDQS

A4.4/5.0
Behavior5/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

The description reveals meaningful internal behavior beyond the annotations: it reads a SQL row, aggregates an Arrow dataset stored on disk, strips paths/row lists, and ensures the label list never leaves the function. This is strong behavioral disclosure that aligns with readOnlyHint and idempotentHint.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is front-loaded with the main purpose, then uses compact context about the underlying GET /predict/ row and the returned JSON shape. Every sentence contributes useful information, though the Arrow/GET explanation could be slightly tighter.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a single-parameter read-only tool with clear annotations, the description covers what the tool does, what it receives, what it returns, and what it deliberately strips away. It even includes the exact JSON shape, and it leaves no major ambiguity for selecting or invoking it.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The only parameter, prediction_id, is already described in the schema as 'Id returned by dashai_predict'; the description essentially repeats that without adding new constraints, examples, or edge-case guidance. The schema does the heavy lifting, so this is acceptable but not enriched.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description opens with a sharp statement: 'Returns class counts for a finished prediction — never the rows.' This clearly identifies the resource, the action, and the exact scope, distinguishing it from row-level or run-level tools.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description explicitly states that it applies to a finished prediction and that the prediction_id comes from dashai_predict. It also implies that this tool is not for retrieving raw rows, since 'paths and row lists are stripped.' It does not name sibling alternatives directly, but the usage context is clear.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

dashai_get_runA
Read-onlyIdempotent

Returns the configuration and metrics of a training run.

This is where results are read once dashai_job_status says finished. If the run did not finish, the metrics will come back empty — that is not an error.

Args: params (GetRun): contains: - run_id (int): run id

Returns: str: JSON with the full run: model parameters, status and metrics per split (train / validation / test).

ParametersJSON Schema
NameRequiredDescriptionDefault
paramsYes

Output Schema

ParametersJSON Schema
NameRequiredDescription
resultYes

TDQS

A4.9/5.0
Behavior5/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Despite annotations already declaring readOnlyHint, openWorldHint, idempotentHint, and non-destructive behavior, the description adds important behavioral context: metrics are empty for unfinished runs (not an error) and the return format (JSON with model parameters, status, and per-split metrics). This enhances transparency beyond the annotations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is concise and well-structured: a one-sentence purpose, followed by a use-case note, and clearly labeled Args/Returns sections. Every sentence adds value, and the format is easy to scan.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple read-only tool with one parameter and an output schema, the description fully covers the relevant context: the return value's structure, the dependency on run completion, and the absence of errors for empty metrics. No significant gaps are present.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 0%, so description must compensate. It explains the nested 'params' structure containing run_id and describes run_id as the run identifier. While it repeats the schema's 'run id' description, it clarifies the nesting and provides enough context for a single-param tool. It could add how to obtain run_id (e.g., from list_runs), but it's sufficient.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description states a specific action and resource: 'Returns the configuration and metrics of a training run.' It clearly differentiates from siblings like dashai_job_status (status only) and dashai_list_runs (list only) by focusing on full run details. The tool's role is unambiguous.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines5/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Explicit guidance is provided: 'This is where results are read once dashai_job_status says `finished`.' This instructs when to use it and implies the alternative workflow with job_status, while also warning that incomplete runs yield empty metrics. This is clear usage direction.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

dashai_job_statusA
Read-onlyIdempotent

Polls the status of an enqueued job (training, prediction, explanation).

dashAI's statuses: not_started (queued), started (running), finished (done) and error (failed). Telling started from error matters: the first is worth waiting on, the second does not improve by polling again.

Args: params (JobStatus): contains: - job_id (str): id returned when enqueuing

Returns: str: JSON {"job_id": str, "status": str, "finished": bool, "failed": bool, "raw": {...}}

ParametersJSON Schema
NameRequiredDescriptionDefault
paramsYes

Output Schema

ParametersJSON Schema
NameRequiredDescription
resultYes

TDQS

A4.5/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnly, idempotent, and non-destructive behavior, so the bar is lower. The description adds meaningful context by explaining the status values (not_started, started, finished, error) and their practical interpretation, which helps the agent decide whether to keep polling.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is compact and well-structured: a clear purpose line, a brief but valuable status explanation, then Args and Returns sections. Every sentence adds necessary information with no filler or repetition.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

This is a simple polling tool, and the description covers purpose, parameter source, return format, and status interpretation. With annotations providing the safety profile, there is no critical missing context.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Although schema_description_coverage is reported as 0%, the description explicitly documents the 'job_id' parameter and clarifies that it is returned when enqueuing. The schema also includes a similar description, so the parameter's meaning is fully covered and not just left to schema alone.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description opens with 'Polls the status of an enqueued job', using a specific verb and resource. It also lists examples (training, prediction, explanation), which distinguishes it from sibling tools like dashai_train_model or dashai_predict.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides clear context on when polling is useful, explicitly stating that a 'started' status is worth waiting on while 'error' will not improve with further polling. This gives implicit when-to-use and when-not-to-use guidance, though it does not explicitly name alternative tools.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

dashai_list_componentsA
Read-onlyIdempotent

Lists the registered components: models, metrics, tasks and optimizers.

ALWAYS use this before dashai_train_model. The names dashAI expects are exact and case-sensitive, and the catalogue changes with the plugins that instance has installed — they cannot be guessed.

Args: params (ListComponents): contains: - types (Optional[List[str]]): filter by 'Model', 'Metric', 'Task', 'Optimizer'

Returns: str: JSON {"count": int, "components": [{"name": str, "type": str, "schema": {...}}]} The schema field describes the hyperparameters that component accepts.

ParametersJSON Schema
NameRequiredDescriptionDefault
paramsYes

Output Schema

ParametersJSON Schema
NameRequiredDescription
resultYes

TDQS

A4.6/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint, openWorldHint, idempotentHint, and destructiveHint=false. The description adds behavioral context beyond those: the catalogue is plugin-dependent, names cannot be guessed, and an unfiltered call returns a long result. It also documents the return JSON structure, including the 'schema' field, which is not present in the annotations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is well-structured: a one-sentence purpose, a high-value usage note, and compact Args/Returns sections. It is not overly long and every sentence carries useful information, though the Args section partly repeats schema content.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool's simplicity, the description covers purpose, when to use it, the parameter, the return format, and a critical behavioral caveat (plugin-dependent catalogue). It is complete for an agent to invoke the tool correctly without additional context.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The only parameter, 'params', is described in an Args section, and the 'types' filter's valid values are listed. While the input schema's description for 'types' already provides the same valid values and the long-output caveat, the tool description nonetheless clarifies the structure of the 'params' wrapper and the meaning of the returned 'schema' field, adding value beyond the raw schema.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description opens with 'Lists the registered components: models, metrics, tasks and optimizers', using a specific verb and enumerating the resource types. This clearly distinguishes the tool from sibling tools like dashai_list_datasets and dashai_describe_dataset.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines5/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

It explicitly states 'ALWAYS use this before dashai_train_model' and explains that names are exact/case-sensitive and the catalogue changes with installed plugins. This provides strong when-to-use guidance and a rationale for why the tool must be called first, which is more than typical.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

dashai_list_datasetsA
Read-onlyIdempotent

Lists the datasets loaded in dashAI.

Returns only id, name, date and status — just enough to pick one. To see columns and types use dashai_describe_dataset with the id.

Args: params (ListDatasets): contains: - limit (int): maximum to return, 1-200 (default 50)

Returns: str: JSON {"count": int, "datasets": [{"id", "name", "created", "status"}]} If there are none: a message explaining how to load data from the GUI.

ParametersJSON Schema
NameRequiredDescriptionDefault
paramsYes

Output Schema

ParametersJSON Schema
NameRequiredDescription
resultYes

TDQS

A4.7/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already provide readOnlyHint, idempotentHint, and destructiveHint, so the description doesn't need to restate these. It adds value by detailing the exact return fields (id, name, date, status) and the empty response behavior, which are not evident from annotations alone.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is well-structured with a clear summary, sections for args and returns, and a bullet-point parameter explanation. Every sentence adds value and there is no redundant fluff.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool's simplicity (one optional parameter), the description covers the purpose, usage, return format, and empty-case behavior. It also references a sibling tool for deeper inspection, making the description fully self-contained for an agent to invoke correctly.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The description explains the 'limit' parameter with its range (1-200) and default (50), which compensates for the low schema description coverage (0% as per context). It provides enough detail for an agent to use the parameter correctly without relying solely on the schema.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description uses a specific verb ('Lists') and a clear resource ('datasets loaded in dashAI'). It clearly distinguishes from sibling tools like dashai_describe_dataset by specifying it returns only summary fields, making it easy for an agent to choose this tool for overview purposes.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines5/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description explicitly states when to use this tool ('just enough to pick one') and directs the user to dashai_describe_dataset for detailed column information. It also explains the behavior when no datasets exist, giving clear context for expected use cases.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

dashai_list_runsA
Read-onlyIdempotent

Lists the recorded training runs, with their status.

Useful for comparing models trained within the same experiment.

Args: params (ListRuns): contains: - model_session_id (Optional[int]): filter by experiment - limit (int): maximum to return, 1-200 (default 50)

Returns: str: JSON {"count": int, "runs": [{"id", "name", "model_name", "status", "goal_metric"}]}

ParametersJSON Schema
NameRequiredDescriptionDefault
paramsYes

Output Schema

ParametersJSON Schema
NameRequiredDescription
resultYes

TDQS

A4.4/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true, idempotentHint=true, and destructiveHint=false, so the safety profile is well covered. The description adds return format and filtering context, but does not disclose additional behavioral traits such as rate limits or auth needs. This is acceptable given the strong annotations, but not exemplary.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is compact and well-organized: a clear purpose statement, a usage hint, a structured Args section, and a Returns section. Every sentence adds value, and the most important information (what it does) is front-loaded.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a straightforward list tool, the description covers purpose, usage context, parameters, and return shape. It is complete enough for an agent to select and invoke the tool without needing external documentation, especially with strong annotations and a simple schema.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters5/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Despite context showing 0% schema description coverage, the description explicitly explains both parameters: model_session_id as 'filter by experiment' and limit as 'maximum to return, 1-200 (default 50)'. This fully compensates for the schema gap and adds practical meaning beyond parameter names.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description opens with 'Lists the recorded training runs, with their status,' which clearly states the action (list) and resource (training runs). It also distinguishes from siblings by focusing on training runs and comparing models within an experiment, avoiding confusion with list_datasets or get_run.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The phrase 'Useful for comparing models trained within the same experiment' provides a clear context for when to use this tool. It implies usage for browsing runs and filtering by experiment, but does not explicitly exclude alternatives like get_run for single-run details, so it misses the top score.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

dashai_predictA

Enqueues a prediction using the model of an already finished run.

Like training, it is asynchronous: it returns a job_id and the result is followed with dashai_job_status.

Collapses the two calls the GUI makes (read from DatasetPredictionPanel + createPrediction + enqueuePredictionJob, not from the docs):

  1. POST /predict/ creates the Prediction row ({run_id, dataset_id})

  2. POST /job/ PredictJob enqueues with {prediction_id} — NOT run_id

Passing only run_id to the job raises KeyError 'prediction_id' inside PredictJob.run. The Prediction row must exist first.

Args: params (Predict): contains: - run_id (int): id of a finished run - dataset_id (Optional[int]): dataset to score; defaults to the run's training dataset (from its model session)

Returns: str: JSON {"job_id", "run_id", "prediction_id", "dataset_id", "status": "enqueued", "next_step"}

ParametersJSON Schema
NameRequiredDescriptionDefault
paramsYes

Output Schema

ParametersJSON Schema
NameRequiredDescription
resultYes

TDQS

A4.7/5.0
Behavior5/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

The description goes well beyond annotations by explaining that the tool creates a Prediction row and then enqueues a PredictJob, that the job expects prediction_id rather than run_id, that passing only run_id causes a KeyError, and that the operation is asynchronous. This is valuable behavioral disclosure beyond the readOnlyHint/idempotentHint flags.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is well-structured: a one-sentence purpose, a clear async follow-up note, a concise two-step internal flow, a warning about a specific failure mode, and an Args/Returns recap. Every section adds important operational knowledge without padding.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the complexity of the two-step internal flow, the description covers the operation end-to-end: input semantics, async behavior, response shape, and follow-up tool. The KeyError warning is especially valuable for correct use of the returned prediction_id.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The description includes an Args section explaining run_id as a finished run and dataset_id as optional with a default to the run's training dataset. It adds important context about the internal run_id/prediction_id distinction, though the input schema already provides detailed descriptions for the nested fields.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description opens with a specific verb and resource: 'Enqueues a prediction using the model of an already finished run.' It clearly distinguishes this from training, dataset listing, and job-status tools, and it states that the operation is asynchronous and returns a job_id.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description gives clear usage context: use it for a finished run, the operation is asynchronous like training, and the result should be followed via dashai_job_status. It does not explicitly enumerate when not to use it, but it provides enough contextual guidance for selection.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

dashai_server_infoA
Read-onlyIdempotent

Checks that dashAI is running and summarizes what is loaded.

Call this FIRST when something fails or when you do not know whether the backend is up: it tells "dashAI is down" apart from "that id does not exist", which are two problems with different fixes.

Args: params (NoArgs): no parameters.

Returns: str: JSON with the following schema: { "base_url": str, # which instance is being targeted "reachable": bool, # whether it responded "datasets": int, # number of loaded datasets "runs": int, # number of recorded runs "queue_empty": bool, # whether the job queue is empty "compatibility": { # live API vs the release verified end to end "verified_against": str, # e.g. "dashAI 0.9.7.post1" "status": str, # "ok" | "mismatch" | "unknown" "warnings": [str], # only on mismatch: what differs "note": str # only on mismatch/unknown } } On failure: "Error: ".

ParametersJSON Schema
NameRequiredDescriptionDefault
paramsYes

Output Schema

ParametersJSON Schema
NameRequiredDescription
resultYes

TDQS

A4.9/5.0
Behavior5/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

The description goes beyond the readOnly/idempotent annotations by detailing the exact response shape, including reachability, queue state, dataset/run counts, and API compatibility status. It also discloses the failure string format ('Error: <what happened and what to do>'), so the agent knows what to expect on both success and failure.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is front-loaded with the core purpose, followed by a concise use-case directive and then well-structured Args/Returns sections. The return schema is detailed but necessary because it documents a complex JSON payload, so every section earns its place.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a read-only health-check tool, the description is complete: it explains when to call it, what it checks, what the output contains, what the compatibility field means, and what failure messages look like. The rich output schema and annotations cover the remaining structured details.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The tool takes no meaningful parameters: the input schema defines a NoArgs object and the description explicitly states 'no parameters.' With effectively zero parameters, the baseline is 4, and the description's confirmation removes any ambiguity.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description opens with a specific verb and resource: 'Checks that dashAI is running and summarizes what is loaded.' It also distinguishes this tool from sibling data-operations tools by framing it as the backend health diagnostic, and explicitly separates 'dashAI is down' from 'that id does not exist'.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines5/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Usage guidance is explicit and actionable: 'Call this FIRST when something fails or when you do not know whether the backend is up.' It also tells the agent what diagnostic distinction the tool provides, which directly informs decision-making about which problem is being debugged.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

dashai_train_modelA

Trains a model on a dataset and returns the id of the enqueued job.

It does NOT wait for it to finish. Training can take minutes or hours, so dashAI enqueues it and this tool returns immediately; progress is polled with dashai_job_status.

Collapses the three calls the raw API demands:

  1. POST /model-session/ creates the experiment (dataset, task, columns, metrics)

  2. POST /run/ creates the run (model, hyperparameters)

  3. POST /job/ enqueues the ModelJob

Args: params (TrainModel): contains: - dataset_id (int), task_name (str), model_name (str) - input_columns / output_columns (List[str]) - metrics (List[str]), goal_metric (str) - parameters (Dict): model hyperparameters - splits (Dict[str, float]): proportions adding up to 1.0 - optimizer_name (str), optimizer_parameters (Dict) - run_name (Optional[str])

Returns: str: JSON {"job_id": str, "run_id": int, "model_session_id": int, "status": "enqueued", "next_step": str} On failure: "Error: ..." stating which parameter dashAI rejected.

Examples: - "Train a random forest on dataset 3 predicting 'species'" - Do not use it to read results: that is dashai_get_run, with the run_id.

ParametersJSON Schema
NameRequiredDescriptionDefault
paramsYes

Output Schema

ParametersJSON Schema
NameRequiredDescription
resultYes

TDQS

A4.8/5.0
Behavior5/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations provide readOnlyHint=false, destructiveHint=false, idempotentHint=false, but the description adds critical behavioral context: it enqueues a job and returns immediately, does not wait, training can take minutes/hours, and it collapses three raw API calls. Error behavior is also described ('On failure: "Error: ..." stating which parameter dashAI rejected'). This goes well beyond annotation data.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is structured with clear paragraphs: function, async behavior, API collapsation, Args, Returns, Examples. Every sentence adds value, but the Args section largely duplicates schema information and makes the description longer than strictly necessary. Still, it is front-loaded with the most important usage rules and alternative references.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool's complexity (async, multi-step training, many parameters, output schema), the description covers all necessary context: how it works, how to poll, what returns, error handling, and how it differs from siblings. It even provides usage examples. No significant gap remains.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The schema already has detailed descriptions for nested TrainModel properties. The description's Args section condenses these into a readable list and adds context by explaining that the parameters map to the three API calls (session, run, job). It also notes 'proportions adding up to 1.0' for splits, reinforcing the schema. This adds semantic clarity beyond the raw schema, especially given the top-level schema coverage is 0%.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Description opens with 'Trains a model on a dataset and returns the id of the enqueued job.' This is a specific verb+resource statement that clearly distinguishes the tool from siblings like dashai_get_run ('Do not use it to read results') and dashai_job_status (polling). It also details the collapsed API calls, leaving no ambiguity about what the tool accomplishes.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines5/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Explicitly states when to use: 'It does NOT wait for it to finish... progress is polled with dashai_job_status.' Provides a clear exclusion: 'Do not use it to read results: that is dashai_get_run, with the run_id.' This gives direct when/when-not guidance relative to siblings.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Tool Schema Changelog

Recent tool additions, removals, and schema changes observed during successful MCP inspections. Dates show when Glama detected each change.

  1. 2 tool updatesv0.2.2
    • Addeddashai_get_prediction
    • Changeddashai_predict1 field changed
      • addedInput schema / $defs / Predict / properties / dataset_id
        Added value: +{
        +  "anyOf": [
        +    {
        +      "minimum": 1,
        +      "type": "integer"
        +    },
        +    {
        +      "type": "null"
        +    }
        +  ],
        +  "default": null,
        +  "description": "Dataset to predict on. If omitted, the run's training dataset is used. Must have the same input columns as the model; pick it from dashai_list_datasets.",
        +  "title": "Dataset Id"
        +}
  2. 9 tool updatesv0.2.0
    • First observeddashai_describe_dataset
    • First observeddashai_get_run
    • First observeddashai_job_status
    • First observeddashai_list_components
    • First observeddashai_list_datasets
    • First observeddashai_list_runs
    • First observeddashai_predict
    • First observeddashai_server_info
    • First observeddashai_train_model

TDQS

A4.5/5.0
Disambiguation5/5

Each tool targets a distinct resource and action: server health, dataset summaries, dataset details, component catalog, training launch, job polling, run listing, run details, and prediction. No two tools overlap in purpose; list vs describe and list vs get are clearly summary vs detail pairs.

Naming Consistency4/5

All tools share a consistent 'dashai_' prefix, and most use a verb_noun pattern (list_datasets, describe_dataset, train_model, get_run). Exceptions are 'server_info' and 'job_status' which are noun_noun, and 'predict' which is verb-only, but the pattern is still predictable and readable.

Tool Count5/5

With 9 tools, the set is well-scoped and each tool serves a distinct step in the ML workflow. No unnecessary duplication exists, and the count is within the ideal range for a focused server.

Completeness4/5

The toolset covers the core train-predict lifecycle comprehensively: dataset exploration, component lookup, async training, job polling, run inspection, and prediction. Minor gaps like no job listing or dataset deletion are acknowledged and do not block the primary use cases.

Maintenance

ActivityMaintained
ResponsivenessNo issues

Resources

Unclaimed servers have limited discoverability.

Looking for Admin?

If you are the server author, to access and configure the admin panel.

Related MCP Connectors

Related MCP Servers

  • F
    license
    A
    quality
    F
    maintenance
    MCP server that exposes 300+ AI agents as tools via a single API key. Supports listing agents, invoking any agent with chat-completion style messages, checking agent health, and retrieving platform statistics.
    5
    3
    -
  • A
    license
    Not graded
    quality
    C
    maintenance
    MCP server that exposes Pakunoda project state to AI agents, providing resources, tools, and prompts for inspecting candidates, scores, and triggering hyperparameter searches.
    MIT
  • A
    license
    Not graded
    quality
    B
    maintenance
    MCP server that enables agents to dynamically switch between multiple AI models (OpenAI, Anthropic, Google, etc.) with unified protocol-driven configuration and capability discovery.
    Apache 2.0

Latest Blog Posts

MCP directory API

We provide all the information about MCP servers via our MCP API.

curl -X GET 'https://glama.ai/api/mcp/v1/servers/Maarmapa/dashai-mcp'

If you have feedback or need assistance with the MCP directory API, please join our Discord server