Augent
OfficialEnables exporting transcriptions to Obsidian graph view with wikilinks, MOCs, and frontmatter.
Click on "Install Server".
Wait a few minutes for the server to deploy. Once ready, it will show a "Started" state.
In the chat, type
@followed by the MCP server name and your instructions, e.g., "@Augenttranscribe this YouTube URL: https://youtu.be/abc123"
That's it! The server will respond to your query, and you can continue using it as needed.
Here is a step-by-step guide with screenshots.
Augent — The Audio Layer for Agents
If the answer is trapped in audio or video, this is the way through.
Augent turns any audio or video source into structured, searchable intelligence for agents. Give it URLs or files. It downloads, transcribes, indexes, and stores everything in persistent memory. Search by keyword or meaning, find where concepts intersect, identify speakers, generate chapters and notes, batch process entire libraries, and more. One install, full pipeline, entirely on your machine.
If you want the quality info from content without sitting through it, the fastest way, this is it.
Preferred setup: run the one-line installer in your terminal. One command installs Augent, all dependencies, and the MCP server config. Works on macOS and Linux. Windows: install via pip. Works with Claude Code, Codex, and any MCP client. New install? Start here: Getting started.
Install
curl -fsSL https://augent.app/install.sh | bashWorks on macOS and Linux. Installs everything automatically.
Windows: pip install "augent[all] @ git+https://github.com/AugentDevs/Augent.git"
The installer is a single bash script (source). Every dependency is open source:
Dependency | What it does |
Runtime | |
Audio processing | |
Media downloads | |
Parallel downloads | |
TTS phonemizer | |
Speech-to-text | |
ML framework | |
Semantic search | |
Speaker diarization | |
Text-to-speech | |
Audio source separation | |
Local web UI |
No background services. No telemetry. No sudo on macOS.
What each phase installs and why | |
Step-by-step for macOS, Linux, and Windows | |
How to fully remove Augent |
Related MCP server: MCP Audio Server
How it works (short)
graph TB
A["URL / File"] --> B["Download + Separate"]
B --> C["Transcribe"]
C --> D["Memory + Tag"]
D --> E["Search"]
D --> F["Analyze"]
D --> G["Export"]
style A fill:#0d2618,stroke:#00f060,color:#00f060,stroke-width:2px
style B fill:#0d2618,stroke:#00f060,color:#00f060,stroke-width:2px
style C fill:#0d2618,stroke:#00f060,color:#00f060,stroke-width:2px
style D fill:#0d2618,stroke:#00f060,color:#00f060,stroke-width:2px
style E fill:#0a0a0a,stroke:#00f060,color:#00f060,stroke-width:2px
style F fill:#0a0a0a,stroke:#00f060,color:#00f060,stroke-width:2px
style G fill:#0a0a0a,stroke:#00f060,color:#00f060,stroke-width:2px
linkStyle default stroke:#00f060,stroke-width:1.5pxProject Structure
augent/
├── mcp.py # MCP server — 22 tools for agents
├── config.py # User configuration (~/.augent/config.yaml)
├── core.py # Transcription engine (faster-whisper)
├── search.py # Keyword search
├── embeddings.py # Semantic search, chapters, visual scoring
├── speakers.py # Speaker diarization (pyannote-audio)
├── separator.py # Audio source separation (Demucs v4)
├── tts.py # Text-to-speech (Kokoro)
├── memory.py # Three-layer memory (SQLite)
├── graph.py # Obsidian graph view (wikilinks, MOCs, frontmatter)
├── clips.py # CLI clip extraction (audio segments around matches)
├── export.py # Export formats (JSON, CSV, SRT, VTT, MD)
├── cli.py # CLI interface
└── web.py # Web UI (FastAPI)MCP Tools
The primary way to use Augent. Any MCP client gets direct access to all tools.
Add to ~/.claude.json (global) or .mcp.json (project):
{
"mcpServers": {
"augent": {
"command": "augent-mcp"
}
}
}Restart Claude Code. Run /mcp to verify connection.
Tool | Description |
Download audio from video URLs at maximum speed (1,000+ supported sites) | |
Full transcription with metadata | |
Find keywords with timestamps and context snippets | |
Search audio by meaning, not just keywords (semantic search) | |
Take notes from any URL with style presets | |
Auto-detect topic chapters in audio with timestamps | |
Search multiple files in parallel, built for batch workflows and agent swarms | |
Convert text to natural speech audio (Kokoro TTS, 54 voices, 9 languages) | |
Find where keywords appear near each other | |
Identify who speaks when in audio (speaker diarization) | |
Isolate vocals from music and background noise (Demucs v4) | |
Export a video clip from a URL for a specific time range | |
Export MP4 clips of specific moments, auto-pick the best or target exactly what you want | |
Add, remove, or list tags on transcriptions for organized filtering | |
Extract visual context from video at moments that matter (query, auto, or manual) | |
Rebuild Obsidian graph view data for all transcriptions | |
Search across ALL stored transcriptions by keyword or meaning | |
List media files in a directory | |
List stored transcriptions by title | |
View transcription memory statistics | |
Clear stored transcriptions | |
Download, check, or stop X/Twitter Spaces recordings |
"Download these 10 podcasts and find every moment a host covers a product in a positive or unique way. Not just brand mentions, only real endorsements or life-changing recommendations. Give me the timestamps and exactly what they said: url1, url2, url3, url4, url5, url6, url7, url8, url9, url10"
CLI
Full CLI for terminal-based workflows. Works standalone or with any agent.
Command | Description |
| Download audio from video URL (speed-optimized) |
| Search for keywords |
| Full transcription |
| Find keyword A near keyword B |
| Search across all stored transcriptions |
| View memory statistics |
| List stored transcriptions |
| Clear memory |
Eyes & Ears
Someone explains their entire workflow in a video. Augent transcribes it, builds the workflow files, maps the sequencing, the decision points, the tool stack. Every piece structured into something an agent can act on.
But some steps are inherently visual. Augent detects where visual context is needed and exports multiple screenshots at those moments, giving the agent frame-by-frame context of the flow being described. Audio intelligence plus visual context equals a complete, replicable system.
graph TB
A["Expert explains workflow or automation"] --> B["Augent transcribes + structures"]
B --> C["Builds workflow files + sequencing"]
C --> D["Maps decision logic"]
C --> E["Identifies tools + platforms"]
C --> F["Flags visual gaps"]
F --> G["Exports screenshots for context"]
D --> H["Ready to run"]
E --> H
G --> H
style A fill:#0d2618,stroke:#00f060,color:#00f060,stroke-width:2px
style B fill:#0d2618,stroke:#00f060,color:#00f060,stroke-width:2px
style C fill:#0d2618,stroke:#00f060,color:#00f060,stroke-width:2px
style D fill:#0a0a0a,stroke:#00f060,color:#00f060,stroke-width:2px
style E fill:#0a0a0a,stroke:#00f060,color:#00f060,stroke-width:2px
style F fill:#0a0a0a,stroke:#00f060,color:#00f060,stroke-width:2px
style G fill:#0a0a0a,stroke:#00f060,color:#00f060,stroke-width:2px
style H fill:#0d2618,stroke:#00f060,color:#00f060,stroke-width:2pxX/Twitter Spaces
Download or live-record Twitter/X Spaces audio. Auto-detects whether a Space is live or ended and handles both. Live Spaces record from the current moment using ffmpeg, ended Spaces download the full recording via yt-dlp. All downloads run in the background so your agent keeps working.
One-time setup
X/Twitter requires authentication to access Space audio. Any account works, including a burner.
Log into x.com in any browser
Open DevTools (F12 or Cmd+Option+I) > Application > Cookies >
https://x.comCopy the
auth_tokenandct0valuesCreate
~/.augent/auth.json:
{"auth_token": "PASTE_HERE", "ct0": "PASTE_HERE"}Tokens are stored locally and only sent to Twitter's servers to fetch audio. Augent never posts, DMs, follows, or modifies anything on your account. To revoke access, log out of Twitter or delete ~/.augent/auth.json.
Claude Code Skill
Claude and Codex already know how to use Augent's tools from their descriptions. The skill adds advanced workflows on top: multi-step note-taking pipelines, auto-tagging rules, translation flows, quiz formatting, and optimal search strategies.
mkdir -p ~/.claude/skills/augent
curl -o ~/.claude/skills/augent/SKILL.md \
https://raw.githubusercontent.com/AugentDevs/Augent/main/skills/augent/SKILL.mdWorks globally across all projects. One install, every conversation benefits.
OpenClaw
Augent is available as an OpenClaw skill on ClawHub.
Install via ClawHub:
npx clawhub@latest install augentOr set up manually:
augent setup openclawIf you installed Augent with curl -fsSL https://augent.app/install.sh | bash, OpenClaw is detected and configured automatically. These commands are only needed for manual setup or pip installs.
Obsidian Graph View
Every transcription builds a node. Every shared tag builds a connection. Your audio memory becomes a navigable knowledge graph, entirely automatic.
Every take_notes call, every transcription, every tag creates structure: YAML frontmatter, [[wikilinks]] between related content, and MOC hub files that cluster topics. Run rebuild_graph once to upgrade existing memory. The graph grows on its own from there.
Use Augent inside your main Obsidian vault, alongside your personal notes, journals, and projects. Everything compounds together. Full guide.
Using Claude Code or Codex with Obsidian? Set up augent-obsidian to make every
.txtand.mdfile on your Mac open directly in Obsidian, with automatic sync for external edits.
Multilingual
Augent transcribes audio in its original language with full accuracy, powered by OpenAI's Whisper, supporting 99 languages including Chinese, French, Spanish, Japanese, Arabic, Hindi, Korean, German, Russian, Portuguese, and many more. Language is auto-detected, no configuration needed. Translation to English is handled by Claude (or your LLM), producing far better translations than any local model.
When a transcription returns a non-English language, the MCP response includes a translation offer
Accepting stores a clean English
(eng)sibling file in memory alongside the originalBoth the original and translated versions appear in the Memory Explorer
Model Sizes
tiny is the default. Handles everything from clean studio recordings to noisy field audio. Use small or above for heavy accents, poor audio, or lyrics.
Model | Speed | Accuracy |
tiny | Fastest | Excellent (default) |
base | Fast | Excellent |
small | Medium | Superior |
medium | Slow | Outstanding |
large | Slowest | Maximum |
Configuration
Customize defaults and disable tools you don't need via ~/.augent/config.yaml:
# ~/.augent/config.yaml
model_size: tiny # Default Whisper model
output_dir: ~/Downloads # Default download directory
notes_output_dir: ~/Desktop # Notes, clips, TTS output
clip_padding: 15 # Seconds of padding around clips
context_words: 25 # Words of context in search results
tts_voice: af_heart # Default TTS voice
tts_speed: 1.0 # TTS speed multiplier
disabled_tools: [] # Hide tools from MCP clientsPer-call arguments always override config. No config file needed, all values have sensible defaults.
Web UI
Local web interface. Runs 100% locally. No internet, no API keys, no data leaves your machine.
augent-webOpen: http://127.0.0.1:8282
Search view:
Upload an audio file or paste a YouTube/video URL to download audio directly
Enter keywords separated by commas
Click SEARCH and results stream live with timestamps and context
YouTube timestamps are automatically hyperlinked when the source is YouTube
Clip export:
Click the film icon on any search result to create a visual region on the waveform, or drag on the waveform to select any range manually
Nudge buttons (±1s / ±5s) on each edge for precise boundary adjustment
Preview plays only the selected range so you hear exactly what will be exported
Export MP4 downloads only the selected segment, not the full video
Keyboard shortcuts:
Spacepreview,Enterexport,Escclose
Memory Explorer:
Browse all stored transcriptions, including files transcribed via MCP or CLI. Every tool writes to the same memory.
View full transcripts with clickable YouTube timestamps
Delete individual transcriptions from memory
Show Audio to reveal the source audio file in Finder
Show Transcript to reveal the
.mdtranscript file in Finder. Drag it into a Claude Code session to run the full MCP pipeline on a previously transcribed file.Share as HTML to download a self-contained, shareable transcript page
Search across all memories by keyword to find matches across every transcription in your library
Source URL persistence: When audio is downloaded from any URL (YouTube, Twitter/X, TikTok, Instagram, SoundCloud, and 1000+ sites) the source URL is permanently stored by file hash. Any future search or transcription of that file, even weeks later or from a different path, automatically links back to the original source. No need to re-enter the URL.
Command | Description |
| Start on port 8282 |
| Custom port |
Star History
Contributing
PRs welcome. Open an issue for bugs or feature requests.
License
MIT
Available Tools
22 toolsbatch_searchA
Search multiple audio files for keywords in parallel. Ideal for processing podcast libraries, interview collections, or any batch of audio files. Returns aggregated results with file paths.
| Name | Required | Description | Default |
|---|---|---|---|
| workers | No | Number of parallel workers. Default: 2 | |
| keywords | Yes | List of keywords or phrases to search for | |
| model_size | No | Whisper model size. ALWAYS use tiny unless the user explicitly requests a different size. tiny is already highly accurate. | |
| audio_paths | Yes | List of paths to audio files |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description carries the full burden. It discloses that the search runs 'in parallel' and 'Returns aggregated results with file paths,' which gives some behavioral insight. However, it does not mention potential resource intensity from parallel workers, model download behavior, or whether files are modified (though 'search' implies read-only). It is not completely vague but lacks deeper behavioral context.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is three sentences: the first states the core function, the second provides a use case, and the third describes the return value. There is no fluff or repetition. Every sentence earns its place, and the key information is front-loaded.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a tool with 4 parameters, no output schema, and no annotations, the description gives the essential purpose, use case, and return format. It does not explain the aggregation format in detail or mention any constraints, but given the simplicity of the tool (search and return results), it is largely sufficient. The lack of output schema is partially mitigated by saying 'aggregated results with file paths.'
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 100%, so the baseline is 3. Each parameter (audio_paths, keywords, workers, model_size) already has a description in the schema, including the important note to 'ALWAYS use tiny unless...' for model_size. The description text itself adds no extra parameter meaning, but since the schema covers all parameters, score 3 is appropriate.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the action: 'Search multiple audio files for keywords in parallel.' It identifies the resource (audio files), the operation (search), and the distinguishing feature (parallel, multiple files). This separates it from sibling tools like 'search_audio' which likely handles single files, and 'deep_search' which may imply a different scope.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description provides strong usage context by mentioning 'Ideal for processing podcast libraries, interview collections, or any batch of audio files.' This implies when to use it (batch scenarios), but it does not explicitly mention when not to use it or name alternative tools (e.g., 'use search_audio for single files'). This is clear context without exclusions, fitting score 4.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
chaptersB
Auto-detect topic chapters in audio.
| Name | Required | Description | Default |
|---|---|---|---|
| audio_path | Yes | Path to the audio file | |
| model_size | No | Whisper model size. ALWAYS use tiny unless the user explicitly requests a different size. tiny is already highly accurate. | |
| sensitivity | No | 0.0 = many chapters, 1.0 = few chapters. Default: 0.4 |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations provided, the description carries the full burden of behavioral disclosure. It does not state what the tool returns, whether it modifies files, or any side effects. The word 'auto-detect' implies a read-only operation, but no details are given.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single, clear sentence with no fluff. It quickly communicates the tool's core purpose without unnecessary detail, making it easy to parse.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
The tool has three parameters, no output schema, and no annotations. The description does not explain the output format, expected behavior, or how chapters are returned. This lack of contextual information makes it incomplete for an agent to use effectively.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The input schema covers 100% of parameters with detailed descriptions, including guidance on model_size and sensitivity. The description itself adds no additional parameter meaning, so baseline score 3 is appropriate.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description 'Auto-detect topic chapters in audio' clearly states the tool's function with a specific verb ('detect') and resource ('topic chapters'). It distinguishes itself from sibling tools like transcribe_audio or identify_speakers by focusing on chapter segmentation.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description provides no guidance on when to use this tool versus alternatives. It does not mention exclusions or alternative tools, leaving the agent to infer usage solely from the purpose.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
clear_memoryA
Clear the transcription memory to free disk space.
| Name | Required | Description | Default |
|---|---|---|---|
No parameters | |||
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description must disclose behavioral traits. It states the action and purpose but does not explain the consequences (e.g., whether all memories are deleted, if it is irreversible, or if it affects transcriptions). The word 'clear' hints at destruction but is insufficiently detailed.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single, concise sentence that is front-loaded with the action and outcome. Every word contributes meaning, and there is no redundant or irrelevant information.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the potentially destructive nature of clearing memory, the description lacks important context such as whether the operation is reversible, what exactly gets deleted, and success/failure behavior. No output schema exists, so the description should explain more. It is too sparse for safe usage.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The input schema has no parameters, so the baseline for 0 parameters is 4. There is nothing to compensate for, and the description does not need to explain parameters.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description uses a specific verb ('clear') and resource ('transcription memory'), and the purpose ('to free disk space') is explicitly stated. This clearly distinguishes it from sibling tools like memory_stats or list_memories, which have different actions.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description implies usage when disk space needs to be freed, but it lacks explicit when-to-use or when-not-to-use guidance and does not mention alternatives. It gives a clear context but no exclusions or comparisons to sibling tools.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
clip_exportA
Export a video clip from a URL for a specific time range. Downloads only the requested segment — not the full video. Perfect for extracting moments around keyword matches. Supports YouTube and 1000+ sites.
| Name | Required | Description | Default |
|---|---|---|---|
| end | Yes | End time in seconds | |
| url | Yes | Video URL to extract clip from (YouTube, Vimeo, etc.) | |
| start | Yes | Start time in seconds | |
| output_dir | No | Directory to save the clip. Default: ~/Desktop | |
| output_filename | No | Custom filename for the clip (without extension). Auto-generated if not set. |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description carries the burden. It discloses a key behavioral trait: 'Downloads only the requested segment — not the full video.' It also mentions broad site support. However, it does not describe potential side effects like network usage, file format, or failure modes, and it lacks any detail about authentication or rate limits.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is three concise sentences, each adding value. It leads with the action, clarifies behavioral scope, gives a use case, and states supported sites. No redundant wording.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a tool with 5 params and no output schema, the description covers purpose, key behavior, use case, and platform support. It doesn't explain return values or output file specifics, but those are partly covered by parameter descriptions. Given the sibling context, this is adequately complete for an agent to select and invoke the tool correctly.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 100% with all parameters already documented. The description adds minimal extra semantics beyond the schema, such as 'specific time range' which maps to start/end, but does not provide syntax or format details beyond what the schema already contains. Baseline of 3 is appropriate.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool's function: 'Export a video clip from a URL for a specific time range.' It also differentiates from siblings by emphasizing that it downloads only the requested segment, not the full video, which is distinct from audio-focused tools like download_audio or transcribe_audio.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description implies when to use it: 'Perfect for extracting moments around keyword matches.' However, it does not explicitly mention when not to use it or contrast with alternative tools like download_audio or highlights. The use case is clear but not exhaustive.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
deep_searchC
Search audio by meaning, not just keywords.
| Name | Required | Description | Default |
|---|---|---|---|
| clip | No | Download actual video clips around each match. Set to true when the user asks for clips, highlights, compilations, or says they want the video itself, not just timestamps. Requires the audio to have been downloaded from a URL. Default: false | |
| query | Yes | Natural language search query (e.g. 'discussion about funding challenges') | |
| top_k | No | Number of results to return. Default: 5 | |
| output | No | Optional file path to save results. Use .csv for plain data or .xlsx for styled spreadsheets with bold headers and formatting. | |
| audio_path | Yes | Path to the audio file | |
| model_size | No | Whisper model size. ALWAYS use tiny unless the user explicitly requests a different size. tiny is already highly accurate. | |
| clip_padding | No | Seconds of padding before and after each match for clip export. Default: 15 | |
| context_words | No | Words of context per result. Default: 25. Use 150 for full evidence blocks when Claude needs to answer a question, not just find a moment. | |
| dedup_seconds | No | Merge matches within this many seconds of each other to avoid redundant results. Default: 0 (off). Use 60 for Q&A. |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations provided, the description carries the full burden of behavioral disclosure. It discloses nothing about return format, side effects, or operational behavior—just a tagline. This is a significant gap for a tool that could be read-only or have download/implications.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single concise sentence, but it's under-specified for a 9-parameter tool. It's memorable but doesn't provide enough operational detail to guide an agent, so it's not appropriately sized for the tool's complexity.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
The description lacks essential context: what results look like, when to set clip, how output is returned, and how it differs from sibling tools. Given the high parameter count, rich schema, and no output schema, this bare-bones description is insufficient for correct invocation.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The description itself adds no parameter information, but the schema provides detailed descriptions for all 9 parameters (100% coverage), including specific guidance like 'ALWAYS use tiny unless the user explicitly requests a different size.' This meets the baseline for high schema coverage.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly identifies the tool as a semantic audio search ('Search audio by meaning'), which distinguishes it from keyword-based search. However, it doesn't explicitly state the output (e.g., timestamps or matches) nor name sibling tools, so it's clear but not fully differentiated.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description offers no guidance on when to use deep_search versus alternatives like search_audio or batch_search. It doesn't mention any prerequisites, use cases, or exclusions, leaving the agent to infer entirely from the schema.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
download_audioA
Download audio from video URLs at maximum speed. Built by Augent with speed optimizations (aria2c multi-connection, concurrent fragments). Downloads audio ONLY - never video. Supports YouTube, Vimeo, TikTok, Twitter, SoundCloud, and 1000+ sites. IMPORTANT: When a user pastes ANY URL and asks what was said, what happened, or wants the content — use this tool to download, then transcribe_audio to get the text. This is the correct path for tweets, videos, podcasts, and any link with audio/video content. Do NOT use WebFetch for media URLs.
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | Video URL to download audio from (YouTube, Vimeo, TikTok, etc.) | |
| output_dir | No | Directory to save the audio file. Default: ~/Downloads |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description carries the full burden. It discloses some behaviors: audio-only, speed optimizations via aria2c, and broad site support. However, it does not mention return values, error handling, prerequisites (e.g., network), or side effects like directory creation/overwrite, leaving gaps for an agent.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single paragraph with the purpose front-loaded, followed by the key usage note. It is somewhat long but every sentence adds value, with the exception of 'Built by Augent' which is mildly redundant. Overall well-structured.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
There is no output schema and no annotations. The description explains the tool's purpose and usage well but fails to clarify what the tool returns (e.g., file path, success message) or behavior on failure. This missing information is significant for an agent to confidently use the tool.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100% with both parameters described. The description adds context about supported sites and the 'audio only' behavior, but it does not meaningfully extend the schema descriptions for url or output_dir. Baseline 3 is appropriate.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool downloads audio from video URLs, explicitly notes it downloads audio only (never video), and lists supported platforms. This distinguishes it from sibling tools like transcribe_audio and search_audio.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
It gives explicit when-to-use guidance: 'When a user pastes ANY URL and asks what was said... use this tool to download, then transcribe_audio' and directly warns against WebFetch for media URLs. This provides strong context for choosing the tool over alternatives.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
highlightsA
Export MP4 clips of specific moments. Two modes: auto (AI picks top moments by quotability and insight density) or focused (find moments matching a specific topic, person, or concept). Returns timestamps and text for each highlight, the calling agent decides which to export as clips.
| Name | Required | Description | Default |
|---|---|---|---|
| clip | No | Export each highlight as an MP4 video clip. Requires the audio to have been downloaded from a URL. Default: false | |
| query | No | What to highlight. Omit for auto mode (top moments). Provide a topic, person, concept, or description for focused mode. Examples: 'product recommendations', 'heated debate moments', 'life advice' | |
| top_k | No | Number of highlights to return. Default: 5 | |
| audio_path | Yes | Path to the audio file (must be transcribed already) | |
| model_size | No | Whisper model size. ALWAYS use tiny unless the user explicitly requests a different size. | |
| clip_padding | No | Seconds of padding around each highlight when exporting clips. Default: 15 | |
| context_words | No | Words of context around each highlight. Default: 40 |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations provided, the description carries the full burden. It discloses AI-driven selection criteria, returns timestamps and text, and explicitly states the calling agent decides which to export. Minor gap: it doesn't mention dependencies like 'audio must be transcribed' or the side effects of clip export, but these are covered in the schema.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Three sentences, front-loaded with the core purpose, and every sentence earns its place. There is no fluff or repetition, making it easy for an agent to scan and understand quickly.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the 7-parameter complexity and absence of an output schema, the description sufficiently explains return values (timestamps and text) and the decision workflow. The schema covers parameter details and prerequisites, so the tool is reasonably complete for an agent to invoke correctly.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 100%, so the baseline is 3. The tool description adds a high-level mode distinction ('auto' vs 'focused') but doesn't provide additional parameter-level semantics beyond what the schema already explains for each parameter.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
Clearly states the verb and resource ('Export MP4 clips of specific moments') and immediately distinguishes two modes (auto and focused). This differentiates it from sibling tools like transcribe_audio or search_audio, making the tool's purpose unmistakable.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description provides clear context on when to use each mode ('Omit for auto mode' vs 'Provide a topic, person, concept...'), but it does not explicitly contrast with alternative sibling tools such as search_audio or clip_export. It gives solid usage direction within the tool itself.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
identify_speakersC
Identify who speaks when in audio.
| Name | Required | Description | Default |
|---|---|---|---|
| audio_path | Yes | Path to the audio file | |
| model_size | No | Whisper model size. ALWAYS use tiny unless the user explicitly requests a different size. tiny is already highly accurate. | |
| num_speakers | No | Number of speakers if known. Auto-detects if not set. |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description is the only source of behavioral disclosure, but it only restates the high-level function. It does not mention output format, limitations, whether any model or download is required, or what 'who speaks when' returns. The schema provides model_size guidance, but the description itself adds no behavioral context.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single front-loaded sentence with no filler, repetition, or irrelevant detail. It is optimally concise, even though more content could be added for completeness in other dimensions.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
This is a speaker-diarization tool with no output schema and no annotations, but the description does not describe the output format (e.g., speaker segments or timestamps) or any prerequisites. While the schema covers parameters well, the overall tool context is incomplete for an agent to know what result to expect.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 100%, so the baseline is 3. The description itself adds no parameter explanation beyond the schema, though the schema already includes useful guidance such as 'ALWAYS use tiny unless the user explicitly requests a different size.'
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description 'Identify who speaks when in audio' uses a specific verb and resource, clearly indicating speaker diarization. It is distinct in meaning from sibling tools like transcribe_audio or separate_audio, but it does not explicitly name alternatives or scope, so it misses the top score.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance is provided on when to use this tool versus alternatives such as transcribe_audio or separate_audio. It neither states use cases, prerequisites, nor exclusions, just a functional one-liner.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
list_filesB
List media files in a directory.
| Name | Required | Description | Default |
|---|---|---|---|
| pattern | No | Glob pattern for matching files. Default: all common media formats | |
| directory | Yes | Directory path to search | |
| recursive | No | Search subdirectories. Default: false |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description carries the full burden of behavioral disclosure, but it only says 'List media files in a directory' without detailing return format, sorting, or file type specifics. It does not reveal limitations like hidden files or symlink handling.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single concise sentence with no filler words. It is front-loaded with the action and resource, earning a high score for conciseness.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the tool's simplicity and full schema coverage, the description is minimally viable but leaves gaps such as return format and scope of 'media files'. The absence of annotations and output schema means the description should have provided more context.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
All three parameters have schema descriptions, so the baseline is 3. The description doesn't add any parameter semantics beyond the schema, making it adequate but not enhanced.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the verb 'List' and the resource 'media files in a directory', making the tool's purpose immediately obvious. It is distinct from sibling tools like search_audio and list_memories, though it does not explicitly name alternatives.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description provides no guidance on when to use this tool versus alternatives, nor any context about prerequisites or exclusions. It simply states the operation without addressing usage scenarios.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
list_memoriesA
List all stored transcriptions with their titles, durations, dates, and file paths to markdown files. Useful for browsing what has already been transcribed.
| Name | Required | Description | Default |
|---|---|---|---|
No parameters | |||
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations provided, the description must carry behavioral disclosure. It reveals that this is a listing operation returning specific fields, which implies a read-only, non-destructive action. However, it does not mention pagination, ordering, or whether 'all' means no filtering, leaving some behavior implicit.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Two concise sentences with the core action front-loaded. Every word adds value: 'List all stored transcriptions' states purpose, followed by a practical use case. No redundancy or fluff.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a zero-parameter listing tool with no output schema, the description adequately covers what it does and when to use it. It could potentially mention how it relates to list_files or whether the markdown paths are local paths, but for its simple complexity, the description is sufficiently complete.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The input schema has no parameters, so the baseline is 4. The description adds no parameter information, but none is needed. It clarifies what the returned fields are, providing some semantic context despite the absence of parameters.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description uses a specific verb ('List') and a clear resource ('all stored transcriptions') with the exact fields returned. It distinguishes itself from sibling tools by focusing on transcription metadata and markdown file paths, which is distinct from search-oriented tools like search_memory or list_files.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The phrase 'Useful for browsing what has already been transcribed' clearly indicates a primary use case. It doesn't explicitly name alternatives or exclusions, but the context is sufficiently clear for a simple listing tool.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
memory_statsA
View transcription memory statistics including number of stored files and total duration.
| Name | Required | Description | Default |
|---|---|---|---|
No parameters | |||
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations provided, the description carries the burden of behavioral disclosure. The verb 'View' implies a read-only operation, and the description mentions what information is returned, but it does not explicitly state that there are no side effects or mention any permissions or limitations. This is adequate but not rich.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single, front-loaded sentence that immediately states the action and resource, followed by specific details. Every word earns its place, with no redundancy or filler.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a simple tool with no parameters and no output schema, the description adequately covers purpose and the key return values (stored file count and total duration). It could be slightly more explicit about the read-only nature, but overall it is complete enough for the tool's simplicity.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The tool has zero parameters, so there is nothing to explain. The schema coverage is vacuously 100%, and the description does not need to elaborate on parameters. A baseline of 4 is appropriate.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description uses the specific verb 'View' and identifies the resource as 'transcription memory statistics', then details exactly what statistics are included (number of stored files and total duration). This clearly distinguishes it from sibling tools like clear_memory or list_memories, which have different purposes.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description implies that the tool is for viewing summary statistics about transcription memory, so the usage context is inferable. However, there is no explicit mention of when to prefer this over alternatives like list_memories, nor any exclusion criteria.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
rebuild_graphA
Rebuild Obsidian graph view data for all transcriptions. Migrates .md files to YAML frontmatter format, computes [[wikilinks]] between semantically related transcriptions, and generates MOC (Map of Content) hub files for tag clusters. Safe to run repeatedly. Run this once to upgrade existing memory for Obsidian.
| Name | Required | Description | Default |
|---|---|---|---|
| min_moc_members | No | Minimum transcriptions per tag to generate a MOC file. Default: 3 |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description carries the burden of behavioral context. It discloses that the tool mutates files (migrates .md files), computes links, generates MOC files, and is safe to run repeatedly. It does not detail potential side effects (e.g., overwriting existing files) but does state idempotency ('Safe to run repeatedly'), which is valuable behavioral information.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is three sentences, each adding meaningful information: the core action, the three sub-tasks, and the safe-to-re-run guidance. No wasted words, and it is front-loaded with the main verb and resource.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the tool mutates files and has no output schema, the description explains the transformation and hub generation, which is complete enough for a one-time migration tool. It could mention that it is a post-transcription step, but the 'upgrade existing memory' phrase implies that. The only slight gap is lack of explicit mention of any risks (e.g., changing file contents), but 'safe to run repeatedly' mitigates that.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The only parameter, min_moc_members, is fully described in the schema (100% coverage). The description mentions 'generates MOC hub files for tag clusters', which gives context for the parameter's purpose. Since schema coverage is 100%, the description adds minimal extra value but the schema itself is sufficient.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description states a specific verb ('Rebuild') and resource ('Obsidian graph view data for all transcriptions'). It clearly distinguishes from siblings by naming the specific actions: migrating .md files to YAML frontmatter, computing [[wikilinks]], and generating MOC files. This is a unique purpose among sibling tools.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description says 'Run this once to upgrade existing memory for Obsidian' and 'Safe to run repeatedly', implying it is an initialization/upgrade tool. It doesn't explicitly say when not to use it or compare to alternatives, but the context is clear enough for an agent to recognize it as a one-time migration task.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
search_audioA
Search audio files for keywords and return timestamped matches with context snippets. Useful for finding specific moments in podcasts, interviews, lectures, or any audio content.
| Name | Required | Description | Default |
|---|---|---|---|
| clip | No | Download actual video clips around each match. Set to true when the user asks for clips, highlights, compilations, or says they want the video itself, not just timestamps. Requires the audio to have been downloaded from a URL. Default: false | |
| output | No | Optional file path to save results. Use .csv for plain data or .xlsx for styled spreadsheets with bold headers and formatting. | |
| keywords | Yes | List of keywords or phrases to search for | |
| audio_path | Yes | Path to the audio file (MP3, WAV, M4A, etc.) | |
| model_size | No | Whisper model size. ALWAYS use tiny unless the user explicitly requests a different size. tiny is already highly accurate. | |
| clip_padding | No | Seconds of padding before and after each match for clip export. Default: 15 | |
| include_full_text | No | Include full transcription text in response. Default: false |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description bears the full burden of behavioral disclosure. It mentions the output format but omits that the tool relies on Whisper transcription, potential performance costs, or prerequisites like audio-download status. This is a significant gap.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Two tight sentences: the first specifies the action and output, the second gives usage context. No filler or redundancy.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a tool with 7 parameters, no output schema, and no annotations, this description is too thin. It fails to explain operational behavior like transcription dependency, clip export requirements, or how this integrates with downloaded audio.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 100% and each parameter (including model_size and clip) has detailed guidance. The description adds no parameter-specific information, so the baseline score of 3 applies.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
Clearly states the tool searches audio files for keywords and returns timestamped matches with context snippets. The verb+resource+output structure distinguishes it from siblings like transcribe_audio or search_proximity.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
Provides a clear use case ('finding specific moments in podcasts, interviews, lectures') but doesn't explicitly compare to alternative tools or state when not to use.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
search_memoryA
Search across ALL stored transcriptions. No audio_path needed, queries everything in memory. Default mode is 'keyword' (literal match). Use 'semantic' mode for meaning-based search.
| Name | Required | Description | Default |
|---|---|---|---|
| mode | No | Search mode. 'keyword' (default) finds segments containing the exact word/phrase. 'semantic' finds segments similar in meaning. | |
| query | Yes | Search query. For keyword mode: a word or phrase to find literally. For semantic mode: a natural language description (e.g. 'discussion about funding challenges'). | |
| top_k | No | Number of results to return. Default: 10 | |
| output | No | Optional file path to save results. Use .csv for plain data or .xlsx for styled spreadsheets with bold headers and formatting. | |
| context_words | No | Words of context per result. Default: 25. Use 150 for full evidence blocks when Claude needs to answer a question. Semantic mode only. | |
| dedup_seconds | No | Merge matches within this many seconds of each other. Default: 0 (off). Semantic mode only. |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description carries the full burden. It discloses the search scope and modes, which is helpful, but it does not explain return format, result ordering, pagination, or any permissions/rate limits. For a search tool, this is acceptable but not rich; a description of the output structure would have been more transparent.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is only three sentences, each earning its place: the first states scope, the second clarifies no audio_path, and the third explains modes. It is front-loaded and contains no redundancy or filler.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
The tool has 6 parameters and no output schema, so the description should compensate by explaining what the agent can expect in return. While the parameter descriptions cover input semantics, the description does not provide any return value details, result format, or behavioral constraints (e.g., how results are scored or sorted). This is a notable gap for an agent.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100%, so the baseline is 3. The description adds value by explaining the default mode ('keyword' = literal match) and how to use semantic mode, which is not fully captured in the schema. It also clarifies that no audio_path is needed, reinforcing the query scope. This extra context raises the score above baseline.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool searches across ALL stored transcriptions, with a specific verb ('Search'), a defined resource ('ALL stored transcriptions'), and scope that distinguishes it from siblings like search_audio ('No audio_path needed'). It also introduces the two modes, leaving no ambiguity about what the tool does.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description explicitly tells when to use this tool ('No audio_path needed, queries everything in memory') and provides guidance on mode selection ('Default mode is keyword... Use semantic mode for meaning-based search'). It doesn't mention alternatives like deep_search or batch_search, so it lacks full exclusions, but the guidance is clear enough for most use cases.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
search_proximityA
Find where one keyword appears near another keyword in audio. Useful for finding contextual discussions, e.g., 'startup' near 'funding'.
| Name | Required | Description | Default |
|---|---|---|---|
| output | No | Optional file path to save results. Use .csv for plain data or .xlsx for styled spreadsheets with bold headers and formatting. | |
| keyword1 | Yes | Primary keyword to find | |
| keyword2 | Yes | Secondary keyword that must appear nearby | |
| audio_path | Yes | Path to the audio file | |
| model_size | No | Whisper model size. ALWAYS use tiny unless the user explicitly requests a different size. tiny is already highly accurate. | |
| max_distance | No | Maximum number of words between keywords. Default: 30 |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations provided, the description carries the full burden of behavioral disclosure. It only states the purpose and gives an example, without indicating read-only nature, output format, error conditions, or any side effects. This is a significant gap for a tool with no annotation support.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is two sentences, front-loaded with the main purpose, and uses no redundant words. It efficiently conveys the core function and a practical example.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
The tool has six parameters and no output schema, yet the description does not explain what the tool returns (e.g., timestamps, snippets) or mention varying behavior for different parameter settings. While the schema covers parameter details, the description should provide more context about expected results and limitations, making it only partially complete.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 100%, so the schema fully documents each parameter. The description adds an illustrative example but does not explain parameter nuances or usage details beyond what the schema provides. Baseline of 3 is appropriate.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the specific action ('Find where one keyword appears near another keyword in audio') and includes a concrete example ('startup' near 'funding'). This distinguishes it from sibling tools like search_audio by highlighting the proximity-based search mechanism.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description provides a clear use case ('Useful for finding contextual discussions'), signaling when to use this tool. However, it does not explicitly mention alternatives or when not to use it, so it falls short of full guidelines.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
separate_audioA
Separate audio into stems (vocals, drums, bass, other) using Meta's Demucs v4. Isolates vocals from music, background noise, and other sounds. Use this before transcription when audio has music, intros, or heavy background noise for dramatically cleaner results.
| Name | Required | Description | Default |
|---|---|---|---|
| model | No | Demucs model. htdemucs is the default (fast, great quality). htdemucs_ft is fine-tuned (slower, best quality). Default: htdemucs | |
| audio_path | Yes | Path to the audio file | |
| vocals_only | No | If true, only separate into vocals + no_vocals (faster). If false, separate into all 4 stems: vocals, drums, bass, other. Default: true |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description carries the full burden for behavioral disclosure. It does convey the isolation behavior and stem outputs, but it omits side effects like output file locations, processing time/resource usage, or whether the original audio is modified. This is a moderate gap given the lack of annotation support.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is two sentences, front-loaded with the core purpose, and includes a practical usage recommendation. Every sentence contributes meaning without repetition or fluff.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
The description covers the tool's purpose, method (Demucs v4), and usage scenario, which is sufficient for a straightforward audio-processing tool. However, it lacks details about expected outputs (e.g., files created) and prerequisites or limitations, but given the no-output-schema context, it is reasonably complete.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 100%, so the parameters are already well-documented in the input schema. The description adds some context by mentioning the specific stems and the vocals focus, but it doesn't elaborate on the model parameter or vocals_only behavior beyond what the schema already provides.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool separates audio into specific stems (vocals, drums, bass, other) using Meta's Demucs v4, which directly conveys its function. It also differentiates from sibling tools like transcribe_audio by focusing on the separation use case and explicitly tying it to cleaning audio before transcription.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description gives explicit guidance on when to use the tool: 'Use this before transcription when audio has music, intros, or heavy background noise for dramatically cleaner results.' This provides clear context and links to a sibling tool, though it doesn't mention when not to use it or alternative tools beyond transcription.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
spacesA
Download or live-record a Twitter/X Space. Three modes: (1) Pass url to start a download (returns recording_id), (2) Pass recording_id to check status, (3) Pass recording_id + stop=true to stop a live recording.
| Name | Required | Description | Default |
|---|---|---|---|
| url | No | Twitter/X Space URL to download (e.g., https://x.com/i/spaces/1yNxaNvaMYQKj). Starts download in background. | |
| stop | No | Stop a live recording. Requires recording_id. Default: false | |
| output_dir | No | Directory to save the audio file. Default: ~/Downloads | |
| recording_id | No | Check status of a previous download, or stop it when combined with stop=true. |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description carries the burden of disclosing behavior. It mentions that downloads return a recording_id, that status can be checked, and that live recordings can be stopped. However, it lacks details on authentication requirements, side effects like file persistence, or any non-obvious operational constraints.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is concise and well-structured. It leads with the core purpose, then enumerates the three modes in a clear numbered list. Every sentence provides essential information without redundancy.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
The tool has three distinct modes and four parameters, and the description covers the primary scenarios comprehensively. It does not detail the output format for status checks or error conditions, but the absence of an output schema and the clarity of the modes make this acceptable.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Although the input schema already describes each parameter well (100% coverage), the description adds semantic connections by explaining the three modes: how url initiates a download, how recording_id serves for status/stop, and how stop modifies behavior. This goes beyond the schema's individual descriptions.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool's purpose: 'Download or live-record a Twitter/X Space.' It uses specific verbs and a specific resource, and outlines three distinct usage modes, which distinguishes it from sibling tools like download_audio or transcribe_audio.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description provides clear context for when to use each mode: pass url to start a download, pass recording_id to check status, and pass recording_id with stop=true to stop a live recording. However, it does not explicitly compare with alternative tools or mention when not to use it.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
tagA
Add, remove, or list tags on a transcription. Tags are broad topic categories (e.g. 'AI', 'Health', 'Music') that help organize and filter memories in the Web UI.
| Name | Required | Description | Default |
|---|---|---|---|
| tags | No | Tag names to add or remove. Use 2-4 broad topic categories, not names of people or specific tools. E.g. ['AI', 'Startups'] not ['Greg Eisenberg', 'Claude Code'] | |
| action | Yes | Action to perform: add, remove, or list | |
| cache_key | Yes | The cache_key of the transcription to tag |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations provided, the description carries the full burden of behavioral disclosure. It states the actions (add, remove, list) but does not disclose side effects, prerequisites (e.g., valid cache_key), reversibility, or return format for the 'list' action. This is a significant gap for a tool that modifies state.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is two sentences long, front-loads the primary action, and provides relevant context about tag usage. Every sentence earns its place with no redundancy or irrelevant detail.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
The tool is simple (3 parameters, no output schema) and the description covers its core purpose. However, it omits behavioral details like what 'list' returns or whether tags are case-sensitive, which would be useful given the lack of annotations and output schema. It is adequate but has room for improvement.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The input schema has 100% coverage, with each parameter described in detail, including constraints and examples for 'tags' and an enum for 'action'. The description adds no new parameter-specific meaning beyond reinforcing that tags are broad topic categories, which is already in the schema. This matches the baseline for high schema coverage.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool's function: 'Add, remove, or list tags on a transcription.' This is a specific verb+resource combination. It also explains that tags are 'broad topic categories' for organizing memories, which adds helpful context. However, it does not explicitly distinguish this tool from sibling tools like 'chapters' or 'highlights' that also operate on transcriptions.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description provides clear context for when to use the tool: tags help 'organize and filter memories in the Web UI.' This implies the tool is for categorizing transcriptions with broad topics. It does not mention exclusions or alternatives, but the context is sufficient for an agent to infer appropriate usage.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
take_notesA
Take notes from a URL. Downloads audio, transcribes, and saves .md to Desktop. This single tool handles the entire pipeline — download, transcribe, and save — when the user asks for notes, summaries, highlights, takeaways, eye-candy, quiz, or any formatted content from a video/audio URL. Returns audio_path for follow-up tools (chapters, search). Also used to SAVE formatted notes: call with save_content to write notes to the file from the previous take_notes call (no url needed).
| Name | Required | Description | Default |
|---|---|---|---|
| url | No | Video/audio URL to take notes from (YouTube, Vimeo, TikTok, Twitter, SoundCloud, etc.) | |
| style | No | Note style. tldr > notes > highlight > eye-candy increases formatting richness. quiz generates questions. Default: notes. Pick based on what the user asks for. | |
| model_size | No | Whisper model size. ALWAYS use tiny unless the user explicitly requests a different size. tiny is already highly accurate. | |
| output_dir | No | Directory to save the .md notes file. Default: ~/Desktop | |
| read_aloud | No | Generate a spoken audio summary and embed it in the notes for Obsidian playback. Default: false | |
| output_path | No | Explicit file path to save notes to. Use this when saving notes from a memory transcript (no prior take_notes url call). E.g. ~/Desktop/My_Notes.md | |
| save_content | No | Formatted notes content to save. When provided, writes this content to a file. Works with a previous take_notes call OR with output_path for saving notes from memory transcripts. |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description carries the full burden and discloses key behaviors: downloads audio, transcribes, saves .md to Desktop, returns audio_path, and supports a save_content mode. It could add more detail about failure modes or time costs, but the core side effects are clearly stated.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Three sentences pack a lot of information without being bloated. It front-loads the main purpose, then explains the pipeline, follow-up use, and save mode. Slightly dense but each sentence contributes distinct value.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a complex 7-parameter tool with no output schema and no annotations, the description is remarkably complete: it explains the full pipeline, the return value, the save_content alternative, and gives guidance on style and model size. This is sufficient for an agent to invoke the tool correctly in most scenarios.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The input schema already provides descriptions for all 7 parameters (100% coverage), so the baseline is 3. The description adds some operational context (e.g., model_size 'ALWAYS use tiny', style selection logic, save_content as separate mode) but does not significantly extend beyond what the schema already defines.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description uses specific verbs and resources: 'Take notes from a URL', 'Downloads audio, transcribes, and saves .md to Desktop'. It clearly differentiates itself from sibling tools by stating it handles the entire pipeline (download, transcribe, save) for note-related requests, and also covers the save_content variant.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
Explicitly states when to use this tool: whenever the user asks for notes, summaries, highlights, takeaways, eye-candy, quiz, or any formatted content from a video/audio URL. It also clarifies the save_content workflow ('no url needed') and mentions return of audio_path for follow-up tools like chapters and search, effectively guiding selection among siblings.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
text_to_speechA
Convert text to natural speech audio using Kokoro TTS. Saves an MP3 file. Runs in background — returns a job_id immediately. Call again with job_id to check status. Pass text for raw TTS, or file_path to read a notes file (strips markdown, skips metadata, embeds audio player).
| Name | Required | Description | Default |
|---|---|---|---|
| text | No | Text to convert to speech. Either text or file_path is required. | |
| speed | No | Speech speed multiplier. Default: 1.0 | |
| voice | No | Voice ID. American English female: af_heart (default), af_alloy, af_aoede, af_bella, af_jessica, af_kore, af_nicole, af_nova, af_river, af_sarah, af_sky. American English male: am_adam, am_echo, am_eric, am_fenrir, am_liam, am_michael, am_onyx, am_puck. British English: bf_emma, bf_isabella, bf_lily, bm_daniel, bm_fable, bm_george, bm_lewis. Other languages: Spanish (ef_dora, em_alex), French (ff_siwis), Hindi (hf_alpha, hf_beta, hm_omega, hm_psi), Italian (if_sara, im_nicola), Japanese (jf_alpha, jf_gongitsune, jf_nezumi, jf_tebukuro, jm_kumo), Brazilian Portuguese (pf_dora, pm_alex), Mandarin Chinese (zf_xiaobei, zf_xiaoni, zf_xiaoxiao, zf_xiaoyi, zm_yunjian, zm_yunxi, zm_yunxia, zm_yunyang). | |
| job_id | No | Check status of a running TTS job. Pass the job_id returned from a previous call. | |
| file_path | No | Path to a notes file to read aloud. Strips markdown formatting, skips metadata, generates MP3, and embeds audio player in the file. | |
| output_dir | No | Directory to save the MP3 file. Default: ~/Desktop | |
| output_filename | No | Custom filename. Auto-generated if not set. |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations provided, the description carries the full burden. It discloses the asynchronous behavior (returns job_id), the output (MP3 file), and the file_path side effects (strips markdown, skips metadata, embeds audio player). This is strong behavioral detail, though it could be more explicit about status response contents or permissions.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is concise, with every sentence contributing valuable information: purpose, output, background behavior, and two usage modes. It is well-structured and front-loaded with the core function, with no unnecessary repetition.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the tool's complexity (async workflow, multiple modes, no output schema), the description covers the essential workflow: initial call, job_id polling, and both text and file_path input. It misses details like status response format or error handling, but the description is sufficiently complete for an agent to invoke the tool correctly.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 100%, so the schema already documents all parameters. The description adds workflow context (e.g., passing job_id to check status) but largely repeats the schema's parameter descriptions. It does not add significant new semantics beyond the schema.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states 'Convert text to natural speech audio using Kokoro TTS' and 'Saves an MP3 file', giving a specific verb and resource. This distinguishes it from sibling tools like transcribe_audio and download_audio, which serve opposite or different functions.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description explains the usage pattern: 'Runs in background — returns a job_id immediately. Call again with job_id to check status.' It also distinguishes between raw text and file_path modes. However, it does not explicitly name sibling tools or state when not to use it, so it falls short of a perfect score.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
transcribe_audioA
Transcribe an audio file and return the full text with timestamps. Useful when you need the complete transcription rather than searching for specific keywords.
| Name | Required | Description | Default |
|---|---|---|---|
| start | No | Start transcription at this many seconds into the audio. Default: 0 (beginning) | |
| output | No | Optional file path to save transcription. Use .csv for plain data or .xlsx for styled spreadsheets with bold headers and formatting. | |
| duration | No | Only transcribe this many seconds of audio. Example: 600 = first 10 minutes. Default: full file | |
| audio_path | Yes | Path to the audio file | |
| model_size | No | Whisper model size. ALWAYS use tiny unless the user explicitly requests a different size. tiny is already highly accurate. | |
| translated_text | No | English translation of a non-English transcription. When provided, no audio processing occurs — the translation is stored alongside the existing cached transcription as a sibling (eng) markdown file. The audio must have been transcribed already. Pass the full English text as a single string. |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations provided, the description must carry the full burden of behavioral disclosure. It only mentions that the tool returns full text with timestamps, omitting side effects such as audio file requirements, model download behavior, optional output file writing, or the special translated_text short-circuit path. The schema covers some parameters, but the description itself adds minimal behavioral depth.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is two concise sentences, front-loading the core action and purpose. Every sentence earns its place, with no redundancy or filler.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the rich schema with full parameter descriptions and no output schema, the description sufficiently covers the tool's purpose and usage context. It explains the return value (full text with timestamps) and differentiates from search. Some behaviors (like the recommended model size) are left to the schema but are still covered, making the overall definition quite complete.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 100%, so the baseline is 3. The description does not add any parameter-level meaning beyond the schema, but the schema descriptions are already rich (e.g., model_size includes a strong guideline to always use tiny). The description's high-level context is helpful but not parameter-specific.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool's function: "Transcribe an audio file and return the full text with timestamps." It uses a specific verb+resource and distinguishes from sibling search tools by noting its utility is for complete transcription "rather than searching for specific keywords."
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description provides explicit context: use this tool when you need the complete transcription, not for keyword search. It implies the alternative (search tools) but does not name a specific sibling or mention other exclusions such as when to use a batch or speaker-identification tool. This is clear context without exhaustive exclusions.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
visualA
ONLY call this tool when the user explicitly asks for visual context, screenshots, or frames. Do NOT call it alongside take_notes or download_audio unless the user specifically requests visuals. Extract visual context from a video at moments that matter. Four modes: (1) Query mode (default): describe what you need visual context for and the tool finds those moments in the transcript, then extracts frames. (2) Auto mode: autonomously detects moments where the speaker implies visual content (UI actions, screen recordings, demonstrations). (3) Manual mode: extract frames at specific timestamps. (4) Assist mode: analyzes the transcript for visual gaps and returns time ranges where the user should provide their own screenshots (ideal for talking-head videos where the speaker describes a UI but doesn't show it). Frames are stored in augent memory alongside the transcription and embedded in the .md file as Obsidian wikilinks.
| Name | Required | Description | Default |
|---|---|---|---|
| url | No | Video URL (YouTube, etc). Downloads the video automatically if video_path is not provided. | |
| auto | No | Auto mode: autonomously detect visual moments from transcript (UI actions, demonstrations, spatial references). Default: false. Ignored if query or timestamps are provided. | |
| clear | No | Remove all previously extracted frames and the visual context .md for this video. Use to redo or clean up. Default: false | |
| query | No | What you need visual context for. The tool searches the transcript semantically and extracts frames at matching moments. Examples: 'connecting Gmail to the agent', 'the dashboard configuration', 'where he sets up the branching logic'. | |
| top_k | No | Number of transcript matches to extract frames for in query mode. Default: 10 | |
| assist | No | Assist mode: analyze the transcript for visual gaps and return time ranges where the user should provide their own screenshots. Ideal for talking-head videos or podcasts where the speaker describes a workflow or UI but the video doesn't show it. No frames are extracted — instead, returns structured gaps with time windows, transcript excerpts, and what kind of screenshot would help. Default: false. | |
| max_frames | No | Maximum frames to extract. Default: 30 | |
| model_size | No | Whisper model size for transcription. Default: 'tiny' | |
| timestamps | No | Manual mode: list of timestamps (in seconds) to extract frames at. Overrides query and auto detection. | |
| video_path | No | Path to a video file (MP4, MKV, etc). Can be output from clip_export. | |
| context_words | No | Words of context around each match in query mode. Default: 40 |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description carries the full burden. It discloses that frames are stored in augent memory, embedded as Obsidian wikilinks, and describes auto/manual/assist mode behaviors. It does not cover all edge cases (e.g., errors, download behavior), but provides substantial behavioral context.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is slightly longer than necessary but well-structured, front-loading the critical usage restriction and then compactly describing modes. Each sentence contributes, though the mode enumeration could be more terse.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the tool's complexity (11 params, no output schema), the description covers the core functional behavior, modes, and storage details. It does not detail the exact return format for query or assist outputs, but offers enough for an agent to invoke correctly in most scenarios.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 100%, so the baseline is 3. The description adds value by explaining how the modes (query, auto, manual, assist) correspond to parameters like `query`, `auto`, `timestamps`, and `assist`. It also notes `video_path` can be output from `clip_export`, linking to a sibling tool.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool's purpose: extract visual context from videos at relevant moments. It is distinguished from sibling tools by explicitly limiting usage to visual requests and providing mode breakdowns (query, auto, manual, assist).
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
Provides explicit when-to-use ('ONLY call this tool when the user explicitly asks for visual context') and when-not-to ('Do NOT call it alongside take_notes or download_audio unless the user specifically requests visuals'). It also gives mode selection guidance, which is an alternative-aware usage guide.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
Tool Schema Changelog
Recent tool additions, removals, and schema changes observed during successful MCP inspections. Dates show when Glama detected each change.
22 tool updates
v0.1.0- First observed
batch_search - First observed
chapters - First observed
clear_memory - First observed
clip_export - First observed
deep_search - First observed
download_audio - First observed
highlights - First observed
identify_speakers - First observed
list_files - First observed
list_memories - First observed
memory_stats - First observed
rebuild_graph - First observed
search_audio - First observed
search_memory - First observed
search_proximity - First observed
separate_audio - First observed
spaces - First observed
tag - First observed
take_notes - First observed
text_to_speech - First observed
transcribe_audio - First observed
visual
TDQS
The set includes multiple search tools (search_audio, deep_search, batch_search, search_memory, search_proximity) with overlapping capabilities, which could confuse an agent about which to use. Additionally, clip_export and highlights both export video clips, and download_audio and spaces both handle Twitter content. Most other tools are distinct.
Most tools follow a verb_noun pattern (download_audio, transcribe_audio, list_memories), but several are single-word nouns (chapters, tag, highlights, visual, spaces) and deep_search doesn't match the search_* convention. Overall still readable and predictable.
With 22 tools, the server is slightly above the ideal 3-15 range, but the broad scope of audio/video processing, memory management, and export features justifies this count. It feels heavy but not excessive.
The tool set covers the full pipeline from download to transcription, search, note-taking, and export, including optional enhancements like speaker identification and audio separation. However, it lacks individual transcription deletion (only clear_memory) and a direct get-by-ID retrieval, which are minor gaps.
Maintenance
Resources
Unclaimed servers have limited discoverability.
Looking for Admin?
If you are the server author, to access and configure the admin panel.
Related MCP Connectors
OCR, transcription, file extraction, and image generation for AI agents via MCP.
Media intelligence analysis for audio, video, and images via the Echosaw MCP server.
An MCP server that provides tools to discover and retrieve podcast episodes transcripts.
MCP server for Speech-to-Text
Related MCP Servers
- AlicenseNot gradedqualityCmaintenanceMCP server for offline speech-to-text and speaker diarization, enabling AI agents to transcribe audio locally without cloud APIs.3MIT
- FlicenseNot gradedqualityCmaintenanceA Model Context Protocol (MCP) server that gives AI agents the ability to process audio files — transcribe speech to text, detect spoken languages, and extract audio metadata.1-

video-analyzerofficial
FlicenseNot gradedqualityDmaintenanceMCP server enabling video analysis via scene detection, audio transcription, visual description, and stylistic fingerprinting, with tools for full pipeline execution and storyboard generation.-- AlicenseNot gradedqualityAmaintenanceMCP server that enables audio transcription from files (wav, mp4, mp3, flac) or microphone recording, with dynamic tool selection and enterprise-grade security.2MIT
Latest Blog Posts
- Who's Calling? MCP Hosts Are an Identity Blind Spot (And the Spec Knows It)By Om-Shree-0709 on .mcpAgent IdentityOAuth 2.1
- Your AI Chatbot Just Exposed Your CEO's Salary to an InternBy Om-Shree-0709 on .Agent IdentityMCP SecurityOAuth Delegation
- Why MCP Servers Need Execution Sandboxing (And Why Your Current Stack Isn't Enough)By Om-Shree-0709 on .Agentic AiPrompt InjectionWebAssembly
MCP directory API
We provide all the information about MCP servers via our MCP API.
curl -X GET 'https://glama.ai/api/mcp/v1/servers/AugentDevs/augent'
If you have feedback or need assistance with the MCP directory API, please join our Discord server