llms.txt for agents
Server Details
Any site's llms.txt: find the covering index, read its linked docs as markdown, search sections.
- Status
- Healthy
- Last Tested
- Transport
- Streamable HTTP
- URL
- Repository
- ux-xd/llms-txt-mcp
- GitHub Stars
- 0
- Server Listing
- llms-txt
Available Tools
3 toolsllms_indexARead-onlyIdempotentInspect
Find and parse the llms.txt that covers a site or page URL: title, summary, H2 sections of title links with notes, the Optional section, and (HEAD-probed only) whether an llms-full.txt exists. Use first, before llms_page, whenever the user needs a product or library's own docs; every rung tried is returned so a miss is diagnosable.
| Name | Required | Description | Default |
|---|---|---|---|
| site | Yes | Site or page URL, e.g. "docs.stripe.com" or "https://hono.dev/docs/". The most specific covering llms.txt wins. | |
| refresh | No | Bypass the 24 h cache and fetch again. | |
| task_context | Yes | One sentence on what the user is ultimately trying to do (the task this call serves). Required; it tunes the result and is how this free service learns what agents need. |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
Annotations already cover readOnly/openWorld/idempotent, so the safety profile is known. The description adds useful behavioral nuance beyond that: the HEAD-probe caveat for llms-full.txt existence and the fact that all attempted rungs are returned for diagnosability. This goes beyond what annotations express, though it stops short of describing edge cases like network failures or malformed llms.txt files.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is two sentences with no filler. The first sentence front-loads the core operation and details what is parsed; the second gives routing guidance and a behavioral promise. Every clause earns its place, and the structure is easy to scan.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
There is no output schema, so the description shoulders the burden of explaining return content, and it does list the key parsed sections. It also prepares the agent for miss behavior. Minor gaps remain: the exact return shape is not described, and llms_search is not referenced as an alternative, but overall the description is sufficient for correct invocation in most scenarios.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 100%, so the parameters (site, refresh, task_context) are already well documented in the schema. The description adds no parameter-level semantics beyond what the schema states, which matches the baseline of 3 for high schema coverage.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description leads with a specific verb and resource: 'Find and parse the llms.txt that covers a site or page URL', then enumerates exactly what gets parsed (title, summary, H2 sections, Optional section, llms-full.txt probe). It also explicitly names the sibling it is differentiated from ('Use first, before llms_page'), so an agent can tell them apart.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description gives a clear when-to-use rule: 'Use first, before llms_page, whenever the user needs a product or library's own docs'. It also provides diagnostic context ('every rung tried is returned so a miss is diagnosable') that helps the agent decide whether to call a fallback. This is explicit, actionable guidance.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
llms_pageARead-onlyIdempotentInspect
Return one docs page as markdown, paginated: tries Accept: text/markdown negotiation, the page's rel="alternate" markdown mirror, the .md / .html.md / index.md conventions, then a bounded HTML-to-markdown conversion. Use on the URLs llms_index returns, or on any docs URL you already hold.
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | Page URL (http/https). | |
| offset | No | Character offset to continue from (use next_offset from a truncated result). | |
| max_chars | No | Characters of markdown to return in this call. | |
| task_context | Yes | One sentence on what the user is ultimately trying to do (the task this call serves). Required; it tunes the result and is how this free service learns what agents need. |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
The description discloses a useful fallback chain: Accept negotiation, markdown mirror, .md conventions, then bounded HTML-to-markdown conversion. This is meaningful behavioral context beyond the annotations, and it aligns with the read-only, idempotent, and non-destructive hints. It does not contradict the annotations.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Two tightly packed sentences: the first front-loads the primary function and conversion strategy, the second gives usage guidance. Every clause contributes, with no filler or repetition of schema details.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a paginated markdown fetcher, the description adequately conveys the return type, pagination behavior, and conversion pipeline. It does not describe failure modes or exact response envelope (e.g., next_offset), but the schema and annotations cover parameter and safety aspects, making the definition reasonably complete.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 100%, so the schema already documents url, offset, max_chars, and task_context. The description adds only indirect context about pagination and bounded conversion, which slightly enriches offset/max_chars semantics but does not substantially go beyond what the schema provides.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states a specific operation: 'Return one docs page as markdown, paginated' with a precise verb and resource. It also distinguishes itself from siblings by referencing URLs from llms_index and focusing on individual page retrieval rather than index discovery or search.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
It explicitly instructs when to use the tool: 'Use on the URLs llms_index returns, or on any docs URL you already hold.' This gives a clear invocation context, though it does not explicitly name alternative tools or state when not to use it, so it stops short of a full exclusionary guide.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
llms_searchARead-onlyIdempotentInspect
Search the llms.txt indexes this server has parsed (section headings ×3, link titles ×2, notes ×1) and get the matching docs links with their covering index; pass site to search one site (it is indexed on demand). Use to jump straight to the right page of a docs set instead of reading the whole index.
| Name | Required | Description | Default |
|---|---|---|---|
| site | No | Restrict to one site (indexed via llms_index if not yet cached). | |
| limit | No | ||
| query | Yes | Words to match against section headings, link titles and notes. | |
| max_bytes | No | Byte cap on the results array. | |
| task_context | Yes | One sentence on what the user is ultimately trying to do (the task this call serves). Required; it tunes the result and is how this free service learns what agents need. |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
The annotations already establish read-only, idempotent, non-destructive behavior, so the description adds meaningful context: weighted matching across section headings (×3), link titles (×2), and notes (×1), plus on-demand indexing per site. This goes beyond the annotations and helps an agent predict how results are ranked.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is three sentences with no wasted words. It front-loads the search action and resource, then adds the key behavioral details and the primary use case. The weighted scoring notation is compact but informative.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given no output schema, the description adequately states what is returned (matching doc links and covering index). The annotations cover safety, and the schema covers parameter constraints and the task_context rationale. Minor gaps include not describing the exact result format or ordering, but the overall picture is complete enough for correct invocation.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is high at 80%, so the schema already documents site, query, max_bytes, and task_context. The description adds value by explaining the weighting behind query matching and reinforcing that site restricts to one site and is indexed on demand. It does not cover limit or max_bytes, but the schema handles those adequately.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description opens with a specific verb and resource: 'Search the llms.txt indexes this server has parsed' and states the concrete output: 'matching docs links with their covering index.' It also distinguishes itself from the sibling tools by framing this as a way to jump to the right page instead of reading the whole index.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description gives a clear use case: use it to jump straight to the right page of a docs set instead of reading the whole index. It also explains when to pass the site parameter ('search one site (it is indexed on demand)'). It does not explicitly name the sibling tools or state when not to use them, but the context is clear.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
Tool Schema Changelog
Recent tool additions, removals, and schema changes observed during successful MCP inspections. Dates show when Glama detected each change.
3 tool updates
- First observed
llms_index - First observed
llms_page - First observed
llms_search
Frequently Asked Questions
Claiming proves that you control a remote MCP connector. It does not move, proxy, or interrupt the server.
Open the connector listing, choose Claim ownership, and sign in to Glama.
Complete one verification method:
GitHub identity — fastest for official registry listings. For a namespace such as
io.github.alice/server, link the matching GitHub user, then choose Claim with GitHub. An organization namespace such asio.github.acme/serveralso needs that organization to have installed the Glama AI GitHub App and approved its permissions, because GitHub discloses organization membership only to apps it has installed. Use HTTP or DNS when it has not.HTTP challenge — works when you can deploy a public file. Generate a token, publish the exact JSON Glama shows at
/.well-known/glama.jsonon the same origin as the connector, then choose Check HTTP challenge.DNS challenge — works when you control DNS but cannot change the server. Generate a token, create the exact TXT record Glama shows, wait for it to propagate, then choose Check DNS challenge.
After verification, Glama sends a confirmation email and gives you access to listing details, thumbnails, health checks, and analytics. Keep the HTTP file or DNS record in place: Glama periodically checks it and ownership remains verified while the token is discoverable.
The HTTP ownership file has this structure:
{
"$schema": "https://glama.ai/mcp/schemas/connector.json",
"claim": "glama_claim_..."
}Claim tokens are opaque, stable, and bound to the signed-in Glama account. They contain no email address or other personal information. If Glama can no longer discover a verified HTTP or DNS token, it starts a seven-day grace period before removing claim-based access. Restore the same token during that period to keep ownership verified. Never publish an email address, Glama session token, GitHub token, or connector credential as ownership proof.
If verification fails, confirm that you copied the current token exactly. The HTTP file must be public, return valid JSON with a successful HTTP response, and stay on the connector's origin. DNS changes may need more time to propagate. A claim cannot transfer to a different origin or hostname: if the connector target changes, Glama starts the grace period and the new target must be claimed separately after the previous claim is released.
For a connector linked to the official MCP Registry, registry updates continue to replace its name, description, and URL by default. After claiming, open Manage connector and enable Use Glama listing details as the source of truth if edits made on Glama should be preserved. Categories and thumbnails are always managed on Glama; registry linkage and technical connection settings continue to sync.
Control your server's listing on Glama, including description and metadata
Access analytics and receive server usage reports
Get monitoring and health status updates for your server
Feature your server to boost visibility and reach more users
To improve your MCP server's ranking:
Claim ownership of the server listing
Complete the server profile with an accurate description and thumbnail
Provide a test profile so Glama can connect to and evaluate the server
Keep tool definitions clear and complete to earn a high Tool Definition Quality Score (TDQS)
Route real usage through the Glama Gateway; more recorded successful server uses also improve the ranking
For users:
Full audit trail – every tool call is logged with inputs and outputs for compliance and debugging
Granular tool control – enable or disable individual tools per connector to limit what your AI agents can do
Centralized credential management – store and rotate API keys and OAuth tokens in one place
Change alerts – get notified when a connector changes its schema, adds or removes tools, or updates tool definitions, so nothing breaks silently
For server owners:
Proven adoption – public usage metrics on your listing show real-world traction and build trust with prospective users
Tool-level analytics – see which tools are being used most, helping you prioritize development and documentation
Direct user feedback – users can report issues and suggest improvements through the listing, giving you a channel you would not have otherwise
The connector status is unhealthy when Glama is unable to successfully connect to the server. This can happen for several reasons:
The server is experiencing an outage
The URL of the server is wrong
Credentials required to access the server are missing or invalid
If you are the owner of this MCP connector and would like to make modifications to the listing, including providing test credentials for accessing the server, please contact support@glama.ai.
Discussions
No comments yet. Be the first to start the discussion!
Related MCP Connectors
Read-only search and discovery for the international llms.txt directory maintained by llmsmap.me.
Search indexed websites, read raw page markdown, and score AI visibility for any site.
Web search, URL content extraction to Markdown, site mapping, and recursive web crawler.
Read-only search and Markdown access to liz's public docs, prompts, resources, and an MCP App.
Related MCP Servers
- AlicenseAqualityAmaintenanceLive, ranked search across any number of llms.txt documentation sites - Strands, Kiro, the AWS guides, and whatever you add at runtime.756MIT
- AlicenseNot gradedqualityCmaintenanceEnables fast, token-efficient access to large documentation files in llms.txt format through semantic search. Solves token limit issues by searching first and retrieving only relevant sections instead of dumping entire documentation.3MIT
- AlicenseNot gradedqualityBmaintenanceEnables AI agents to extract, validate, and discover documentation from websites using llms.txt and install.md standards.2433-
- AlicenseNot gradedqualityCmaintenanceEnables Claude and other LLMs to search through any published MkDocs documentation site using the Lunr.js search engine, allowing the AI to find and summarize relevant documentation for users.14921MIT
Glama MCP Gateway
Add one secure layer between your agents and this server.
TDQS
Each tool has a clearly distinct role: llms_index discovers and parses the covering index for a URL, llms_search queries already-parsed indexes, and llms_page fetches individual docs pages. The descriptions explicitly guide when to use each, so there is no real ambiguity.
All names share the llms_ prefix and use lowercase snake_case, making the family obvious. However, llms_index and llms_page read as noun-like resources while llms_search is verb-like, so the names are not perfectly uniform in verb_noun structure.
Three tools is ideal for this server's scope: discover an index, search across indexes, and fetch a page. Each tool earns its place and the set does not feel thin or bloated.
The domain is llms.txt-aware documentation retrieval, and the tools cover the full workflow: find the relevant index, search it for the right page, and retrieve that page as markdown. llms_page can also fetch any URL, including llms-full.txt, so there are no obvious dead ends.