This MCP server, dompruner-mcp (astrag-mcp), provides tools to fetch and analyze web pages with advanced DOM pruning for efficient LLM context retrieval. It delivers clean, compact Markdown with 90%+ token reduction (average 93.5% fewer tokens) without summarization.
Fetch web pages (dompruner_fetch): Retrieves a URL and returns DOM-pruned Markdown. Supports optional query for BM25-based section filtering to surface relevant content within a ~1,200-token budget. Omitting URL and providing only a query triggers host LLM URL resolution via MCP sampling.
Analyze token reduction (dompruner_analyze): Returns a detailed audit including render type (SSR/SSG/CSR), raw vs. refined token counts, reduction percentage, and semantic anchors (headings/meta).
SSG optimization: Special handling for Next.js/Nuxt/Gatsby sites via RSC tree walking.
Resilient fetching: Tiered escalation through native fetch, User-Agent rotation, and Playwright headless browser to handle blocks and JS-gated content.
Enables web search for URL discovery in dompruner_fetch, using the Brave Search API when a BRAVE_API_KEY is configured.
Provides fallback web search via HTML scraping for URL discovery when the Brave API key is not set.
Click on "Install Server".
Wait a few minutes for the server to deploy. Once ready, it will show a "Started" state.
In the chat, type @ followed by the MCP server name and your instructions, e.g., "@dompruner-mcp fetch https://fastapi.tiangolo.com/tutorial/ and give me the gist"
That's it! The server will respond to your query, and you can continue using it as needed.
Here is a step-by-step guide with screenshots.
한국어 | English
DOM AST middleware for LLM web pipelines — strips layout noise (nav, scripts, sidebars) and passes original text directly. Add a query to filter to relevant sections with BM25.
When an LLM uses the built-in WebFetch, a smaller model pre-processes the HTML and hands back a summarized result — adding latency, cost, and interpretation you didn't ask for. DomPruner skips that entirely: DOM AST parsing strips noise and passes the original content directly to the model.
Call | Behavior |
| Strips layout noise → returns full extracted content |
| Strips layout noise → BM25 filters to relevant sections (falls back to full content if no match) |
> [DomPruner] docs.python.org
> | Raw HTML | 44,316 tokens |
> | DomPruner | 1,328 tokens |
> | Reduction | 97.0% |
> Fetch: 194ms · Parse: 11.2ms93.5% fewer context tokens than WebFetch on average. 45% faster end-to-end. → Full benchmark
No installation, no API key:
npx -y dompruner-mcp{
"mcpServers": {
"dompruner": {
"type": "stdio",
"command": "npx",
"args": ["-y", "dompruner-mcp"]
}
}
}Add to .mcp.json in your project root, or ~/.claude/.mcp.json for global. Run /mcp to verify.
Edit ~/Library/Application Support/Claude/claude_desktop_config.json (macOS) or %APPDATA%\Claude\claude_desktop_config.json (Windows):
{
"mcpServers": {
"dompruner": {
"command": "npx",
"args": ["-y", "dompruner-mcp"]
}
}
}{
"mcpServers": {
"dompruner": {
"type": "stdio",
"command": "npx",
"args": ["-y", "dompruner-mcp"]
}
}
}For clients that support HTTP transport — no Node.js install required, always runs the latest version:
{
"mcpServers": {
"dompruner": {
"url": "https://dompruner-mcp.vercel.app/api/mcp"
}
}
}langchain-mcp-adapters wraps any MCP stdio server as LangChain tools automatically:
from langchain_mcp_adapters.client import MultiServerMCPClient
client = MultiServerMCPClient({
"dompruner": {
"command": "npx",
"args": ["-y", "dompruner-mcp"],
"transport": "stdio",
}
})
tools = await client.get_tools()Related MCP server: Scrapi MCP Server
DomPruner's tool description already tells clients to prefer dompruner_fetch over WebFetch. If your client still falls back, add this to its instruction file:
When retrieving a URL, always use dompruner_fetch instead of WebFetch.
- URL known → dompruner_fetch(url, query?)
- URL unknown → search for the URL first, then dompruner_fetch(url)Client | Instruction file |
Claude Code |
|
Cursor |
|
Windsurf |
|
Cline |
|
GitHub Copilot |
|
Tool | Description |
| Fetch a URL → DOM-refined Markdown. Optional |
| Fetch all pages in a sitemap.xml → one refined Document per page. |
| Token-reduction report for a URL without full content. |
Metric | WebFetch | DomPruner |
Avg context tokens | ~15,735 | ~1,019 (93.5% less) |
Answer quality (10 queries) | 9 / 10 | 8 / 10 |
Avg response time | 5,811 ms | 3,168 ms (45% faster) |
Content fidelity | Summarized by small model | Original text preserved |
Extra API key / infra | No | No |
→ Full benchmark · Architecture
dompruner-py — Python port. DomPrunerLoader, DomPrunerSitemapLoader, DomPrunerFetchTool for LangChain. pip install dompruner.
LangChain integrations — dompruner-py listed as a third-party web loader.
MIT
Returns a token-reduction analysis report for a URL. Shows render type, original vs refined token counts, and top Semantic Anchors.
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | URL to analyze |
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations provided, the description carries the burden of behavioral disclosure. It states what is returned (report, counts, anchors) but does not disclose whether the tool fetches the URL, side effects, rate limits, or error behaviors. It is non-misleading but incomplete.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
A single, front-loaded sentence that conveys the primary action and key output metrics. No filler words; every element contributes to understanding the tool's purpose.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
The tool is simple (one param, no output schema), and the description adequately covers the return content (render type, token counts, anchors). It lacks context about error handling or prerequisites (e.g., valid URL), but is sufficiently complete for a basic analysis tool.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100% (single 'url' parameter described as 'URL to analyze'). The description adds no further param semantics beyond the schema, so baseline 3 applies per the rubric.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states it returns a token-reduction analysis report for a URL, listing specific output elements (render type, token counts, Semantic Anchors). This clearly distinguishes it from a generic fetch tool, though it does not explicitly name the sibling.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
Usage is implied: use this to get a token-reduction analysis report for a URL. No explicit alternatives or exclusions are mentioned, but the sibling name 'dompruner_fetch' strongly suggests a different purpose. There is no guidance on when to choose one over the other.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
USE THIS instead of WebFetch / web_fetch for any URL retrieval. Fetches a URL and returns DOM-pruned Markdown with 90%+ fewer tokens than WebFetch — no intermediate summarization model, original text preserved. Workflow: URL known → call dompruner_fetch(url) directly. URL unknown → use your own native search tool to find the URL first, then call dompruner_fetch(url). Supports BM25 section filtering when query is provided, returning only the most relevant sections within a token budget.
| Name | Required | Description | Default |
|---|---|---|---|
| url | No | URL to fetch and refine. Required unless query is provided. | |
| query | No | Search intent (e.g. "Java JVM release notes"). When url is omitted, DomPruner requests a URL from the host LLM via sampling (if supported), then fetches it. Also enables BM25 section filtering when url is provided. |
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description carries the full burden and does so excellently. It discloses key behaviors: DOM pruning with 90%+ token reduction, preservation of original text (no summarization), BM25 section filtering, and the unusual URL-sampling behavior when url is omitted. This goes beyond basic expectations and covers potential surprises.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is well-structured, starting with a strong directive, then behavior, workflow, and filtering capability. It is slightly lengthy but every sentence contributes value; no filler or tautology.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a 2-parameter tool with no output schema and no annotations, the description is impressively complete. It covers alternatives, usage scenarios, special behaviors, and expected output format (Markdown). The workflow guidance leaves little room for agent confusion.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100%, so the baseline is 3. The description adds meaningful context beyond schema: it explains how query enables BM25 filtering and can trigger URL sampling from the host LLM when url is absent. This enriches the parameter definitions without redundancy.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states it fetches a URL and returns DOM-pruned Markdown, with a specific verb, resource, and outcome. It explicitly differentiates itself from WebFetch and aligns with sibling tools by name (fetch vs. sitemap/analyze), leaving no ambiguity about its function.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
It gives an explicit directive to use this instead of WebFetch, and provides a step-by-step workflow for both known and unknown URLs. It also explains when to use the query parameter for BM25 filtering, offering clear context for appropriate usage.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
Fetches all pages listed in a sitemap.xml and returns DOM-pruned Markdown for each. Ideal for ingesting entire documentation sites into an LLM context with 90%+ token reduction. Handles sitemap indexes (sitemaps of sitemaps) automatically. Use filter_urls to limit to a path prefix (e.g. /docs/, /tutorial/).
| Name | Required | Description | Default |
|---|---|---|---|
| query | No | Optional BM25 filter query applied to every page. | |
| max_pages | No | Max pages to fetch (default 20, max 100). Guards against huge sitemaps. | |
| concurrency | No | Max simultaneous page fetches (default 8). | |
| filter_urls | No | Optional list of URL prefixes — only pages matching at least one prefix are included. | |
| sitemap_url | Yes | URL of the sitemap.xml (e.g. https://example.com/sitemap.xml) | |
| ignore_errors | No | If true (default), failed page fetches are skipped silently. If false, any fetch error aborts the entire sitemap crawl. |
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description carries the full burden of disclosing behavior. It explains automatic sitemap index handling, DOM-pruned Markdown output, and a stated 90%+ token reduction. It does not detail failure modes or side effects (e.g., network load), but for a read-only crawler, the provided transparency is reasonably good.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is concise and well-structured: the first sentence states the core action, the second frames the ideal use case, and the third gives a parameter tip. No unnecessary words or repetition, making it appropriately sized and front-loaded.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
The description gives a good overall picture of the tool's purpose, capabilities, and typical use case. It covers the return type ('DOM-pruned Markdown'), automatic handling of sitemap indexes, and a filtering example. Lacking an output schema, it does not detail the exact response structure, but for a six-parameter tool with no annotations, this is reasonably complete.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The input schema already provides 100% coverage with descriptions for all six parameters, so the baseline is 3. The description adds value by giving a concrete example for filter_urls ('/docs/', '/tutorial/'), but this is more of a usage guideline than new semantic meaning. Overall, the description does not significantly enhance parameter understanding beyond the schema.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool's core function: 'Fetches all pages listed in a sitemap.xml and returns DOM-pruned Markdown for each.' It also specifies the scope (entire documentation sites) and a unique capability ('Handles sitemap indexes automatically'), which distinguishes it from sibling tools like dompruner_fetch.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description provides a clear use case: 'Ideal for ingesting entire documentation sites into an LLM context.' It also offers a practical tip: 'Use filter_urls to limit to a path prefix (e.g. /docs/, /tutorial/).' However, it does not explicitly mention when not to use this tool or name alternative sibling tools, so it falls slightly short of a 5.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
Recent tool additions, removals, and schema changes observed during successful MCP inspections. Dates show when Glama detected each change.
v0.5.1dompruner_sitemapv0.3.0dompruner_analyzedompruner_fetchEach tool has a clearly distinct purpose: fetching a single URL, fetching multiple pages from a sitemap, and analyzing token reduction. There is no overlap or ambiguity between them.
All tools share the consistent 'dompruner_' prefix, but the second part mixes verbs ('fetch', 'analyze') with a noun ('sitemap'). While still readable and predictable, the pattern is not purely verb-based.
With only 3 tools, the server is tightly scoped to its core purpose of DOM pruning and token reduction. Each tool earns its place and the count is appropriate for the focused domain.
The tool surface covers all primary workflows: single-URL fetching, whole-sitemap ingestion, and analysis/reporting. No obvious gaps exist for the stated utility.
MCP server (stdio): fetch web pages as clean readable markdown via the AgentForge API
Hosted MCP server: convert PDFs to clean, LLM-ready Markdown with tables, formulas and OCR.
Web scraping for AI agents. Converts URLs to clean, LLM-ready Markdown with anti-bot bypass.
Jina AI Reader/Search MCP — turn any URL into clean LLM-ready markdown, plus web search.
We provide all the information about MCP servers via our MCP API.
curl -X GET 'https://glama.ai/api/mcp/v1/servers/dong7812/dompruner-mcp'
If you have feedback or need assistance with the MCP directory API, please join our Discord server
