Skip to main content
Glama
523,718 tools. Updated 2026-09-06 13:58

"Web crawler for sequential URL content retrieval" matching MCP tools:

Matching MCP Servers

Matching MCP Connectors

  • URL parsing & building MCP.

  • Web search, URL content extraction to Markdown, site mapping, and recursive web crawler.

  • Scrape a web URL and split its content into structured chunks for RAG pipelines. Ideal for summarizing or processing page content without field extraction.
    MIT
  • Retrieve readable content from any web page by submitting its URL. Returns the page title, main content, and a list of links for further exploration.
    MIT
  • Capture evidence of a URL hosting stolen or impersonating content. Creates an independent archive snapshot with retrieval timestamp, SHA-256 hash, and PDQ perceptual fingerprint. Run before content is removed.
    Apache 2.0
  • Initiates a structured web crawl from a specified URL, following internal links to explore site content with configurable depth, breadth, and filtering options for targeted data extraction.
    MIT
  • Starts a structured web crawl from a given URL, following internal links to discover and extract content. Control crawl depth, breadth, and focus on specific site sections.
    MIT
  • Fetch a web page URL and extract its readable content using Mozilla Readability. Control the maximum characters returned.
    MIT
  • Fetch text content from any URL, including web pages and APIs, and receive up to 100KB of response data for analysis or reading.
    MIT
  • Initiate a crawler scan on a target URL to map web application structure and identify accessible pages for security assessment.
    MIT
  • Extract full text content, metadata, and structured information from specific web URLs for detailed content analysis and data retrieval.
    MIT
  • Extract and convert web page content from any URL into readable markdown format for analysis and information retrieval.
    MIT