Skip to main content
Glama
RistrixOP

freecrawl

by RistrixOP
OverviewSchemaRelated ServersScoreDiscussions
Python
Hybrid

🔥 Freecrawl

Open-source web scraping API with anti-bot bypass. Drop-in Firecrawl alternative. AI-first: MCP server, OpenAI tool definitions, REST API — any AI model can use it. No API keys, no credits, no limits.

Quick Start

pip install -r requirements.txt
patchright install chromium
python -m freecrawl serve  # REST API on :9100

Related MCP server: scraperapi-mcp-server

AI Integration

MCP Server (Claude, Cursor, any MCP client)

{"mcpServers":{"freecrawl":{"command":"python","args":["-m","freecrawl.mcp_server"]}}}

OpenAI Tool Definitions

from freecrawl.ai_tools import get_tools
tools = get_tools()  # 9 tool definitions, pass to any LLM

REST API

curl -X POST http://localhost:9100/v1/scrape \
  -H "Content-Type: application/json" \
  -d '{"url":"https://example.com","formats":["markdown"]}'

Features

Feature

Status

Scrape (URL→Markdown/HTML/text)

✅

Anti-bot bypass (Cloudflare, DataDome)

✅

Auto-escalation engine chain

✅

Crawl (BFS + sitemap)

✅

Search (DuckDuckGo/SearXNG)

✅

Map (fast URL discovery)

✅

Batch scrape (parallel)

✅

LLM extraction (structured JSON)

✅

Change tracking (diff)

✅

PDF parsing

✅

CSS extraction

✅

Screenshots

✅

JS actions (click/scroll/type)

✅

Product/Menu/Branding extractors

✅

Summary (LLM)

✅

Proxy rotation

✅

MCP server

✅

OpenAI tool definitions

✅

Docker deployment

✅

CLI tool

✅

Architecture

Engine Chain (auto-escalation):
  httpx (fast) → flaresolverr (Cloudflare) → patchright (DataDome/Akamai)

License

MIT

Tool Schema Changelog

Recent tool additions, removals, and schema changes observed during successful MCP inspections. Dates show when Glama detected each change.

No tool schema history has been recorded yet.

This server cannot be installed

RayrunBuild, deploy, and operate MCP servers without becoming an infrastructure team.ray.runAd

Maintenance

ActivitySlowing
ResponsivenessNo issues

Resources

Unclaimed servers have limited discoverability.

Looking for Admin?

If you are the server author, to access and configure the admin panel.

Related MCP Connectors

Related MCP Servers

  • ISIS MCP

    alucardeht
    A
    license
    B
    quality
    D
    maintenance
    A local web scraping MCP server with RAG capabilities that provides intelligent web search, content extraction, and screenshot tools without requiring API keys.
    4
    16
    MIT
  • scraperapi-mcp-server by scraperapi

    scraperapi-mcp-serverofficial

    scraperapi
    A
    license
    A
    quality
    B
    maintenance
    A local MCP server that lets AI agents bypass bot detection, geo-restrictions, and JavaScript rendering challenges when scraping the web, backed by ScraperAPI's services
    28
    5
    MIT

  • crawl4ai-mcp-server

    amienbou121
    -
    license
    Not graded
    quality
    C
    maintenance
    Self-hosted MCP server that provides web scraping and crawling tools, integrating seamlessly with AI frameworks like OpenAI Agents SDK, Cursor, and Claude Code.
    4
    -

  • better-fetch

    dhruvparmar372
    A
    license
    Not graded
    quality
    D
    maintenance
    An MCP server that gives AI tools a reliable way to fetch content from the web, handling anti-bot protection and JavaScript-rendered pages.
    885
    MIT

Appeared in Searches

Latest Blog Posts

MCP directory API

We provide all the information about MCP servers via our MCP API.

curl -X GET 'https://glama.ai/api/mcp/v1/servers/RistrixOP/freecrawl'

If you have feedback or need assistance with the MCP directory API, please join our Discord server