Tokenectomy 🕵️‍♂️ — Autonomous Context Surgery & Secret Shield for AI Agents (M2M MCP Server)

[]#(https://github.com/daffa2555/tokenectomy-bechmark-history)

👑 Looking for Auto-Fixer, AST Smart Healer, Anti-Halu, and Time Machine Undo? Get Tokenectomy Pro (Enterprise Edition) →

🔀 Pair with Tokenectomy Git (OSS) for autonomous Git PR creation!

📊 Full Historical Telemetry Receipts (25K ➔ 1M Lines): Check out the transparent Tokenectomy Benchmark History repository.

Tokenectomy is an agent-native Machine-to-Machine (M2M) MCP server built with Rust. Designed specifically as a background sidecar for autonomous coding agents (Claude Desktop, Cursor, Cline, Roo Code, Windsurf, Google Antigravity), it acts as an autonomous sub-cortex: surgically scrubbing 90%+ of internal framework noise (node_modules, site-packages, .cargo/registry) from error logs, auto-redacting sensitive credentials before cloud transmission, and enforcing AST syntax safety—with zero human babysitting.

                     ┌──────────────────┐
   Agent Error Dump  │   TOKENECTOMY    │      Clean Agent Context
   (38K tokens) ───► │   🕵️‍♂️ OSS (M2M)  │ ───►  (2K tokens)  ───► LLM Brain
                     │                  │
   node_modules/     │  🔍 Smart Filter │      Only YOUR code
   site-packages/    │  🛡️ Redact       │      + error message
   .cargo/registry/  │  💾 Cache        │      + StackOverflow refs
                     └──────────────────┘

✨ Key Features

• 🔍 Smart Framework Filter — Strips thousands of lines of noisy internal stack frames (node_modules, site-packages, .cargo/registry, __pycache__) and keeps only the code you wrote.

• 🌐 Stack Overflow Search — Silently queries StackExchange APIs and injects top community solutions into the AI's context.

• ⚡ SHA-256 Response Cache — Identical errors hit local cache (24h TTL). Recurring CI/CD failures cost $0.00 in API calls.

• 🛡️ Secret Redaction — Regex engine strips API keys, AWS secrets, JWTs, and database connection strings before any data leaves your machine (ReDoS-safe, linear-time).

• 🔒 Anti-Hardcode Secret Shield — Automatically detects and blocks AI patches that attempt to hardcode raw API keys, passwords, or credentials into your source code.

• 📐 AST Syntax Validation — In-memory Tree-sitter AST parser ensures AI patches never write broken syntax to your repository.

• 🔒 Path Traversal Protection — MCP file operations are canonicalized and locked to your current working directory.

• 🤖 MCP Server Mode — Full JSON-RPC 2.0 over stdio. Works with Claude Desktop, Cursor, VS Code, Google Antigravity, and any MCP-compatible client.

• 🔌 Multi-Provider — Supports OpenAI, Anthropic, and Ollama (100% offline mode).

Related MCP server: ProjectBrain

📊 Verifiable Real-World Performance & Benchmark (OSS vs Pro)

No buzzwords or artificial benchmarks. Every developer can verify the core functions on their own machine:

🔍 100% Transparent Benchmark History & Industry Standards (ISO/IEC 25010 & OWASP):
We track our complete scaling timeline (from 25K to 1 Million lines) and hardware telemetry logs in the tokenectomy-bechmark-history repository.

🆓 Tokenectomy OSS (Community Edition) — Verifiable Heavy Stress Benchmark

You don't need to buy anything to test this. Clone this repository right now and verify these heavy load benchmarks directly on your hardware:

💡 "Skeptical about these numbers? Don't take our word for it."
We hate marketing fluff and sweet talk as much as you do. You don't need to take our word for it or pay a single cent. Clone this repository, run the benchmark on your own machine, watch your CPU blaze through 250,000 lines of logs in a third of a second, and verify the exact telemetry in your own terminal:

cargo test --release --test stress_benchmark -- --nocapture

👑 Tokenectomy Pro — Industrial-Grade Heavy Production Torture Benchmark

To prove stability under enterprise workloads, we hammered Tokenectomy Pro with sustained multi-million token traffic, a 10MB Kubernetes crash avalanche, and 250 parallel OS threads on a 12-Core Intel i5-1235U with Arch Linux:

💡 "Skeptical about these enterprise numbers? Don't take our word for it."
Every purchaser of Tokenectomy Pro receives the full, standalone benchmark and torture test suite (tests/heavy_production_torture.rs) bundled in the package. You can run cargo test --release --test heavy_production_torture -- --nocapture on your own infrastructure to verify every metric before deployment.

👉 Get Tokenectomy Pro on Gumroad ($9) → (Native binaries for Linux, macOS Apple Silicon, and Windows).

📦 Installation

⚡ Install via Cargo (crates.io)

cargo install tokenectomy

🦀 Build from Source

git clone https://github.com/daffa2555/Tokenectomy.git
cd Tokenectomy
cargo build --release
sudo cp target/release/tokenectomy /usr/local/bin/tkmy

⚙️ Install via Smithery (for Claude Desktop)

npx -y @smithery/cli install tokenectomy --client claude

🔌 M2M Agent Setup (1-Minute Integration)

Tokenectomy is architected to run silently between your AI Coding Agent and your repository over JSON-RPC 2.0 stdio. You configure it once, and your agent autonomously invokes Tokenectomy in the background during debugging and refactoring loops—no manual copy-pasting or piping required.

tkmy --mcp

Claude Desktop

Add to ~/Library/Application Support/Claude/claude_desktop_config.json:

{
  "mcpServers": {
    "tokenectomy": {
      "command": "tkmy",
      "args": ["--mcp"]
    }
  }
}

Cursor

Add to .cursor/mcp.json in your project root:

{
  "mcpServers": {
    "tokenectomy": {
      "command": "tkmy",
      "args": ["--mcp"]
    }
  }
}

Cline / Roo Code / Windsurf / VS Code

Add to your MCP settings (settings.json or cline_mcp_settings.json):

{
  "mcpServers": {
    "tokenectomy": {
      "command": "tkmy",
      "args": ["--mcp"]
    }
  }
}

Google Antigravity CLI

agy mcp add tokenectomy -- tkmy --mcp

🤖 Available M2M MCP Tools

🔀 Companion MCP Server: Tokenectomy Git

Close the autonomous loop from error diagnosis all the way to a published GitHub Pull Request! Pair Tokenectomy with our official companion MCP server: Tokenectomy Git.

{
  "mcpServers": {
    "tokenectomy": {
      "command": "tkmy",
      "args": ["--mcp"]
    },
    "tokenectomy-git": {
      "command": "tkmy-git",
      "args": ["--mcp"]
    }
  }
}

Together, they enable your AI coding assistant to:

1. Scrub noisy error logs & redact credentials (tokenectomy)

2. Generate an accurate fix patch

3. Create a branch, commit files, and open a GitHub PR autonomously (tokenectomy-git)

🛠️ Standalone / Local CLI Mode (Optional)

While Tokenectomy is architected for autonomous machine-to-machine agent operation, it also provides a standalone CLI binary if you want to pipe logs in CI/CD pipelines, local shell scripts, or manual debugging:

Pipe errors directly

python3 app.py 2>&1 | tkmy
cargo build 2>&1 | tkmy
node server.js 2>&1 | tkmy

Read from a log file

tkmy --file /var/log/app/error.log

Advanced options

tkmy --local-only            # 100% offline via Ollama ($0 cost)
tkmy --provider openai       # Use OpenAI GPT-4o
tkmy --provider anthropic    # Use Claude 3.5 Sonnet
tkmy --context-lines 20      # Extract 20 lines of surrounding context
tkmy --yes                   # Skip interactive prompts (CI/CD mode)

🧠 Configuration

Create ~/.tokenectomy.toml:

default_provider = "openai"  # openai | anthropic | ollama | mock
openai_api_key = "sk-..."
anthropic_api_key = "sk-ant-..."
ollama_base_url = "http://localhost:11434"
context_lines = 10
max_context_chars = 10000

🔒 Security

• No secrets leave your machine. Regex engine redacts API keys, JWTs, AWS credentials, and database URLs before any data is sent to an LLM.

• No path traversal. MCP file operations are canonicalized and locked to CWD.

• No stdin bombs. Input is capped at 10MB (CLI) / 50MB (MCP) via .take().

• No weak hashing. Cache uses sha2::Sha256, never DefaultHasher.

🏗️ Architecture

src/
├── main.rs          # Entry point, CLI args, REPL, pipeline orchestration
├── mcp.rs           # JSON-RPC 2.0 over stdio MCP server
├── extractor/       # Language-specific context extraction (Rust, Python, JS)
├── provider/        # AI backends (OpenAI, Anthropic, Ollama, Mock)
├── redact.rs        # Secret redaction (linear-time regex, ReDoS-safe)
├── cache.rs         # SHA-256 response cache (24h TTL, 0700 perms)
├── search.rs        # Stack Overflow API integration
└── git.rs           # Recent git diff extraction

🧠 Bundled Open Source Agent Skills

Tokenectomy OSS includes 2 native Antigravity & Coding Agent Skills in .agents/skills/ to elevate your AI assistant's engineering discipline:

🆓 vs 👑 — OSS vs Pro

👉 Get Tokenectomy Pro →

📜 License

MIT — see LICENSE for details.

Built with 🦀 Rust for maximum performance, strict memory safety, and uncompromising security.