web_fetch
Fetch web pages with browser-like headers to bypass bot protection, handling redirects and cookies. Extract text or raw HTML for content analysis.
Instructions
Fetch a URL with browser-like headers to bypass basic bot protection.
Returns page content as plain text (HTML tags stripped) or raw HTML. Handles redirects, cookies, and common anti-bot headers automatically.
Args: url: URL to fetch max_length: Max content length in chars (default 20000) extract_text: Strip HTML tags and return plain text (default true) timeout: Request timeout in seconds (default 30)
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | ||
| timeout | No | ||
| max_length | No | ||
| extract_text | No |