Anakin

Anakin is a web scraping API for developers feeding website content into AI agents, RAG pipelines, or data extraction workflows. You can run its scraping engine on your own server or use the hosted service.

• Content extraction: Convert pages into Markdown with boilerplate removed, or extract structured JSON through Gemini with your own API key when self-hosting.
• JavaScript rendering: The Camoufox anti-detect browser handles JavaScript-heavy pages, including content that loads after the initial page request.
• Scraping fallbacks: Try local fetching and browser rendering before optionally sending a failed request to anakin.io or another external scraping service.
• Jobs and monitoring: Run synchronous, asynchronous, or batch scrapes, and use the web dashboard to inspect job history, manage domain settings, and monitor proxy performance.
• Hosted web tools: The cloud service adds web search, research with citations, scheduled change monitoring, and Wire actions for sites such as Reddit, Amazon, and LinkedIn. Its MCP integration connects these tools to Claude Code and Cursor.

The self-hosted engine is open source under AGPL-3.0 and runs as a Go binary or through Docker. Basic scraping needs no API key or cloud service, though fetching live websites requires internet access. You supply proxies for self-hosted proxy selection. Gemini extraction sends page content to an external AI provider, and optional API fallbacks send scraping requests to the chosen provider. The hosted service supplies managed proxy infrastructure and persistent browser sessions for pages behind logins.