anakin-inc/anakin

README EXCERPT

AnakinScraper OSS The open-source web scraping API for AI. Turn any website into LLM-ready markdown or structured data. Self-host with a single command. No cloud dependencies. Powers RAG pipelines, AI agents, and data extraction at scale. Why AnakinScraper? AnakinScraper Firecrawl Crawlee Scrapy --- --- --- --- --- Anti-detect browser Camoufox (Firefox) Headless Chrome Playwright No Smart proxy selection Thompson Sampling (ML) Round-robin Manual Manual Zero-config start go run — no DB needed Docker required npm install pip install Single binary Go — one 30MB binary Node.js Node.js Python Handler chain fallback HTTP → Browser → API Single mode Single mode Single mode Structured JSON (AI) Gemini extraction LLM extraction No No Features - Handler chain with fallback — HTTP fetch → anti-detect browser → external API. Each handler tries in order; if one fails, the next picks up automatically. Most pages resolve on the free local HTTP handler — paid APIs are only called for the ~5% that actually need them. Docs → - Custom API handlers — plug in any third-party scraping service as a chain fallback. Only invoked when local handlers fail — saves 90%+ on API costs vs routing everything throu…

The opening of the GitHub README as stored, at most 1,200 characters. Markdown is not rendered.