AI Dev Tools

Crawl4AI

Open Source Updated 31d ago

Fast, AI-ready web crawler that generates clean markdown for RAG pipelines. Features adaptive crawling, structured extraction, and advanced browser control.

npm install crawl4ai

Did you build this?

Claim your listing to see exactly how many AI agents recommend this tool, your success rate, and more. Free, no commission, no fees.

Claim This Listing

Open-source web crawler optimized for LLM data extraction — structured scraping for AI training datasets.

Save tools & get AI recommendations

Free forever. No credit card required.

Sign Up Free
Visit Website → ☆ Bookmark

Listed for free · No commission · Claim this listing

10 developers visited via IndieStack this month
𝕏 Share
aicrawlingscrapingllmragopen-source
View on GitHub
Using this saves ~120k tokens vs building from scratch
Something wrong? Log in to report.
Get weekly indie picks straight to your inbox