AI Dev Tools

Spider

Open Source Updated 45d ago

Web crawler and scraper for Rust

go get github.com/spider-rs/spider

Did you build this?

Claim your listing to see exactly how many AI agents recommend this tool, your success rate, and more. Free, no commission, no fees.

Claim This Listing

Fast web crawler and scraper for Rust — concurrent, headless Chrome support, HTTP2, custom headers, streaming output.

Save tools & get AI recommendations

Free forever. No credit card required.

Sign Up Free
Visit Website → ☆ Bookmark

Listed for free · No commission · Claim this listing

13 developers visited via IndieStack this month
𝕏 Share
ai-agentautomationcrawlerheadless-chromeindexer
View on GitHub ★ 2,356Rust
Last commit 32d ago
Using this saves ~120k tokens vs building from scratch
Something wrong? Log in to report.
Get weekly indie picks straight to your inbox