Developer Tools

Spidr

Open Source Updated 45d ago

A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or in

go get github.com/postmodern/spidr

Did you build this?

Claim your listing to see exactly how many AI agents recommend this tool, your success rate, and more. Free, no commission, no fees.

Claim This Listing

A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.

Save tools & get AI recommendations

Free forever. No credit card required.

Sign Up Free
Visit Website → ☆ Bookmark

Listed for free · No commission · Claim this listing

9 developers visited via IndieStack this month
𝕏 Share
crawlerrubyscraperspiderspider-links
View on GitHub ★ 834Ruby
Last commit 105d ago16 open issues
Using this saves ~50k tokens vs building from scratch
Something wrong? Log in to report.
Get weekly indie picks straight to your inbox