⭐ Star AlbumentationsX on GitHub — 307+ stars and counting!

Star on GitHub
scrapy

dirbot

scrapy/dirbot

Scrapy project to scrape public web directories (educational) [DEPRECATED]

1,626stars
View on GitHub
Forks
1,049
Open issues
0
Watchers
1,626
Size
0.0 MB
Python
Created: Apr 28, 2011
Updated: Apr 10, 2026
Last push: Oct 27, 2017