⭐ Star AlbumentationsX on GitHub — 448+ stars and counting!

Star on GitHub
scrapy

dirbot

scrapy/dirbot

Scrapy project to scrape public web directories (educational) [DEPRECATED]

1,627stars
View on GitHub
Forks
1,045
Open issues
0
Watchers
1,627
Size
0.0 MB
Python
Created: Apr 28, 2011
Updated: May 20, 2026
Last push: Oct 27, 2017