Star AlbumentationsX on GitHub — it powers this leaderboard

← Back to leaderboard

scrapy

dirbot

scrapy/dirbot

Scrapy project to scrape public web directories (educational) [DEPRECATED]

1,630stars

Forks

1,054

Open issues

0

Watchers

1,630

Size

0.0 MB

Python

Created: Apr 28, 2011

Updated: Jan 29, 2026

Last push: Oct 27, 2017