dirbot. Scrapy project to scrape public web directories (educational)

github.com/chenyuntc/dirbot
by @chenyuntc

Problem

Audience

Keep exploring

Updates

No founder updates yet. Check back soon.