Rare find

RobotsDisallowed. A curated list of the most common and most interesting robots.txt disallowed directories.

github.com/danielmiessler/RobotsDisallowed
by @danielmiessler

Problem

Audience

Keep exploring

Updates

No founder updates yet. Check back soon.