Rare find

robotstester. This Python script can enumerate all URLs present in robots.txt files, and test whether they can be accessed or not.

github.com/p0dalirius/robotstester
by @p0dalirius

Problem

Audience

Keep exploring

Updates

No founder updates yet. Check back soon.