grab-site. The archivist's web crawler: WARC output, dashboard for all crawls, dynamic ignore patterns

github.com/rebane2001/grab-site

Problem

Audience

Updates

No founder updates yet. Check back soon.