grab-site

grab-site

https://github.com/ArchiveTeam/grab-site

Python1322

5 months ago

Reviews

The archivist's web crawler: WARC output, dashboard for all crawls, dynamic ignore patterns

Search similar apps

License

Other

Share

The archivist's web crawler: WARC output, dashboard for all crawls, dynamic ignore patterns

Creator

ArchiveTeam

Related apps

wpull

Wget-compatible web downloader and crawler.

HTML557gpl-3.0

7 months ago