grab-site

grab-site

https://github.com/ArchiveTeam/grab-site

Python1233

3 months ago

Reviews

The archivist's web crawler: WARC output, dashboard for all crawls, dynamic ignore patterns

Search similar apps

License

Other

Share

The archivist's web crawler: WARC output, dashboard for all crawls, dynamic ignore patterns

Creator

ArchiveTeam

Related apps

wpull

Wget-compatible web downloader and crawler.

HTML523gpl-3.0

6 months ago