robotstxt

A native Rust port of Google's robots.txt parser and matcher C++ library.

License

Apache License 2.0

A native Rust port of Google's robots.txt parser and matcher C++ library.

Creator

Folyd

Related apps