From: Sergey Matveev Date: Tue, 12 Jul 2022 08:45:49 +0000 (+0300) Subject: Mention crawl website crawler X-Git-Tag: v0.1.0~24 X-Git-Url: http://www.git.stargrave.org/?a=commitdiff_plain;h=ddeb8b0fdb92c88aa5860f27627d90e3198d5fd1;p=tofuproxy.git Mention crawl website crawler --- diff --git a/doc/warcs.texi b/doc/warcs.texi index a3bfbce..681354e 100644 --- a/doc/warcs.texi +++ b/doc/warcs.texi @@ -112,3 +112,6 @@ $ wget ... [--page-requisites] [--recursive] \ --no-warc-keep-log --no-warc-digests [--warc-max-size=XXX] \ --warc-file smth.warc ... @end example + +Or even more simpler @url{https://git.jordan.im/crawl/tree/README.md, crawl} +utility written on Go too.