Commit graph

3 commits

Author SHA1 Message Date
Trevor Johnson
3bca696b10 Add size data, approved by maintainers. 2004-03-18 18:01:13 +00:00
Steve Price
746c1a1bf0 Update to version 1.10.
PR:		12081
Submitted by:	maintainer
1999-06-08 22:22:17 +00:00
Bill Fumerola
641e13807e WebCrawl is a program designed to download an entire web-site without
user interaction (although an interactive mode is available). It works simply
by starting with a single web page, and following all links from that page
to attempt to recreate the directory structure on the remote server.

PR:		ports/9846
Submitted By:	Dima Sivachenko <dima@Chg.RU>
1999-02-03 21:26:59 +00:00