989772c9ac
had both lines: Author: ... WWW: .... So standardize on that, and move them to the end of the file when necessary. Also fix some more whitespace, and remove more "signature tags" of varying forms, like -- name, etc. s/AUTHOR/Author/ A few other various formatting issues
4 lines
292 B
Text
4 lines
292 B
Text
WebCrawl is a program designed to download an entire web-site without
|
|
user interaction (although an interactive mode is available). It works simply
|
|
by starting with a single web page, and following all links from that page
|
|
to attempt to recreate the directory structure on the remote server.
|