kpriv/freebsd-ports
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity
freebsd-ports/www/p5-WWW-RobotRules/distinfo

3 lines
144 B
Text
Raw Normal View History

WWW::RobotRules parses /robots.txt files which are used to forbid conforming robots from accessing parts of a web site. The parsed files are kept in a WWW::RobotRules object, and this object provides methods to check if access to a given URL is prohibited. WWW: http://search.cpan.org/dist/WWW-RobotRules/ This new port is needed to update www/p5-libwww.
2011-04-14 15:18:39 +02:00
SHA256 (WWW-RobotRules-6.01.tar.gz) = f817e3e982c9d869c7796bcb5737c3422c2272355424acd162d0f3b132bec9d3
SIZE (WWW-RobotRules-6.01.tar.gz) = 9047
Reference in a new issue Copy permalink