3395f95680
robots from accessing parts of a web site. The parsed files are kept in a WWW::RobotRules object, and this object provides methods to check if access to a given URL is prohibited. WWW: http://search.cpan.org/dist/WWW-RobotRules/ This new port is needed to update www/p5-libwww.
7 lines
306 B
Text
7 lines
306 B
Text
%%SITE_PERL%%/WWW/RobotRules.pm
|
|
%%SITE_PERL%%/WWW/RobotRules/AnyDBM_File.pm
|
|
%%SITE_PERL%%/%%PERL_ARCH%%/auto/WWW/RobotRules/.packlist
|
|
@dirrmtry %%SITE_PERL%%/%%PERL_ARCH%%/auto/WWW/RobotRules
|
|
@dirrmtry %%SITE_PERL%%/%%PERL_ARCH%%/auto/WWW
|
|
@dirrmtry %%SITE_PERL%%/WWW/RobotRules
|
|
@dirrmtry %%SITE_PERL%%/WWW
|