freebsd-ports/www/p5-HTML-RobotsMETA/pkg-descr
Sunpoet Po-Chuan Hsieh ad4f267b7a Update WWW
search.cpan.org is shutting down.
It will redirect to metacpan.org after June 25, 2018.

With hat:	perl
2018-05-27 20:15:16 +00:00

4 lines
161 B
Text

HTML::RobotsMETA is a simple HTML::Parser subclass
that extracts robots exclusion information from meta tags.
WWW: https://metacpan.org/release/HTML-RobotsMETA