1 commit

Author	SHA1	Message	Date
Cheng-Lung Sung	9ff45294c3	HTML::RobotsMETA is a simple HTML::Parser subclass ... that extracts robots exclusion information from meta tags. Author: Daisuke Maki <dmaki@cpan.org> WWW: http://search.cpan.org/~dmaki/HTML-RobotsMETA/ PR: ports/120117 Submitted by: Masahiro Teramoto <markun at onohara.to>	2008-01-30 06:27:21 +00:00