PR: ports/122674 Submitted by: Philip M. Gollucci <pgollucci@p6m7g8.com> Reworked by: araujo (myself) Approved by: portmgr (pav)
that extracts robots exclusion information from meta tags. Author: Daisuke Maki <dmaki@cpan.org> WWW: http://search.cpan.org/~dmaki/HTML-RobotsMETA/ PR: ports/120117 Submitted by: Masahiro Teramoto <markun at onohara.to>