3 lines
81 B
Text
3 lines
81 B
Text
A simple library to obey robots.txt files
|
|
|
|
WWW: http://rubygems.org/gems/robotex
|