kpriv/freebsd-ports
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity
freebsd-ports/www/rubygem-robotex/pkg-descr

4 lines
85 B
Text
Raw Normal View History

A simple library to obey robots.txt files WWW: http://rubygems.org/gems/robotex
2012-06-05 21:40:44 +02:00
A simple library to obey robots.txt files
- Add LICENSE - Update WWW
2015-05-23 17:38:19 +02:00
WWW: https://github.com/chriskite/robotex
Reference in a new issue Copy permalink