kpriv/freebsd-ports
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity
freebsd-ports/www/rubygem-robotex/pkg-descr

4 lines
81 B
Text
Raw Normal View History

A simple library to obey robots.txt files WWW: http://rubygems.org/gems/robotex
2012-06-05 21:40:44 +02:00
A simple library to obey robots.txt files
- Use single space after WWW:
2013-08-29 06:10:37 +02:00
WWW: http://rubygems.org/gems/robotex
Reference in a new issue Copy permalink