markd 9381cc3bb0 py-robot-detection: add version 0.4 ... robot_detection is a python module to detect if a given HTTP User Agent is a web crawler. It uses the list of registered robots from http://www.robotstxt.org: (Robots Database)		2023-05-10 21:59:57 +00:00
..
DESCR
distinfo
Makefile
PLIST