Log Message: py-robot-detection: add version 0.4 robot_detection is a python module to detect if a given HTTP User Agent is a web crawler. It uses the list of registered robots from http://www.robotstxt.org: (Robots Database)
Revision | Action | file |
1.1 | add | pkgsrc/www/py-robot-detection/DESCR |
1.1 | add | pkgsrc/www/py-robot-detection/Makefile |
1.1 | add | pkgsrc/www/py-robot-detection/PLIST |
1.1 | add | pkgsrc/www/py-robot-detection/distinfo |