2013-03-14 17:27:28 by Takahiro Kambe | Files touched by this commit (3) |
Log message:
Update ruby-webrobots to 0.1.0.
* Change the :ignore_crawl_delay option to a handler option :crawl_delay.
* Merge back the previous change to the source file.
* Remove Gemfile.lock.
* Add the ability to externalize the enforcement of the robots.txt Craw
jasonhowes authored a month ago.
* Migrate from jeweler to bundle gem.
|
2012-03-18 06:14:07 by Takahiro Kambe | Files touched by this commit (2) |
Log message:
Update ruby-webrobots to 0.0.13.
Exact changes are unknown.
|
2011-12-16 14:42:20 by Takahiro Kambe | Files touched by this commit (2) |
Log message:
Update www/ruby-webrobots package to 0.0.12.
Simply repackaged, no change.
|
2011-08-12 19:30:51 by Takahiro Kambe | Files touched by this commit (4) | |
Log message:
Imporging www/ruby-webrobots package version 0.0.11.
This library helps write robots.txt compliant web robots in Ruby.
|