Log Message:
Update ruby-webrobots to 0.1.0.

* Change the :ignore_crawl_delay option to a handler option :crawl_delay.
* Merge back the previous change to the source file.
* Remove Gemfile.lock.
* Add the ability to externalize the enforcement of the robots.txt Craw
 jasonhowes authored a month ago.
* Migrate from jeweler to bundle gem.