spidr version 0.1.6 has been released!

Spidr is a versatile Ruby web spidering library that can spider a site,
multiple domains, certain links or infinitely. Spidr is designed to be fast
and easy to use.

Changes:

### 0.1.6 / 2009-04-14

* Added Agent#failures, a list of URLs which could not be visited.
* Added Agent#failed?.
* Added Agent#every_failed_url.
* Added Agent#clear, which clears the history and failures URL lists.
* Improved fault tolerance in Agent#get_page.
* If a Network or HTTP error is encountered, the URL will be added to
the failures list and the next URL will be visited.
* Fixed a typo in Agent#ignore_exts_like.
* Updated the Web Spider Obstacle Course with links that always fail to be
visited.