Files | Admin

Notes:

Release Name: 0.1.9

Notes:
Spidr is a versatile Ruby web spidering library that can spider a site,
multiple domains, certain links or infinitely. Spidr is designed to be fast
and easy to use.


Changes: === 0.1.9 / 2009-06-13 * Upgraded to Hoe 2.0.0. * Use Hoe.spec instead of Hoe.new. * Use the Hoe signing task for signed gems. * Added the Agent#schemes and Agent#schemes= methods. * Added a warning message if 'net/https' cannot be loaded. * Allow the list of acceptable URL schemes to be passed into Agent.new. * Allow history and queue information to be passed into Agent.new. * Agent#start_at no longer clears the history or the queue. * Fixed a bug in the sanitization of semi-escaped URLs. * Fixed a bug where https URLs would be followed even if 'net/https' could not be loaded. * Removed Agent::SCHEMES.