Files | Admin

Notes:

Release Name: 0.1.7

Notes:
Spidr is a versatile Ruby web spidering library that can spider a site,
multiple domains, certain links or infinitely. Spidr is designed to be fast
and easy to use.


Changes: === 0.1.7 / 2009-04-24 * Added Agent#all_headers. * Fixed a bug where Page#headers was always +nil+. * Spidr::Agent will now follow the Location header in HTTP 300, 301, 302, 303 and 307 Redirects. * Spidr::Agent will now follow iframe and frame tags.