Files | Admin

Notes:

Release Name: 0.0.2

Notes: A Ruby web-spider framework for easily developing programs to crawl a domain and gather useful statistics.

Changes: * Allow module-wide options, including option to discard fetched page bodies after use to conserve memory.