Files | Admin

Notes:

Release Name: 0.3

Notes:



Changes: = 0.3 * Renamed the global option :downloadhtml to :download_html. * The downloader for robots and rss enclosures should now be properly configurable via the global options :download_robots and :download_rss_enclosure (default: :openuri). * Respect rel="nofollow" on hyperreferences. * :wdays, :mdays didn't work. * --exclude command line options, exclude configuration command * Check for robots.txt-compliance after testing if the URL is appropriate. * htmldiff.rb can now also highlight differences à la websec's webdiff. * configuration.rb: Ignore pubDate and certain other non-essential fields (tags etc.) when constructing rss item IDs.