Scraper is a project mainly written in Ruby, it's free.
A ruby scraping library using Mechanize
404: Not Found