Idlecrawler-ruby is a project mainly written in Ruby, it's free.
A web page crawler written in Ruby
404: Not Found