Micrathena is a project mainly written in JAVASCRIPT and RUBY, it's free.

a command-line, interactive web-spider