Asset-slurpee is a project mainly written in Ruby, it's free.

A generic crawler that attempts to "slurp" the main content and media assets of each page it crawls.