WebSnake is a project mainly written in Scala, it's free.

Simple tool to extract text data from a list of URLs