WebCrawler is a project mainly written in Python, it's free.
starting crawler: under the project directory, use shell script
sh Run.sh
the output is stored into temp directory. WARNING: you should not directly use python Main.py under myCrawler directory, since it will save outputs into the temp directory under myCrawler.