Home > webCrawler

webCrawler

WebCrawler is a project mainly written in Python, it's free.

starting crawler: under the project directory, use shell script

sh Run.sh

the output is stored into temp directory. WARNING: you should not directly use python Main.py under myCrawler directory, since it will save outputs into the temp directory under myCrawler.

Previous:projectory