A simple HTTP webcrawler written in python
The following webcrawler uses BeautifulSoup library . To download run the following command on your terminal
$ easy_install beautifulsoup4
To use the crawler simply go to the directory via the terminal and execute the command
$ python crawler.py