This web scraper is based off of Scrapy. http://doc.scrapy.org/en/latest/intro/tutorial.html
First, metadataScraper will scrape the title and URL from an XML file. Then GoogleSearchScraper will google that title and collect any relevant information.
This project is still a work in progress.
Follow Scrapy's Installation Guide to install:
- Python 2.7
- pip and setuptools Python packages
- lxml
- OpenSSL
- Scrapy