A simple Python web scraper

Overview

• This scraper writes to CSV for data portability.

Instructions

• Clone down repo
• Make virtual environment and activate:
  • virtualenv env
  • source env/bin/activate
• Install requirements:
  • pip install -r requirements.txt
• Optional: Change the target URL and HTML tag(s) to be scraped (lines 7, 13)
• To run:
  • python3 scraper.py

Output

A file named output.csv with your data should be created within the directory.

More documentation

• csv module: https://docs.python.org/3/library/csv.html
• Beautiful Soup Python library: https://beautiful-soup-4.readthedocs.io/en/latest/