Week 6
Getting Data Part 2: Web Scraping

Important: Update your local environment

• Small update to course's Python environment relevant to today's lecture
• Update the environment on your laptop using these instructions on course website

Recommended readings

• BeautifulSoup and CSS Selectors

New Packages

• Requests
• Beautiful Soup
• Selenium

Useful Links and Reference Materials

• Insights into Housing Markets from Scraping Craigslist
  • and accompanying academic article
• HTML tutorial
  • sections: introduction, basics, elements, attributes
• Tutorial on Web Scraping with Requests and BeautifulSoup
• CSS Selectors
• 101 Web Scraping Exercises