Skip to content

Web-scrape Craigslist using BeautifulSoup, CronTab, and more!

Notifications You must be signed in to change notification settings

taekunkim/scraping_craigslist

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

28 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Please read my blogpost on this subject

https://taekunkim.wordpress.com/2020/08/22/web-scraping-craigslist/

⚠️

The Python script is dependant on the html structure of Craigslist.

The script may not work if Craigslist changes its html structure from what it had on August 11, 2020.

Let's Scrape Craigslist!

Objective

I will be recording the name, id, date posted, image url, location sold, price, and the url of every listing of desk chairs sold on Craigslist - San Diego, CA.

Recently, I had a sudden need to buy a new desk chair. While frequently browsing Craigslist, I wondered how frequently sellers change their listing prices and for how long they keep their listings posted! So, I decided to learn how to webscrape Craigslist.

Tools

I used Python, BeautifulSoup, and CronTab.

About

Web-scrape Craigslist using BeautifulSoup, CronTab, and more!

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published