I wanted to explore data science-related jobs posted to a variety of roles on job listing sites, a job aggregator that updates multiple times daily.
| WebSite | URL | pyscript |
|---|---|---|
| Aasaanjobs | https://www.aasaanjobs.com/ | aasaanjobs.py |
| Dare2compete | https://dare2compete.com/ | dare2compete.py |
| Freshersworld | https://www.freshersworld.com/ | freshersworld.py |
| Internshala | https://internshala.com/ | internshala.py |
| Jobguru | https://www.jobguru.in/ | jobguru.py |
| Myamcat | https://www.myamcat.com/jobs | myamcat.py |
| Timesjobs | https://www.timesjobs.com | timesjobs.py |
| Naukri | https://www.naukri.com | naukri.py |
| Shine | https://www.shine.com | shine.py |
Install the python dependencies/pip modules to start the scrape.
$ pip install beautifulsoup4
$ pip install html5lib
$ pip install lxml
$ pip install pandas
A disclaimer before beginning, many websites can restrict or outright bar scraping of data from their pages. Users may be subject to legal ramifications depending on where and how they attempt to scrape information. Many sites have a devoted page to noting restrictions on data scraping at [example-site].com/robots.txt.
[Scrape carefully, friends]