Skip to content

A python script to extract tables with specific ID or Class from a paginated website and saving that in CSV file. One can extract data from thousands of pages easily. Useful when data is being provided in html table format instead of JSON.

Notifications You must be signed in to change notification settings

NikhilM98/webtablescrapper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

6 Commits
 
 
 
 
 
 

Repository files navigation

WebTableScrapper

Python 2.7 Recommanded

For Older Version

git clone
pip install requests
pip install BeautifulSoup
cd webtablescrapper
python webtablescrapper__timesmed.py

For Newer Version

git clone
pip install requests
pip install BeautifulSoup4
cd webtablescrapper
python webtablescrapper__timesmed_updated.py

To Combine Files Run:

#Linux
cat 0file*.csv > combined.csv
#Windows
copy 0file*.csv combined.csv

About

A python script to extract tables with specific ID or Class from a paginated website and saving that in CSV file. One can extract data from thousands of pages easily. Useful when data is being provided in html table format instead of JSON.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages