This application scrapes the first ten pages of the Hacker News site, and saves a list of news articles with over 100 upvotes to a data frame and creates a new csv. This is developed using Python, and makes use of Beautiful Soup and Pandas.
The original application was inspired by a tutorial within the Zero to Mastery: Complete Python Developer in 2022 course.
This has now been expanded to get data from 10 pages, saves this information to a data frame and creates a new csv.
- Upload Code
- Format Code
- Update Repository
- Update README
- Create Future Ideas
- Write Application Setup / Commands
-
Launch Website - Create Card on Portfolio
- Create Page on Portfolio
- Archive Repository
💡 Display this information on a web page or on my portfolio.
- Language: Python
- Tags: Pandas, BeautifulSoup, Scraper, CSV
- Tutorial: Zero to Mastery: Complete Python Developer in 2022 (Section 18: Scraping Data with Python)
- Author: Rheanne McIntosh
- Run the following command:
python3 server.py
- An up-to-date csv should appear in the
news_csvsfolder with todays date
If you have any questions or can suggest any improvements, please let me know!