This application uses the Beautiful Soup module to scrape web pages from Nature.com. The application takes user input to determine how many pages to scrape and what sorts of articles to scrape. The application uses the os module to create new directories for each web page and saves the body of the pages into text files in these directories based of the article name. I have added some sample files generated by the script for reference.
-
Notifications
You must be signed in to change notification settings - Fork 0
Scapes articles from Nature.com using BS
License
skyler-myers-db/Nature-Scrape
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Folders and files
Name | Name | Last commit message | Last commit date | |
---|---|---|---|---|
Repository files navigation
About
Scapes articles from Nature.com using BS
Topics
Resources
License
Stars
Watchers
Forks
Packages 0
No packages published