Scraping images from one of my favourite subreddit r/Fairytail_Hentai using selenium and beautifulsoup4.
- selenium
> pip install selenium
- Chrome webdriver [ download-link ]
- beautifulsoup4
> pip install beautifulsoup4
- python version above 3.6
In this project/code I've used this specific subreddit, but this code can be used on any other subreddit similarly. no login required.
This script scrapes the dynamically generated website for a specified period of time (default: 10 mins). To change the duration change the end_time variable in seconds.