A collection of Python scripts to scrape and collect data from various websites. This project demonstrates practical applications of web scraping techniques using libraries such as BeautifulSoup and Requests to gather data programmatically.
- Web Scraping: Extracts data from web pages with minimal effort.
- HTML Parsing: Uses BeautifulSoup for parsing HTML content.
- Flexible and Customizable: Scripts can be modified to target different websites or data elements.
- Python 3.x
- pip for installing required libraries
The following libraries are used in this project:
requests
: For making HTTP requests to websitesbeautifulsoup4
: For parsing and navigating HTMLpandas
(optional): For organizing and saving data
-
Clone the repository:
git clone https://github.com/shahramsamar/Python_Scrapping_data_Scripts.git cd Python_Scrapping_data_Scripts
-
Install dependencies:
pip install -r requirements.txt
-
Run individual scripts:
python <script_name>.py
-
Modify each script with the specific URL or HTML elements you want to scrape.
scrape_example1.py
: Example script for scraping data from a target site.scrape_example2.py
: Another script with custom parsing.requirements.txt
: Lists dependencies for easy installation.
Contributions are welcome! If you’d like to add new scripts or improve existing ones, feel free to submit a pull request.
This project is open-source and available for educational purposes. Be mindful of websites' terms of service when scraping data.