Scrapy, a fast high-level web crawling & scraping framework for Python.
-
Updated
May 12, 2024 - Python
Scrapy, a fast high-level web crawling & scraping framework for Python.
Custom Selenium Chromedriver | Zero-Config | Passes ALL bot mitigation systems (like Distil / Imperva/ Datadadome / CloudFlare IUAM)
Collection of useful data science topics along with articles, videos, and code
Pythonic HTML Parsing for Humans™
List of libraries, tools and APIs for web scraping and data processing.
A Python module to scrape several search engines (like Google, Yandex, Bing, Duckduckgo, ...). Including asynchronous networking support.
A Smart, Automatic, Fast and Lightweight Web Scraper for Python
Scrape Facebook public pages without an API key
Simple but useful Python web scraping tutorial code.
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
Python scraper based on AI
Up-to-date simple useragent faker with real world database
Generate Free Edu Mail(s) within minutes
📰 Diários oficiais brasileiros acessíveis a todos | 📰 Brazilian government gazettes, accessible to everyone.
Add a description, image, and links to the scraping topic page so that developers can more easily learn about it.
To associate your repository with the scraping topic, visit your repo's landing page and select "manage topics."