🤖/👨‍🦰 Detect bots/crawlers/spiders using the user agent string

Amazon products scraper with using of rotating proxies and headless Chrome from ScrapingAnt

A IOT Server,support Connector,tree management and HMI

API definition, resources and reference implementation of URL Frontiers

🤩 Python Package for Scraping Amazon Product Reviews ✨

Python course for 2nd year NLP students at NRU HSE, 2018-2019

Python course for 2nd year NLP students at NRU HSE, 2017-2018

GAMECHANGER Policy Analytics Site Crawlers

YiraBot: Simplifying Web Scraping for All. A user-friendly tool for developers and enthusiasts, offering command-line ease and Python integration. Ideal for research, SEO, and data collection.

Detect bots/crawlers/spiders via user-agent string

A Web Crawler developed in Python.

Web crawlers based on travel information, crawler data from Ctrip, tuniu, qunar.

This is a simple web crawler created using python

This is an advanced version of the previously released version of web-crawler

A tutorial on Crawling the Web and Scraping off the Useful bits - without actually doing anything!

一些非常有趣的python爬虫例子,对新手比较友好,主要爬取淘宝、天猫、微信、豆瓣、QQ等网站。(Some interesting examples of python crawlers that are friendly to beginners. )

Web crawlers for Early Irish & Welsh data