Crawling Job Queue Demo using Residential IP

Youtube Video: https://www.youtube.com/watch?v=DjpczJDAOrk&list=PLjB7odcPYBI2kOtQiMmIk6uei4jl7wQsh&index=1

Source Code: https://github.com/beenotung/crawling-job-queue-demo

Message Flow

mobile client <--(ajax)--> web server <--(long polling)--> crawler <--(playwright)--> 3rd party website

Keywords

Playwright, express, AJAX, job queue, scraping, demo, educational video