Pinned

1. scrapydweb scrapydweb Public

   Web app for Scrapyd cluster management, Scrapy log analysis & visualization, Auto packaging, Timer tasks, Monitor & Alert, and Mobile UI. DEMO 👉

   Python 3k 545

2. logparser logparser Public

   A tool for parsing Scrapy log files periodically and incrementally, extending the HTTP JSON API of Scrapyd.

   Python 84 21

3. scrapyd-cluster-on-heroku scrapyd-cluster-on-heroku Public

   Set up free and scalable Scrapyd cluster for distributed web-crawling with just a few clicks. DEMO 👉

   Python 122 94

4. scrapyd scrapyd Public

   Forked from scrapy/scrapyd

   [PR #326] Native support for basic auth 🔒 `pip install -U git+https://github.com/scrapy/scrapyd.git`, then add `username = yourusername` and `password = yourpassword` in the scrapyd.conf file. DOCS 👉

   Python 10 4

5. files files Public

   Docs and files for ScrapydWeb, Scrapyd, Scrapy, and other projects

   417 71

6. notes notes Public

   Keep on reading

   Python 6 2