splash_scrapy_test

Quotes scraper from a site that loads through JS. Needs a docker container running splash on the port 8050 and some changes to settings.py file.

WARNING

If scrapy is installed globally it won't prioritize the one in the venv.

sources

• https://github.com/scrapy-plugins/scrapy-splash
• https://scrapeops.io/python-scrapy-playbook/scrapy-splash/