Hidden API with Requests and Scrapy
In this repo I expose different methods to extract data using hidden or internal APIs present on dynamic sites without having to use scraping programs that simulate javascript.
I choose to use Requests
, Scrapy
and only json
The data was extracted from 3 fashion sites :
Images extractions with Scrapy