- It traverse kinopoisk.ru through recoommendation links starting from top250 movies (https://www.kinopoisk.ru/top/ - ./data/startlinks.txt)
- Don't forget to create db (see comments in ./kinopoisk/pipelines.py) or change pipline as you need, and change proxy settings in middleware.py and like_spider.py (request parameter "meta")
iggisv9t/kinoposik-spider
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
Scrapy spider for getting movie:[recommendations] list
Topics
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published