$ pip install scrapy scrapy-splash
$ docker run -p 8050:8050 scrapinghub/splash
Modify SPLASH_URL in settings.py to you IP Address.
SPLASH_URL = 'http://192.168.99.100:8050'
Run spider
$ cd bgp_bots
$ scrapy crawl BGPSpider -o BGP.json
p0we7/bgp_sample
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
BGP Crawler
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published