one web spider. Fetures: 1, support simulated browser agents, 2, support cookies, 3, support multithreads. 4, spider urls and content are saved in mysql, 5, urllib2, request, mechanized are supported.
mavarick/spider-python
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
webspider
Resources
License
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published