Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

有没有增加 Cookie 池 与 UserAgent 池设计的计划 #84

Closed
lawrence-peng opened this issue Nov 20, 2018 · 3 comments
Closed

有没有增加 Cookie 池 与 UserAgent 池设计的计划 #84

lawrence-peng opened this issue Nov 20, 2018 · 3 comments
Labels
feature

Comments

@lawrence-peng
Copy link

有没有增加 Cookie 池 与 UserAgent 池设计的计划
@zlzforever
Copy link
Collaborator

可以讨论一下在现在的反爬技术体系下, UA 池的作用还有多少？ Cookie现在是支持自己切换的

@lawrence-peng
Copy link
Author

我是爬虫开发新手，没有办法给很有建议性的意见，至于 Cookie 池网上都在说，我的理解不知道对不对，就像 Proxy 池一样，有自己维护的能力，如果 Cookie 还有效，就不去申请

@zlzforever
Copy link
Collaborator

如果你要自实现也不是很难。框架里有CookieInject的接口，你可以自己实现一个从数据库取cookie的接口就可以。在afterdownloaderhandler判断是否要注入新的cookie

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
feature
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@zlzforever @lawrence-peng