New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

你好，这个可以用来收集域名吗？ #17

Open

ghost opened this issue Jun 14, 2015 · 2 comments

ghost commented Jun 14, 2015

你好，这个可以用来收集域名吗？去重的那一步应该在哪里做呢

Author

ghost commented Jun 14, 2015

控制每个网站深度搜索多少层，比较菜，不知道咋改代码

Contributor

sorawa commented Jun 16, 2015

go_spider\core\scheduler\scheduler_queue.go
Poll()

改造这个方法

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment