Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

希望增加爬虫任务失败重试执行次数设置 #1442

Open
534146825 opened this issue Jan 27, 2024 · 0 comments
Open

希望增加爬虫任务失败重试执行次数设置 #1442

534146825 opened this issue Jan 27, 2024 · 0 comments
Labels
enhancement New feature or request task Task related

Comments

@534146825
Copy link

当我使用用crawlab 来配置web爬虫时,会遇到selenium 找不到元素的时就会进程就会意外退出,尽快我做了异常捕获,还是没什么用。
于是我只能通过另外一个方式来执行,编写一个调用执行程序,如果在这个调用程序执行另外一个程序就会退出,设置最大尝试次数为10次。
但是对比部署在crawlab 上面感觉不太方便。希望能增加爬虫任务失败时,能配置重试任务,且支持定时的。

@534146825 534146825 added the enhancement New feature or request label Jan 27, 2024
@tikazyq tikazyq added the task Task related label Mar 20, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request task Task related
Projects
None yet
Development

No branches or pull requests

2 participants