Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jenkins: build timeouts #3157

Closed
mpranj opened this issue Nov 4, 2019 · 3 comments
Closed

Jenkins: build timeouts #3157

mpranj opened this issue Nov 4, 2019 · 3 comments

Comments

@mpranj
Copy link
Member

mpranj commented Nov 4, 2019

The following build message occurred in multiple PRs I have seen (e.g. #3150):

Sending interrupt signal to process

Terminated

It seems that we are increasingly hitting the 10 minute Jenkins limit (when a build has no log output for 10 minutes).

timeout(activity: true, time: 10, unit: 'MINUTES') {

I'm not sure it will help to increase the limit, as some of the killed jobs show that they are running for 5+ hours. We can try to increase the limit and see whether we are only exceeding it by very little. Otherwise I think we will need to evaluate what's causing the builds to take forever and work on a better solution.

The fact that many builds are currently failing (and being re-built) because of problems with our Jenkins ironically puts even more load on the systems, so the effect seems to amplify.

@markus2330
Copy link
Contributor

Thank you for creating this issue!

@Mistreated can you try to change the timeout?

mpranj added a commit to mpranj/libelektra that referenced this issue Nov 5, 2019
@mpranj
Copy link
Member Author

mpranj commented Nov 5, 2019

I took the liberty to test/increase the timeout in my PR, as it keeps hitting this limit. Seems like it is usually a build on a7 (which is slower) and I have not yet seen it on v2 (which is presumably faster).

@markus2330
Copy link
Contributor

Problems seem to be gone.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants