Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[7.17](backport #39174) Enabling retries for Beats flaky tests #39349

Merged
merged 2 commits into from May 2, 2024

Conversation

mergify[bot]
Copy link
Contributor

@mergify mergify bot commented May 1, 2024

Proposed commit message

In scope of beats migration from Jenkins to Buildkite - added retries to tests (Cloud tests not retried at the moment, see comment below).
Packaging, K8Tests are not retried according to global Jenkinsfile.
BK Builds: https://buildkite.com/elastic/beats/builds?branch=oakrizan%3Aenable-retries-for-flaky-tests

Auditbeat MacOS test failure not related/caused by current PR. Related issue: https://github.com/elastic/ingest-dev/issues/3268

Logs

Kafka Go UnitTests for libbeat failures (e.g. https://buildkite.com/elastic/beats-libbeat/builds/4491#018f38c5-3f1c-40d4-adb1-ac53d901ce7b) are due to a known flakyness issue: https://github.com/elastic/ingest-dev/issues/3199

* added retries for auditbeat flaky tests

* added retries for filebeat flaky tests

* added retries

* test exitcode

* checged exit status code for retries

* set larger timeout for pytestOpts

* restored timeout for pytests

(cherry picked from commit 02ea29d)

# Conflicts:
#	.buildkite/packetbeat/pipeline.packetbeat.yml
#	.buildkite/winlogbeat/pipeline.winlogbeat.yml
#	.buildkite/x-pack/pipeline.xpack.heartbeat.yml
#	.buildkite/x-pack/pipeline.xpack.libbeat.yml
#	.buildkite/x-pack/pipeline.xpack.osquerybeat.yml
#	.buildkite/x-pack/pipeline.xpack.packetbeat.yml
#	.buildkite/x-pack/pipeline.xpack.winlogbeat.yml
@mergify mergify bot requested a review from a team as a code owner May 1, 2024 20:06
@mergify mergify bot added backport conflicts There is a conflict in the backported pull request labels May 1, 2024
Copy link
Contributor Author

mergify bot commented May 1, 2024

Cherry-pick of 02ea29d has failed:

On branch mergify/bp/7.17/pr-39174
Your branch is up to date with 'origin/7.17'.

You are currently cherry-picking commit 02ea29d8cf.
  (fix conflicts and run "git cherry-pick --continue")
  (use "git cherry-pick --skip" to skip this patch)
  (use "git cherry-pick --abort" to cancel the cherry-pick operation)

Changes to be committed:
	modified:   .buildkite/auditbeat/auditbeat-pipeline.yml
	modified:   .buildkite/filebeat/filebeat-pipeline.yml
	modified:   .buildkite/heartbeat/heartbeat-pipeline.yml
	modified:   .buildkite/libbeat/pipeline.libbeat.yml
	modified:   .buildkite/metricbeat/pipeline.yml
	modified:   .buildkite/x-pack/pipeline.xpack.auditbeat.yml
	modified:   .buildkite/x-pack/pipeline.xpack.dockerlogbeat.yml
	modified:   .buildkite/x-pack/pipeline.xpack.filebeat.yml
	modified:   .buildkite/x-pack/pipeline.xpack.metricbeat.yml

Unmerged paths:
  (use "git add <file>..." to mark resolution)
	both modified:   .buildkite/packetbeat/pipeline.packetbeat.yml
	both modified:   .buildkite/winlogbeat/pipeline.winlogbeat.yml
	both modified:   .buildkite/x-pack/pipeline.xpack.heartbeat.yml
	both modified:   .buildkite/x-pack/pipeline.xpack.libbeat.yml
	both modified:   .buildkite/x-pack/pipeline.xpack.osquerybeat.yml
	both modified:   .buildkite/x-pack/pipeline.xpack.packetbeat.yml
	both modified:   .buildkite/x-pack/pipeline.xpack.winlogbeat.yml

To fix up this pull request, you can check it out locally. See documentation: https://docs.github.com/en/pull-requests/collaborating-with-pull-requests/reviewing-changes-in-pull-requests/checking-out-pull-requests-locally

@botelastic botelastic bot added the needs_team Indicates that the issue/PR needs a Team:* label label May 1, 2024
@elasticmachine
Copy link
Collaborator

elasticmachine commented May 1, 2024

💚 Build Succeeded

the below badges are clickable and redirect to their specific view in the CI or DOCS
Pipeline View Test View Changes Artifacts preview preview

Expand to view the summary

Build stats

  • Duration: 16 min 31 sec

❕ Flaky test report

No test was executed to be analysed.

🤖 GitHub comments

Expand to view the GitHub comments

To re-run your PR in the CI, just comment with:

  • /test : Re-trigger the build.

  • /package : Generate the packages and run the E2E tests.

  • /beats-tester : Run the installation tests with beats-tester.

  • run elasticsearch-ci/docs : Re-trigger the docs validation. (use unformatted text in the comment!)

@dliappis dliappis requested a review from alexsapran May 2, 2024 09:35
@dliappis dliappis removed conflicts There is a conflict in the backported pull request needs_team Indicates that the issue/PR needs a Team:* label labels May 2, 2024
@botelastic botelastic bot added the needs_team Indicates that the issue/PR needs a Team:* label label May 2, 2024
@dliappis dliappis added Team:Ingest-EngProd and removed needs_team Indicates that the issue/PR needs a Team:* label labels May 2, 2024
@dliappis dliappis merged commit 65ac3af into 7.17 May 2, 2024
96 of 98 checks passed
@dliappis dliappis deleted the mergify/bp/7.17/pr-39174 branch May 2, 2024 10:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants