Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Security Solution] Add ServerlessQA tags for explore area tests #183087

Open
wants to merge 22 commits into
base: main
Choose a base branch
from
Open

[Security Solution] Add ServerlessQA tags for explore area tests #183087

wants to merge 22 commits into from
+86 −79

Conversation

angorayc
Copy link
Contributor

@angorayc angorayc commented May 9, 2024 •
edited

@angorayc
Copy link
Contributor Author

angorayc commented May 9, 2024

buildkite test this

@angorayc
Copy link
Contributor Author

buildkite test this

@kibanamachine
Copy link
Contributor

Flaky Test Runner Stats

🎉 All tests passed! - kibana-flaky-test-suite-runner#5981

[✅] Security Solution Explore - Cypress: 100/100 tests passed.
[✅] [Serverless] Security Solution Explore - Cypress: 100/100 tests passed.

see run history

@angorayc
Copy link
Contributor Author

/ci

@angorayc
Copy link
Contributor Author

buildkite test this

@angorayc
Copy link
Contributor Author

buildkite test this

@angorayc angorayc marked this pull request as ready for review May 16, 2024 16:12
@angorayc angorayc requested a review from a team as a code owner May 16, 2024 16:12
@elasticmachine
Copy link
Contributor

Pinging @elastic/security-threat-hunting-explore (Team:Threat Hunting:Explore)

@angorayc angorayc added the release_note:skip Skip the PR/issue when compiling release notes label May 16, 2024
This was referenced May 21, 2024
Open
Closed
Open
semd
semd approved these changes May 21, 2024
View reviewed changes
Copy link
Contributor

@semd semd left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM! Thanks @angorayc for doing this, and running the flaky test runner on these tests.

@angorayc
Copy link
Contributor Author

/ci

@angorayc @semd
Update x-pack/test/security_solution_cypress/cypress/tasks/common.ts
fd8a056 
Co-authored-by: Sergi Massaneda <sergi.massaneda@gmail.com>
@angorayc
Copy link
Contributor Author

/ci

@kibanamachine
Copy link
Contributor

Flaky Test Runner Stats

🟠 Some tests failed. - kibana-flaky-test-suite-runner#6057

[❌] Security Solution Explore - Cypress: 73/100 tests passed.
[❌] [Serverless] Security Solution Explore - Cypress: 99/100 tests passed.

see run history

@kibanamachine
Copy link
Contributor

Flaky Test Runner Stats

🟠 Some tests failed. - kibana-flaky-test-suite-runner#6060

[❌] Security Solution Explore - Cypress: 74/100 tests passed.
[✅] [Serverless] Security Solution Explore - Cypress: 100/100 tests passed.

see run history

@kibanamachine
Copy link
Contributor

Flaky Test Runner Stats

🟠 Some tests failed. - kibana-flaky-test-suite-runner#6061

[❌] Security Solution Explore - Cypress: 73/100 tests passed.
[✅] [Serverless] Security Solution Explore - Cypress: 100/100 tests passed.

see run history

@kibanamachine
Copy link
Contributor

Flaky Test Runner Stats

🟠 Some tests failed. - kibana-flaky-test-suite-runner#6068

[❌] Security Solution Explore - Cypress: 80/100 tests passed.
[❌] [Serverless] Security Solution Explore - Cypress: 94/100 tests passed.

see run history

@kibanamachine
Copy link
Contributor

Flaky Test Runner Stats

🎉 All tests passed! - kibana-flaky-test-suite-runner#6069

[✅] Security Solution Explore - Cypress: 100/100 tests passed.
[✅] [Serverless] Security Solution Explore - Cypress: 100/100 tests passed.

see run history

@kibanamachine
Copy link
Contributor

Flaky Test Runner Stats

🟠 Some tests failed. - kibana-flaky-test-suite-runner#6077

[✅] Security Solution Explore - Cypress: 100/100 tests passed.
[❌] [Serverless] Security Solution Explore - Cypress: 10/100 tests passed.

see run history

@MadameSheema
Copy link
Member

Please note that the flaky test suite runner is using an stateless environment, not an MKI one so greens there, does not assure for the test to be stable on MKI.

The periodic pipeline is the one that demonstrate how reliable a test is on MKI environments.

@kibanamachine
Copy link
Contributor

Flaky Test Runner Stats

🟠 Some tests failed. - kibana-flaky-test-suite-runner#6082

[❌] Security Solution Explore - Cypress: 68/100 tests passed.
[❌] [Serverless] Security Solution Explore - Cypress: 0/100 tests passed.

see run history

@kibanamachine
Copy link
Contributor

Flaky Test Runner Stats

🟠 Some tests failed. - kibana-flaky-test-suite-runner#6128

[❌] Security Solution Explore - Cypress: 74/100 tests passed.
[✅] [Serverless] Security Solution Explore - Cypress: 100/100 tests passed.

see run history

@angorayc
Copy link
Contributor Author

Please note that the flaky test suite runner is using an stateless environment, not an MKI one so greens there, does not assure for the test to be stable on MKI.

The periodic pipeline is the one that demonstrate how reliable a test is on MKI environments.

Understood @MadameSheema , thanks for the reminder. I'm just hoping these tests will be stable enough for CI.

@angorayc
Copy link
Contributor Author

/ci

@kibanamachine
Copy link
Contributor

Flaky Test Runner Stats

🎉 All tests passed! - kibana-flaky-test-suite-runner#6138

[✅] Security Solution Explore - Cypress: 100/100 tests passed.
[✅] [Serverless] Security Solution Explore - Cypress: 100/100 tests passed.

see run history

@kibana-ci
Copy link
Collaborator

kibana-ci commented Jun 5, 2024 •
edited

💔 Build Failed

Failed CI Steps

Test Failures

  • [job] [logs] Serverless Explore - Security Solution Cypress Tests #1 / Inspect Explore pages inspect Hosts page inspect Hosts page
  • [job] [logs] Serverless Explore - Security Solution Cypress Tests #1 / Inspect Explore pages inspect Users page inspect Users page

Metrics [docs]

Async chunks

Total size of all lazy-loaded chunks that will be downloaded as the user navigates the app

id before after diff
securitySolution 13.6MB 13.6MB +10.0B

History

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@semd semd semd approved these changes

@MadameSheema MadameSheema Awaiting requested review from MadameSheema

Assignees
No one assigned
Labels
release_note:skip Skip the PR/issue when compiling release notes Team:Threat Hunting:Explore v8.15.0
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

None yet
6 participants
@angorayc @kibanamachine @elasticmachine @MadameSheema @kibana-ci @semd