Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature Request]: Automated Iterative Execution of Acceptance Tests for Flake Testing. #20264

Open
rahat2134 opened this issue May 4, 2024 · 0 comments
Labels
enhancement Label to indicate an issue is a feature/improvement

Comments

@rahat2134
Copy link
Contributor

Is your feature request related to a problem? Please describe.

I often find myself repeatedly running acceptance tests with the command python -m scripts.run_acceptance_tests --suite={suite name} to ensure the stability of our code against flakes. This manual process becomes tedious and time-consuming, especially when waiting for each test to complete before initiating the next one. It would be beneficial to streamline this process by implementing a command that automatically runs the tests a specified number of times, one after the other, facilitating efficient flake testing without the need for constant manual intervention.

Describe the solution (or solutions) you'd like

I would like to have a feature implemented that allows for the automated iterative execution of acceptance tests. Specifically, I envision a command that, when invoked with a parameter specifying the number of iterations (n), runs the acceptance tests sequentially n times without manual intervention. This solution would significantly streamline the process of testing for flakes, improving efficiency and reducing the need for manual oversight during testing.

Describe alternatives you've considered and rejected

N/A

Additional context

No response

@rahat2134 rahat2134 added triage needed enhancement Label to indicate an issue is a feature/improvement labels May 4, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement Label to indicate an issue is a feature/improvement
Projects
Status: Todo
Development

No branches or pull requests

2 participants