Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add E2E tests to run on deployment #369

Open
jsdw opened this issue Aug 16, 2021 · 0 comments
Open

Add E2E tests to run on deployment #369

jsdw opened this issue Aug 16, 2021 · 0 comments

Comments

@jsdw
Copy link
Collaborator

jsdw commented Aug 16, 2021

Soemthing that would be nice to have is a set of end to end tests that automatically run against the deployed instacne of telemetry, and mark the deployment as failed if they don't succeed.

Helm has a means to do this (see https://helm.sh/docs/topics/chart_tests/), and there currently exist some E2E tests under backend/telemetry_core/tests.

If we thought it valuable enough, we could:

  • Re-package the (or some of the) E2E tests into a separate e2e binary which can be given the relevant URLs and run tests against them. Currently, some tests can run against external URLs and some tests will fail as they want to control thecreation and deletion of shards and such. This binary could mark each test as being "local" or "any" (or something like that) so that it can run a full suite by locally spinning up binaries (as happens at present) or run only a subset of the tests which are happy with a pre-existing deployment.
  • Add a helm test which kicks off an image to run the above e2e binary against the deployed telemetry instance.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant