Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Conformance: Signal Stability of Tests #3009

Open
robscott opened this issue Apr 22, 2024 · 0 comments
Open

Conformance: Signal Stability of Tests #3009

robscott opened this issue Apr 22, 2024 · 0 comments

Comments

@robscott
Copy link
Member

What would you like to be added:
Some kind of indicator that a conformance test is still "experimental".

Why this is needed:
In some cases we want to add conformance tests before we have any implementations of a feature (x-ref #2821). Not being able to meaningfully run a test like this increases the chances that a test could either be wrong or buggy. In general, our conformance tests represent a contract that we should be very hesitant to change, but when tests are new and untested, we likely need to have some kind of label to indicate that they could still change if needed.

cc @dprotaso

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant