Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Inconsistent behavior of test_app.py #355

Open
arielge opened this issue Feb 16, 2023 · 0 comments
Open

Inconsistent behavior of test_app.py #355

arielge opened this issue Feb 16, 2023 · 0 comments
Labels
bug Something isn't working

Comments

@arielge
Copy link
Collaborator

arielge commented Feb 16, 2023

What is the current behavior?
While the test_full_flow test in test_app.py consistently passes, sporadically we see in the outputs that in some runs an exception occurred.

For instance:

  • Exception: iteration 1 in workspace 'my_test_workspace' category id '0' is not ready for inference. (current status is IterationStatus.MODEL_DELETED, model status is ModelStatus.DELETED)
  • Exception: model id SVM_BOW_96415f48-adfc-11ed-9a60-de5187059c3e is not in READY status while iteration status is IterationStatus.RUNNING_ACTIVE_LEARNING. Something went wrong

What is the expected behavior?

  1. We would expect the test flow to behave consistently, and need to understand why this is not the case.
  2. An unexpected Exception during the flow should cause the test to fail.
@arielge arielge added the bug Something isn't working label Feb 16, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant