Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Flaky TestMetrics #5483

Open
lburgazzoli opened this issue May 9, 2024 · 3 comments
Open

Flaky TestMetrics #5483

lburgazzoli opened this issue May 9, 2024 · 3 comments

Comments

@lburgazzoli
Copy link
Contributor

lburgazzoli commented May 9, 2024

What happened?

The test is marked a problematic and fails for a slightly different metric values:

/*
* TODO
* The duration_seconds tests keep randomly failing on OCP4 with slightly different duration values
* May need to lessen the strict checking parameters
*
* Adding CAMEL_K_TEST_SKIP_PROBLEMATIC env var for the moment.
*/
func TestMetrics(t *testing.T) {

We should investigate the reason of the flakiness

Relevant log output

##[group]�[0;31m❌ TestMetrics�[0;37m (3m36.99s)�[0m
Copy catalog camel-catalog-3.8.1 from namespace default
Setting build timeout to 10m
OLM is not available in the cluster. Fallback to regular installation.
Camel K installed in namespace test-d75e73db-6a7e-442c-b7d7-6471ffbdbb76 
2024-05-08T21:43:47Z	DEBUG	camel-k	Finding available platforms in namespace test-d75e73db-6a7e-442c-b7d7-6471ffbdbb76
2024-05-08T21:43:47Z	DEBUG	camel-k	Found active integration platform camel-k-metrics
Integration "javapmdgm" created
2024-05-08T21:44:18Z	DEBUG	camel-k	Finding available platforms in namespace test-4e73dff2-ea42-45af-b99e-48af4da2e033
2024-05-08T21:44:18Z	DEBUG	camel-k	Found active integration platform camel-k-cli-reset
0 pipes deleted from namespace test-4e73dff2-ea42-45af-b99e-48af4da2e033
2024-05-08T21:44:18Z	INFO	KubeAPIWarningLogger	v1apha1.KameletBinding is deprecated, please, use v1.Pipe instead
0 kameletbindings deleted from namespace test-4e73dff2-ea42-45af-b99e-48af4da2e033
2 integrations deleted from namespace test-4e73dff2-ea42-45af-b99e-48af4da2e033
Camel K platform has been reset successfully!
2024-05-08T21:44:18Z	DEBUG	camel-k	Finding available platforms in namespace test-4e73dff2-ea42-45af-b99e-48af4da2e033
2024-05-08T21:44:18Z	DEBUG	camel-k	Found active integration platform camel-k-cli-reset
Nothing to delete
    operator_metrics_test.go:325: 
        Expected
            <uint>: 10
        to be ==
            <uint64>: 9
@lburgazzoli lburgazzoli added the kind/bug Something isn't working label May 9, 2024
@squakez
Copy link
Contributor

squakez commented May 9, 2024

Probably not an issue (at least, not in upstream CI). See #5484

@lburgazzoli
Copy link
Contributor Author

That is an error I observed upstream at least on two unrelated PRs

@squakez squakez added area/test/flakiness and removed kind/bug Something isn't working labels May 9, 2024
@squakez squakez changed the title Investigate TestMetrics flakiness Flaky TestMetrics May 9, 2024
@squakez
Copy link
Contributor

squakez commented May 9, 2024

Let's add it to the flakiness bucket then.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants