Konflux devfile compatibility nightly run fails

[thepetk]

Which area this feature is related to?

/kind bug

Which area this bug is related to?

/area registry

Bug Summary

The konflux-nightly-devfile-compatibility test is currently reporting daily failures.

Describe the bug:

The nightly run is failing with the same error trace for a few days in row.

Running Suite: konflux suite - /tmp/tmp.VVcv9qOdgB/registry/tests/konflux
=========================================================================
Random Seed: 1714090910
Will run 30 of 30 specs
Running in parallel across 15 processes
••••
------------------------------
• [PANICKED] [1800.072 seconds]
Konflux sample checks nodejs-basic [It] waits component pipeline to be finished [nightly]
/tmp/tmp.VVcv9qOdgB/registry/tests/konflux/konflux_test.go:112
  Timeline >>
  PipelineRun has not been created yet for the Component stack-axhm/devfile-sample-qnje
...
  PipelineRun has not been created yet for the Component stack-axhm/devfile-sample-qnje
  PipelineRun has not been created yet for the Component stack-axhm/devfile-sample-qnje
  [PANICKED] in [It] - /usr/lib/golang/src/runtime/panic.go:260 @ 04/26/24 00:52:43.265
  << Timeline
  [PANICKED] Test Panicked
  In [It] at: /usr/lib/golang/src/runtime/panic.go:260 @ 04/26/24 00:52:43.265
  runtime error: invalid memory address or nil pointer dereference
  Full Stack Trace
    github.com/tektoncd/pipeline/pkg/apis/pipeline/v1.(*PipelineRun).GetName(...)
    	/tmp/tmp.VVcv9qOdgB/registry/tests/konflux/vendor/github.com/tektoncd/pipeline/pkg/apis/pipeline/v1/pipelinerun_types.go:63
    github.com/redhat-appstudio/e2e-tests/pkg/clients/has.(*HasController).WaitForComponentPipelineToBeFinished(0xc0005349d0, 0xc000ca4000, {0x0, 0x0}, 0xc0006e0428, 0xc000745f38)
    	/tmp/tmp.VVcv9qOdgB/registry/tests/konflux/vendor/github.com/redhat-appstudio/e2e-tests/pkg/clients/has/components.go:166 +0x178
    github.com/devfile/registry/tests/konflux.glob..func1.1.7()
    	/tmp/tmp.VVcv9qOdgB/registry/tests/konflux/konflux_test.go:116 +0x185
------------------------------
SSSSSSSSSSSSSSSSSSSSSSSSS
Summarizing 1 Failure:
  [PANICKED!] Konflux sample checks nodejs-basic [It] waits component pipeline to be finished [nightly]
  /usr/lib/golang/src/runtime/panic.go:260

To Reproduce:

You can check the logs of the failure here: https://prow.ci.openshift.org/view/gs/test-platform-results/logs/periodic-ci-devfile-registry-main-v4.13-konflux-nightly-devfile-compatibility/1783647228473118720#1:build-log.txt%3A19

Expected behavior

The nightly run should be completed with a successful status.

Any logs, error output, screenshots etc? Provide the devfile that sees this bug, if applicable

Shared above

Additional context

N/A

Any workaround?

N/A

Suggestion on how to fix the bug

N/A

[thepetk]

Opened PR openshift/release#52112 to upgrade the nightly run to point to ocp 4.14

[thepetk]

The preriodic chek fails on the PR exactly with the same reason as reported here. After investigating the issue seems to me that this occurs due to too concurrent pipelineruns.

[thepetk]

I've updated the PR to remove the periodic test from the openshift/release repo. The main reason is that the test is using HAS to create/update components/cdqs/application and this flow will be deprecated.

[thepetk]

Closing as the periodic check for samples against konflux has been removed