KubernetesPodOperator with multiple containers hangs if container other than base container is still running #39693
Labels
area:providers
kind:bug
This is a clearly a bug
provider:cncf-kubernetes
Kubernetes provider related issues
Apache Airflow version
main (development)
If "Other Airflow 2 version" selected, which one?
No response
What happened?
A
KubernetesPodOperator
with the followingfull_pod_spec
:will not mark the task as successful after 30 seconds because the
sidecar
will continue to run after thebase
container has succeeded. This happens because thepod_manager
gets stuck waiting for pod completion. This if statement returnsFalse
when istio is not enabled on the pod.What you think should happen instead?
The pod should be considered complete when the base container succeeds regardless of whether or not any other containers on the pod are still running.
How to reproduce
Create a
KubernetesPodOperator
with thefull_pod_spec
provided.Operating System
MacOS 14.4.1
Versions of Apache Airflow Providers
apache-airflow-providers-cncf-kubernetes==8.0.1
Deployment
Other
Deployment details
Kubernetes on Google Kubernetes Engine. Kubernetes executors and worker pods all run on the same cluster.
Anything else?
No response
Are you willing to submit PR?
Code of Conduct
The text was updated successfully, but these errors were encountered: