connectivity test times out waiting for other node deployments on a single-worker cluster

[jrajahalme]

Bug report

It seems cilium connectivity test is timing out on waiting for the other-node deployments to become ready on a single-worker kind cluster.

% cilium connectivity test
ℹ️  Monitor aggregation detected, will skip some flow validation steps
✨ [kind-kind] Creating namespace cilium-test for connectivity check...
✨ [kind-kind] Deploying echo-same-node service...
✨ [kind-kind] Deploying DNS test server configmap...
✨ [kind-kind] Deploying same-node deployment...
✨ [kind-kind] Deploying client deployment...
✨ [kind-kind] Deploying client2 deployment...
✨ [kind-kind] Deploying echo-other-node service...
✨ [kind-kind] Deploying other-node deployment...
✨ [host-netns] Deploying kind-kind daemonset...
✨ [host-netns-non-cilium] Deploying kind-kind daemonset...
✨ [kind-kind] Deploying echo-external-node deployment...
✨ [kind-kind] Deploying Ingress resource...
⌛ [kind-kind] Waiting for deployments [client client2 echo-same-node] to become ready...
⌛ [kind-kind] Waiting for deployments [echo-other-node] to become ready...
connectivity test failed: waiting for deployment echo-other-node to become ready has been interrupted: context deadline exceeded (last error: only 0 of 1 replicas are available)

General Information

• Cilium CLI version:

% cilium version  
cilium-cli: v0.15.18 compiled with go1.21.5 on darwin/arm64
cilium image (default): v1.14.4
cilium image (stable): v1.14.4
cilium image (running): 1.13.9

• Orchestration system version in use (e.g. kubectl version, ...)

% kubectl version         
Client Version: version.Info{Major:"1", Minor:"27", GitVersion:"v1.27.4", GitCommit:"fa3d7990104d7c1f16943a67f11b154b71f6a132", GitTreeState:"clean", BuildDate:"2023-07-19T12:14:48Z", GoVersion:"go1.20.6", Compiler:"gc", Platform:"darwin/arm64"}
Kustomize Version: v5.0.1
Server Version: version.Info{Major:"1", Minor:"26", GitVersion:"v1.26.0", GitCommit:"b46a3f887ca979b1a5d14fd39cb1af43e7e5d12d", GitTreeState:"clean", BuildDate:"2022-12-20T03:36:50Z", GoVersion:"go1.19.4", Compiler:"gc", Platform:"linux/arm64"

• Platform / infrastructure information:
  • Kind version: kind v0.20.0 go1.20.5 darwin/arm64
  • Kind config:

kind: Cluster
apiVersion: kind.x-k8s.io/v1alpha4
nodes:
  - role: control-plane
    image: kindest/node:v1.26.0
  - role: worker
    image: kindest/node:v1.26.0
networking:
  disableDefaultCNI: true
  podSubnet: "10.244.0.0/16"
  serviceSubnet: "10.245.0.0/16"

How to reproduce the issue

1. kind create cluster --config=kind-config.yaml
2. `helm install cilium isovalent/cilium --version 1.13.9 --namespace kube-system --set dnsPolicy=ClusterFirstWithHostNet --set ingressController.enabled=true --set kubeProxyReplacement=partial --set nodePort.enabled=true --set=debug.enabled=true --set=debug.verbose=envoy --set operator.replicas=1
3. cilium connectivity test