CI flake: shard-conformance timeout

[jcaamano]

From https://github.com/ovn-org/ovn-kubernetes/actions/runs/8780456440/job/24091514922?pr=4165

2024-04-22T08:40:47.0474624Z === RUN   TestNetworkPolicyV2Conformance
2024-04-22T08:40:47.0483530Z     network_policy_v2_test.go:31: Configuring environment for network policy V2 API conformance tests
2024-04-22T08:40:47.0497364Z     network_policy_v2_test.go:53: Starting the network policy V2 conformance test suite
2024-04-22T08:40:47.0498179Z     suite.go:125: Test Setup: Applying base manifests
2024-04-22T08:40:57.0500370Z     apply.go:101: 
2024-04-22T08:40:57.0502629Z         	Error Trace:	/home/runner/go/pkg/mod/sigs.k8s.io/network-policy-api@v0.1.3/conformance/utils/kubernetes/apply.go:101
2024-04-22T08:40:57.0505718Z         	            				/home/runner/go/pkg/mod/sigs.k8s.io/network-policy-api@v0.1.3/conformance/utils/suite/suite.go:126
2024-04-22T08:40:57.0510840Z         	            				/home/runner/go/pkg/mod/sigs.k8s.io/network-policy-api@v0.1.3/conformance/utils/suite/conformance_suite.go:132
2024-04-22T08:40:57.0513626Z         	            				/home/runner/work/ovn-kubernetes/ovn-kubernetes/test/conformance/network_policy_v2_test.go:83
2024-04-22T08:40:57.0515286Z         	Error:      	Received unexpected error:
2024-04-22T08:40:57.0518312Z         	            	Get "https://raw.githubusercontent.com/kubernetes-sigs/network-policy-api/v0.1.3/conformance/base/manifests.yaml": context deadline exceeded
2024-04-22T08:40:57.0519969Z         	Test:       	TestNetworkPolicyV2Conformance
2024-04-22T08:40:57.0520873Z --- FAIL: TestNetworkPolicyV2Conformance (10.00s)
2024-04-22T08:40:57.0521815Z FAIL
2024-04-22T08:40:57.0523797Z exit status 1
2024-04-22T08:40:57.0524690Z FAIL	github.com/ovn-org/ovn-kubernetes/test/conformance	10.015s