[Feature]: Integration with Kubernetes V2

[czy006]

Description

In #1917,The K8S already has some initial support. we will continue to enhance cloud-native capabilities in subsequent versions. Currently, Amoro has preliminary cloud-native capabilities, and we hope to strengthen this aspect in future versions. We can proceed in the following directions:

• Improve cloud-native auto-scaling functionality, allowing Opitizmer to automatically scale in different engines in Kubernetes environments.
• Enhance Helm chart-related features.
• Support high availability of AMS on ETCD.
• Improve Kubernetes-related unit test infrastructure.

Use case/motivation

No response

Describe the solution

No response

Subtasks

• [Improvement]: Support liveness port testing for standby instance #1957
• [Improvement]: AMS server-expose-host should be adapted to domain name scenarios. #1922
• [Improvement]: FlinkOptimizerContainer Support Submit Optimizer Job To Flink Kubernetes #2796
• [Feature]: Add Tests for helm chart templates #2778

Related issues

No response

Are you willing to submit a PR?

• Yes I am willing to submit a PR!

Code of Conduct

• I agree to follow this project's Code of Conduct