Chore: Kubernetes cluster version upgrades

[raykrueger]

Description

The EKS cluster versions in various blueprints are getting a bit behind. We should upgrade all of our blueprints to latest (1.29 at the time of this wrting, 1.30 due soon).

Find them is done as possible.
Clone the repo and cd to it.

git clone https://github.com/awslabs/data-on-eks.git
cd data-on-eks

In our blueprints the eks_cluster_version is stored in the variables.tf file. There are other notable version references that should get updated as well.

Find clusters with 1.26

$ git grep "1\.26" -- '*.tf'
analytics/terraform/datahub-on-eks/variables.tf:  default     = "1.26"
schedulers/terraform/managed-airflow-mwaa/variables.tf:  default     = "1.26"

Find clusters with 1.27

$ git grep "1\.27" -- '*.tf'
ai-ml/jark-stack/terraform/eks.tf:      # aws ssm get-parameters --names /aws/service/eks/optimized-ami/1.27/amazon-linux-2/recommended/image_id --region us-west-2
ai-ml/jupyterhub/variables.tf:  default     = "1.27"
ai-ml/mlflow/variables.tf:  default     = "1.27"
ai-ml/trainium-inferentia/eks.tf:      # aws ssm get-parameters --names /aws/service/eks/optimized-ami/1.27/amazon-linux-2/recommended/image_id --region us-west-2
ai-ml/trainium-inferentia/eks.tf:      # aws ssm get-parameters --names /aws/service/eks/optimized-ami/1.27/amazon-linux-2-gpu/recommended/image_id --region us-west-2
ai-ml/trainium-inferentia/eks.tf:      # aws ssm get-parameters --names /aws/service/eks/optimized-ami/1.27/amazon-linux-2-gpu/recommended/image_id --region us-west-2
ai-ml/trainium-inferentia/eks.tf:      # aws ssm get-parameters --names /aws/service/eks/optimized-ami/1.27/amazon-linux-2-gpu/recommended/image_id --region us-west-2
ai-ml/trainium-inferentia/eks.tf:      # aws ssm get-parameters --names /aws/service/eks/optimized-ami/1.27/amazon-linux-2-gpu/recommended/image_id --region us-west-2
analytics/terraform/emr-eks-ack/variables.tf:  default     = "1.27"
analytics/terraform/emr-eks-fargate/variables.tf:  default     = "1.27"
streaming/flink/variables.tf:  default     = "1.27"
streaming/kafka/variables.tf:  default     = "1.27"
streaming/nifi/variables.tf:  default     = "1.27"

And finally, 1.28

$ git grep "1\.28" -- '*.tf'
analytics/terraform/emr-eks-karpenter/variables.tf:  default     = "1.28"
analytics/terraform/spark-k8s-operator/variables.tf:  default     = "1.28"
distributed-databases/pinot/variables.tf:  default     = "1.28"

[manjarisri]

Hello, i have raised a PR for the same
PR #523