Skip to content

Latest commit

 

History

History
44 lines (31 loc) · 2.18 KB

File metadata and controls

44 lines (31 loc) · 2.18 KB
title date weight description
Provisioning Admission Check Controller
2023-10-23
1
An admission check controller providing kueue integration with cluster autoscaler.

The Provisioning Admission Check Controller is an Admission Check Controller designed to integrate Kueue with Kubernetes cluster-autoscaler. Its primary function is to create ProvisioningRequests for the workloads holding Quota Reservation and keeping the AdmissionCheckState in sync.

The controller is part of kueue. You can enable it by setting the ProvisioningACC feature gate. Check the Installation guide for details on feature gate configuration.

The Provisioning Admission Check Controller is supported on Kubernetes cluster-autoscaler versions 1.29 and later. However, some cloud-providers may not have an implementation for it.

Parameters

This controller uses a ProvisioningRequestConfig as parameters, like:

apiVersion: kueue.x-k8s.io/v1beta1
kind: ProvisioningRequestConfig
metadata:
  name: prov-test-config
spec:
  provisioningClassName: queued-provisioning.gke.io
  managedResources:
  - nvidia.com/gpu

Where:

  • provisioningClassName - describes the different modes of provisioning the resources. Check autoscaling.x-k8s.io ProvisioningRequestSpec.provisioningClassName for details.
  • managedResources - contains the list of resources managed by the autoscaling.

Check the API definition for more details.

Example

Setup

{{< include "/examples/provisioning/provisioning-setup.yaml" "yaml" >}}

Job using a ProvisioningRequest

{{< include "/examples/provisioning/sample-job.yaml" "yaml" >}}