KAI Scheduler

KAI Scheduler is a robust, efficient, and scalable Kubernetes scheduler that optimizes GPU resource allocation for AI workloads. Designed to handle large-scale GPU clusters, including thousands of nodes, and manage a high throughput of workloads, makes it ideal for extensive and demanding environments.

Quick start

Install the helm chart using the following commands:

# Add helm repository
$ helm repo add nvidia https://helm.ngc.nvidia.com/nvidia/k8s \
   && helm repo update

# Install KAI scheduler Helm chart
$ helm upgrade \
     -i kai-scheduler nvidia/kai-scheduler -n kai-scheduler --create-namespace

# Validate installation
kubectl -n kai-scheduler get pods

Documentation

For information on getting started, visit the documentation.

Support and Getting Help

Please open an issue on the GitHub repository for any questions. Your feedback and contributions are very much appreciated!