The Infra Release of NVIDIA AI Enterprise offers infrastructure management and orchestration software for IT professionals to efficiently manage and scale AI workloads.
Infra Release 5 includes the following software components-
Container orchestration:
GPU Operator - Automate the management of all NVIDIA software components needed to provision GPUs in Kubernetes. Available as a Container and Helm Chart.
Network Operator - Simplifies the provisioning and management of NVIDIA networking resources in a Kubernetes cluster. Available as a Container and Helm Chart.
NIM Operator - Enables cluster administrators to operate the software components and services that are necessary to run NVIDIA NIMs with Kubernetes
Infrastructure optimization:
vGPU Host Driver- NVIDIA driver to be deployed in the hypervisor for virtualized environments.
Containerized vGPU Guest Driver- NVIDIA driver to be deployed in the VM or on a bare metal Operating System
Containerized NVIDIA GPU/Datacenter Driver- Enable GPU acceleration for AI and Deep Learning in data centers.
Cluster management:
Access the listed software components through the Entities tab of this collection.
For optimal performance, deploy the supported AI software (frameworks, libraries, pre-trained models, and tools) with this Infra Release.
Release | GPU Operator Helm Chart | Network Operator Helm Chart | NVIDIA NIM Operator | vGPU Host Driver | Containerized vGPU Guest Driver | vGPU Guest Driver | Containerized NVIDIA GPU/Datacenter Driver | NVIDIA GPU/Datacenter Driver | NVIDIA Base Command Manager Essentials |
---|---|---|---|---|---|---|---|---|---|
Product Documentation | Product Documentation | Product Documentation | Product Documentation | Product Documentation | Product Documentation | Product Documentation | Product Documentation | Product Documentation | |
5.2 Release | 24.6.0 | 24.7.0 | 1.0.0 | vGPU 17.4 | vGPU 17.4: 550.127.05 (Linux) | vGPU 17.4 | 550.127.05 (Linux) | 550.127.05 (Linux) | 10.24.09 |
5.1 Release | 24.3.0 | 24.4.0 | N/A | vGPU 17.3 | vGPU 17.3: 550.90.07 (Linux) | vGPU 17.3 | 550.90.07 (Linux) | 550.90.07 (Linux) | 10.24.05 |
5.0 Release | 23.9.2 | 24.1.0 | N/A | vGPU 17.1 | vGPU 17.1: 550.54.15 (Linux) | vGPU 17.1 | 550.54.15 (Linux) | 550.54.15 (Linux) | 10.24.03 |
NVIDIA AI Enterprise Infra 5 release is compatible with:
To learn more about the software compatibility, visit the Software Compatibility Matrix in the NVIDIA AI Entperise Infra Release 5 release documentation.
Before you start, ensure that your environment is set up by following one of the deployment guides available in the NVIDIA AI Enterprise Documentation.
Get access to knowledge-base articles and support cases or submit a ticket.
Visit the NVIDIA AI Enterprise Documentation Hub for release documentation, deployment guides, and more.
NVIDIA Licensing Portal
Go to the NVIDIA Licensing Portal to manage your software licenses.