NVIDIA AI Enterprise Infra 5
NVIDIA AI Enterprise Infra Release 5
The Infra Release of NVIDIA AI Enterprise offers infrastructure management and orchestration software for IT professionals to efficiently manage and scale AI workloads.
Infra Release 5 includes the following software components-
Container orchestration:
GPU Operator - Automate the management of all NVIDIA software components needed to provision GPUs in Kubernetes. Available as a Container and Helm Chart.
Network Operator - Simplifies the provisioning and management of NVIDIA networking resources in a Kubernetes cluster. Available as a Container and Helm Chart.
NIM Operator - Enables cluster administrators to operate the software components and services that are necessary to run NVIDIA NIMs with Kubernetes
Infrastructure optimization:
vGPU Host Driver- NVIDIA driver to be deployed in the hypervisor for virtualized environments.
Containerized vGPU Guest Driver- NVIDIA driver to be deployed in the VM or on a bare metal Operating System
Containerized NVIDIA GPU/Datacenter Driver- Enable GPU acceleration for AI and Deep Learning in data centers.
Cluster management:
- Base Command Manager- Streamline cluster provisioning, workload management, and infrastructure monitoring across data centers and edge locations.
Access the listed software components through the Entities tab of this collection.
Compatible AI Software Versions
For optimal performance, deploy the supported AI software (frameworks, libraries, pre-trained models, and tools) with this Infra Release.
| Release | GPU Operator Helm Chart | Network Operator Helm Chart | NVIDIA NIM Operator | vGPU Host Driver | Containerized vGPU Guest Driver | vGPU Guest Driver | Containerized NVIDIA GPU/Datacenter Driver | NVIDIA GPU/Datacenter Driver | NVIDIA Base Command Manager Essentials |
|---|---|---|---|---|---|---|---|---|---|
| Product Documentation | Product Documentation | Product Documentation | Product Documentation | Product Documentation | Product Documentation | Product Documentation | Product Documentation | Product Documentation | |
| 5.3 Release | 24.9.2 | 24.10.1 | 1.0.1 | vGPU 17.5 | vGPU 17.5: 550.144.03 (Linux) | vGPU 17.5 | 550.144.03 (Linux) | 550.144.03 (Linux) | 10.24.11a |
| 5.2 Release | 24.6.0 | 24.7.0 | 1.0.0 | vGPU 17.4 | vGPU 17.4: 550.127.05 (Linux) | vGPU 17.4 | 550.127.05 (Linux) | 550.127.05 (Linux) | 10.24.09 |
| 5.1 Release | 24.3.0 | 24.4.0 | N/A | vGPU 17.3 | vGPU 17.3: 550.90.07 (Linux) | vGPU 17.3 | 550.90.07 (Linux) | 550.90.07 (Linux) | 10.24.05 |
| 5.0 Release | 23.9.2 | 24.1.0 | N/A | vGPU 17.1 | vGPU 17.1: 550.54.15 (Linux) | vGPU 17.1 | 550.54.15 (Linux) | 550.54.15 (Linux) | 10.24.03 |
NVIDIA AI Enterprise Infra 5 release is compatible with:
To learn more about the software compatibility, visit the Software Compatibility Matrix
Get Started
Before you start, ensure that your environment is set up by following one of the deployment guides available in the NVIDIA AI Enterprise Documentation.
Get Help
Enterprise Support
Get access to knowledge-base articles and support cases or submit a ticket.
NVIDIA AI Enterprise Documentation
Visit the NVIDIA AI Enterprise Documentation Hub for release documentation, deployment guides, and more.
NVIDIA Licensing Portal
Go to the NVIDIA Licensing Portal to manage your software licenses.