NVIDIA AI Enterprise Infra 6
NVIDIA AI Enterprise Infra Release 6
The Infra Release of NVIDIA AI Enterprise offers infrastructure management and orchestration software for infrastructure and platform teams to efficiently manage and scale AI workloads.
NVIDIA AI Enterprise Infra Release 6 includes the following software components-
Infrastructure optimization:
Containerized NVIDIA GPU/Datacenter Driver- Enable GPU acceleration for AI and Deep Learning in data centers.
NVIDIA DOCA Driver for Networking - Enable accelerated networking for multi-node AI and Deep Learning deployments
Container orchestration:
GPU Operator - Automate the management of all NVIDIA software components needed to provision GPUs in Kubernetes. Available as a Container and Helm Chart.
Network Operator - Simplifies the provisioning and management of NVIDIA networking resources in a Kubernetes cluster. Available as a Container and Helm Chart.
NIM Operator - Enables cluster administrators to operate the software components and services that are necessary to run NVIDIA NIMs with Kubernetes
Cluster management:
- Base Command Manager- Streamline cluster provisioning, workload management, and infrastructure monitoring across data centers and edge locations.
Access the listed software components through the Artifacts tab of this collection.
Compatible AI Software Versions
For optimal performance, deploy the supported AI software (frameworks, libraries, pre-trained models, and tools) with this Infra Release.
| Release | GPU Operator Helm Chart | Network Operator Helm Chart | NVIDIA NIM Operator | vGPU Host Driver | Containerized vGPU Guest Driver | vGPU Guest Driver | Containerized NVIDIA GPU/Datacenter Driver | NVIDIA GPU/Datacenter Driver | NVIDIA DOCA Driver (DOCA-OFED) | NVIDIA Base Command Manager Essentials |
|---|---|---|---|---|---|---|---|---|---|---|
| Product Documentation | Product Documentation | Product Documentation | Product Documentation | Product Documentation | Product Documentation | Product Documentation | Product Documentation | Product Documentation | Product Documentation | |
| 6.1 Release | 24.9.2 | 25.1.0 | 1.0.1 | vGPU 18.0 | vGPU 18.0: 570.124.06 (Linux) | vGPU 18.0 | 570.124.06 | 570.124.06 (Linux) | v25.1.0 (DOCA 2.10.0, Linux) | 10.24.11a |
| 6.0 Release | 24.9.2 | 24.10.1 | 1.0.1 | Available in 6.1 | Available in 6.1 | Available in 6.1 | 570.86.15 | 570.86.15 (Linux) | 24.10.1 (DOCA 2.9.1, Linux) | 10.24.11 |
NVIDIA AI Enterprise Infra 6 release is compatible with:
To learn more about the software compatibility, visit the Software Compatibility Matrix in the NVIDIA AI Entperise Infra Release 6 release documentation.
Get Started
Before you start, ensure that your environment is set up by following one of the deployment guides available in the NVIDIA AI Enterprise Documentation.
Get Help
Enterprise Support
Get access to knowledge-base articles and support cases or submit a ticket.
NVIDIA AI Enterprise Documentation
Visit the NVIDIA AI Enterprise Documentation Hub for release documentation, deployment guides, and more.
NVIDIA Licensing Portal
Go to the NVIDIA Licensing Portal to manage your software licenses.