The Infra Release of NVIDIA AI Enterprise offers infrastructure management and orchestration software for IT professionals to efficiently manage and scale AI workloads. This Infra release is composed to power the Long Term Supported Branches (LTSB) of AI frameworks and SDKs and assures a supported configuration.
Infra Release 4 includes the following software components-
Container orchestration:
GPU Operator - Automate the management of all NVIDIA software components needed to provision GPUs in Kubernetes. Available as a Container and Helm Chart.
Network Operator - Simplifies the provisioning and management of NVIDIA networking resources in a Kubernetes cluster. Available as a Container and Helm Chart.
Infrastructure optimization:
vGPU Host Driver- NVIDIA driver to be deployed in the hypervisor for virtualized environments.
Containerized vGPU Guest Driver- NVIDIA driver to be deployed in the VM or on a bare metal Operating System.
Containerized NVIDIA GPU/Datacenter Driver- Enable GPU acceleration for AI and Deep Learning in data centers.
Cluster management:
Access the listed software components through the Entities tab of this collection.
For optimal performance, deploy the supported AI software (frameworks, libraries, pre-trained models, and tools) with this Infra Release.
Release | GPU Operator Helm Chart | Network Operator Helm Chart | vGPU Host Driver | Containerized vGPU Guest Driver | vGPU Guest Driver | Containerized NVIDIA GPU/Datacenter Driver | NVIDIA GPU/Datacenter Driver | Base Command Manager |
---|---|---|---|---|---|---|---|---|
Product Documentation | Product Documentation | Product Documentation | Product Documentation | Product Documentation | Product Documentation | Product Documentation | Product Documentation | |
4.4 Release | 24.6.2 | 24.7.0 | vGPU 16.8 | 535.216.01 (Linux) | vGPU 16.8 | 535.216.01 (Linux) | 535.216.01 (Linux) | 10.24.09 |
NVIDIA AI Enterprise Infra 4 release is compatible with:
To learn more about the software compatibility, visit the Software Compatibility Matrix
Before you start, ensure that your environment is set up by following one of the deployment guides available in the NVIDIA AI Enterprise Documentation.
Get access to knowledge-base articles and support cases or submit a ticket.
Visit the NVIDIA AI Enterprise Documentation Hub for release documentation, deployment guides, and more.
NVIDIA Licensing Portal
Go to the NVIDIA Licensing Portal to manage your software licenses.