The Infra Release of NVIDIA AI Enterprise offers infrastructure management and orchestration software for infrastructure and platform teams to efficiently manage and scale AI workloads.
NVIDIA AI Enterprise Infra Release 6 includes the following software components-
Infrastructure optimization:
vGPU C-Series Host Driver- NVIDIA driver to be deployed in the hypervisor for virtualized environments.
Containerized vGPU C-Series Guest Driver- NVIDIA driver to be deployed in the VM or on a bare metal Operating System.
Containerized NVIDIA GPU/Datacenter Driver- Enable GPU acceleration for AI and Deep Learning in data centers.
NVIDIA DOCA-OFED Driver for Networking - Enable accelerated networking for multi-node AI and Deep Learning deployments
Container orchestration:
GPU Operator - Automate the management of all NVIDIA software components needed to provision GPUs in Kubernetes. Available as a Container and Helm Chart.
Network Operator - Simplifies the provisioning and management of NVIDIA networking resources in a Kubernetes cluster. Available as a Container and Helm Chart.
NIM Operator - Enables cluster administrators to operate the software components and services that are necessary to run NVIDIA NIMs with Kubernetes
Cluster management:
Access the listed software components through the Artifacts tab of this collection.
For optimal performance, deploy the supported AI software (frameworks, libraries, pre-trained models, and tools) with this Infra Release.
NVIDIA AI Enterprise Infra 6 release is compatible with:
To learn more about the software compatibility, visit the Software Compatibility Matrix in the NVIDIA AI Enterprise Infra Release 6 release documentation.
Before you start, ensure that your environment is set up by following one of the deployment guides available in the NVIDIA AI Enterprise Documentation.
Get access to knowledge-base articles and support cases or submit a ticket.
Visit the NVIDIA AI Enterprise Documentation Hub for release documentation, deployment guides, and more.
NVIDIA Licensing Portal
Go to the NVIDIA Licensing Portal to manage your software licenses.