Access the latest infrastructure software and tools of the NVIDIA AI Enterprise 7 release, exclusively available with your NVIDIA AI Enterprise subscription. This collection includes Government Ready images for regulated environments.
NVIDIA AI Enterprise Infra Release 7
The Infra Release of NVIDIA AI Enterprise offers infrastructure management and orchestration software for infrastructure and platform teams to efficiently manage and scale AI workloads. NVIDIA AI Enterprise Infra Release 7 includes the following software components-
Infrastructure optimization:
- NVIDIA Virtual GPU Manager- NVIDIA driver to be deployed in the hypervisor for virtualized environments.
- NVIDIA vGPU for Compute Guest Driver- NVIDIA driver to be deployed in the Guest VM in virtualized environments.
- Containerized NVIDIA vGPU for Compute Guest Driver- NVIDIA driver to be deployed in the VM or on a bare metal Operating System.
- Containerized NVIDIA GPU/Datacenter Driver- Enable GPU acceleration for AI and Deep Learning in data centers.
- NVIDIA DOCA-OFED Driver for Networking - Enable accelerated networking for multi-node AI and Deep Learning deployments.
- NVIDIA DOCA Microservices - Prebuilt, composable microservices run natively on NVIDIA BlueField DPU to accelerate AI factories with networking, cybersecurity, data acceleration, and orchestration.
Container orchestration:
- GPU Operator* - Automate the management of all NVIDIA software components needed to provision GPUs in Kubernetes. Available as a Container and Helm Chart.
- NIM Operator*- Enables cluster administrators to operate the software components and services that are necessary to run NVIDIA NIMs with Kubernetes
- Network Operator* - Simplifies the provisioning and management of NVIDIA ConnectX NICs and SuperNICs for east–west networking resources in Kubernetes clusters. Available as a Container and Helm Chart.
- DPU Operator (DPF) - Provides cluster-wide provisioning and lifecycle management of BlueField DPUs and DOCA services, enabling north–south networking in Kubernetes clusters. Available as a Container and Helm Chart.
*Indicates the latest release for the artifacts includes Government Ready images for regulated environments.
Cluster management:
Base Command Manager - Streamline cluster provisioning, workload management, and infrastructure monitoring across data centers and edge locations. Access the listed software components through the Artifacts tab of this collection.
Compatible AI Software Versions
For optimal performance, deploy the supported AI software (frameworks, libraries, pre-trained models, and tools) with this Infra Release.
*Indicates the latest release for the artifacts includes Government Ready images for regulated environments.
Government Ready:
This ensures the highest level of security for regulated environments:
- STIG Ubuntu 24.04 hardened
- Supports FIPS 140-2 / 3 validated crypto / uses libraries that support FIPS crypto To use the specific hardened images, navigate to the Artifact repository's Tags tab and look for the purple label indicating Gov ready displayed alongside the tag. Learn more about NVIDIA's hardened images in the AI Software for Regulated Environments White Paper NVIDIA AI Enterprise Infra 7 release is compatible with:
- Production Branch - October 2024 (25h1)
- NVIDIA AI Enterprise Supported To learn more about the software compatibility, visit the Software Compatibility Matrix in the NVIDIA AI Enterprise Infra Release 7 release documentation.
Get Started
Before you start, ensure that your environment is set up by following one of the deployment guides available in the NVIDIA AI Enterprise Documentation.
Get Help
Enterprise Support
Get access to knowledge-base articles and support cases or submit a ticket.
NVIDIA AI Enterprise Documentation
Visit the NVIDIA AI Enterprise Documentation Hub for release documentation, deployment guides, and more. NVIDIA Licensing Portal Go to the NVIDIA Licensing Portal to manage your software licenses.
