GPU-optimized AI, Machine Learning, & HPC Software

NVIDIA

Validator for NVIDIA GPU Operator

Validates NVIDIA GPU Operator components

Container

NVIDIA

NVIDIA GPU Driver

Provision NVIDIA GPU Driver as a Container

Container

NVIDIA

NVIDIA GPU Feature Discovery for Kubernetes

Plugin for the Kubernetes Node Feature Discovery for adding GPU node labels.

Container

NVIDIA

Triton Inference Server

Triton Inference Server is an open source software that lets teams deploy trained AI models from any framework, from local or cloud storage and on any GPU- or CPU-based infrastructure in the cloud, data center, or embedded devices.

Container

NVIDIA

DOCA Telemetry Service

DOCA Telemetry Service (DTS) is a DOCA Service for collecting and exporting telemetry data. Both predefined and user-defined telemetry counters are available and the export is made by Prometheus, Fluent Bit, Open Telemetry and netflow.

Container

NVIDIA

DOCA HBN

Host based networking (HBN) is a DOCA Service that runs on NVIDIA's DPU. It orchestrates network connectivity of dynamically created VMs/Containers on cloud servers. HBN service is a BGP router that supports EVPN extension to enable multi-tenant cloud.

Container

Allegro AI

Allegro Trains Agent

Allegro Trains delivers an optimized, seamless, and scalable solution for training on DGX machines with ML-Ops and experiment management features.

Container

NVIDIA

NVIDIA vGPU Device Manager

Manages NVIDIA vGPU devices in a Kubernetes cluster

Container

NVIDIA

DPF System

DOCA Platform Framework enables the management of NVIDIA DPUs and the services that run on them at scale. DPF System contains the main system components for DPF.

Container

NVIDIA

NVIDIA Magnum IO Developer Environment

NVIDIA Magnum IO is the I/O technologies from NVIDIA and Mellanox that enable applications at scale. The Magnum IO Developer Environment container allows developers to begin scaling their applications on a laptop, desktop, workstation, or in the cloud.

Container

NVIDIA

Dynamo vLLM Runtime

The Dynamo vLLM runtime image is a containerized build of Dynamo + vLLM which serves as the base runtime environment for vLLM based inference with Dynamo's distributed inference framework.

Container

NVIDIA

Dynamo Tensorrt-LLM Runtime

The Dynamo TensorRT-LLM runtime image is a containerized build of Dynamo + TensorRT-LLM which serves as the base runtime environment for tensorrt-llm based inference with Dynamo's distributed inference framework.

Container

NVIDIA

CUDA GL

CUDA is a parallel computing platform and programming model that enables dramatic increases in computing performance by harnessing the power of the NVIDIA GPUs. These images extend the CUDA images to include OpenGL support through libglvnd.

Container

NVIDIA

RDMA Shared Device Plugin

This is simple RDMA Device Plugin that support IB and RoCE HCA.

Container

NVIDIA

DPF DPU Networking

DOCA Platform Framework enables the management of NVIDIA DPUs and the services that run on them at scale. This helm chart is deployed by the DPF Operator and is responsible for setting up networking related components required on the DPU.

Helm Chart

NVIDIA

Dynamo SGLang Runtime

The Dynamo SGLang runtime image is a containerized build of Dynamo + SGLang which serves as the base runtime environment for sglang based inference with Dynamo's distributed inference framework.

Container

NVIDIA AI Enterprise

NVIDIA

NVIDIA vGPU Guest Driver 6

Containerized NVIDIA vGPU Guest Driver

Container

NVIDIA

DPU (DPF) Operator

DOCA Platform Framework enables the management of NVIDIA DPUs and the services that run on them at scale. This helm chart enables the deployment of DPF.

Helm Chart

NVIDIA

Dynamo kubernetes-operator

kubernetes-operator is a container that runs as part of the Dynamo cloud platform. Dynamo cloud is a kubernetes platform for deploying and managing inference services. This container manages the lifecycle of Dynamo inference deployments in kubernetes.