ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIAKit SDK - Windows (PB25h1)NVIDIAKit SDK - Linux (PB25h1)NVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Triton Inference Server
Container
NVIDIA
NVIDIA
Triton Inference Server

Triton Inference Server is an open source software that lets teams deploy trained AI models from any framework, from local or cloud storage and on any GPU- or CPU-based infrastructure in the cloud, data center, or embedded devices.

NVIDIA AI Enterprise Supported
LayerLabelCreated
0df337b3d61cbbf1545e30a7784640c20ecc8ae3b9a4a82d380a586003b876ccCONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /opt/tritonserver
07/28/2025 5:03 PM UTC
320ac7e82d21f96ed09822a5da26bb6ad957dd08d70d20cafdea20fc09bcb11fLABEL
com.amazonaws.sagemaker.capabilities.accept-bind-to-port=true
07/28/2025 5:03 PM UTC
e165b2e1d28607ae6c02207c3007fae68d5ece879d86257aa385faad7a73d33eRUN
TRITON_VERSION=2.59.1 TRITON_CONTAINER_VERSION=25.07 chown triton-server:triton-server /opt/tritonserver/caches
07/28/2025 5:03 PM UTC
a481f989d1f6e61546426bd2552962afac9409a9af8f356b7c11bcbb3656bb3fCOPY
--chown=1000:1000 /opt/tritonserver/caches/local /opt/tritonserver/caches/local
07/28/2025 5:03 PM UTC
13e8c4844273bcf7749361ebbf42a1f741d87292e4552f7515a63fcdae90c3f6RUN
TRITON_VERSION=2.59.1 TRITON_CONTAINER_VERSION=25.07 chown triton-server:triton-server /opt/tritonserver/repoagents
07/28/2025 5:03 PM UTC
4278615c5410d1266a88ba7c7c4f8fc9d8e1018f724f4b250da18a3be4203ea7COPY
--chown=1000:1000 /opt/tritonserver/repoagents/checksum /opt/tritonserver/repoagents/checksum
07/28/2025 5:03 PM UTC
12f50434b2c61cc2b3c9be8109e16c4fa29a6597428ced861f6af56643f78df1RUN
TRITON_VERSION=2.59.1 TRITON_CONTAINER_VERSION=25.07 chown triton-server:triton-server /opt/tritonserver/backends
07/28/2025 5:03 PM UTC
97da299fbe5a9329344e75f996be16556e5478483f3d9a268811f8da9f11e562COPY
--chown=1000:1000 /opt/tritonserver/backends/python /opt/tritonserver/backends/python
07/28/2025 5:03 PM UTC
79d639326e74c6ace96a58ccc59187b9b6a37bf62a09f9f077bf1d403cba9f95COPY
--chown=1000:1000 /opt/tritonserver/backends/identity /opt/tritonserver/backends/identity
07/28/2025 5:03 PM UTC
bfe9cb4fa25939e408d6df991c58398bffcaa208673b4372d1e5e91f3482651bCOPY
--chown=1000:1000 /opt/tritonserver/backends/pytorch /opt/tritonserver/backends/pytorch
07/28/2025 5:03 PM UTC
...