ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIAKit SDK - Windows (PB25h1)NVIDIAKit SDK - Linux (PB25h1)NVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Triton Inference Server
Container
NVIDIA
NVIDIA
Triton Inference Server

Triton Inference Server is an open source software that lets teams deploy trained AI models from any framework, from local or cloud storage and on any GPU- or CPU-based infrastructure in the cloud, data center, or embedded devices.

NVIDIA AI Enterprise Supported
LayerLabelCreated
83082a35e42fa8ac5d2b9f4d24e0a5f4da7fdbb68f6943868251b310b4af4993CONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh
10/29/2025 7:09 PM UTC
ca1584eee91fbc5e5ed2b64c76e0abbd6c943ae4ed3e06c0e3af05b526e4166bCOPY
docker/entrypoint.d/ /opt/nvidia/entrypoint.d/
10/29/2025 7:09 PM UTC
9dfdb920ca2ba1249e77952cba96e945023a439da8ef62996e0dd6a33c6b684bENV
NVIDIA_PRODUCT_NAME=Triton Server Base
10/29/2025 7:09 PM UTC
6174fe08b5ef6df337bc581e6f0572feab9c6bb82fbe93a129e0d0b25f572e28ENV
NVIDIA_BUILD_ID=226999189
10/29/2025 7:09 PM UTC
ce72e67f5dfbf77c2a436bb2ba0a9224294632ddd15909d0f2ebd846cbbb8a08ENV
NVIDIA_TRITON_SERVER_BASE_VERSION=25.10
10/29/2025 7:09 PM UTC
d13f7cb4d1c237fb4730d639a9d41a908c21c599c84c25726a1d02f483ba46a5ARG
NVIDIA_BUILD_ID=226999189
10/29/2025 7:09 PM UTC
409aa107a642d8f96f99b2e4b1b223e74baa2787fac78acca1ab70ee42be9eadARG
NVIDIA_TRITON_SERVER_BASE_VERSION=25.10
10/29/2025 7:09 PM UTC
f147dfd6bf926d426e4c350d9056297294120857b8a60d5bc70fd7bbf1cc2b66RUN
ENABLE_MITMPROXY=0 /tmp/manage_cert.sh uninstall
10/17/2025 12:25 AM UTC
fe2e29a5ae0d2a47df3be16a51f8fb8fdacfc0e852696e93dc5aed1740f6a6c0ENV
LIBRARY_PATH=/usr/local/cuda/lib64/stubs:
10/17/2025 12:25 AM UTC
faf1b80e74ac4bc69e16ff0f4bacc0c67d72d94047d433f47d45858b2e8d9f8cRUN
ENABLE_MITMPROXY=0 export DEVEL=1 BASE=0 &&
  /nvidia/build-scripts/installNCU.sh &&
  /nvidia/build-scripts/installCUDA.sh &&
  /nvidia/build-scripts/installLIBS.sh &&
  if [ ! -f /etc/ld.so.conf.d/nvidia-tegra.conf ]; then /nvidia/build-scripts/installNCCL.sh; fi &&
  /nvidia/build-scripts/installCUDNN.sh &&
  /nvidia/build-scripts/installTRT.sh &&
  /nvidia/build-scripts/installNSYS.sh &&
  /nvidia/build-scripts/installCUSPARSELT.sh &&
  if [ -f "/tmp/cuda-${_CUDA_VERSION_MAJMIN}.patch" ]; then patch -p0 < /tmp/cuda-${_CUDA_VERSION_MAJMIN}.patch; fi &&
  rm -f /tmp/cuda-*.patch
10/17/2025 12:25 AM UTC
...