ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIAKit SDK - Windows (PB25h1)NVIDIAKit SDK - Linux (PB25h1)NVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Triton Inference Server
Container
NVIDIA
NVIDIA
Triton Inference Server

Triton Inference Server is an open source software that lets teams deploy trained AI models from any framework, from local or cloud storage and on any GPU- or CPU-based infrastructure in the cloud, data center, or embedded devices.

NVIDIA AI Enterprise Supported
LayerLabelCreated
c5c4e6ef00b50f7906336454989ea762c2c088038150ab3317ddcc9c25a8dec4CONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh
12/19/2025 1:18 AM UTC
270ef8829437481db4d5a3c45485586ae99e9bee63bf34c7dd7c212c5d5509e2COPY
docker/entrypoint.d/ /opt/nvidia/entrypoint.d/
12/19/2025 1:18 AM UTC
c4db3a24e9bdb36ac4e44fc33cf8fdbf6b2e0346b804f50f251ce6ddd7b40534ENV
NVIDIA_PRODUCT_NAME=Triton Server Base
12/19/2025 1:18 AM UTC
c4c66cd54a574b177a4c0343bae33dae3c15cf5d8d8cdf025e306e343aa6ab3fENV
NVIDIA_BUILD_ID=246541503
12/19/2025 1:18 AM UTC
e06c551898d558f3e7a183a3888d9e6ad2797d04c71b817159d10d69adb40f92ENV
NVIDIA_TRITON_SERVER_BASE_VERSION=25.12
12/19/2025 1:18 AM UTC
a9fff39f5e3052f7493a460cc4443c9e0542d852451696a035ac9289f881f953ARG
NVIDIA_BUILD_ID=246541503
12/19/2025 1:18 AM UTC
ec989bc238ff650975b74d049c906d111a5165eecc171ab4517280eb2abfb472ARG
NVIDIA_TRITON_SERVER_BASE_VERSION=25.12
12/19/2025 1:18 AM UTC
3ba7941181e640d8a902c919de8449c9a5aab45b4cfae549b5bb19506a025f36RUN
TARGETARCH=amd64 ENABLE_FIPS=0 ENABLE_MITMPROXY=0 /tmp/manage_cert.sh uninstall
12/04/2025 6:50 AM UTC
9b379e33493989d450664012d76692b09a48e7248e7238c243258f9163e2b42cENV
LIBRARY_PATH=/usr/local/cuda/lib64/stubs:/usr/local/cuda/lib64/stubs:
12/04/2025 6:50 AM UTC
2cade9cf48fac15ea0798f1abeedc1069f77757c67d5401c2060dcd8ea2e353eRUN
TARGETARCH=amd64 ENABLE_FIPS=0 ENABLE_MITMPROXY=0 export DEVEL=1 BASE=0 &&
  /nvidia/build-scripts/installNCU.sh &&
  /nvidia/build-scripts/installCUDA.sh &&
  /nvidia/build-scripts/installLIBS.sh &&
  if [ ! -f /etc/ld.so.conf.d/nvidia-tegra.conf ]; then /nvidia/build-scripts/installNCCL.sh; fi &&
  /nvidia/build-scripts/installCUDNN.sh &&
  /nvidia/build-scripts/installTRT.sh &&
  /nvidia/build-scripts/installNSYS.sh &&
  /nvidia/build-scripts/installCUSPARSELT.sh &&
  if [ -f "/tmp/cuda-${_CUDA_VERSION_MAJMIN}.patch" ]; then patch -p0 < /tmp/cuda-${_CUDA_VERSION_MAJMIN}.patch; fi &&
  rm -f /tmp/cuda-*.patch
12/04/2025 6:50 AM UTC
...