ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIAKit SDK - Windows (PB25h1)NVIDIAKit SDK - Linux (PB25h1)NVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Triton Inference Server
Container
NVIDIA
NVIDIA
Triton Inference Server

Triton Inference Server is an open source software that lets teams deploy trained AI models from any framework, from local or cloud storage and on any GPU- or CPU-based infrastructure in the cloud, data center, or embedded devices.

NVIDIA AI Enterprise Supported
LayerLabelCreated
f45a7eba42066c1b9eb03ee91d7de76c3f5e59e8808901ee4a3c6f54c37114f3CONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh
10/03/2025 5:16 PM UTC
da9c876caeecceec948f5e185695e57cbe60466725eb6a6cebfd357a64a792aaCOPY
docker/entrypoint.d/ /opt/nvidia/entrypoint.d/
10/03/2025 5:16 PM UTC
1631fab831e45d07da789f2dcaa024d64ccdf45bbe47edbe60b2a0da40510d07ENV
NVIDIA_PRODUCT_NAME=Triton Server Base
10/03/2025 5:16 PM UTC
74ce8c6aa025bbe8d350aa9e2b0b7ddf6d7117c7787964f602a6321be373c29fENV
NVIDIA_BUILD_ID=216994193
10/03/2025 5:16 PM UTC
7056cdca7608ce51ef2776908fd01fb982785989f91770c112f6f47a688e3e27ENV
NVIDIA_TRITON_SERVER_BASE_VERSION=25.09
10/03/2025 5:16 PM UTC
5d5d6447a7b6e74c37dda9d4f20308e74ffff3cb2f803bfe3f483ab88f9de9c2ARG
NVIDIA_BUILD_ID=216994193
10/03/2025 5:16 PM UTC
d5e5d790ebe665114b68cf383f150617e9c8d46ad349a7821578bebf66e9a1fdARG
NVIDIA_TRITON_SERVER_BASE_VERSION=25.09
10/03/2025 5:16 PM UTC
fbda5bdf0b9349ddf9a3f01070457ba208632db15963634603e552e63eff1070RUN
ENABLE_MITMPROXY=0 /tmp/manage_cert.sh uninstall
09/05/2025 8:00 PM UTC
8f56b92ff2e7753ebb60d578eb82cb80b12213a9d80e63f2ddbcf933b337e30fENV
LIBRARY_PATH=/usr/local/cuda/lib64/stubs:
09/05/2025 8:00 PM UTC
373808979cc342bafd90c435a699f5a510701e5a9977f9d2c0b0fa619c943273RUN
ENABLE_MITMPROXY=0 export DEVEL=1 BASE=0 &&
  /nvidia/build-scripts/installNCU.sh &&
  /nvidia/build-scripts/installCUDA.sh &&
  /nvidia/build-scripts/installLIBS.sh &&
  if [ ! -f /etc/ld.so.conf.d/nvidia-tegra.conf ]; then /nvidia/build-scripts/installNCCL.sh; fi &&
  /nvidia/build-scripts/installCUDNN.sh &&
  /nvidia/build-scripts/installTRT.sh &&
  /nvidia/build-scripts/installNSYS.sh &&
  /nvidia/build-scripts/installCUSPARSELT.sh &&
  if [ -f "/tmp/cuda-${_CUDA_VERSION_MAJMIN}.patch" ]; then patch -p0 < /tmp/cuda-${_CUDA_VERSION_MAJMIN}.patch; fi &&
  rm -f /tmp/cuda-*.patch
09/05/2025 8:00 PM UTC
...