ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIAKit SDK - Windows (PB25h1)NVIDIAKit SDK - Linux (PB25h1)NVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Triton Inference Server
Container
NVIDIA
NVIDIA
Triton Inference Server

Triton Inference Server is an open source software that lets teams deploy trained AI models from any framework, from local or cloud storage and on any GPU- or CPU-based infrastructure in the cloud, data center, or embedded devices.

NVIDIA AI Enterprise Supported
LayerLabelCreated
932d199dd164d6180c8b500d26a66308ee4895ebdebcaf9e41d98f3d7bfc7e1fCONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh
11/20/2025 9:44 PM UTC
99179701ad4260314719f7958aae5384b479e903efd890e7b9844af58b89accaCOPY
docker/entrypoint.d/ /opt/nvidia/entrypoint.d/
11/20/2025 9:44 PM UTC
9b02c2b13cdd80ec00b05124667bec61b1d1b3524a1af647c13779211f33db2cENV
NVIDIA_PRODUCT_NAME=Triton Server Base
11/20/2025 9:44 PM UTC
c68a5f38f9c780e43af399ac05c88ded709ace9356ee7d745781f7f5a419db6eENV
NVIDIA_BUILD_ID=236082522
11/20/2025 9:44 PM UTC
5bcff259974f746ae79d6fdaab0cbf8525ad4d48024348e1b56ccb8a090a1a21ENV
NVIDIA_TRITON_SERVER_BASE_VERSION=25.11
11/20/2025 9:44 PM UTC
c5b282ec06b847656f8ac3bbd0de862cd3eefae2f5265cf7524041292d8a204eARG
NVIDIA_BUILD_ID=236082522
11/20/2025 9:44 PM UTC
1be96b033d617d95c36ea48a7103d2484e8780b5aa1b2e2989563f24374ab6a5ARG
NVIDIA_TRITON_SERVER_BASE_VERSION=25.11
11/20/2025 9:44 PM UTC
94c370fb05517b7c591a9982e01b72e858db70c9f1d1a3b711b2da72da2c9553RUN
ENABLE_MITMPROXY=0 /tmp/manage_cert.sh uninstall
11/08/2025 4:01 AM UTC
bd1277269f3edb2a7859e09c1bb1dd07b72bdaedc5cb1d7a18c598c07e4168b2ENV
LIBRARY_PATH=/usr/local/cuda/lib64/stubs:/usr/local/cuda/lib64/stubs:
11/08/2025 4:01 AM UTC
be2d7530bd6a002bfef158879675300446a996a19efa67d949946bec03fa4581RUN
ENABLE_MITMPROXY=0 export DEVEL=1 BASE=0 &&
  /nvidia/build-scripts/installNCU.sh &&
  /nvidia/build-scripts/installCUDA.sh &&
  /nvidia/build-scripts/installLIBS.sh &&
  if [ ! -f /etc/ld.so.conf.d/nvidia-tegra.conf ]; then /nvidia/build-scripts/installNCCL.sh; fi &&
  /nvidia/build-scripts/installCUDNN.sh &&
  /nvidia/build-scripts/installTRT.sh &&
  /nvidia/build-scripts/installNSYS.sh &&
  /nvidia/build-scripts/installCUSPARSELT.sh &&
  if [ -f "/tmp/cuda-${_CUDA_VERSION_MAJMIN}.patch" ]; then patch -p0 < /tmp/cuda-${_CUDA_VERSION_MAJMIN}.patch; fi &&
  rm -f /tmp/cuda-*.patch
11/08/2025 4:01 AM UTC
...