ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIAKit SDK - Windows (PB25h1)NVIDIAKit SDK - Linux (PB25h1)NVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Triton Inference Server
Container
NVIDIA
NVIDIA
Triton Inference Server

Triton Inference Server is an open source software that lets teams deploy trained AI models from any framework, from local or cloud storage and on any GPU- or CPU-based infrastructure in the cloud, data center, or embedded devices.

NVIDIA AI Enterprise Supported
LayerLabelCreated
5a5e6d664205aed0e2c1e8ee8397a3733d41e6f028c8f67c93c7793376e70b2eCONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh
07/28/2025 4:29 PM UTC
3f2a82789aa489f319e10e363db232e2e6ddcb468b284dd3a5941d120726c4bbCOPY
docker/entrypoint.d/ /opt/nvidia/entrypoint.d/
07/28/2025 4:29 PM UTC
bfc92aa6228815872227dd12f17a66ff2f9d703a253437c4cfc1f98f722c4baaENV
NVIDIA_PRODUCT_NAME=Triton Server Base
07/28/2025 4:29 PM UTC
e69d3b48faa848842825ecd3e2ffac59e6d367e6f57cc9b726d41e732d1ee45bENV
NVIDIA_BUILD_ID=193148793
07/28/2025 4:29 PM UTC
c3d10f9835f36cc56ecff4fdcd572077fe898d0316476afa8f156111e6b3c458ENV
NVIDIA_TRITON_SERVER_BASE_VERSION=25.07
07/28/2025 4:29 PM UTC
d0cdef5e5cd9f48811433d007bf45cc995adc20156992916a5691aca440ca244ARG
NVIDIA_BUILD_ID=193148793
07/28/2025 4:29 PM UTC
3275ee10edbb4def31dd089f5bd1a7f305339e9fe147a6607f553b5445cd8b96ARG
NVIDIA_TRITON_SERVER_BASE_VERSION=25.07
07/28/2025 4:29 PM UTC
2e57555c8f9a999c9804e7f6f746fe2bbd20785209000199422369f74270ccefENV
LIBRARY_PATH=/usr/local/cuda/lib64/stubs:
06/12/2025 7:17 AM UTC
09bd2db3a23f673201aeabe16b3953816dcfd23311fdbbb8f6ef0b65adfd09edRUN
export DEVEL=1 BASE=0 &&
  /nvidia/build-scripts/installNCU.sh &&
  /nvidia/build-scripts/installCUDA.sh &&
  /nvidia/build-scripts/installLIBS.sh &&
  if [ ! -f /etc/ld.so.conf.d/nvidia-tegra.conf ]; then /nvidia/build-scripts/installNCCL.sh; fi &&
  /nvidia/build-scripts/installCUDNN.sh &&
  /nvidia/build-scripts/installTRT.sh &&
  /nvidia/build-scripts/installNSYS.sh &&
  /nvidia/build-scripts/installCUSPARSELT.sh &&
  if [ -f "/tmp/cuda-${_CUDA_VERSION_MAJMIN}.patch" ]; then patch -p0 < /tmp/cuda-${_CUDA_VERSION_MAJMIN}.patch; fi &&
  rm -f /tmp/cuda-*.patch
06/12/2025 7:17 AM UTC
e498fce560ffaa821b2d861d7f6184810bcf1963ae75a38f38e718c9ef3f2e68COPY
cuda-*.patch /tmp
06/12/2025 7:02 AM UTC