ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIAKit SDK - Windows (PB25h1)NVIDIAKit SDK - Linux (PB25h1)NVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Triton Inference Server
Container
NVIDIA
NVIDIA
Triton Inference Server

Triton Inference Server is an open source software that lets teams deploy trained AI models from any framework, from local or cloud storage and on any GPU- or CPU-based infrastructure in the cloud, data center, or embedded devices.

NVIDIA AI Enterprise Supported
LayerLabelCreated
82f838a86cee0e42e8e5bdd8eb5fae3b6e4e892560d3a284b5cfb719330aac4dCONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh
12/19/2025 12:40 AM UTC
f38e3f6846c906e9e9364b6f5d29c4073ba44cc76150a5feee2587c5b203332cCOPY
docker/entrypoint.d/ /opt/nvidia/entrypoint.d/
12/19/2025 12:40 AM UTC
d68fa6013db4960dc569e940941bac086f8818884f0b4174cd9f5fc385d026e4ENV
NVIDIA_PRODUCT_NAME=Triton Server Base
12/19/2025 12:40 AM UTC
fafdc0895e577a8c0436ac3d1354a1b4d5afd8fe35e0fe08c98959f1399f85f5ENV
NVIDIA_BUILD_ID=246541557
12/19/2025 12:40 AM UTC
39233e33500f133ed2774d990fe9f393741af2484a603f3171dbde3c934365bcENV
NVIDIA_TRITON_SERVER_BASE_VERSION=25.12
12/19/2025 12:40 AM UTC
555b05c5587e7b5c824b0426e1572787f181cdbd44e46ac3cb1a98788a7bbfcdARG
NVIDIA_BUILD_ID=246541557
12/19/2025 12:40 AM UTC
0c4cecd3991474636bc98e643ee4bc9772e40cdabaf67011a42ffb09e8c2c894ARG
NVIDIA_TRITON_SERVER_BASE_VERSION=25.12
12/19/2025 12:40 AM UTC
1aaa6ecceede901093fb09385f27883f14675707598dc5b2c1cfbe3ee92f7ac6RUN
TARGETARCH=arm64 ENABLE_FIPS=0 ENABLE_MITMPROXY=0 /tmp/manage_cert.sh uninstall
12/04/2025 4:51 AM UTC
4816ac94e46eeaef39074ddb5f664697bf35e63a609aca27455e64eeae0c83d0ENV
LIBRARY_PATH=/usr/local/cuda/lib64/stubs:/usr/local/cuda/lib64/stubs:
12/04/2025 4:51 AM UTC
acbb98e4bb288a6604ccf072c7cc6a3e53ba278f9bb921edbca6e57a80ea3195RUN
TARGETARCH=arm64 ENABLE_FIPS=0 ENABLE_MITMPROXY=0 export DEVEL=1 BASE=0 &&
  /nvidia/build-scripts/installNCU.sh &&
  /nvidia/build-scripts/installCUDA.sh &&
  /nvidia/build-scripts/installLIBS.sh &&
  if [ ! -f /etc/ld.so.conf.d/nvidia-tegra.conf ]; then /nvidia/build-scripts/installNCCL.sh; fi &&
  /nvidia/build-scripts/installCUDNN.sh &&
  /nvidia/build-scripts/installTRT.sh &&
  /nvidia/build-scripts/installNSYS.sh &&
  /nvidia/build-scripts/installCUSPARSELT.sh &&
  if [ -f "/tmp/cuda-${_CUDA_VERSION_MAJMIN}.patch" ]; then patch -p0 < /tmp/cuda-${_CUDA_VERSION_MAJMIN}.patch; fi &&
  rm -f /tmp/cuda-*.patch
12/04/2025 4:51 AM UTC
...