ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIAKit SDK - Windows (PB25h1)NVIDIAKit SDK - Linux (PB25h1)NVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Triton Inference Server
Container
NVIDIA
NVIDIA
Triton Inference Server

Triton Inference Server is an open source software that lets teams deploy trained AI models from any framework, from local or cloud storage and on any GPU- or CPU-based infrastructure in the cloud, data center, or embedded devices.

NVIDIA AI Enterprise Supported
LayerLabelCreated
f1ecb90c3ab342783cafde7ebc77031960df8839a64b5c11a7df350f4adac307CONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh
08/22/2025 1:04 AM UTC
8a79f6c39eb18ead34ab4cc499be6edcc5c33f8a1e619fdd2a00f0d5eb742d88COPY
docker/entrypoint.d/ /opt/nvidia/entrypoint.d/
08/22/2025 1:04 AM UTC
505591ba72128beadf11cf834195caff80122b1fbbeb756850f285b66d0b6523ENV
NVIDIA_PRODUCT_NAME=Triton Server Base
08/22/2025 1:04 AM UTC
85fc28c4a837dc4981d0c114916c3eab44e48fe33dda87f3506feab5f55d32abENV
NVIDIA_BUILD_ID=202022691
08/22/2025 1:04 AM UTC
be760237b5b0735c2e9ceb0ffba95e02ab7bc1da78e19d35bd55e5e84a759620ENV
NVIDIA_TRITON_SERVER_BASE_VERSION=25.08
08/22/2025 1:04 AM UTC
f2feea3454b0f25675a3f89d153e5150538eee1106980a64081b6fb46035d5f3ARG
NVIDIA_BUILD_ID=202022691
08/22/2025 1:04 AM UTC
de3dcb795cdde31ec3f605faaedceb4d671e62cdba4cc0cfccdf79cc5aff5513ARG
NVIDIA_TRITON_SERVER_BASE_VERSION=25.08
08/22/2025 1:04 AM UTC
c8e12853cd5f39e03c3cf89f3dae77e28fca5c7954e20664ddea8233e9f0b24cRUN
ENABLE_MITMPROXY=0 /tmp/manage_cert.sh uninstall
08/07/2025 8:14 PM UTC
a8ea08b980a3fea89fa61bc143ec44928fa989e3126094dbc273ae17e32749f4ENV
LIBRARY_PATH=/usr/local/cuda/lib64/stubs:
08/07/2025 8:14 PM UTC
4a1172750ce725114208e476b611204032f7325c5a240cc27b19592bdd5d993aRUN
ENABLE_MITMPROXY=0 export DEVEL=1 BASE=0 &&
  /nvidia/build-scripts/installNCU.sh &&
  /nvidia/build-scripts/installCUDA.sh &&
  /nvidia/build-scripts/installLIBS.sh &&
  if [ ! -f /etc/ld.so.conf.d/nvidia-tegra.conf ]; then /nvidia/build-scripts/installNCCL.sh; fi &&
  /nvidia/build-scripts/installCUDNN.sh &&
  /nvidia/build-scripts/installTRT.sh &&
  /nvidia/build-scripts/installNSYS.sh &&
  /nvidia/build-scripts/installCUSPARSELT.sh &&
  if [ -f "/tmp/cuda-${_CUDA_VERSION_MAJMIN}.patch" ]; then patch -p0 < /tmp/cuda-${_CUDA_VERSION_MAJMIN}.patch; fi &&
  rm -f /tmp/cuda-*.patch
08/07/2025 8:14 PM UTC
...