ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIAKit SDK - Windows (PB25h1)NVIDIAKit SDK - Linux (PB25h1)NVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Triton Inference Server
Container
NVIDIA
NVIDIA
Triton Inference Server

Triton Inference Server is an open source software that lets teams deploy trained AI models from any framework, from local or cloud storage and on any GPU- or CPU-based infrastructure in the cloud, data center, or embedded devices.

NVIDIA AI Enterprise Supported
LayerLabelCreated
893dd02e17acc0000a01f6d022b9cd6a22763de24731fd1d82f6dc4783bca5daCONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh
11/20/2025 9:03 PM UTC
2ed1c7615bf2ae733e8c3ed27627d1b2ab493e14ee40fc9f79b7c99631879739COPY
docker/entrypoint.d/ /opt/nvidia/entrypoint.d/
11/20/2025 9:03 PM UTC
50c93c41722102f915146a7362bb48326fb8cef7c0befe092996bc3702a9c316ENV
NVIDIA_PRODUCT_NAME=Triton Server Base
11/20/2025 9:03 PM UTC
15b8c323698024f22d423195e74bb74b5a29a814971fde1f7e6a4931838402a4ENV
NVIDIA_BUILD_ID=236082569
11/20/2025 9:03 PM UTC
00967de0dde7aaf398cf053fe9d09aa978d6fa965951e8254d79069d0e394351ENV
NVIDIA_TRITON_SERVER_BASE_VERSION=25.11
11/20/2025 9:03 PM UTC
24455a7abd0f397b1ec35ce3bbfa786c966acae4a0a518d1c464c3fa6b6c8cf8ARG
NVIDIA_BUILD_ID=236082569
11/20/2025 9:03 PM UTC
3cb045f053f4ac2d7845ada769c5e4bce5ac79636ca34474d51321dea0ef51cbARG
NVIDIA_TRITON_SERVER_BASE_VERSION=25.11
11/20/2025 9:03 PM UTC
1062ac14027b6f111eaa49add9087c20ae41328fd0c85ceb9425ad957e40b7f5RUN
ENABLE_MITMPROXY=0 /tmp/manage_cert.sh uninstall
11/08/2025 3:47 AM UTC
1383b5ce45e617fd9a80714b64e5aed1226617d3f5775791990bf707574f328cENV
LIBRARY_PATH=/usr/local/cuda/lib64/stubs:/usr/local/cuda/lib64/stubs:
11/08/2025 3:47 AM UTC
c6d2d7db1be18286706c10a4eb23674a7063159dc5d3565e97fb4786f6c5ffefRUN
ENABLE_MITMPROXY=0 export DEVEL=1 BASE=0 &&
  /nvidia/build-scripts/installNCU.sh &&
  /nvidia/build-scripts/installCUDA.sh &&
  /nvidia/build-scripts/installLIBS.sh &&
  if [ ! -f /etc/ld.so.conf.d/nvidia-tegra.conf ]; then /nvidia/build-scripts/installNCCL.sh; fi &&
  /nvidia/build-scripts/installCUDNN.sh &&
  /nvidia/build-scripts/installTRT.sh &&
  /nvidia/build-scripts/installNSYS.sh &&
  /nvidia/build-scripts/installCUSPARSELT.sh &&
  if [ -f "/tmp/cuda-${_CUDA_VERSION_MAJMIN}.patch" ]; then patch -p0 < /tmp/cuda-${_CUDA_VERSION_MAJMIN}.patch; fi &&
  rm -f /tmp/cuda-*.patch
11/08/2025 3:47 AM UTC
...