ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIAKit SDK - Windows (PB25h1)NVIDIAKit SDK - Linux (PB25h1)NVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Triton Inference Server
Container
NVIDIA
NVIDIA
Triton Inference Server

Triton Inference Server is an open source software that lets teams deploy trained AI models from any framework, from local or cloud storage and on any GPU- or CPU-based infrastructure in the cloud, data center, or embedded devices.

NVIDIA AI Enterprise Supported
LayerLabelCreated
22dec4d1891c9321e1e1077fe3013b4bfa18061d388ab7153abd347981712aa6CONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh
08/22/2025 1:33 AM UTC
bb7ebd87e9436774f6cba83b2a3dabeb89e935cafa63021353a9978469d9c139COPY
docker/entrypoint.d/ /opt/nvidia/entrypoint.d/
08/22/2025 1:33 AM UTC
4c89103e626af0a1196f5c26a2a13466cedd1a2f558ae5c225e35f94e14f2289ENV
NVIDIA_PRODUCT_NAME=Triton Server Base
08/22/2025 1:33 AM UTC
170db6310e796a278f9eacd32b5dc6a40939a6c86d80ab36293c11ffad10ab72ENV
NVIDIA_BUILD_ID=202022639
08/22/2025 1:33 AM UTC
f423d8c89c0dd0c51f66b87f2e5c602dfca83d3f1528dfacd688ad9250afbe85ENV
NVIDIA_TRITON_SERVER_BASE_VERSION=25.08
08/22/2025 1:33 AM UTC
cf0ab46829ad84c5d5d45a56847c86437ebc900250cbb0603a1b488b0d072aceARG
NVIDIA_BUILD_ID=202022639
08/22/2025 1:33 AM UTC
b1aefa01788579f6ae5cd6916bf4dc9224579d762831dba26b2bf4ee9f1bc915ARG
NVIDIA_TRITON_SERVER_BASE_VERSION=25.08
08/22/2025 1:33 AM UTC
d462cf75f3ff9bd43b3125c2d5e2dcd8e82f9ef6094d81992659e8ae52b9ab17RUN
ENABLE_MITMPROXY=0 /tmp/manage_cert.sh uninstall
08/08/2025 4:04 PM UTC
fdde6bcdd88a99cc8d285be2a7e366991d4bcc2ae0ebf0d5ddd04dca15534197ENV
LIBRARY_PATH=/usr/local/cuda/lib64/stubs:
08/08/2025 4:04 PM UTC
58a2ddc3f8aada8c00ef458043bbf1c14853ebbcdae2e03440be97a651b0e9adRUN
ENABLE_MITMPROXY=0 export DEVEL=1 BASE=0 &&
  /nvidia/build-scripts/installNCU.sh &&
  /nvidia/build-scripts/installCUDA.sh &&
  /nvidia/build-scripts/installLIBS.sh &&
  if [ ! -f /etc/ld.so.conf.d/nvidia-tegra.conf ]; then /nvidia/build-scripts/installNCCL.sh; fi &&
  /nvidia/build-scripts/installCUDNN.sh &&
  /nvidia/build-scripts/installTRT.sh &&
  /nvidia/build-scripts/installNSYS.sh &&
  /nvidia/build-scripts/installCUSPARSELT.sh &&
  if [ -f "/tmp/cuda-${_CUDA_VERSION_MAJMIN}.patch" ]; then patch -p0 < /tmp/cuda-${_CUDA_VERSION_MAJMIN}.patch; fi &&
  rm -f /tmp/cuda-*.patch
08/08/2025 4:04 PM UTC
...