ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIAKit SDK - Windows (PB25h1)NVIDIAKit SDK - Linux (PB25h1)NVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Triton Inference Server
Container
NVIDIA
NVIDIA
Triton Inference Server

Triton Inference Server is an open source software that lets teams deploy trained AI models from any framework, from local or cloud storage and on any GPU- or CPU-based infrastructure in the cloud, data center, or embedded devices.

NVIDIA AI Enterprise Supported
LayerLabelCreated
0963dd35f6359a35315a1b2359aafe54ee93c645eadadfba9f7247c3851f14c0CONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh
07/28/2025 3:49 PM UTC
45a55109b503b0c47e9d4a33b8f01c6020e7403caf82900e96837e9d4da7a8bbCOPY
docker/entrypoint.d/ /opt/nvidia/entrypoint.d/
07/28/2025 3:49 PM UTC
7c50d76c1e7afc4169a140e2bf6a61eaec735208956f222ba4219f0e6c15c8d6ENV
NVIDIA_PRODUCT_NAME=Triton Server Base
07/28/2025 3:49 PM UTC
02d53a0562d1fe21c4bc460fb459bfd19336abd5adef023888237b2a944a7080ENV
NVIDIA_BUILD_ID=193148867
07/28/2025 3:49 PM UTC
7540b9373f83eff078212aa24df69d1ef4bb4cb369bc8d21f743b3c77a1ef825ENV
NVIDIA_TRITON_SERVER_BASE_VERSION=25.07
07/28/2025 3:49 PM UTC
e903ee80913ed3d99618289769d7bac2ff58dfaa0c1589764d3cc574d28e96ffARG
NVIDIA_BUILD_ID=193148867
07/28/2025 3:49 PM UTC
b8ab9102d5ac6a9a6e001b616440c4c24799b8171dd82f26a5c035f8cb500879ARG
NVIDIA_TRITON_SERVER_BASE_VERSION=25.07
07/28/2025 3:49 PM UTC
e19e4e1c0fddce787933b0848e8cf19432b4410dc4db1df52ea3e772f89c008dENV
LIBRARY_PATH=/usr/local/cuda/lib64/stubs:
06/12/2025 7:00 AM UTC
813d19cb74daa7ae8c56a816b7b1986e674fd811601ecf0f2ea79149bdb10fa9RUN
export DEVEL=1 BASE=0 &&
  /nvidia/build-scripts/installNCU.sh &&
  /nvidia/build-scripts/installCUDA.sh &&
  /nvidia/build-scripts/installLIBS.sh &&
  if [ ! -f /etc/ld.so.conf.d/nvidia-tegra.conf ]; then /nvidia/build-scripts/installNCCL.sh; fi &&
  /nvidia/build-scripts/installCUDNN.sh &&
  /nvidia/build-scripts/installTRT.sh &&
  /nvidia/build-scripts/installNSYS.sh &&
  /nvidia/build-scripts/installCUSPARSELT.sh &&
  if [ -f "/tmp/cuda-${_CUDA_VERSION_MAJMIN}.patch" ]; then patch -p0 < /tmp/cuda-${_CUDA_VERSION_MAJMIN}.patch; fi &&
  rm -f /tmp/cuda-*.patch
06/12/2025 7:00 AM UTC
8bfd8d8a6f413c917253f96e3930fda5d57c537c3cb3e5b210edba0b78cf7b80COPY
cuda-*.patch /tmp
06/12/2025 6:58 AM UTC