ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIAKit SDK - Windows (PB25h1)NVIDIAKit SDK - Linux (PB25h1)NVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Triton Inference Server
Container
NVIDIA
NVIDIA
Triton Inference Server

Triton Inference Server is an open source software that lets teams deploy trained AI models from any framework, from local or cloud storage and on any GPU- or CPU-based infrastructure in the cloud, data center, or embedded devices.

NVIDIA AI Enterprise Supported
LayerLabelCreated
c2ef83be8a2209e7c20f19c4b4bf89e0d5b2ed3253550b8586a9dffd89c1781eCONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh
01/27/2026 10:37 PM UTC
248c2cf04b008ca5d835e60bf1a3d43ab788002b6a6a9a1b9a1265b46a401446COPY
docker/entrypoint.d/ /opt/nvidia/entrypoint.d/
01/27/2026 10:37 PM UTC
231b7f79d335c76fcf77be24a96aa1a733ca50594294512e8b37d33d6f8abcc1ENV
NVIDIA_PRODUCT_NAME=Triton Server Base
01/27/2026 10:37 PM UTC
392b235885fb5c3cce760ea9b14e56d870c6777a1f639f2b13df14357a186be3ENV
NVIDIA_BUILD_ID=259401985
01/27/2026 10:37 PM UTC
57465fdfe74b618527d49d066a72595c95273bbf728e4684a281c2d0474c7910ENV
NVIDIA_TRITON_SERVER_BASE_VERSION=26.01
01/27/2026 10:37 PM UTC
298d85a2d8cbbd656bfc8243e1ec7cca9b18a2dee73aeed73253fb1cb01649edARG
NVIDIA_BUILD_ID=259401985
01/27/2026 10:37 PM UTC
b320d01dd24e44b3a84f110a0e5938991ab225ef18442b9f0cfa4ad65ddb6a72ARG
NVIDIA_TRITON_SERVER_BASE_VERSION=26.01
01/27/2026 10:37 PM UTC
ef30c1ca41171da771193cdb6906d5816c7b8099c7b1207de1f7d1473af73774RUN
TARGETARCH=amd64 ENABLE_FIPS=0 ENABLE_MITMPROXY=0 /tmp/manage_cert.sh uninstall
01/09/2026 11:40 PM UTC
49b3752381079b183372c30b1f3fdba2ce4c467f56bfe005710f107417f97405ENV
LIBRARY_PATH=/usr/local/cuda/lib64/stubs:/usr/local/cuda/lib64/stubs:
01/09/2026 11:40 PM UTC
f3bd27fdcd0d05b778881fdcc32c33e62d4c76fb5ff34ac65f5f19cddb0b9509RUN
TARGETARCH=amd64 ENABLE_FIPS=0 ENABLE_MITMPROXY=0 export DEVEL=1 BASE=0 &&
  /nvidia/build-scripts/installNCU.sh &&
  /nvidia/build-scripts/installCUDA.sh &&
  /nvidia/build-scripts/installLIBS.sh &&
  if [ ! -f /etc/ld.so.conf.d/nvidia-tegra.conf ]; then /nvidia/build-scripts/installNCCL.sh; fi &&
  /nvidia/build-scripts/installCUDNN.sh &&
  /nvidia/build-scripts/installTRT.sh &&
  /nvidia/build-scripts/installNSYS.sh &&
  /nvidia/build-scripts/installCUSPARSELT.sh &&
  if [ -f "/tmp/cuda-${_CUDA_VERSION_MAJMIN}.patch" ]; then patch -p0 < /tmp/cuda-${_CUDA_VERSION_MAJMIN}.patch; fi &&
  rm -f /tmp/cuda-*.patch
01/09/2026 11:40 PM UTC
...