ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIAKit SDK - Windows (PB25h1)NVIDIAKit SDK - Linux (PB25h1)NVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Triton Inference Server
Container
NVIDIA
NVIDIA
Triton Inference Server

Triton Inference Server is an open source software that lets teams deploy trained AI models from any framework, from local or cloud storage and on any GPU- or CPU-based infrastructure in the cloud, data center, or embedded devices.

NVIDIA AI Enterprise Supported
LayerLabelCreated
65193597bec3299498573a5ebb78ebeb9616f2eceb2cd04c8e4131740570e643CONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh
01/27/2026 9:22 PM UTC
0bedab0e835c47c6552c443cdd68a04cce3040a362c974c8efb99d87414a7284COPY
docker/entrypoint.d/ /opt/nvidia/entrypoint.d/
01/27/2026 9:22 PM UTC
4e93a7cfa697c52f8524707b8d89281ef629b4dff235fe2e84584fe0b6949830ENV
NVIDIA_PRODUCT_NAME=Triton Server Base
01/27/2026 9:22 PM UTC
aba709d2a1481815c8b9456bf1f2f0bf3700e244848887349631c4298559ee46ENV
NVIDIA_BUILD_ID=259402043
01/27/2026 9:22 PM UTC
6757ee1e46430970b05a423e43c3af500e650e725de41f6727adcc2928b6063aENV
NVIDIA_TRITON_SERVER_BASE_VERSION=26.01
01/27/2026 9:22 PM UTC
a2c1cd0996e2a429cad6f72f17a7d71c5cd1f13db00de5dbdf045b0bc1a7c384ARG
NVIDIA_BUILD_ID=259402043
01/27/2026 9:22 PM UTC
4eb47036604955d7820afa058334bf01b6a1bb80bad2fcf9542e6a1e947b6fffARG
NVIDIA_TRITON_SERVER_BASE_VERSION=26.01
01/27/2026 9:22 PM UTC
64287668d7cdeae9bc5de1f23e47f7d53c911271a33bd1c49adcc083a232b659RUN
TARGETARCH=arm64 ENABLE_FIPS=0 ENABLE_MITMPROXY=0 /tmp/manage_cert.sh uninstall
01/09/2026 12:14 AM UTC
63bd58e8b2c893af31fd68f519ed3826d4bb6f11d3b7157129fdbcf38e581064ENV
LIBRARY_PATH=/usr/local/cuda/lib64/stubs:/usr/local/cuda/lib64/stubs:
01/09/2026 12:14 AM UTC
ebaad496cb428c51912bcdf795499a403ab96c2bcba99307aff908a75e087a78RUN
TARGETARCH=arm64 ENABLE_FIPS=0 ENABLE_MITMPROXY=0 export DEVEL=1 BASE=0 &&
  /nvidia/build-scripts/installNCU.sh &&
  /nvidia/build-scripts/installCUDA.sh &&
  /nvidia/build-scripts/installLIBS.sh &&
  if [ ! -f /etc/ld.so.conf.d/nvidia-tegra.conf ]; then /nvidia/build-scripts/installNCCL.sh; fi &&
  /nvidia/build-scripts/installCUDNN.sh &&
  /nvidia/build-scripts/installTRT.sh &&
  /nvidia/build-scripts/installNSYS.sh &&
  /nvidia/build-scripts/installCUSPARSELT.sh &&
  if [ -f "/tmp/cuda-${_CUDA_VERSION_MAJMIN}.patch" ]; then patch -p0 < /tmp/cuda-${_CUDA_VERSION_MAJMIN}.patch; fi &&
  rm -f /tmp/cuda-*.patch
01/09/2026 12:14 AM UTC
...

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.