ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIAKit SDK - Windows (PB25h1)NVIDIAKit SDK - Linux (PB25h1)NVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Triton Inference Server
Container
NVIDIA
NVIDIA
Triton Inference Server

Triton Inference Server is an open source software that lets teams deploy trained AI models from any framework, from local or cloud storage and on any GPU- or CPU-based infrastructure in the cloud, data center, or embedded devices.

NVIDIA AI Enterprise Supported
LayerLabelCreated
e927af7cd3e2c14237ba9a8d4485ea10f2ddd8f9eb0850e56e36b3620547dc90CONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh
02/13/2026 9:45 PM UTC
40da4e7e617c82b7f07a7a4a91e33185b0e9fdd58e674af7cff9b05b9ef2c81aCOPY
docker/entrypoint.d/ /opt/nvidia/entrypoint.d/
02/13/2026 9:45 PM UTC
73ad20354566164ad9a91c428eef9ab476b63e1ab0c374dc3acea7cf7a9f47f3ENV
NVIDIA_PRODUCT_NAME=Triton Server Base
02/13/2026 9:45 PM UTC
ca945edfd1cea58bfd5779d563fce5aa8bdc5c0ca7df4a56d853d2de0b927876ENV
NVIDIA_BUILD_ID=267832247
02/13/2026 9:45 PM UTC
a98054592d18175a8f811489c5acec681546c21333d1770f3e8b05d0b9a17709ENV
NVIDIA_TRITON_SERVER_BASE_VERSION=26.02
02/13/2026 9:45 PM UTC
9aa5b677eab0c32c28620e26ad65613f601a2bd641524158b4a533bdc944a537ARG
NVIDIA_BUILD_ID=267832247
02/13/2026 9:45 PM UTC
52e23cfa54977f9ae4c765c108cc2e24978a1f4a06be6b52b5bdeb9c6a41cb9fARG
NVIDIA_TRITON_SERVER_BASE_VERSION=26.02
02/13/2026 9:45 PM UTC
133eac131e089e52b85d8ca0e75b15ccef53c7acc32d93de8216b9c595290dfcRUN
TARGETARCH=amd64 ENABLE_FIPS=0 ENABLE_MITMPROXY=0 /tmp/manage_cert.sh uninstall
02/03/2026 9:29 PM UTC
5d10748462a86f1d88a979022c9d7562c4418fbb0e24db901be0385f056365b2ENV
LIBRARY_PATH=/usr/local/cuda/lib64/stubs:/usr/local/cuda/lib64/stubs:
02/03/2026 9:29 PM UTC
e13520a5602378bfe88db36823efa20c5b20712e41cf97419f3ed1c5c1e17885RUN
TARGETARCH=amd64 ENABLE_FIPS=0 ENABLE_MITMPROXY=0 export DEVEL=1 BASE=0 &&
  /nvidia/build-scripts/installNCU.sh &&
  /nvidia/build-scripts/installCUDA.sh &&
  /nvidia/build-scripts/installLIBS.sh &&
  if [ ! -f /etc/ld.so.conf.d/nvidia-tegra.conf ]; then /nvidia/build-scripts/installNCCL.sh; fi &&
  /nvidia/build-scripts/installCUDNN.sh &&
  /nvidia/build-scripts/installTRT.sh &&
  /nvidia/build-scripts/installNSYS.sh &&
  /nvidia/build-scripts/installCUSPARSELT.sh &&
  if [ -f "/tmp/cuda-${_CUDA_VERSION_MAJMIN}.patch" ]; then patch -p0 < /tmp/cuda-${_CUDA_VERSION_MAJMIN}.patch; fi &&
  rm -f /tmp/cuda-*.patch
02/03/2026 9:29 PM UTC
...

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.