ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIAKit SDK - Windows (PB25h1)NVIDIAKit SDK - Linux (PB25h1)NVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Triton Inference Server
Container
NVIDIA
NVIDIA
Triton Inference Server

Triton Inference Server is an open source software that lets teams deploy trained AI models from any framework, from local or cloud storage and on any GPU- or CPU-based infrastructure in the cloud, data center, or embedded devices.

NVIDIA AI Enterprise Supported
LayerLabelCreated
7fcf7c2a480496c8abfdac9eba06f56567f31d4b965477b50c048f6327e882a6CONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh
02/13/2026 7:15 PM UTC
a349b9825eb75733d0614939008e4fcc6a70e267335cbc7c8ef1a2705b67bc92COPY
docker/entrypoint.d/ /opt/nvidia/entrypoint.d/
02/13/2026 7:15 PM UTC
a85c71e40e37b80df122ae0991506621b99e61cef030f0c6c9583a637dccfabbENV
NVIDIA_PRODUCT_NAME=Triton Server Base
02/13/2026 7:15 PM UTC
3598e4c97005b6445f5ae1f3a972455831b47750e32d0519a735aea86f3dbde9ENV
NVIDIA_BUILD_ID=267853693
02/13/2026 7:15 PM UTC
514122f98b6bcf0ce8b2223c4b08e6d308a67dce043d1db58c042ac79bf31a78ENV
NVIDIA_TRITON_SERVER_BASE_VERSION=26.02
02/13/2026 7:15 PM UTC
847971ce22b97dff371c3b5db81a278c4b55d72f7c11539e32a2e1a517b0cd51ARG
NVIDIA_BUILD_ID=267853693
02/13/2026 7:15 PM UTC
f508505dd8e7bf5f5450950944b8895b11a73338c82b6a7c7ff05653abe67899ARG
NVIDIA_TRITON_SERVER_BASE_VERSION=26.02
02/13/2026 7:15 PM UTC
9bdb10d5343d9b67a99ce87826f2f0c390070a031f157077ed7b4287605f8a20RUN
TARGETARCH=arm64 ENABLE_FIPS=0 ENABLE_MITMPROXY=0 /tmp/manage_cert.sh uninstall
01/31/2026 12:46 AM UTC
6fdec3d9e1cefe60920c3373933daa580055b81ca389062ad0adc6b704d9a6edENV
LIBRARY_PATH=/usr/local/cuda/lib64/stubs:/usr/local/cuda/lib64/stubs:
01/31/2026 12:46 AM UTC
06ef1a4e62366e17e38e3b9928824013f47a941f60ded59dec8408017abea2a9RUN
TARGETARCH=arm64 ENABLE_FIPS=0 ENABLE_MITMPROXY=0 export DEVEL=1 BASE=0 &&
  /nvidia/build-scripts/installNCU.sh &&
  /nvidia/build-scripts/installCUDA.sh &&
  /nvidia/build-scripts/installLIBS.sh &&
  if [ ! -f /etc/ld.so.conf.d/nvidia-tegra.conf ]; then /nvidia/build-scripts/installNCCL.sh; fi &&
  /nvidia/build-scripts/installCUDNN.sh &&
  /nvidia/build-scripts/installTRT.sh &&
  /nvidia/build-scripts/installNSYS.sh &&
  /nvidia/build-scripts/installCUSPARSELT.sh &&
  if [ -f "/tmp/cuda-${_CUDA_VERSION_MAJMIN}.patch" ]; then patch -p0 < /tmp/cuda-${_CUDA_VERSION_MAJMIN}.patch; fi &&
  rm -f /tmp/cuda-*.patch
01/31/2026 12:46 AM UTC
...

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.