ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIAKit SDK - Windows (PB25h1)NVIDIAKit SDK - Linux (PB25h1)NVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Triton Inference Server
Container
NVIDIA
NVIDIA
Triton Inference Server

Triton Inference Server is an open source software that lets teams deploy trained AI models from any framework, from local or cloud storage and on any GPU- or CPU-based infrastructure in the cloud, data center, or embedded devices.

NVIDIA AI Enterprise Supported
LayerLabelCreated
1b78565fc9fd0a7db246aa807e42b74e36a50cfd88a145018396174a9a2a9ae1CONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace
05/19/2026 12:45 AM UTC
2d5e142287fc89afa897f9d97c18f27863bb5c6ff92ed347de35dd0eeb00ba21ENV
LD_LIBRARY_PATH=/opt/hpcx/ompi/lib:/workspace/install/lib:/usr/local/cuda/compat/lib:/usr/local/nvidia/lib:/usr/local/nvidia/lib64
05/19/2026 12:45 AM UTC
6119caa04d7179a0021705f6d0f4a0798a5ba3bf24a0eb30492e22be6f9e6824ENV
LD_LIBRARY_PATH=/workspace/install/lib:/usr/local/cuda/compat/lib:/usr/local/nvidia/lib:/usr/local/nvidia/lib64
05/19/2026 12:45 AM UTC
1c00a6aba7ceac714d5a782404d096dcde1ad4dac638c10aba30bd61556c4116ENV
PATH=/workspace/install/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/mpi/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/ucx/bin:/opt/amazon/efa/bin
05/19/2026 12:45 AM UTC
7ef7065250be5b254f9f1e5081dc7b1f490472895434ef10e3f33790fee07eadENV
NVIDIA_BUILD_ID=321060096
05/19/2026 12:45 AM UTC
83e2a8962d518016dbf8919145826ee8a73ff2f5aa66864a8bb446bebfef65fbENV
NVIDIA_TRITON_SERVER_SDK_VERSION=26.05
05/19/2026 12:45 AM UTC
76688ca94bbb5bf34b7d7a505598f0a4901e6d5220ee6967dd1c37089771ef90ARG
NVIDIA_BUILD_ID=321060096
05/19/2026 12:45 AM UTC
95ddc4eb9c9f1ab0fbd0c9034176e72677e638335d231696bd1f638d427607aeARG
NVIDIA_TRITON_SERVER_SDK_VERSION=26.05
05/19/2026 12:45 AM UTC
442ca065f1c778be50862cf5ccf736bd958029dbd0e0030eb85190f06ca2cb79RUN
DCGM_VERSION=4.5.3-1 TRITON_REPO_ORGANIZATION=https://github.com/triton-inference-server TRITON_CORE_REPO_TAG=r26.05 TARGETPLATFORM=linux/amd64 TRITON_ENABLE_GPU=ON TRITON_MODEL_ANALYZER_REPO_TAG=r26.05 TRITON_MODEL_ANALYZER_REPO=https://github.com/triton-inference-server/model_analyzer@r26.05 sed 's/Server/Server SDK/' /opt/nvidia/entrypoint.d/10-banner.txt | sed 's/^===/=======/' > /opt/nvidia/entrypoint.d/10-banner.new &&
  mv /opt/nvidia/entrypoint.d/10-banner.new /opt/nvidia/entrypoint.d/10-banner.txt
05/19/2026 12:45 AM UTC
60fdd8b98488c73513081964cf3a9657cd1698d78516da01e3414eee2bdeefdeCOPY
docker/entrypoint.d/ /opt/nvidia/entrypoint.d/
05/19/2026 12:45 AM UTC
...