ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIAKit SDK - Windows (PB25h1)NVIDIAKit SDK - Linux (PB25h1)NVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Triton Inference Server
Container
NVIDIA
NVIDIA
Triton Inference Server

Triton Inference Server is an open source software that lets teams deploy trained AI models from any framework, from local or cloud storage and on any GPU- or CPU-based infrastructure in the cloud, data center, or embedded devices.

NVIDIA AI Enterprise Supported
LayerLabelCreated
a6f990c40594bf125956f01b85ef9f7d6cfe0d8e31a9613cef73190d4d7ba664CONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace
04/24/2026 12:52 AM UTC
e4d3f842adb7088fef16eb61d5cb60e0ee5aee28ff318fce5d5dfc8abd2f18afENV
LD_LIBRARY_PATH=/opt/hpcx/ompi/lib:/workspace/install/lib:/usr/local/cuda/compat/lib:/usr/local/nvidia/lib:/usr/local/nvidia/lib64
04/24/2026 12:52 AM UTC
97fac47685fd6054e43d63a7db4374186fd022888be678020c0154f0fadc3048ENV
LD_LIBRARY_PATH=/workspace/install/lib:/usr/local/cuda/compat/lib:/usr/local/nvidia/lib:/usr/local/nvidia/lib64
04/24/2026 12:52 AM UTC
1954a7085305945354986e4e233c5f93a1b0c0aa33187e041cdfcf2c800cbf05ENV
PATH=/workspace/install/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/mpi/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/ucx/bin:/opt/amazon/efa/bin
04/24/2026 12:52 AM UTC
fa99cb6d5e94fbfffda96903afa7f5fbe7aa18fb91d165a518bbe4d92b9dca05ENV
NVIDIA_BUILD_ID=304383834
04/24/2026 12:52 AM UTC
99c846f8a41962fae7a9c112cb3f65469136eb605d489e1da34e3106704b6e80ENV
NVIDIA_TRITON_SERVER_SDK_VERSION=26.04
04/24/2026 12:52 AM UTC
512ece395d2a730646fd1613391b355d29a1eed6c54d013f9c268d17f6fed36dARG
NVIDIA_BUILD_ID=304383834
04/24/2026 12:52 AM UTC
cc895d8a39ed02fb014649eb8033bfe38d18069b7326e686e8bda78ac5a2f747ARG
NVIDIA_TRITON_SERVER_SDK_VERSION=26.04
04/24/2026 12:52 AM UTC
12b0237765f097045dea17873a26854b7052be3e8dee6ea09746cd8b36c3a9e4RUN
DCGM_VERSION=4.5.3-1 TRITON_REPO_ORGANIZATION=https://github.com/triton-inference-server TRITON_CORE_REPO_TAG=r26.04 TARGETPLATFORM=linux/amd64 TRITON_ENABLE_GPU=ON TRITON_MODEL_ANALYZER_REPO_TAG=r26.04 TRITON_MODEL_ANALYZER_REPO=https://github.com/triton-inference-server/model_analyzer@r26.04 sed 's/Server/Server SDK/' /opt/nvidia/entrypoint.d/10-banner.txt | sed 's/^===/=======/' > /opt/nvidia/entrypoint.d/10-banner.new &&
  mv /opt/nvidia/entrypoint.d/10-banner.new /opt/nvidia/entrypoint.d/10-banner.txt
04/24/2026 12:52 AM UTC
837c4070b2de58be6981b7745edb53d7f3454875ef7ef420944ec6e1ec84b270COPY
docker/entrypoint.d/ /opt/nvidia/entrypoint.d/
04/24/2026 12:52 AM UTC
...