ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIAKit SDK - Windows (PB25h1)NVIDIAKit SDK - Linux (PB25h1)NVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Triton Inference Server
Container
NVIDIA
NVIDIA
Triton Inference Server

Triton Inference Server is an open source software that lets teams deploy trained AI models from any framework, from local or cloud storage and on any GPU- or CPU-based infrastructure in the cloud, data center, or embedded devices.

NVIDIA AI Enterprise Supported
LayerLabelCreated
f7d272229348df678cd6e092c558b6ff79766c68fd9e7c6089cc4ef9114c8acfCONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace
11/20/2025 9:12 PM UTC
38ed1eb48473b4e7c820c1adaf5b35a70b00c4a16b1f6a6746c4a9955c6a6061ENV
LD_LIBRARY_PATH=/opt/hpcx/ompi/lib:/workspace/install/lib:/usr/local/cuda/compat/lib:/usr/local/nvidia/lib:/usr/local/nvidia/lib64
11/20/2025 9:12 PM UTC
805a13c5cd66ba8ddc439a94f01fd46d9285fec1f0b5be3c38313706c275b1b4ENV
LD_LIBRARY_PATH=/workspace/install/lib:/usr/local/cuda/compat/lib:/usr/local/nvidia/lib:/usr/local/nvidia/lib64
11/20/2025 9:12 PM UTC
33980d99e257eee9cb21705c2d7fbc378f13c383f1979dc2cd13ff073efb2615ENV
PATH=/workspace/install/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/mpi/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/ucx/bin:/opt/amazon/efa/bin
11/20/2025 9:12 PM UTC
cc5276caf11e310139a1a37b5be2ef55db86c9224d3f5c7cfe69a37b63f36e64ENV
NVIDIA_BUILD_ID=236082526
11/20/2025 9:12 PM UTC
19bb13807c1bf644b19cbe06aa90b2c24cc99c1d9a20971a4544b25e0394bb41ENV
NVIDIA_TRITON_SERVER_SDK_VERSION=25.11
11/20/2025 9:12 PM UTC
067ba1936825dcbc598d27336aab406acbaa552d5d2992e424caaa50b3944c76ARG
NVIDIA_BUILD_ID=236082526
11/20/2025 9:12 PM UTC
85aded1c0be447ec57355aedecda3bcfa37756faf376bec91fde41d29659facaARG
NVIDIA_TRITON_SERVER_SDK_VERSION=25.11
11/20/2025 9:12 PM UTC
52ddb07aa5fc7e0ad8d28d63d60bfc562b060635f03bb1e6b08d46d0b6399c32RUN
DCGM_VERSION=4.4.0-1 TRITON_REPO_ORGANIZATION=https://github.com/triton-inference-server TRITON_CORE_REPO_TAG=r25.11 TARGETPLATFORM=linux/amd64 TRITON_ENABLE_GPU=ON TRITON_MODEL_ANALYZER_REPO_TAG=r25.11 TRITON_MODEL_ANALYZER_REPO=https://github.com/triton-inference-server/model_analyzer@r25.11 sed 's/Server/Server SDK/' /opt/nvidia/entrypoint.d/10-banner.txt | sed 's/^===/=======/' > /opt/nvidia/entrypoint.d/10-banner.new &&
  mv /opt/nvidia/entrypoint.d/10-banner.new /opt/nvidia/entrypoint.d/10-banner.txt
11/20/2025 9:12 PM UTC
26f66666df4bff7441de3386e0933029bf50315df0dafc1e03364e52ed1cd63cCOPY
docker/entrypoint.d/ /opt/nvidia/entrypoint.d/
11/20/2025 9:12 PM UTC
...