ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIAKit SDK - Windows (PB25h1)NVIDIAKit SDK - Linux (PB25h1)NVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Triton Inference Server
Container
NVIDIA
NVIDIA
Triton Inference Server

Triton Inference Server is an open source software that lets teams deploy trained AI models from any framework, from local or cloud storage and on any GPU- or CPU-based infrastructure in the cloud, data center, or embedded devices.

NVIDIA AI Enterprise Supported
LayerLabelCreated
cffd712050bae4f531bad24ef914c08574aabfdb96d747122b74f7dd9c856b81CONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace
12/19/2025 12:48 AM UTC
cf46d31b0ff41a5bffa97063af798c54fc56d9b554a566b3684325a00de0fa12ENV
LD_LIBRARY_PATH=/opt/hpcx/ompi/lib:/workspace/install/lib:/usr/local/cuda/compat/lib:/usr/local/nvidia/lib:/usr/local/nvidia/lib64
12/19/2025 12:48 AM UTC
64820026dd072c5cbf1975c42a12044371e992a65f2f324142ba8a37d220188cENV
LD_LIBRARY_PATH=/workspace/install/lib:/usr/local/cuda/compat/lib:/usr/local/nvidia/lib:/usr/local/nvidia/lib64
12/19/2025 12:48 AM UTC
3df895dabce7fccacfb812a8ecd08f11586451185b12ea15e9045684c3de0fccENV
PATH=/workspace/install/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/mpi/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/ucx/bin:/opt/amazon/efa/bin
12/19/2025 12:48 AM UTC
d4e0fca144e6d0c34e77ef68fa513bb1bc805cf39695216534f507c0a202024dENV
NVIDIA_BUILD_ID=246541509
12/19/2025 12:48 AM UTC
e957ed570d22e7c2f2448bfcaf8abe1ba285e55c31f94b7d8f21a1c64722eddeENV
NVIDIA_TRITON_SERVER_SDK_VERSION=25.12
12/19/2025 12:48 AM UTC
4bcb5b7590992cfc79fac69866d17827ccb3d82849e2efa136ab33da2227fa1bARG
NVIDIA_BUILD_ID=246541509
12/19/2025 12:48 AM UTC
0b1ab903d5da9cb28d1607f180bafbe90339332f9bf5e43627708ca9a5d92560ARG
NVIDIA_TRITON_SERVER_SDK_VERSION=25.12
12/19/2025 12:48 AM UTC
f9c258c85af57dd2c59ea6ba09d49b861eaa2eaf594ead94986b54a121f76f20RUN
DCGM_VERSION=4.4.2-1 TRITON_REPO_ORGANIZATION=https://github.com/triton-inference-server TRITON_CORE_REPO_TAG=r25.12 TARGETPLATFORM=linux/amd64 TRITON_ENABLE_GPU=ON TRITON_MODEL_ANALYZER_REPO_TAG=r25.12 TRITON_MODEL_ANALYZER_REPO=https://github.com/triton-inference-server/model_analyzer@r25.12 sed 's/Server/Server SDK/' /opt/nvidia/entrypoint.d/10-banner.txt | sed 's/^===/=======/' > /opt/nvidia/entrypoint.d/10-banner.new &&
  mv /opt/nvidia/entrypoint.d/10-banner.new /opt/nvidia/entrypoint.d/10-banner.txt
12/19/2025 12:48 AM UTC
e33ae53c3b398a3ad164e324038e8625e3a51f512dab532f4c9ba5ea7c5936b3COPY
docker/entrypoint.d/ /opt/nvidia/entrypoint.d/
12/19/2025 12:48 AM UTC
...