ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIAKit SDK - Windows (PB25h1)NVIDIAKit SDK - Linux (PB25h1)NVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Triton Inference Server
Container
NVIDIA
NVIDIA
Triton Inference Server

Triton Inference Server is an open source software that lets teams deploy trained AI models from any framework, from local or cloud storage and on any GPU- or CPU-based infrastructure in the cloud, data center, or embedded devices.

NVIDIA AI Enterprise Supported
LayerLabelCreated
520ad4014ca9d9ec29a80b9a20ef039fb92cfe8ae5fd9ce6da367655950a1e32CONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace
12/19/2025 12:46 AM UTC
b8afec9a1a23e7684b521b91dea42e2e7fbfc34d700f4b2e8cd93a287f79bb4cENV
LD_LIBRARY_PATH=/opt/hpcx/ompi/lib:/workspace/install/lib:/usr/local/cuda/compat/lib:/usr/local/nvidia/lib:/usr/local/nvidia/lib64
12/19/2025 12:46 AM UTC
969212c89595fee3b520e69bc0336931219daaf8b6b6b952fa872e8f29b0a6ccENV
LD_LIBRARY_PATH=/workspace/install/lib:/usr/local/cuda/compat/lib:/usr/local/nvidia/lib:/usr/local/nvidia/lib64
12/19/2025 12:46 AM UTC
7807b950eca9802f24343653f04edc3228333166df792663b0a8ad1c24f512e0ENV
PATH=/workspace/install/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/mpi/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/ucx/bin:/opt/amazon/efa/bin
12/19/2025 12:46 AM UTC
0a8defb4798097c3f084f2b1c9a84e0127d05e61d9df624894c7f5cf5a5c187aENV
NVIDIA_BUILD_ID=246541559
12/19/2025 12:46 AM UTC
69f351b568de2ef9ace672571158719ee81649048fca16cf9e5b3f2293a21518ENV
NVIDIA_TRITON_SERVER_SDK_VERSION=25.12
12/19/2025 12:46 AM UTC
a3e1737285ee1438cec76445323c32db9fd729d86607a8a83726062976828824ARG
NVIDIA_BUILD_ID=246541559
12/19/2025 12:46 AM UTC
99320a0eb49b1961056e6b2514251335bbcf57fa7c95fbdffe21d9757d8a7013ARG
NVIDIA_TRITON_SERVER_SDK_VERSION=25.12
12/19/2025 12:46 AM UTC
24811b694567ace417b32df1a7947f97ff9521afda552ae9c2d3aa34b315cb01RUN
DCGM_VERSION=4.4.2-1 TRITON_REPO_ORGANIZATION=https://github.com/triton-inference-server TRITON_CORE_REPO_TAG=r25.12 TARGETPLATFORM=linux/arm64 TRITON_ENABLE_GPU=ON TRITON_MODEL_ANALYZER_REPO_TAG=r25.12 TRITON_MODEL_ANALYZER_REPO=https://github.com/triton-inference-server/model_analyzer@r25.12 sed 's/Server/Server SDK/' /opt/nvidia/entrypoint.d/10-banner.txt | sed 's/^===/=======/' > /opt/nvidia/entrypoint.d/10-banner.new &&
  mv /opt/nvidia/entrypoint.d/10-banner.new /opt/nvidia/entrypoint.d/10-banner.txt
12/19/2025 12:46 AM UTC
5690ef4edd9a0844f7cb7206fb70d35bf8c19db31d850dbbb9c2de34278de8f8COPY
docker/entrypoint.d/ /opt/nvidia/entrypoint.d/
12/19/2025 12:46 AM UTC
...

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.