ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIAKit SDK - Windows (PB25h1)NVIDIAKit SDK - Linux (PB25h1)NVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Triton Inference Server
Container
NVIDIA
NVIDIA
Triton Inference Server

Triton Inference Server is an open source software that lets teams deploy trained AI models from any framework, from local or cloud storage and on any GPU- or CPU-based infrastructure in the cloud, data center, or embedded devices.

NVIDIA AI Enterprise Supported
LayerLabelCreated
5e849a836f7d467a46f5219ac5941f13efc5e1c0ac4991aa4d0951c7af9cf05bCONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace
10/03/2025 5:27 PM UTC
402e06da4fb0af53b895f5c6f2d182a0a8580e5998d079ea897580159bcdc6b5ENV
LD_LIBRARY_PATH=/opt/hpcx/ompi/lib:/workspace/install/lib:/usr/local/cuda/compat/lib:/usr/local/nvidia/lib:/usr/local/nvidia/lib64
10/03/2025 5:27 PM UTC
7599f223e2327be6b97ec8cd0d313199f174171156695c079a03a2f91de25ddaENV
LD_LIBRARY_PATH=/workspace/install/lib:/usr/local/cuda/compat/lib:/usr/local/nvidia/lib:/usr/local/nvidia/lib64
10/03/2025 5:27 PM UTC
44788f628bda87dde00c0ad079f699fa56553ad080382d41b2d5a506043c45f6ENV
PATH=/workspace/install/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/mpi/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/ucx/bin:/opt/amazon/efa/bin
10/03/2025 5:27 PM UTC
6f17006d013d5833d3c5e843a96be5b37e088f80edb255331de532c6c8c815b2ENV
NVIDIA_BUILD_ID=216994150
10/03/2025 5:27 PM UTC
13b0b2a3eec841be97240fe55a8478ca28b0994d9b5d3c0569f9509b22d943d2ENV
NVIDIA_TRITON_SERVER_SDK_VERSION=25.09
10/03/2025 5:27 PM UTC
f383f21ba5b0ce0f487fc84423ba43b9f09942b5ea9afff0f9556df888bb311eARG
NVIDIA_BUILD_ID=216994150
10/03/2025 5:27 PM UTC
f260f1086eb87a4de4d650647253c42a6d074f225f5771ac49387d7a52a43646ARG
NVIDIA_TRITON_SERVER_SDK_VERSION=25.09
10/03/2025 5:27 PM UTC
5f47f60d08ee09bf57fa46823c28d6970c03ca307933a0e1d461c24bf03b6f1dRUN
DCGM_VERSION=4.4.0-1 TRITON_REPO_ORGANIZATION=https://github.com/triton-inference-server TRITON_CORE_REPO_TAG=r25.09 TARGETPLATFORM=linux/amd64 TRITON_ENABLE_GPU=ON sed 's/Server/Server SDK/' /opt/nvidia/entrypoint.d/10-banner.txt | sed 's/^===/=======/' > /opt/nvidia/entrypoint.d/10-banner.new &&
  mv /opt/nvidia/entrypoint.d/10-banner.new /opt/nvidia/entrypoint.d/10-banner.txt
10/03/2025 5:27 PM UTC
488b0e9d56492a2f31a141b5d2976f21d8da37f5fa1bbc954f207bf1eb96cf33COPY
docker/entrypoint.d/ /opt/nvidia/entrypoint.d/
10/03/2025 5:27 PM UTC
...