ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIAKit SDK - Windows (PB25h1)NVIDIAKit SDK - Linux (PB25h1)NVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Triton Inference Server
Container
NVIDIA
NVIDIA
Triton Inference Server

Triton Inference Server is an open source software that lets teams deploy trained AI models from any framework, from local or cloud storage and on any GPU- or CPU-based infrastructure in the cloud, data center, or embedded devices.

NVIDIA AI Enterprise Supported
LayerLabelCreated
2b730d836909df56a0649499930679667624be4fa841d5b552f4ef9bb59feb34CONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace
08/22/2025 1:21 AM UTC
e819f7b6ae4762f4678397d8ae7608e1d4ab5b0f3f6475e2d0ff4769bd86c9a8ENV
LD_LIBRARY_PATH=/opt/hpcx/ompi/lib:/workspace/install/lib:/usr/local/cuda/compat/lib:/usr/local/nvidia/lib:/usr/local/nvidia/lib64
08/22/2025 1:21 AM UTC
3815909c9c692ddf3eec9b8a875c2a37db62261f53fe857e77b3b9fc0177785fENV
LD_LIBRARY_PATH=/workspace/install/lib:/usr/local/cuda/compat/lib:/usr/local/nvidia/lib:/usr/local/nvidia/lib64
08/22/2025 1:21 AM UTC
b0c065e72891b4c3b1e97a23041ef5e4133fdafef1199076be26c3ecb5fbc484ENV
PATH=/workspace/install/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/mpi/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/ucx/bin:/opt/amazon/efa/bin
08/22/2025 1:21 AM UTC
18d1e7f117836f16970865a8e802c4704ca5775aa5445906f2b15b133975772dENV
NVIDIA_BUILD_ID=202022643
08/22/2025 1:21 AM UTC
cd753139c5bf89bb9299f2e28a99f2473dfc8051ac80de61db3c489e87ddd768ENV
NVIDIA_TRITON_SERVER_SDK_VERSION=25.08
08/22/2025 1:21 AM UTC
686c4fb151d661e0487d58f437e544cde9379bfabcb6b8bdb63126811e42a086ARG
NVIDIA_BUILD_ID=202022643
08/22/2025 1:21 AM UTC
4d4866efda9d967b55658704cea7a09244ccb8252dc484d34b43288d32de1d77ARG
NVIDIA_TRITON_SERVER_SDK_VERSION=25.08
08/22/2025 1:21 AM UTC
d77fbf8a0e0e838d4d7823847a7f6e8be28f13e55964a1a9e048a4e02c1c783fRUN
DCGM_VERSION=4.4.0-1 TRITON_REPO_ORGANIZATION=https://github.com/triton-inference-server TRITON_CORE_REPO_TAG=r25.08 TARGETPLATFORM=linux/amd64 TRITON_ENABLE_GPU=ON sed 's/Server/Server SDK/' /opt/nvidia/entrypoint.d/10-banner.txt | sed 's/^===/=======/' > /opt/nvidia/entrypoint.d/10-banner.new &&
  mv /opt/nvidia/entrypoint.d/10-banner.new /opt/nvidia/entrypoint.d/10-banner.txt
08/22/2025 1:21 AM UTC
c675552f413b9da463c7a624864ea5097026287b58c68384b171c02be0778dd7COPY
docker/entrypoint.d/ /opt/nvidia/entrypoint.d/
08/22/2025 1:21 AM UTC
...