ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIAKit SDK - Windows (PB25h1)NVIDIAKit SDK - Linux (PB25h1)NVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Triton Inference Server
Container
NVIDIA
NVIDIA
Triton Inference Server

Triton Inference Server is an open source software that lets teams deploy trained AI models from any framework, from local or cloud storage and on any GPU- or CPU-based infrastructure in the cloud, data center, or embedded devices.

NVIDIA AI Enterprise Supported
LayerLabelCreated
54b4812cbfd0b3c618c8176415762e1a8971ba7e53926dd7d9566b58e3819686CONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace
10/03/2025 5:26 PM UTC
6b28221d26f09afba6bddc504cdf2f67c52e9f0b0127cd7439c436753ec6c32bENV
LD_LIBRARY_PATH=/opt/hpcx/ompi/lib:/workspace/install/lib:/usr/local/cuda/compat/lib:/usr/local/nvidia/lib:/usr/local/nvidia/lib64
10/03/2025 5:26 PM UTC
b853fb0a169f4765af6f06177fdba8ee72e311ab5551e5c8d3433cdaca3ebcfeENV
LD_LIBRARY_PATH=/workspace/install/lib:/usr/local/cuda/compat/lib:/usr/local/nvidia/lib:/usr/local/nvidia/lib64
10/03/2025 5:26 PM UTC
b5e38718ccd87082c676fa024f1eddec832f817d759649f9669d3addfb0ab9daENV
PATH=/workspace/install/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/mpi/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/ucx/bin:/opt/amazon/efa/bin
10/03/2025 5:26 PM UTC
a9a9425329b9b5630478bd942d37bbcbc02074c7a44d17596dee593eb91d5815ENV
NVIDIA_BUILD_ID=216994194
10/03/2025 5:26 PM UTC
0f915fea49cf9d12cb68603e26cfbb1c980ee7cb3c6e5406a50c8116edaa696fENV
NVIDIA_TRITON_SERVER_SDK_VERSION=25.09
10/03/2025 5:26 PM UTC
c0b14c96ac4bde9b2e6b3d5597f9cd8fa40bf70fabad488d9ae59f58e1fb2890ARG
NVIDIA_BUILD_ID=216994194
10/03/2025 5:26 PM UTC
a722b5a35f966f2643e9f9ab44a2c0e78ff8621f62d24c370bbba4b336b049c3ARG
NVIDIA_TRITON_SERVER_SDK_VERSION=25.09
10/03/2025 5:26 PM UTC
cfcf0faaaaad32f71832a0f741cedaa6598bbb3f0d88b1cdab02ce9e505cbf9bRUN
DCGM_VERSION=4.4.0-1 TRITON_REPO_ORGANIZATION=https://github.com/triton-inference-server TRITON_CORE_REPO_TAG=r25.09 TARGETPLATFORM=linux/arm64 TRITON_ENABLE_GPU=ON sed 's/Server/Server SDK/' /opt/nvidia/entrypoint.d/10-banner.txt | sed 's/^===/=======/' > /opt/nvidia/entrypoint.d/10-banner.new &&
  mv /opt/nvidia/entrypoint.d/10-banner.new /opt/nvidia/entrypoint.d/10-banner.txt
10/03/2025 5:26 PM UTC
d4069396f54f1f5ff6ffaafb43bb07eed97dd62a55fe560aacd4872a706f635dCOPY
docker/entrypoint.d/ /opt/nvidia/entrypoint.d/
10/03/2025 5:26 PM UTC
...