ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIAKit SDK - Windows (PB25h1)NVIDIAKit SDK - Linux (PB25h1)NVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Triton Inference Server
Container
NVIDIA
NVIDIA
Triton Inference Server

Triton Inference Server is an open source software that lets teams deploy trained AI models from any framework, from local or cloud storage and on any GPU- or CPU-based infrastructure in the cloud, data center, or embedded devices.

NVIDIA AI Enterprise Supported
LayerLabelCreated
8cc368b75992ca9632a3b7a1deb6f9af97af5ca1066783e1b72d73138907b337CONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace
07/28/2025 4:04 PM UTC
bc1aae1bb55916f7a8dfb497ba15a3e3188a3aa3dfb5715949567a8f33ea33b2ENV
LD_LIBRARY_PATH=/opt/hpcx/ompi/lib:/workspace/install/lib:/usr/local/cuda/compat/lib:/usr/local/nvidia/lib:/usr/local/nvidia/lib64
07/28/2025 4:04 PM UTC
455c7bc8aa4bfac0dd2edbd1a32d22c0300a13ab125113e8a378bb3b44afe3c3ENV
LD_LIBRARY_PATH=/workspace/install/lib:/usr/local/cuda/compat/lib:/usr/local/nvidia/lib:/usr/local/nvidia/lib64
07/28/2025 4:04 PM UTC
db05250766993e76abe545afad5938391f9259afa8b2ae58a22d1694b4206c62ENV
PATH=/workspace/install/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/mpi/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/ucx/bin:/opt/amazon/efa/bin
07/28/2025 4:04 PM UTC
edfa6acd43bd5df6c53741dcc2375078a3319164f1dd9c801e0a5aab66bb08bdENV
NVIDIA_BUILD_ID=193148800
07/28/2025 4:04 PM UTC
5e1568e64b399d25c069e25c68cd2a6a59c6d38a77afb63153fee85ac907ab9aENV
NVIDIA_TRITON_SERVER_SDK_VERSION=25.07
07/28/2025 4:04 PM UTC
1177cd51312165ecb2573ed867ada42d012daeb523461c3a5a537c6d89224dfbARG
NVIDIA_BUILD_ID=193148800
07/28/2025 4:04 PM UTC
b6e6252a60551e210e065d58ce97e2fc11017e5e9ecd08abc87642c861e56cd0ARG
NVIDIA_TRITON_SERVER_SDK_VERSION=25.07
07/28/2025 4:04 PM UTC
a3356b304266929d86f5f6f599a9e6dcd9638d808bd304ed771590ce55a0df28RUN
DCGM_VERSION=3.3.6 TRITON_REPO_ORGANIZATION=https://github.com/triton-inference-server TRITON_CORE_REPO_TAG=r25.07 TARGETPLATFORM=linux/amd64 TRITON_ENABLE_GPU=ON sed 's/Server/Server SDK/' /opt/nvidia/entrypoint.d/10-banner.txt | sed 's/^===/=======/' > /opt/nvidia/entrypoint.d/10-banner.new &&
  mv /opt/nvidia/entrypoint.d/10-banner.new /opt/nvidia/entrypoint.d/10-banner.txt
07/28/2025 4:04 PM UTC
0e7c78a39bc8482f4870c197314260c3c8fe2546a77646ef5d200c908693b321COPY
docker/entrypoint.d/ /opt/nvidia/entrypoint.d/
07/28/2025 4:04 PM UTC
...