Triton Inference Server

NVIDIA

Container

NVIDIA

Triton Inference Server

Triton Inference Server is an open source software that lets teams deploy trained AI models from any framework, from local or cloud storage and on any GPU- or CPU-based infrastructure in the cloud, data center, or embedded devices.

NVIDIA AI Enterprise Supported

Layer	Label		Created
5c815fb4331692735ffb4708e858a29b864886991f63181804fd7c2ad819b2bf	CONFIG	`Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace`	07/28/2025 4:10 PM UTC
d26e8ad7ee2bc68db41392395f04fd145e811f95ea1f8fb07475d42808e27e63	ENV	`LD_LIBRARY_PATH=/opt/hpcx/ompi/lib:/workspace/install/lib:/usr/local/cuda/compat/lib:/usr/local/nvidia/lib:/usr/local/nvidia/lib64`	07/28/2025 4:10 PM UTC
05c3ff3d3f5cd100b1d8ad2c409f38957bc45febc452854ac30d98e0fbd35787	ENV	`LD_LIBRARY_PATH=/workspace/install/lib:/usr/local/cuda/compat/lib:/usr/local/nvidia/lib:/usr/local/nvidia/lib64`	07/28/2025 4:10 PM UTC
a4b6bf194c9e6eb7cf2bd245beb69b86b2b8e9fdf8159aa149a95da2f9fbd046	ENV	`PATH=/workspace/install/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/mpi/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/ucx/bin:/opt/amazon/efa/bin`	07/28/2025 4:10 PM UTC
ba4b8c3c6da39ad698d521d75731f3953d92757c70861278ee50edd269f4474e	ENV	`NVIDIA_BUILD_ID=193148868`	07/28/2025 4:10 PM UTC
1ec0eac179a0e69e75b77ebed713c8c79d741499fd67dcad8b078c64bdba087d	ENV	`NVIDIA_TRITON_SERVER_SDK_VERSION=25.07`	07/28/2025 4:10 PM UTC
3a8d31aa8022bb20b83ba445c757390dafa90274604a42d8b2b1bcf6a56ca7bc	ARG	`NVIDIA_BUILD_ID=193148868`	07/28/2025 4:10 PM UTC
42dc86d8582a2c65833ad85746a12a2927f3eab432aecb8491e9e6b8bc732cf0	ARG	`NVIDIA_TRITON_SERVER_SDK_VERSION=25.07`	07/28/2025 4:10 PM UTC
5c155f4e29145d38c503ad60039758b7e72840cc3ea44348bd992d578f781425	RUN	`DCGM_VERSION=3.3.6 TRITON_REPO_ORGANIZATION=https://github.com/triton-inference-server TRITON_CORE_REPO_TAG=r25.07 TARGETPLATFORM=linux/arm64 TRITON_ENABLE_GPU=ON sed 's/Server/Server SDK/' /opt/nvidia/entrypoint.d/10-banner.txt \| sed 's/^===/=======/' > /opt/nvidia/entrypoint.d/10-banner.new && mv /opt/nvidia/entrypoint.d/10-banner.new /opt/nvidia/entrypoint.d/10-banner.txt`	07/28/2025 4:10 PM UTC
1faccb290562322ec42f48935bbe8d369355699458cfa779c2dda5963b13908f	COPY	`docker/entrypoint.d/ /opt/nvidia/entrypoint.d/`	07/28/2025 4:10 PM UTC