ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIAKit SDK - Windows (PB25h1)NVIDIAKit SDK - Linux (PB25h1)NVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Triton Inference Server
Container
NVIDIA
NVIDIA
Triton Inference Server

Triton Inference Server is an open source software that lets teams deploy trained AI models from any framework, from local or cloud storage and on any GPU- or CPU-based infrastructure in the cloud, data center, or embedded devices.

NVIDIA AI Enterprise Supported
LayerLabelCreated
127e794b1b8adc4b57b997a4791ad3c38154fb6dd9b40424e76fd2a0fe6a7333CONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace
10/29/2025 6:29 PM UTC
5f7966e02e940c5f28f4a3852473074d0da14bbeaa68028d1b4da69a2089aa1cENV
LD_LIBRARY_PATH=/opt/hpcx/ompi/lib:/workspace/install/lib:/usr/local/cuda/compat/lib:/usr/local/nvidia/lib:/usr/local/nvidia/lib64
10/29/2025 6:29 PM UTC
7d140ae381cd5f9d8df70147b7f58ba5b66fa139d116cb962d5e24b5f3238a09ENV
LD_LIBRARY_PATH=/workspace/install/lib:/usr/local/cuda/compat/lib:/usr/local/nvidia/lib:/usr/local/nvidia/lib64
10/29/2025 6:29 PM UTC
df97ffe3acf5a04b6fe4c96bda96304e6e3292d4da6e9df7f127f1733c3dfc7bENV
PATH=/workspace/install/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/mpi/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/ucx/bin:/opt/amazon/efa/bin
10/29/2025 6:29 PM UTC
22859690c179abfc2c71ee2251b9fe01e3a937d71a4d711795e3f29adf54f6f0ENV
NVIDIA_BUILD_ID=226999241
10/29/2025 6:29 PM UTC
72dffc439ed57a5b610eae405b9ba20cee10522a6c43d4c816b64d4e6f3df268ENV
NVIDIA_TRITON_SERVER_SDK_VERSION=25.10
10/29/2025 6:29 PM UTC
dce1309bc1bfee8f399166c8ae67f44c08ce6ef89aab89460e274df38f527af8ARG
NVIDIA_BUILD_ID=226999241
10/29/2025 6:29 PM UTC
c52fbaf62924080eed0247d5490538ff833a0bb2ba89791014e18a765db8f7dfARG
NVIDIA_TRITON_SERVER_SDK_VERSION=25.10
10/29/2025 6:29 PM UTC
76ca25686835456ee6a7f3e71cd73f33db33d564a13fd52bd04dea91cd254922RUN
DCGM_VERSION=4.4.0-1 TRITON_REPO_ORGANIZATION=https://github.com/triton-inference-server TRITON_CORE_REPO_TAG=r25.10 TARGETPLATFORM=linux/arm64 TRITON_ENABLE_GPU=ON sed 's/Server/Server SDK/' /opt/nvidia/entrypoint.d/10-banner.txt | sed 's/^===/=======/' > /opt/nvidia/entrypoint.d/10-banner.new &&
  mv /opt/nvidia/entrypoint.d/10-banner.new /opt/nvidia/entrypoint.d/10-banner.txt
10/29/2025 6:29 PM UTC
9c5e0d02521469f6d8276a2ade8c895f201f8a0b07fcecbbf5a9a083d7815e74COPY
docker/entrypoint.d/ /opt/nvidia/entrypoint.d/
10/29/2025 6:29 PM UTC
...

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.