ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIAKit SDK - Windows (PB25h1)NVIDIAKit SDK - Linux (PB25h1)NVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Triton Inference Server
Container
NVIDIA
NVIDIA
Triton Inference Server

Triton Inference Server is an open source software that lets teams deploy trained AI models from any framework, from local or cloud storage and on any GPU- or CPU-based infrastructure in the cloud, data center, or embedded devices.

NVIDIA AI Enterprise Supported
LayerLabelCreated
3f6c447db3114741a222a408d8a3acea879f6ae2e623805c28f2fed37744a89aCONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace
03/20/2026 9:58 PM UTC
ca16ddd6c971395e73a82e1a816bc4d71ee2b6f39d3019917d1ba7df0d9e1a9bENV
LD_LIBRARY_PATH=/opt/hpcx/ompi/lib:/workspace/install/lib:/usr/local/cuda/compat/lib:/usr/local/nvidia/lib:/usr/local/nvidia/lib64
03/20/2026 9:58 PM UTC
c6922732d3172efcb40df2721f26b3670dcf95a71231ef3332b09cbe6c8b8205ENV
LD_LIBRARY_PATH=/workspace/install/lib:/usr/local/cuda/compat/lib:/usr/local/nvidia/lib:/usr/local/nvidia/lib64
03/20/2026 9:58 PM UTC
311b96259fb71810f5011c48a391e213fbb43b24e1872b216ec5080a4731d98dENV
PATH=/workspace/install/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/mpi/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/ucx/bin:/opt/amazon/efa/bin
03/20/2026 9:58 PM UTC
578148d831ee4fbe0061f39120637fd30ba6501df66f6aa55d6af1a9ee838381ENV
NVIDIA_BUILD_ID=285427402
03/20/2026 9:58 PM UTC
3b97e1196bed3d4c756812914ed612fd9bda58a18872e0801d0bff4bfa2cc91dENV
NVIDIA_TRITON_SERVER_SDK_VERSION=26.03
03/20/2026 9:58 PM UTC
00ffbbe60dc8e5962ab7de10574c3a41e6800f42a59421e0ed4476678b27983aARG
NVIDIA_BUILD_ID=285427402
03/20/2026 9:58 PM UTC
7915ba3da699815bfe88b39d363ce4f53882bccdbeafa258840fbac1163bdb6dARG
NVIDIA_TRITON_SERVER_SDK_VERSION=26.03
03/20/2026 9:58 PM UTC
6f28ea876918a2e8c1960d0a870807e6caf7547bca18dcfb0f7a7b5fde42e3d7RUN
DCGM_VERSION=4.5.2-1 TRITON_REPO_ORGANIZATION=https://github.com/triton-inference-server TRITON_CORE_REPO_TAG=r26.03 TARGETPLATFORM=linux/amd64 TRITON_ENABLE_GPU=ON TRITON_MODEL_ANALYZER_REPO_TAG=r26.03 TRITON_MODEL_ANALYZER_REPO=https://github.com/triton-inference-server/model_analyzer@r26.03 sed 's/Server/Server SDK/' /opt/nvidia/entrypoint.d/10-banner.txt | sed 's/^===/=======/' > /opt/nvidia/entrypoint.d/10-banner.new &&
  mv /opt/nvidia/entrypoint.d/10-banner.new /opt/nvidia/entrypoint.d/10-banner.txt
03/20/2026 9:58 PM UTC
49d95f0398754d88d81e0095d89dcd22a415785292327e1a64c3ee923b7a24b5COPY
docker/entrypoint.d/ /opt/nvidia/entrypoint.d/
03/20/2026 9:58 PM UTC
...

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.