ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIAKit SDK - Windows (PB25h1)NVIDIAKit SDK - Linux (PB25h1)NVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Triton Inference Server
Container
NVIDIA
NVIDIA
Triton Inference Server

Triton Inference Server is an open source software that lets teams deploy trained AI models from any framework, from local or cloud storage and on any GPU- or CPU-based infrastructure in the cloud, data center, or embedded devices.

NVIDIA AI Enterprise Supported
LayerLabelCreated
14be4aef5d6111a2face22df7bd97a9914a6545fff0aea6b64f2687deba415daCONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /opt/tritonserver
07/28/2025 4:20 PM UTC
799610fdc2b36a2243b94af597e128acdebe1453bfe0c3e01f676e5ca522e78fLABEL
com.amazonaws.sagemaker.capabilities.multi-models=true
07/28/2025 4:20 PM UTC
b0f1afdff35622174b6087890d4e84db5fb6a6368f3665ab1c732204b63ad2afLABEL
com.amazonaws.sagemaker.capabilities.accept-bind-to-port=true
07/28/2025 4:20 PM UTC
417bfc1206edd8601f4d041179f4d647cbccb6c4f5eba355a65924fc4d1a796fRUN
TRITON_VERSION=2.59.1 TRITON_CONTAINER_VERSION=25.07 pip3 install -r python/openai/requirements.txt
07/28/2025 4:20 PM UTC
26ff99375aca678489ac8502acfddaf4bc94bc0313c840e774aa3abf65b4da4aRUN
TRITON_VERSION=2.59.1 TRITON_CONTAINER_VERSION=25.07 find /opt/tritonserver/python -maxdepth 1 -type f -name "tritonserver-*.whl" | xargs -I {} pip install --upgrade {}[all] &&
  find /opt/tritonserver/python -maxdepth 1 -type f -name "tritonfrontend-*.whl" | xargs -I {} pip install --upgrade {}[all]
07/28/2025 4:20 PM UTC
09be5318cb64cede87537f1b3bd79faa1dff71c30a949dc8beb689b1938dd1aaCOPY
--chown=1000:1000 NVIDIA_Deep_Learning_Container_License.pdf .
07/28/2025 4:19 PM UTC
943534ab1d23670efd3c6fe0753499b70285804f41e646fe39e2962c82b9ed4cWORKDIR
/opt/tritonserver
07/28/2025 4:19 PM UTC
032cf6fecab2891a22df1db17a011cb9888db34d3d6a528061a65f920587a65cCOPY
--chown=1000:1000 build/install tritonserver
07/28/2025 4:19 PM UTC
86bd2f4852499628248cc24cd950581d04fed8439f10a01e42f77557ad41101bWORKDIR
/opt
07/28/2025 4:19 PM UTC
05edadac147197d1e1cac561b38d4fbabea146a6106e6bb80cb9cf49ae664eaaLABEL
com.nvidia.build.ref=94e3a7cf3e836818273f6a353849cd3f9fc26b5a
07/28/2025 4:19 PM UTC
...