ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIAKit SDK - Windows (PB25h1)NVIDIAKit SDK - Linux (PB25h1)NVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Triton Inference Server
Container
NVIDIA
NVIDIA
Triton Inference Server

Triton Inference Server is an open source software that lets teams deploy trained AI models from any framework, from local or cloud storage and on any GPU- or CPU-based infrastructure in the cloud, data center, or embedded devices.

NVIDIA AI Enterprise Supported
LayerLabelCreated
18a3644f47a08fa64817a88e008f2d15989c123dc48305f76e62b1cd6ca791b0CONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /opt/tritonserver
06/24/2026 11:54 PM UTC
e9a778b54dcb29f859827c72aedbebd505daa3006b4968015c0e17aae5f29842LABEL
com.amazonaws.sagemaker.capabilities.accept-bind-to-port=true
06/24/2026 11:54 PM UTC
256fd7f62c1d6a5b7313af0a7776a9f1009d91a55090cb901402ae95a696471cCOPY
/opt/tritonserver/caches/local /opt/tritonserver/caches/local
06/24/2026 11:54 PM UTC
f1c777989835ff52e202906aae0104acdedc0b89d7e7f68f5e2c62cf6c83508dCOPY
/opt/tritonserver/repoagents/checksum /opt/tritonserver/repoagents/checksum
06/24/2026 11:54 PM UTC
328d138839b5c5e755f2ad50c309d5b8db5b4e8666717c8de4d63ec67b23637dCOPY
/opt/tritonserver/backends/python /opt/tritonserver/backends/python
06/24/2026 11:54 PM UTC
9c0721fbe8af2097cf4e1fec6c0a5fad53a828b0782ca23b3f1a0c7f75c89423COPY
/opt/tritonserver/backends/identity /opt/tritonserver/backends/identity
06/24/2026 11:54 PM UTC
02e711b60c37e734f0ae316de41c3092a066e3f00b4cf9d7550b6e1f7192175bCOPY
/opt/tritonserver/backends/pytorch /opt/tritonserver/backends/pytorch
06/24/2026 11:54 PM UTC
7bea8c015773b7a9312fc3f529777446bfdc86154e81408ed35b6b72f8fdde52COPY
/opt/tritonserver/include include/
06/24/2026 11:54 PM UTC
4cce8779029f54766239310a342d944139616c6c2d3b41d19ec4352a6c13aee6COPY
/opt/tritonserver/lib lib/
06/24/2026 11:54 PM UTC
145d9b14ffcb18ff70a42838a955700936a8b3142568742546db3e271f636e38COPY
/opt/tritonserver/bin bin/
06/24/2026 11:54 PM UTC
...

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.