NVIDIA
NVIDIA
Triton Inference Server
Container
NVIDIA
NVIDIA
Triton Inference Server

Triton Inference Server is an open source software that lets teams deploy trained AI models from any framework, from local or cloud storage and on any GPU- or CPU-based infrastructure in the cloud, data center, or embedded devices.

LayerLabelCreated
7122adf3febeba41b4e7ee50adaf2e52d0a889fe7571682c620fd7dec30667e2CONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /opt/tritonserver
06/24/2026 11:19 PM UTC
470a91f2853549a13728b24b7128257e3ff63e94d7106c0ed43bc434c41cecd4LABEL
com.amazonaws.sagemaker.capabilities.multi-models=true
06/24/2026 11:19 PM UTC
fb35e5ae527984d8eeb8952888b500f25763a0e1b3694f26528123243cd8fb7fLABEL
com.amazonaws.sagemaker.capabilities.accept-bind-to-port=true
06/24/2026 11:19 PM UTC
ea5f9133b6819db02e74319e6297a3dc0c4925e745c169b6a52b44ac86f4d34fRUN
TRITON_VERSION=2.70.0 TRITON_CONTAINER_VERSION=26.06 pip3 install -r python/openai/requirements.txt
06/24/2026 11:19 PM UTC
f4cbc474be78b2c97375052ed6ea3bdb3bc455208963aed0e26f9a096d05c911RUN
TRITON_VERSION=2.70.0 TRITON_CONTAINER_VERSION=26.06 set -e; for pkg in tritonserver tritonfrontend; do wheels=$(find /opt/tritonserver/python -maxdepth 1 -type f -name "${pkg}-*.whl"); if [ -z "$wheels" ]; then echo "ERROR: ${pkg}-*.whl missing from /opt/tritonserver/python -- build did not stage the wheel into the image" >&2; exit 1; fi; printf '%s\n' "$wheels" | xargs -I {} pip install --upgrade "{}[all]"; done
06/24/2026 11:19 PM UTC
89d9597f0f813ad2d20d2789e51a55234bf91cf4c32f7b35f70d45399f81fa28COPY
NVIDIA_Deep_Learning_Container_License.pdf .
06/24/2026 11:19 PM UTC
23e63c1f0ddd1e3c872dc8a3a66812f06fd30717ce7b0c4f680159015daeeb26WORKDIR
/opt/tritonserver
06/24/2026 11:19 PM UTC
106472f57d249184e0ebcb644c5a1c40f5ecd833dcc93801a6b982e20f30fc89COPY
build/install tritonserver
06/24/2026 11:19 PM UTC
378dcfa0a96597c39dabfb56827a4d676e39529aa1de738bc139966e2ab224a2WORKDIR
/opt
06/24/2026 11:19 PM UTC
279325f6e1c6e3005e51f73b2898d65066a0c8bdbbaf6cb58318f545e49e59fdLABEL
com.nvidia.build.ref=04a5082d584f92086a02a47a5f3e75e4d644e1f6
06/24/2026 11:19 PM UTC
...