ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
  • NVIDIA
    NVIDIA
    Triton Inference Server
    Container
    NVIDIA
    NVIDIA
    Triton Inference Server

    Triton Inference Server is an open source software that lets teams deploy trained AI models from any framework, from local or cloud storage and on any GPU- or CPU-based infrastructure in the cloud, data center, or embedded devices.

  • LayerLabelCreated
    sha256:8b9e0ecf26a39b21d97d5f019e5f978730839be72b0c448819f80032d7d5775bCOPY
    docker/sagemaker/serve /usr/bin/.
    		07/25/2026 8:06 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4LABEL
    com.amazonaws.sagemaker.capabilities.multi-models=true
    		07/25/2026 8:06 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4LABEL
    com.amazonaws.sagemaker.capabilities.accept-bind-to-port=true
    		07/25/2026 8:06 PM UTC
    sha256:920bf082ca62a52f2d43b3cc65fd3a6bde3017d933f34e05e29fc3939d466103RUN
    TRITON_VERSION=2.71.0 TRITON_CONTAINER_VERSION=26.07 /bin/bash -c pip3 install -r python/openai/requirements.txt
    		07/25/2026 8:06 PM UTC
    sha256:99d9c61c38904de829668b1ee040d4fda52aa7ce6b1fda13afb0b4d78e8d04a2RUN
    TRITON_VERSION=2.71.0 TRITON_CONTAINER_VERSION=26.07 /bin/bash -c set -e; for pkg in tritonserver tritonfrontend; do wheels=$(find /opt/tritonserver/python -maxdepth 1 -type f -name "${pkg}-*.whl"); if [ -z "$wheels" ]; then echo "ERROR: ${pkg}-*.whl missing from /opt/tritonserver/python -- build did not stage the wheel into the image" >&2; exit 1; fi; printf '%s\n' "$wheels" | xargs -I {} pip install --upgrade "{}[all]"; done
    		07/25/2026 8:06 PM UTC
    sha256:6b4caa855e0d0f92de0b3b666d6d89778254ceedac5d437b741e9f53217030c7COPY
    NVIDIA_Deep_Learning_Container_License.pdf .
    		07/25/2026 8:06 PM UTC
    sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1WORKDIR
    /opt/tritonserver
    		07/25/2026 8:06 PM UTC
    sha256:9eaa495cc712823a02265284c27ba8e774e2521c1fb93d3ace493b5b3cb7fcb3COPY
    build/install tritonserver
    		07/25/2026 8:06 PM UTC
    sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1WORKDIR
    /opt
    		07/25/2026 8:06 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4LABEL
    com.nvidia.build.ref=a2baab4da6d90d5b21280b303187e8984c66f19a
    		07/25/2026 8:06 PM UTC
    ...