ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
  • NVIDIA
    NVIDIA
    Dynamo Tensorrt-LLM Runtime
    Container
    NVIDIA
    NVIDIA
    Dynamo Tensorrt-LLM Runtime

    The Dynamo TensorRT-LLM runtime image is a containerized build of Dynamo + TensorRT-LLM which serves as the base runtime environment for tensorrt-llm based inference with Dynamo's distributed inference framework.

  • LayerLabelCreated
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENTRYPOINT
    /opt/nvidia/nvidia_entrypoint.sh
    		09/10/2025 7:29 PM UTC
    sha256:bca85d724e57880e49b31587750660bf5eb7d9845fc15dcfcfd43f4c44e798a0COPY
    ATTRIBUTION* LICENSE /workspace/
    		09/10/2025 7:29 PM UTC
    sha256:35b1d0d17a65615bafe8c8e63c9a5a16e28e5d8a810bcc48633eb6659d781dcfRUN
    ARCH=amd64 ARCH_ALT=x86_64 RUSTARCH=x86_64-unknown-linux-gnu /bin/bash -c pip install /workspace/dist/ai_dynamo_runtime*cp312*.whl &&
  pip install /workspace/dist/ai_dynamo*any.whl
    		09/10/2025 7:29 PM UTC
    sha256:7e136ea61a93cd8b08700d7e7d2165ca52ea9fd6a95a4706b505d1891cea0fa1RUN
    ARCH=amd64 ARCH_ALT=x86_64 RUSTARCH=x86_64-unknown-linux-gnu /bin/bash -c mkdir -p /opt/dynamo/bindings/wheels &&
  mkdir /opt/dynamo/bindings/lib &&
  cp dist/ai_dynamo*cp312*.whl /opt/dynamo/bindings/wheels/
    		09/10/2025 7:29 PM UTC
    sha256:6a2cea84c72883fe521040ea0a15442c36899e663477feb34bee0d696bc167c1RUN
    ARCH=amd64 ARCH_ALT=x86_64 RUSTARCH=x86_64-unknown-linux-gnu /bin/bash -c uv build --wheel --out-dir /workspace/dist &&
  cd /workspace/lib/bindings/python &&
  uv build --wheel --out-dir /workspace/dist --python 3.12
    		09/10/2025 7:29 PM UTC
    sha256:d658fc52f459fc9917698c9889f7e135ef02917294a41bff49a280de9697a069COPY
    /uv /uvx /bin/
    		09/10/2025 7:28 PM UTC
    sha256:6ab0c1d5fe72b3841c81607ab34a9be5c73a981a35dd6ebd11eaafebccfd056bRUN
    ARCH=amd64 ARCH_ALT=x86_64 RUSTARCH=x86_64-unknown-linux-gnu /bin/bash -c cargo build --release --locked --workspace
    		09/10/2025 7:28 PM UTC
    sha256:9e21057bc11704fc8c3d8377cc80fd2461f2e921c7308f62622762f1dc3e76bcRUN
    ARCH=amd64 ARCH_ALT=x86_64 RUSTARCH=x86_64-unknown-linux-gnu /bin/bash -c wget --tries=3 --waitretry=5 "https://static.rust-lang.org/rustup/archive/1.28.1/${RUSTARCH}/rustup-init" &&
  chmod +x rustup-init &&
  ./rustup-init -y --no-modify-path --profile default --default-toolchain $RUST_VERSION --default-host ${RUSTARCH} &&
  rm rustup-init &&
  chmod -R a+w $RUSTUP_HOME $CARGO_HOME
    		09/10/2025 7:22 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    RUSTUP_HOME=/usr/local/rustup CARGO_HOME=/usr/local/cargo PATH=/usr/local/cargo/bin:/usr/local/bin/etcd/:/usr/local/lib/python3.12/dist-packages/torch_tensorrt/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/mpi/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/ucx/bin:/opt/amazon/efa/bin:/opt/tensorrt/bin RUST_VERSION=1.89.0
    		09/10/2025 7:22 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    RUSTARCH=x86_64-unknown-linux-gnu
    		09/10/2025 7:22 PM UTC
    ...