NVIDIA
tensorrtllm-runtime-nightly
Container
NVIDIA
tensorrtllm-runtime-nightly

The Dynamo TensorRT-LLM runtime nightly image is a containerized build of Dynamo + TensorRT-LLM which serves as the base runtime environment for tensorrt-llm based inference with Dynamo's distributed inference framework published at a nightly cadence.

  • LayerLabelCreated
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4USER
    dynamo
    08/17/2026 8:23 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NIXL_PLUGIN_DIR=/opt/nvidia/nvda_nixl/lib64/plugins
    08/17/2026 8:23 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    LD_PRELOAD=/opt/nvidia/nvda_nixl/lib64/libnixl.so
    08/17/2026 8:23 AM UTC
    sha256:430cc4e2c9ebafb6d6aa831e47b95ae5447e813b27fe02c64e51975aef75e1e7RUN
    DYNAMO_COMMIT_SHA=a7e0eacfc57f3846b6c11bf1a090d5aaa5127866 EFA_VERSION=1.49.0 /bin/bash -c rm -rf /opt/nvidia/nvda_nixl &&
      cp -Pfr /tmp/nvda_nixl /opt/nvidia/nvda_nixl &&
      export LD_PRELOAD=/opt/nvidia/nvda_nixl/lib64/libnixl.so &&
      export NIXL_PLUGIN_DIR=/opt/nvidia/nvda_nixl/lib64/plugins &&
      ldconfig
    08/17/2026 8:23 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    EFA_VERSION=1.49.0
    08/17/2026 8:23 AM UTC
    sha256:ce512a73e696822bcae13ac8fc274bb2fe00a5d37ee4f30e9f5805f9f155688dRUN
    DYNAMO_COMMIT_SHA=a7e0eacfc57f3846b6c11bf1a090d5aaa5127866 EFA_VERSION=1.49.0 /bin/bash -c curl --retry 3 --retry-delay 2 -fsSL -o aws-efa-installer-${EFA_VERSION}.tar.gz https://efa-installer.amazonaws.com/aws-efa-installer-${EFA_VERSION}.tar.gz &&
      tar -xf aws-efa-installer-${EFA_VERSION}.tar.gz &&
      cd aws-efa-installer &&
      apt-get update &&
      ./efa_installer.sh -y --skip-kmod --skip-limit-conf --no-verify &&
      cd .. &&
      rm -rf aws-efa-installer* &&
      ldconfig
    08/17/2026 8:23 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4USER
    root
    08/17/2026 8:22 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    EFA_VERSION=1.49.0
    08/17/2026 8:22 AM UTC
    sha256:65f308ca84dd2d7268f8e059f5a9694a2f740cd0678a988a995893cbb758dc4bCOPY
    /legal /legal
    08/17/2026 8:22 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NVIDIA_DRIVER_CAPABILITIES=video,compute,utility
    08/17/2026 8:22 AM UTC
    ...