NVIDIA
tensorrtllm-runtime-nightly
Container
NVIDIA
tensorrtllm-runtime-nightly

The Dynamo TensorRT-LLM runtime nightly image is a containerized build of Dynamo + TensorRT-LLM which serves as the base runtime environment for tensorrt-llm based inference with Dynamo's distributed inference framework published at a nightly cadence.

  • LayerLabelCreated
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4USER
    dynamo
    08/11/2026 8:30 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NIXL_PLUGIN_DIR=/opt/nvidia/nvda_nixl/lib64/plugins
    08/11/2026 8:30 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    LD_PRELOAD=/opt/nvidia/nvda_nixl/lib64/libnixl.so
    08/11/2026 8:30 AM UTC
    sha256:00fedfe2e05d690dbcc1aeaad6732261cb970582e0d19f52fd8a7c03d916e1e7RUN
    DYNAMO_COMMIT_SHA=7a4e47ead90ec6b479e397996f6479ce7d251510 EFA_VERSION=1.49.0 /bin/bash -c rm -rf /opt/nvidia/nvda_nixl &&
      cp -Pfr /tmp/nvda_nixl /opt/nvidia/nvda_nixl &&
      export LD_PRELOAD=/opt/nvidia/nvda_nixl/lib64/libnixl.so &&
      export NIXL_PLUGIN_DIR=/opt/nvidia/nvda_nixl/lib64/plugins &&
      ldconfig
    08/11/2026 8:30 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    EFA_VERSION=1.49.0
    08/11/2026 8:30 AM UTC
    sha256:9ba21394257a7c39935be78bb7d536a0aa7caee75033a7cd48806fb471d7d36dRUN
    DYNAMO_COMMIT_SHA=7a4e47ead90ec6b479e397996f6479ce7d251510 EFA_VERSION=1.49.0 /bin/bash -c curl --retry 3 --retry-delay 2 -fsSL -o aws-efa-installer-${EFA_VERSION}.tar.gz https://efa-installer.amazonaws.com/aws-efa-installer-${EFA_VERSION}.tar.gz &&
      tar -xf aws-efa-installer-${EFA_VERSION}.tar.gz &&
      cd aws-efa-installer &&
      apt-get update &&
      ./efa_installer.sh -y --skip-kmod --skip-limit-conf --no-verify &&
      cd .. &&
      rm -rf aws-efa-installer* &&
      ldconfig
    08/11/2026 8:30 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4USER
    root
    08/11/2026 8:29 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    EFA_VERSION=1.49.0
    08/11/2026 8:29 AM UTC
    sha256:674434270564ec96e7c98b2a7f259b5c5e4344b3fb9f8743ebd0dff20c7eb35cCOPY
    /legal /legal
    08/11/2026 8:29 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NVIDIA_DRIVER_CAPABILITIES=video,compute,utility
    08/11/2026 8:29 AM UTC
    ...