NVIDIA
sglang-runtime-nightly
Container
NVIDIA
sglang-runtime-nightly

The Dynamo SGLang runtime nightly image is a containerized build of Dynamo + SGLang which serves as the base runtime environment for sglang based inference with Dynamo's distributed inference framework which is published every night.

  • LayerLabelCreated
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4USER
    dynamo
    08/03/2026 9:49 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    EFA_VERSION=1.49.0
    08/03/2026 9:49 AM UTC
    sha256:4abcf8446c570d99858dc7e461debb07f7c3f9ec573d199ed19aaaefca436150RUN
    MODELEXPRESS_VERSION=0.4.0 ENABLE_GPU_MEMORY_SERVICE=true DYNAMO_COMMIT_SHA=c574e4d7c1a804c1e04056215adebd593cc3c187 EFA_VERSION=1.49.0 curl --retry 3 --retry-delay 2 -fsSL -o aws-efa-installer-${EFA_VERSION}.tar.gz https://efa-installer.amazonaws.com/aws-efa-installer-${EFA_VERSION}.tar.gz &&
      tar -xf aws-efa-installer-${EFA_VERSION}.tar.gz &&
      cd aws-efa-installer &&
      apt-get update &&
      ./efa_installer.sh -y --skip-kmod --skip-limit-conf --no-verify &&
      cd .. &&
      rm -rf aws-efa-installer* &&
      ldconfig
    08/03/2026 9:49 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4USER
    root
    08/03/2026 9:46 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    EFA_VERSION=1.49.0
    08/03/2026 9:46 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4CMD
    08/03/2026 9:46 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENTRYPOINT
    /opt/nvidia/nvidia_entrypoint.sh
    08/03/2026 9:46 AM UTC
    sha256:7174d76c63d9641f28f7ae67dc791cb627a489b7445ea3ae4bba406ac03e08a1COPY
    /legal /legal
    08/03/2026 9:46 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4CMD
    08/03/2026 9:45 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENTRYPOINT
    /opt/nvidia/nvidia_entrypoint.sh
    08/03/2026 9:45 AM UTC
    ...