NVIDIA
sglang-runtime-nightly
Container
NVIDIA
sglang-runtime-nightly

The Dynamo SGLang runtime nightly image is a containerized build of Dynamo + SGLang which serves as the base runtime environment for sglang based inference with Dynamo's distributed inference framework which is published every night.

  • LayerLabelCreated
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4USER
    dynamo
    08/11/2026 7:10 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    EFA_VERSION=1.49.0
    08/11/2026 7:10 PM UTC
    sha256:c76b9e4b93b9cc72ba6d603b3acb189fdf028001144d7e847150dbee7c72b5edRUN
    MODELEXPRESS_VERSION=0.5.0 ENABLE_GPU_MEMORY_SERVICE=true DYNAMO_COMMIT_SHA=e0c4917c80f7f8af8d028ee914861233432803f1 EFA_VERSION=1.49.0 curl --retry 3 --retry-delay 2 -fsSL -o aws-efa-installer-${EFA_VERSION}.tar.gz https://efa-installer.amazonaws.com/aws-efa-installer-${EFA_VERSION}.tar.gz &&
      tar -xf aws-efa-installer-${EFA_VERSION}.tar.gz &&
      cd aws-efa-installer &&
      apt-get update &&
      ./efa_installer.sh -y --skip-kmod --skip-limit-conf --no-verify &&
      cd .. &&
      rm -rf aws-efa-installer* &&
      ldconfig
    08/11/2026 7:10 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4USER
    root
    08/11/2026 7:09 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    EFA_VERSION=1.49.0
    08/11/2026 7:09 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4CMD
    08/11/2026 7:09 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENTRYPOINT
    /opt/nvidia/nvidia_entrypoint.sh
    08/11/2026 7:09 PM UTC
    sha256:22a3dc06ea7ac2a2ea2eb92511720a5eb46f1820ae42e29b6f84096e40dbc453COPY
    /legal /legal
    08/11/2026 7:09 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NVIDIA_DRIVER_CAPABILITIES=video,compute,utility
    08/11/2026 7:08 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4CMD
    08/11/2026 7:08 PM UTC
    ...