NVIDIA
sglang-runtime-nightly
Container
NVIDIA
sglang-runtime-nightly

The Dynamo SGLang runtime nightly image is a containerized build of Dynamo + SGLang which serves as the base runtime environment for sglang based inference with Dynamo's distributed inference framework which is published every night.

  • LayerLabelCreated
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4USER
    dynamo
    08/25/2026 8:23 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    EFA_VERSION=1.49.0
    08/25/2026 8:23 AM UTC
    sha256:36a857a8038419d525e24a7d43d89d9f6f5a51c4991575c327d7ff779e4d4231RUN
    MODELEXPRESS_VERSION=0.5.0 ENABLE_GPU_MEMORY_SERVICE=true DYNAMO_COMMIT_SHA=f7de8eb87cf2332c3fc535779ff26eb1f5d438e8 EFA_VERSION=1.49.0 curl --retry 3 --retry-delay 2 -fsSL -o aws-efa-installer-${EFA_VERSION}.tar.gz https://efa-installer.amazonaws.com/aws-efa-installer-${EFA_VERSION}.tar.gz &&
      tar -xf aws-efa-installer-${EFA_VERSION}.tar.gz &&
      cd aws-efa-installer &&
      apt-get update &&
      ./efa_installer.sh -y --skip-kmod --skip-limit-conf --no-verify &&
      cd .. &&
      rm -rf aws-efa-installer* &&
      ldconfig
    08/25/2026 8:23 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4USER
    root
    08/25/2026 8:22 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    EFA_VERSION=1.49.0
    08/25/2026 8:22 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4CMD
    08/25/2026 8:22 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENTRYPOINT
    /opt/nvidia/nvidia_entrypoint.sh
    08/25/2026 8:22 AM UTC
    sha256:aa846de34261812f26f2b9060aa25521aad7f770063708c0059a55431560d6f6COPY
    /legal /legal
    08/25/2026 8:22 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NVIDIA_DRIVER_CAPABILITIES=video,compute,utility
    08/25/2026 8:22 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4CMD
    08/25/2026 8:22 AM UTC
    ...