NVIDIA
NVIDIA
Dynamo SGLang Runtime
Container
NVIDIA
NVIDIA
Dynamo SGLang Runtime

The Dynamo SGLang runtime image is a containerized build of Dynamo + SGLang which serves as the base runtime environment for sglang based inference with Dynamo's distributed inference framework.

  • LayerLabelCreated
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4CMD
    02/12/2026 1:07 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENTRYPOINT
    /opt/nvidia/nvidia_entrypoint.sh
    02/12/2026 1:07 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    DYNAMO_COMMIT_SHA=76c1889aeb078219eb4fbd2b0c0fc21df75d8d0b
    02/12/2026 1:07 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    DYNAMO_COMMIT_SHA=76c1889aeb078219eb4fbd2b0c0fc21df75d8d0b
    02/12/2026 1:07 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4USER
    dynamo
    02/12/2026 1:07 AM UTC
    sha256:0d4ca93243cee28a1fa1ebaa4733a2522b59ea702954b56618beb6ed8825f989RUN
    RUNTIME_IMAGE_TAG=v0.5.8-runtime ENABLE_GPU_MEMORY_SERVICE=true chmod 755 /opt/dynamo/.launch_screen &&
      echo 'cat /opt/dynamo/.launch_screen' >> /etc/bash.bashrc &&
      ln -s /workspace /sgl-workspace/dynamo
    02/12/2026 1:07 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4USER
    root
    02/12/2026 1:07 AM UTC
    sha256:b0c72d3f2cf6b3fb2a1fbced23bfc8f36accb3d1325b7c521f38b45daabd764eRUN
    RUNTIME_IMAGE_TAG=v0.5.8-runtime ENABLE_GPU_MEMORY_SERVICE=true sed '/^#\s/d' /opt/dynamo/launch_message.txt > /opt/dynamo/.launch_screen
    02/12/2026 1:07 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    SGLANG_FORCE_SHUTDOWN=1
    02/12/2026 1:07 AM UTC
    sha256:748c1ec7b3d38492c7091bc247b70fde80c0b5005363b138e90e6e6c222e6a9cCOPY
    --chown=dynamo:0 --chmod=775 recipes/ /workspace/recipes/
    02/12/2026 1:07 AM UTC
    ...