NVIDIA
Dynamo SGLang Runtime
Container
NVIDIA
Dynamo SGLang Runtime

The Dynamo SGLang runtime image is a containerized build of Dynamo + SGLang which serves as the base runtime environment for sglang based inference with Dynamo's distributed inference framework.

  • LayerLabelCreated
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    DYNAMO_COMMIT_SHA=5ea7ff0979feb0bb44c1191ee968959b871ae2bc
    01/22/2026 8:21 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    DYNAMO_COMMIT_SHA=5ea7ff0979feb0bb44c1191ee968959b871ae2bc
    01/22/2026 8:21 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4USER
    dynamo
    01/22/2026 8:21 PM UTC
    sha256:4b21cd98a70f09d7cc674b2fb9ed44391b7849598ffe79e7bb145e521a0e3e2bRUN
    RUNTIME_IMAGE_TAG=v0.5.6.post2-cu130-runtime chmod 755 /opt/dynamo/.launch_screen &&
      echo 'cat /opt/dynamo/.launch_screen' >> /etc/bash.bashrc &&
      ln -s /workspace /sgl-workspace/dynamo
    01/22/2026 8:21 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4USER
    root
    01/22/2026 8:21 PM UTC
    sha256:aa437fdeef90b659ee9a88fef624871645f6ef98af1114d45ef48579bcc22d2eRUN
    RUNTIME_IMAGE_TAG=v0.5.6.post2-cu130-runtime sed '/^#\s/d' /opt/dynamo/launch_message.txt > /opt/dynamo/.launch_screen
    01/22/2026 8:21 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    SGLANG_FORCE_SHUTDOWN=1
    01/22/2026 8:21 PM UTC
    sha256:53d93f66b807c030f96bc9ef35a8d77f173671a02402fee759d4b7b9843b7e11COPY
    --chown=dynamo:0 --chmod=775 recipes/ /workspace/recipes/
    01/22/2026 8:21 PM UTC
    sha256:67f08ba1f3f1d76c3fd710d74f4befb680a5ac706490c5dadf648ea309ad71a5COPY
    --chown=dynamo:0 --chmod=775 components/ /workspace/components/
    01/22/2026 8:21 PM UTC
    sha256:d845b9dd05ed89a8c2809b62bde93d9c83c00a3bb693a6c728a6836cdfbd96a1COPY
    --chown=dynamo:0 --chmod=775 deploy /workspace/deploy
    01/22/2026 8:21 PM UTC
    ...