NVIDIA
Dynamo SGLang Runtime
Container
NVIDIA
Dynamo SGLang Runtime

The Dynamo SGLang runtime image is a containerized build of Dynamo + SGLang which serves as the base runtime environment for sglang based inference with Dynamo's distributed inference framework.

  • LayerLabelCreated
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    DYNAMO_COMMIT_SHA=5ea7ff0979feb0bb44c1191ee968959b871ae2bc
    01/22/2026 8:24 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    DYNAMO_COMMIT_SHA=5ea7ff0979feb0bb44c1191ee968959b871ae2bc
    01/22/2026 8:24 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4USER
    dynamo
    01/22/2026 8:24 PM UTC
    sha256:e54b436b0e46d92fe75be38765bbd9c64a527e96939e31175a5f6c599584899dRUN
    RUNTIME_IMAGE_TAG=v0.5.6.post2-runtime chmod 755 /opt/dynamo/.launch_screen &&
      echo 'cat /opt/dynamo/.launch_screen' >> /etc/bash.bashrc &&
      ln -s /workspace /sgl-workspace/dynamo
    01/22/2026 8:24 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4USER
    root
    01/22/2026 8:24 PM UTC
    sha256:e953eba1701d5c4f493e41a0326b43c0f066bf4ed3cd7925681fca1cc84a1948RUN
    RUNTIME_IMAGE_TAG=v0.5.6.post2-runtime sed '/^#\s/d' /opt/dynamo/launch_message.txt > /opt/dynamo/.launch_screen
    01/22/2026 8:24 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    SGLANG_FORCE_SHUTDOWN=1
    01/22/2026 8:24 PM UTC
    sha256:baa3665294b8416d7f57497a479683f6b0f66716067e42b4551795c520bbc760COPY
    --chown=dynamo:0 --chmod=775 recipes/ /workspace/recipes/
    01/22/2026 8:24 PM UTC
    sha256:da25145c4c27f741ec05154a4088d54390a7a1a988e6d2c5345ee7ee8e8662ecCOPY
    --chown=dynamo:0 --chmod=775 components/ /workspace/components/
    01/22/2026 8:24 PM UTC
    sha256:8a23bfef8e2ff7ff4f5c24d333844ca65e3d246ee5e9a3c4126fcf89572c0f5eCOPY
    --chown=dynamo:0 --chmod=775 deploy /workspace/deploy
    01/22/2026 8:24 PM UTC
    ...