NVIDIA
Dynamo SGLang Runtime
Container
NVIDIA
Dynamo SGLang Runtime

The Dynamo SGLang runtime image is a containerized build of Dynamo + SGLang which serves as the base runtime environment for sglang based inference with Dynamo's distributed inference framework.

  • LayerLabelCreated
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4CMD
    02/12/2026 1:03 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENTRYPOINT
    /opt/nvidia/nvidia_entrypoint.sh
    02/12/2026 1:03 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    DYNAMO_COMMIT_SHA=76c1889aeb078219eb4fbd2b0c0fc21df75d8d0b
    02/12/2026 1:03 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    DYNAMO_COMMIT_SHA=76c1889aeb078219eb4fbd2b0c0fc21df75d8d0b
    02/12/2026 1:03 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4USER
    dynamo
    02/12/2026 1:03 AM UTC
    sha256:41bf65bba9c5d360e7a8ae390fa5a36427442f8d97da9af3020de601f4cd47d9RUN
    RUNTIME_IMAGE_TAG=v0.5.8-cu130-runtime ENABLE_GPU_MEMORY_SERVICE=true chmod 755 /opt/dynamo/.launch_screen &&
      echo 'cat /opt/dynamo/.launch_screen' >> /etc/bash.bashrc &&
      ln -s /workspace /sgl-workspace/dynamo
    02/12/2026 1:03 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4USER
    root
    02/12/2026 1:03 AM UTC
    sha256:db65e4726e7d4cfe2a4490127049a30a3559d3b2a651ffb34d28a4aacfcc0936RUN
    RUNTIME_IMAGE_TAG=v0.5.8-cu130-runtime ENABLE_GPU_MEMORY_SERVICE=true sed '/^#\s/d' /opt/dynamo/launch_message.txt > /opt/dynamo/.launch_screen
    02/12/2026 1:03 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    SGLANG_FORCE_SHUTDOWN=1
    02/12/2026 1:03 AM UTC
    sha256:3f3b2ff9244cbedc0d50f0e19e6c57fb11bb6dd85da6da620df5351903d24ed1COPY
    --chown=dynamo:0 --chmod=775 recipes/ /workspace/recipes/
    02/12/2026 1:03 AM UTC
    ...