NVIDIA
NVIDIA
Dynamo SGLang Runtime
Container
NVIDIA
NVIDIA
Dynamo SGLang Runtime

The Dynamo SGLang runtime image is a containerized build of Dynamo + SGLang which serves as the base runtime environment for sglang based inference with Dynamo's distributed inference framework.

LayerLabelCreated
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4CMD
02/12/2026 1:03 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENTRYPOINT
/opt/nvidia/nvidia_entrypoint.sh
02/12/2026 1:03 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
DYNAMO_COMMIT_SHA=76c1889aeb078219eb4fbd2b0c0fc21df75d8d0b
02/12/2026 1:03 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
DYNAMO_COMMIT_SHA=76c1889aeb078219eb4fbd2b0c0fc21df75d8d0b
02/12/2026 1:03 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4USER
dynamo
02/12/2026 1:03 AM UTC
sha256:41bf65bba9c5d360e7a8ae390fa5a36427442f8d97da9af3020de601f4cd47d9RUN
RUNTIME_IMAGE_TAG=v0.5.8-cu130-runtime ENABLE_GPU_MEMORY_SERVICE=true chmod 755 /opt/dynamo/.launch_screen &&
  echo 'cat /opt/dynamo/.launch_screen' >> /etc/bash.bashrc &&
  ln -s /workspace /sgl-workspace/dynamo
02/12/2026 1:03 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4USER
root
02/12/2026 1:03 AM UTC
sha256:db65e4726e7d4cfe2a4490127049a30a3559d3b2a651ffb34d28a4aacfcc0936RUN
RUNTIME_IMAGE_TAG=v0.5.8-cu130-runtime ENABLE_GPU_MEMORY_SERVICE=true sed '/^#\s/d' /opt/dynamo/launch_message.txt > /opt/dynamo/.launch_screen
02/12/2026 1:03 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
SGLANG_FORCE_SHUTDOWN=1
02/12/2026 1:03 AM UTC
sha256:3f3b2ff9244cbedc0d50f0e19e6c57fb11bb6dd85da6da620df5351903d24ed1COPY
--chown=dynamo:0 --chmod=775 recipes/ /workspace/recipes/
02/12/2026 1:03 AM UTC
...