NVIDIA
NVIDIA
Dynamo SGLang Runtime
Container
NVIDIA
NVIDIA
Dynamo SGLang Runtime

The Dynamo SGLang runtime image is a containerized build of Dynamo + SGLang which serves as the base runtime environment for sglang based inference with Dynamo's distributed inference framework.

LayerLabelCreated
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4CMD
02/12/2026 1:07 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENTRYPOINT
/opt/nvidia/nvidia_entrypoint.sh
02/12/2026 1:07 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
DYNAMO_COMMIT_SHA=76c1889aeb078219eb4fbd2b0c0fc21df75d8d0b
02/12/2026 1:07 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
DYNAMO_COMMIT_SHA=76c1889aeb078219eb4fbd2b0c0fc21df75d8d0b
02/12/2026 1:07 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4USER
dynamo
02/12/2026 1:07 AM UTC
sha256:0d4ca93243cee28a1fa1ebaa4733a2522b59ea702954b56618beb6ed8825f989RUN
RUNTIME_IMAGE_TAG=v0.5.8-runtime ENABLE_GPU_MEMORY_SERVICE=true chmod 755 /opt/dynamo/.launch_screen &&
  echo 'cat /opt/dynamo/.launch_screen' >> /etc/bash.bashrc &&
  ln -s /workspace /sgl-workspace/dynamo
02/12/2026 1:07 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4USER
root
02/12/2026 1:07 AM UTC
sha256:b0c72d3f2cf6b3fb2a1fbced23bfc8f36accb3d1325b7c521f38b45daabd764eRUN
RUNTIME_IMAGE_TAG=v0.5.8-runtime ENABLE_GPU_MEMORY_SERVICE=true sed '/^#\s/d' /opt/dynamo/launch_message.txt > /opt/dynamo/.launch_screen
02/12/2026 1:07 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
SGLANG_FORCE_SHUTDOWN=1
02/12/2026 1:07 AM UTC
sha256:748c1ec7b3d38492c7091bc247b70fde80c0b5005363b138e90e6e6c222e6a9cCOPY
--chown=dynamo:0 --chmod=775 recipes/ /workspace/recipes/
02/12/2026 1:07 AM UTC
...