NVIDIA
NVIDIA
Dynamo SGLang Runtime
Container
NVIDIA
NVIDIA
Dynamo SGLang Runtime

The Dynamo SGLang runtime image is a containerized build of Dynamo + SGLang which serves as the base runtime environment for sglang based inference with Dynamo's distributed inference framework.

LayerLabelCreated
7c346f129f055778757dcbd6260ebcfa2380e3eae66938d72121d904cad70237CONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace
01/22/2026 8:21 PM UTC
1ce1aecf9d8d63f745c2b622a0108eaa2be21f5017bfe4c030f5870312b7b23bARG
DYNAMO_COMMIT_SHA=5ea7ff0979feb0bb44c1191ee968959b871ae2bc
01/22/2026 8:21 PM UTC
cfdbf64bf3fdcb6a463b515038ce1ecd71c153c24c6af0074616314eec72c2d6USER
dynamo
01/22/2026 8:21 PM UTC
89e03b9fb727bdeb27516d568c9e71e928f56b88dafe613dfc9f3d48ef156635RUN
RUNTIME_IMAGE_TAG=v0.5.6.post2-cu130-runtime chmod 755 /opt/dynamo/.launch_screen &&
  echo 'cat /opt/dynamo/.launch_screen' >> /etc/bash.bashrc &&
  ln -s /workspace /sgl-workspace/dynamo
01/22/2026 8:21 PM UTC
fb0d2bc1bcf29003b3ab743d3c42e5e3a87331c2eef503fc0692ea5a36ac461dUSER
root
01/22/2026 8:21 PM UTC
3b6ede3a5d33902c3596aad051da03b7cfeb497de3f347b78a47f1768a34ff65RUN
RUNTIME_IMAGE_TAG=v0.5.6.post2-cu130-runtime sed '/^#\s/d' /opt/dynamo/launch_message.txt > /opt/dynamo/.launch_screen
01/22/2026 8:21 PM UTC
cfa4e088a1d4ad0715c1233ebffb566ccf8e295d8a04e44d3d179cb3e964af1dENV
SGLANG_FORCE_SHUTDOWN=1
01/22/2026 8:21 PM UTC
e6e9cf5663ecafb6536abeb5d52a09ac5b251d5cd1a47373214fb65af24222daCOPY
--chown=dynamo:0 --chmod=775 recipes/ /workspace/recipes/
01/22/2026 8:21 PM UTC
bf8b0293e3a0b7a368e16f24de56e806af34db3367c968edcb9f49d9e3dd55e5COPY
--chown=dynamo:0 --chmod=775 components/ /workspace/components/
01/22/2026 8:21 PM UTC
7a5e8acb8aae3752a87f42b2754aef281d7de3bbf53f0bb7d59e76e5ce1f692bCOPY
--chown=dynamo:0 --chmod=775 deploy /workspace/deploy
01/22/2026 8:21 PM UTC
...