NVIDIA
NVIDIA
Dynamo SGLang Runtime
Container
NVIDIA
NVIDIA
Dynamo SGLang Runtime

The Dynamo SGLang runtime image is a containerized build of Dynamo + SGLang which serves as the base runtime environment for sglang based inference with Dynamo's distributed inference framework.

LayerLabelCreated
b4e2cc6fa7a525e0829f210be1a2037403c8ea809f86819b0dbcbd165b911901CONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace
01/15/2026 2:08 PM UTC
15559735c3010b18c82d12d0ccc866e27998aab1e5854c388332f9796a1af848ARG
DYNAMO_COMMIT_SHA=115531a0c0bf58ff12df7ef7e69082d50fd4d707
01/15/2026 2:08 PM UTC
072d3b01c7fa47ce78b4e521a102fe8c9985c1431899d673f1fa94f20c124105USER
dynamo
01/15/2026 2:08 PM UTC
4373c11cac1de3586d634edc88826b557c036aff59aea3ac1a32a98f356ee7a3RUN
RUNTIME_IMAGE_TAG=v0.5.6.post2-runtime chmod 755 /opt/dynamo/.launch_screen &&
  echo 'cat /opt/dynamo/.launch_screen' >> /etc/bash.bashrc &&
  ln -s /workspace /sgl-workspace/dynamo
01/15/2026 2:08 PM UTC
986f2654655372e6a25f7558f47b0f9cf4e632a3944acb53b9f7cda9424b376bUSER
root
01/15/2026 2:08 PM UTC
56bffc350d6fa0e02363c5032bd3aca1216bc4b97f43668b644f805b641fdd6dRUN
RUNTIME_IMAGE_TAG=v0.5.6.post2-runtime sed '/^#\s/d' /opt/dynamo/launch_message.txt > /opt/dynamo/.launch_screen
01/15/2026 2:08 PM UTC
3b88650bb6508dde5427687c2fe7117184a5ec92c9f27ad204d8a1858063914aENV
SGLANG_FORCE_SHUTDOWN=1
01/15/2026 2:08 PM UTC
219cca3336dfa92fa69f68dc839655f8d392d1a346f621de117a43a0ec5486bcCOPY
--chown=dynamo:0 --chmod=775 recipes/ /workspace/recipes/
01/15/2026 2:08 PM UTC
f27bafe0b59d7164b5e5e0c926325cc0c1ebb4280968427bfee86c935b40a2c0COPY
--chown=dynamo:0 --chmod=775 components/ /workspace/components/
01/15/2026 2:08 PM UTC
877f77d47d9ce1026729e84ad5451b29273fbb1da855a9b687d35187432ca842COPY
--chown=dynamo:0 --chmod=775 deploy /workspace/deploy
01/15/2026 2:08 PM UTC
...

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.