NVIDIA
NVIDIA
Dynamo SGLang Runtime
Container
NVIDIA
NVIDIA
Dynamo SGLang Runtime

The Dynamo SGLang runtime image is a containerized build of Dynamo + SGLang which serves as the base runtime environment for sglang based inference with Dynamo's distributed inference framework.

LayerLabelCreated
7daad9e847bbef55db3a157ade44806314395fe3a3666c8cee2b6daeb050d67cCONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace
01/15/2026 2:06 PM UTC
25f2f6d6f628b5052c46814d3c9e90b131c04b0fcbe994a0d41433872284a2e7ARG
DYNAMO_COMMIT_SHA=115531a0c0bf58ff12df7ef7e69082d50fd4d707
01/15/2026 2:06 PM UTC
b25c4354652197e6929e6c81667ea2538526c99649ec46aa15283aaac11f9529USER
dynamo
01/15/2026 2:06 PM UTC
a198fcf3c63ca640b8abd9f9d920d6da2b661cf5e76c429e8a8b428900891595RUN
RUNTIME_IMAGE_TAG=v0.5.6.post2-cu130-runtime chmod 755 /opt/dynamo/.launch_screen &&
  echo 'cat /opt/dynamo/.launch_screen' >> /etc/bash.bashrc &&
  ln -s /workspace /sgl-workspace/dynamo
01/15/2026 2:06 PM UTC
08fed9b6ab6575fb2fd3addd3111ad8cb1f3c02d83d6066e86d594b50d92cfe7USER
root
01/15/2026 2:06 PM UTC
68f84c6e12c1c76ce8f640f9f376d5a2967d018bdcdef676917c01cf8dd23388RUN
RUNTIME_IMAGE_TAG=v0.5.6.post2-cu130-runtime sed '/^#\s/d' /opt/dynamo/launch_message.txt > /opt/dynamo/.launch_screen
01/15/2026 2:06 PM UTC
6095dcb52d0c95f61d2da29b459ab0ba1e2a70f698b3a25c0ef990f559f7e0b1ENV
SGLANG_FORCE_SHUTDOWN=1
01/15/2026 2:06 PM UTC
1191c7348f15e5bdf28145f5bf5574f1deb99baea202e45ce43030bc57c3c3d6COPY
--chown=dynamo:0 --chmod=775 recipes/ /workspace/recipes/
01/15/2026 2:06 PM UTC
48e80bac5fb931de51c811561631247009635ffa9f4f63981ae12cf2586ad02fCOPY
--chown=dynamo:0 --chmod=775 components/ /workspace/components/
01/15/2026 2:06 PM UTC
6aafe3f8ddebcdc72ca5db00b904a727fe65a919b705ccdab4ec7eef20f6212dCOPY
--chown=dynamo:0 --chmod=775 deploy /workspace/deploy
01/15/2026 2:06 PM UTC
...

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.