NVIDIA
NVIDIA
Dynamo SGLang Runtime
Container
NVIDIA
NVIDIA
Dynamo SGLang Runtime

The Dynamo SGLang runtime image is a containerized build of Dynamo + SGLang which serves as the base runtime environment for sglang based inference with Dynamo's distributed inference framework.

LayerLabelCreated
ae6450bca39ac2f742547ef108fa35e151297de9c67d998b53acec60ba2fe02dCONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace
01/22/2026 8:24 PM UTC
0b07d07dd42a9813cfe2b501b72c2f96d376f46ff07604a0223d1548f1700ed8ARG
DYNAMO_COMMIT_SHA=5ea7ff0979feb0bb44c1191ee968959b871ae2bc
01/22/2026 8:24 PM UTC
3ef5338ac72cef3d8f5a05464fa549a47c20802483bdd3b69a42d5e8d012fb8fUSER
dynamo
01/22/2026 8:24 PM UTC
3c533479249b204a872732c95fe4e6e3558646b06e2760487ba36ce22d2c66cdRUN
RUNTIME_IMAGE_TAG=v0.5.6.post2-runtime chmod 755 /opt/dynamo/.launch_screen &&
  echo 'cat /opt/dynamo/.launch_screen' >> /etc/bash.bashrc &&
  ln -s /workspace /sgl-workspace/dynamo
01/22/2026 8:24 PM UTC
0be5fe2299e2cd9974f2c0bd0d2fac4a1936e1b3eaf95851f29f531b8c1271dcUSER
root
01/22/2026 8:24 PM UTC
70c5b128189bc6ceb6d8d5a09131f03793a640993e591f4a0baa5c5575ceff20RUN
RUNTIME_IMAGE_TAG=v0.5.6.post2-runtime sed '/^#\s/d' /opt/dynamo/launch_message.txt > /opt/dynamo/.launch_screen
01/22/2026 8:24 PM UTC
2e1771ad1b6f292ce198970224c993f534f9e12a071e82696f9f29f6f9eecdaeENV
SGLANG_FORCE_SHUTDOWN=1
01/22/2026 8:24 PM UTC
ead93ee42dbcffec443e8710dc3aa07a72cef9b76e66c089fcc199d6e26055c5COPY
--chown=dynamo:0 --chmod=775 recipes/ /workspace/recipes/
01/22/2026 8:24 PM UTC
0a2fe0e41cc5ccebd32908c4da8eeaa806e4044d9b7f29efeb89868272c8071aCOPY
--chown=dynamo:0 --chmod=775 components/ /workspace/components/
01/22/2026 8:24 PM UTC
e888dc3865030a76b5df55c367c24d1eb7d741ad72f01f3923785e818fa71dcaCOPY
--chown=dynamo:0 --chmod=775 deploy /workspace/deploy
01/22/2026 8:24 PM UTC
...

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.