Dynamo SGLang Runtime

NVIDIA

Container

NVIDIA

Dynamo SGLang Runtime

The Dynamo SGLang runtime image is a containerized build of Dynamo + SGLang which serves as the base runtime environment for sglang based inference with Dynamo's distributed inference framework.

Layer	Label		Created
7daad9e847bbef55db3a157ade44806314395fe3a3666c8cee2b6daeb050d67c	CONFIG	`Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace`	01/15/2026 2:06 PM UTC
25f2f6d6f628b5052c46814d3c9e90b131c04b0fcbe994a0d41433872284a2e7	ARG	`DYNAMO_COMMIT_SHA=115531a0c0bf58ff12df7ef7e69082d50fd4d707`	01/15/2026 2:06 PM UTC
b25c4354652197e6929e6c81667ea2538526c99649ec46aa15283aaac11f9529	USER	`dynamo`	01/15/2026 2:06 PM UTC
a198fcf3c63ca640b8abd9f9d920d6da2b661cf5e76c429e8a8b428900891595	RUN	`RUNTIME_IMAGE_TAG=v0.5.6.post2-cu130-runtime chmod 755 /opt/dynamo/.launch_screen && echo 'cat /opt/dynamo/.launch_screen' >> /etc/bash.bashrc && ln -s /workspace /sgl-workspace/dynamo`	01/15/2026 2:06 PM UTC
08fed9b6ab6575fb2fd3addd3111ad8cb1f3c02d83d6066e86d594b50d92cfe7	USER	`root`	01/15/2026 2:06 PM UTC
68f84c6e12c1c76ce8f640f9f376d5a2967d018bdcdef676917c01cf8dd23388	RUN	`RUNTIME_IMAGE_TAG=v0.5.6.post2-cu130-runtime sed '/^#\s/d' /opt/dynamo/launch_message.txt > /opt/dynamo/.launch_screen`	01/15/2026 2:06 PM UTC
6095dcb52d0c95f61d2da29b459ab0ba1e2a70f698b3a25c0ef990f559f7e0b1	ENV	`SGLANG_FORCE_SHUTDOWN=1`	01/15/2026 2:06 PM UTC
1191c7348f15e5bdf28145f5bf5574f1deb99baea202e45ce43030bc57c3c3d6	COPY	`--chown=dynamo:0 --chmod=775 recipes/ /workspace/recipes/`	01/15/2026 2:06 PM UTC
48e80bac5fb931de51c811561631247009635ffa9f4f63981ae12cf2586ad02f	COPY	`--chown=dynamo:0 --chmod=775 components/ /workspace/components/`	01/15/2026 2:06 PM UTC
6aafe3f8ddebcdc72ca5db00b904a727fe65a919b705ccdab4ec7eef20f6212d	COPY	`--chown=dynamo:0 --chmod=775 deploy /workspace/deploy`	01/15/2026 2:06 PM UTC