Dynamo SGLang Runtime

NVIDIA

Container

NVIDIA

Dynamo SGLang Runtime

The Dynamo SGLang runtime image is a containerized build of Dynamo + SGLang which serves as the base runtime environment for sglang based inference with Dynamo's distributed inference framework.

Layer	Label		Created
c537e89fa6df9d1d527e3f8dfe351213fa8eea12c65a39015111cb420a5a122d	CONFIG	`Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace`	03/03/2026 11:54 AM UTC
93e54e3d3ab2136a5e27c257e66dd9ef821169a50b694a6d5c6f7b92974571ff	ENTRYPOINT	`/opt/nvidia/nvidia_entrypoint.sh`	03/03/2026 11:54 AM UTC
8052a02e825db73d5e65df47cea9f0e72ce415f542466d934f15eda94234ec21	ENV	`DYNAMO_COMMIT_SHA=ebcbd617aa4dea3bf608a8f0d25d98f013549085`	03/03/2026 11:54 AM UTC
657f360c71384fa26efdbef2034cbc73adfe74ae535107f00ad9d4a3c4d3fd44	ARG	`DYNAMO_COMMIT_SHA=ebcbd617aa4dea3bf608a8f0d25d98f013549085`	03/03/2026 11:54 AM UTC
0b8747002473d9781c4df1cd93361e5abe8df662bfb423d0a34eb2e7c747a8e1	USER	`dynamo`	03/03/2026 11:54 AM UTC
67bcb01cf835041fb51010abacb6bcab3898c5ac422b82566eb945e4b415f2b2	RUN	`RUNTIME_IMAGE_TAG=v0.5.8-runtime ENABLE_GPU_MEMORY_SERVICE=true chmod 755 /opt/dynamo/.launch_screen && echo 'cat /opt/dynamo/.launch_screen' >> /etc/bash.bashrc && ln -s /workspace /sgl-workspace/dynamo`	03/03/2026 11:54 AM UTC
12d64d0d6b75913d4dba8283a7310d943218e003a25d27185123bfb02c06867f	USER	`root`	03/03/2026 11:54 AM UTC
b1ed5ff736d2acd8a8bc90d4783ebbf3b7726b606811d3db9a917394e6570894	RUN	`RUNTIME_IMAGE_TAG=v0.5.8-runtime ENABLE_GPU_MEMORY_SERVICE=true sed '/^#\s/d' /opt/dynamo/launch_message.txt > /opt/dynamo/.launch_screen`	03/03/2026 11:54 AM UTC
de60727b769b576e0698804f55e66edfc74c0a8b1d4de47c79fd271c88fa5213	ENV	`SGLANG_FORCE_SHUTDOWN=1`	03/03/2026 11:54 AM UTC
dfb181d1c513b1b46a7e415fbc9f784e7be1fbaf0cdf2633f174d13c17045de7	COPY	`--chown=dynamo:0 --chmod=775 recipes/ /workspace/recipes/`	03/03/2026 11:54 AM UTC