Dynamo SGLang Runtime

NVIDIA

Container

NVIDIA

Dynamo SGLang Runtime

The Dynamo SGLang runtime image is a containerized build of Dynamo + SGLang which serves as the base runtime environment for sglang based inference with Dynamo's distributed inference framework.

Layer	Label		Created
b6869041fdeb1a4d6ce292c8795f17a54c50a7fb72ab3bab00ba8720475abdc3	CONFIG	`Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace`	03/03/2026 11:52 AM UTC
7c4cc0d28014dd9313635327b5a6dd8ebdc85df7230b14699657011e20a736be	ENTRYPOINT	`/opt/nvidia/nvidia_entrypoint.sh`	03/03/2026 11:52 AM UTC
2230684c961d1f570b8b23b2fc715627c130a111614a39aadfc2d02333f9cb1e	ENV	`DYNAMO_COMMIT_SHA=ebcbd617aa4dea3bf608a8f0d25d98f013549085`	03/03/2026 11:52 AM UTC
9731e7db025e0aaac6a8b9e4dd8ef6ae26477cadfe5329b01f92efe7b5d36734	ARG	`DYNAMO_COMMIT_SHA=ebcbd617aa4dea3bf608a8f0d25d98f013549085`	03/03/2026 11:52 AM UTC
7e2ad6af5c72b6f3eb6d4998c4fe6e056c477834bafee8ed3bf2c393edac6d1b	USER	`dynamo`	03/03/2026 11:52 AM UTC
229fb2115e856a29742cc32541960b9bf060155a1e208026ef5fb2c7d98e0d10	RUN	`RUNTIME_IMAGE_TAG=v0.5.8-cu130-runtime ENABLE_GPU_MEMORY_SERVICE=true chmod 755 /opt/dynamo/.launch_screen && echo 'cat /opt/dynamo/.launch_screen' >> /etc/bash.bashrc && ln -s /workspace /sgl-workspace/dynamo`	03/03/2026 11:52 AM UTC
d4dcf7d39b30952cb2b60151434b891eae9ae8a1ec3085e6d49c1874c488d41d	USER	`root`	03/03/2026 11:52 AM UTC
9ad0ac0ac81720e491035157f8d71b816fdc17292404507a679a84389dd30ef9	RUN	`RUNTIME_IMAGE_TAG=v0.5.8-cu130-runtime ENABLE_GPU_MEMORY_SERVICE=true sed '/^#\s/d' /opt/dynamo/launch_message.txt > /opt/dynamo/.launch_screen`	03/03/2026 11:52 AM UTC
9352e6a7739717fcdda6e1d43a6856240ef8b194dc55a216c2e9e3ee40768f12	ENV	`SGLANG_FORCE_SHUTDOWN=1`	03/03/2026 11:52 AM UTC
f88a04ed2861e3b56fc56fb11cf2fd53fcc708ecb72e8b09e1543efdb3a95ffc	COPY	`--chown=dynamo:0 --chmod=775 recipes/ /workspace/recipes/`	03/03/2026 11:52 AM UTC