Dynamo SGLang Runtime

NVIDIA

Container

NVIDIA

Dynamo SGLang Runtime

The Dynamo SGLang runtime image is a containerized build of Dynamo + SGLang which serves as the base runtime environment for sglang based inference with Dynamo's distributed inference framework.

Layer	Label		Created
b4e2cc6fa7a525e0829f210be1a2037403c8ea809f86819b0dbcbd165b911901	CONFIG	`Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace`	01/15/2026 2:08 PM UTC
15559735c3010b18c82d12d0ccc866e27998aab1e5854c388332f9796a1af848	ARG	`DYNAMO_COMMIT_SHA=115531a0c0bf58ff12df7ef7e69082d50fd4d707`	01/15/2026 2:08 PM UTC
072d3b01c7fa47ce78b4e521a102fe8c9985c1431899d673f1fa94f20c124105	USER	`dynamo`	01/15/2026 2:08 PM UTC
4373c11cac1de3586d634edc88826b557c036aff59aea3ac1a32a98f356ee7a3	RUN	`RUNTIME_IMAGE_TAG=v0.5.6.post2-runtime chmod 755 /opt/dynamo/.launch_screen && echo 'cat /opt/dynamo/.launch_screen' >> /etc/bash.bashrc && ln -s /workspace /sgl-workspace/dynamo`	01/15/2026 2:08 PM UTC
986f2654655372e6a25f7558f47b0f9cf4e632a3944acb53b9f7cda9424b376b	USER	`root`	01/15/2026 2:08 PM UTC
56bffc350d6fa0e02363c5032bd3aca1216bc4b97f43668b644f805b641fdd6d	RUN	`RUNTIME_IMAGE_TAG=v0.5.6.post2-runtime sed '/^#\s/d' /opt/dynamo/launch_message.txt > /opt/dynamo/.launch_screen`	01/15/2026 2:08 PM UTC
3b88650bb6508dde5427687c2fe7117184a5ec92c9f27ad204d8a1858063914a	ENV	`SGLANG_FORCE_SHUTDOWN=1`	01/15/2026 2:08 PM UTC
219cca3336dfa92fa69f68dc839655f8d392d1a346f621de117a43a0ec5486bc	COPY	`--chown=dynamo:0 --chmod=775 recipes/ /workspace/recipes/`	01/15/2026 2:08 PM UTC
f27bafe0b59d7164b5e5e0c926325cc0c1ebb4280968427bfee86c935b40a2c0	COPY	`--chown=dynamo:0 --chmod=775 components/ /workspace/components/`	01/15/2026 2:08 PM UTC
877f77d47d9ce1026729e84ad5451b29273fbb1da855a9b687d35187432ca842	COPY	`--chown=dynamo:0 --chmod=775 deploy /workspace/deploy`	01/15/2026 2:08 PM UTC