Dynamo SGLang Runtime

NVIDIA

Container

NVIDIA

Dynamo SGLang Runtime

The Dynamo SGLang runtime image is a containerized build of Dynamo + SGLang which serves as the base runtime environment for sglang based inference with Dynamo's distributed inference framework.

Layer	Label		Created
955034f9f6f5a559e8653b0bcfc08e9c0ec33a789a7a930ced9ecb83e7393ce7	CONFIG	`Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace`	02/12/2026 1:03 AM UTC
e3e8fc5adfa236fa10b4314b00528884b7a2ff9e9ec8f9c1e3c5431b837092e2	ENTRYPOINT	`/opt/nvidia/nvidia_entrypoint.sh`	02/12/2026 1:03 AM UTC
a2cf144ad199c6e73ebcc6f20bedc8af49dd9b1d3c901f1bda64e1555aa085a2	ENV	`DYNAMO_COMMIT_SHA=76c1889aeb078219eb4fbd2b0c0fc21df75d8d0b`	02/12/2026 1:03 AM UTC
abc49c439b54936727f604eed6cfea68cf06c6c8a9d8eebc06085c46827471db	ARG	`DYNAMO_COMMIT_SHA=76c1889aeb078219eb4fbd2b0c0fc21df75d8d0b`	02/12/2026 1:03 AM UTC
bf09eb8f535bd4abf5de57f8bdd87dc276efc40aaec146d67a3c40c0864a76c7	USER	`dynamo`	02/12/2026 1:03 AM UTC
855ff07b926912df5fa92729b11f2aa53a12ececcf0e3052a637670bff32a8e1	RUN	`RUNTIME_IMAGE_TAG=v0.5.8-cu130-runtime ENABLE_GPU_MEMORY_SERVICE=true chmod 755 /opt/dynamo/.launch_screen && echo 'cat /opt/dynamo/.launch_screen' >> /etc/bash.bashrc && ln -s /workspace /sgl-workspace/dynamo`	02/12/2026 1:03 AM UTC
31e448f79be42cfa1dfb6244fbbc551e5649a46c647e83e0095ebdaf6a404614	USER	`root`	02/12/2026 1:03 AM UTC
06490cad418a3a5f0bc60be5684a087a52eb60cd392fb3c9d6d1f5821d14e6f7	RUN	`RUNTIME_IMAGE_TAG=v0.5.8-cu130-runtime ENABLE_GPU_MEMORY_SERVICE=true sed '/^#\s/d' /opt/dynamo/launch_message.txt > /opt/dynamo/.launch_screen`	02/12/2026 1:03 AM UTC
e15b43b14086657e1098d68f9a473d3861d313439280d180255e8bb59cf74262	ENV	`SGLANG_FORCE_SHUTDOWN=1`	02/12/2026 1:03 AM UTC
28273b309fc671fc1b6cd03017304c6429ce63e38ca75c4731d692185324ffea	COPY	`--chown=dynamo:0 --chmod=775 recipes/ /workspace/recipes/`	02/12/2026 1:03 AM UTC