Dynamo SGLang Runtime

NVIDIA

Container

NVIDIA

Dynamo SGLang Runtime

The Dynamo SGLang runtime image is a containerized build of Dynamo + SGLang which serves as the base runtime environment for sglang based inference with Dynamo's distributed inference framework.

Layer	Label		Created
4b60fff7a223fff2d9e94e320b8319e075d420398ff09c8f66c05e5d2c3ee13a	CONFIG	`Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace`	08/27/2025 3:31 AM UTC
41177b315eb343ebc71ca24ba6da7e8b77f7a7261637f52fff911f07fb098784	ENTRYPOINT	`/opt/nvidia/nvidia_entrypoint.sh`	08/27/2025 3:31 AM UTC
1d11ebafadb32c7187b3eb491c104aa65486b2e43f8ad06e5cb4ee38eb8735cc	ENV	`PYTHONPATH=/workspace/examples/sglang/utils:`	08/27/2025 3:31 AM UTC
ef8452a56c3b4d60ac372706c171829203f4c7def638b96a7369fdfff36324be	COPY	`ATTRIBUTION* LICENSE /workspace/`	08/27/2025 3:31 AM UTC
b97f7bd8c2a9588cefb36a32427f4a06b394ef23925fff594691dc686e04bda5	RUN	`ARCH_ALT=x86_64 SGLANG_VERSION=0.5.0rc2 uv pip install /workspace/benchmarks`	08/27/2025 3:31 AM UTC
988f9ccd2276eddbf99c1b70580f6b53413d69cce73cf5f58dc6e090f1207f47	COPY	`examples /workspace/examples`	08/27/2025 3:31 AM UTC
2e7a52c796684ebde96c64ab547eadbc751bd64f25cef5a16c833d2524c65995	COPY	`benchmarks /workspace/benchmarks`	08/27/2025 3:31 AM UTC
013f20e888eaf585acdb9c39f7b498cba9df8201cda1fe7fac8113e16a153c2a	COPY	`tests /workspace/tests`	08/27/2025 3:31 AM UTC
900f92dea4656fd2920b584d1041b0af5cb1f035ae2d52b7c9ae32e5610df13c	COPY	`components/ /workspace/components/`	08/27/2025 3:31 AM UTC
f66193e44ce45d46b53f816948bf50d8bca7cf1e55a67ae3eaab237c5e440f11	RUN	`ARCH_ALT=x86_64 SGLANG_VERSION=0.5.0rc2 sed '/^#\s/d' /workspace/launch_message.txt > ~/.launch_screen && echo "cat ~/.launch_screen" >> ~/.bashrc`	08/27/2025 3:31 AM UTC