Dynamo SGLang Runtime

NVIDIA

Container

NVIDIA

Dynamo SGLang Runtime

The Dynamo SGLang runtime image is a containerized build of Dynamo + SGLang which serves as the base runtime environment for sglang based inference with Dynamo's distributed inference framework.

Layer	Label		Created
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	CMD	`—`	08/27/2025 3:31 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENTRYPOINT	`/opt/nvidia/nvidia_entrypoint.sh`	08/27/2025 3:31 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`PYTHONPATH=/workspace/examples/sglang/utils:`	08/27/2025 3:31 AM UTC
sha256:76570ba9847a53d34b8f89412f1f7a5eebc5e9af455b88a7608df765c775ce02	COPY	`ATTRIBUTION* LICENSE /workspace/`	08/27/2025 3:31 AM UTC
sha256:de021e91311a4c0d135fbef16d8e05a06d3ad247b2493d40885ca9b727a83d21	RUN	`ARCH_ALT=x86_64 SGLANG_VERSION=0.5.0rc2 uv pip install /workspace/benchmarks`	08/27/2025 3:31 AM UTC
sha256:b3862860a8c0aa8db27d4527dc247b9690af4019e89af4abb524c2b246e78ea4	COPY	`examples /workspace/examples`	08/27/2025 3:31 AM UTC
sha256:3b49c2fb4282d0b3ea78478ebe30e88e693eb904e3813d36af660dc8794ab1cc	COPY	`benchmarks /workspace/benchmarks`	08/27/2025 3:31 AM UTC
sha256:c99575d6359ba052127133945912c1c9dea0219d8dc2e4d5133f47e17e7d6550	COPY	`tests /workspace/tests`	08/27/2025 3:31 AM UTC
sha256:d9e08dc2991d44aa753e2f5efb66cef1b90ecdcadc4e0dcc1578d94b236f61f9	COPY	`components/ /workspace/components/`	08/27/2025 3:31 AM UTC
sha256:47e847b019449dbda61a24d7f5be4e4a45510eb3c7fdef9d152631e30a96f6f1	RUN	`ARCH_ALT=x86_64 SGLANG_VERSION=0.5.0rc2 sed '/^#\s/d' /workspace/launch_message.txt > ~/.launch_screen && echo "cat ~/.launch_screen" >> ~/.bashrc`	08/27/2025 3:31 AM UTC