Dynamo SGLang Runtime

NVIDIA

Container

NVIDIA

Dynamo SGLang Runtime

The Dynamo SGLang runtime image is a containerized build of Dynamo + SGLang which serves as the base runtime environment for sglang based inference with Dynamo's distributed inference framework.

Layer	Label		Created
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	CMD	`—`	07/16/2025 9:34 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENTRYPOINT	`/opt/nvidia/nvidia_entrypoint.sh`	07/16/2025 9:34 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`PYTHONPATH=/workspace/examples/sglang/utils:`	07/16/2025 9:34 PM UTC
sha256:0d7fbd9e7aea82baeff3ce1c4eee5fc7a9e45c37eb77e67a1d94457f0cfac2c1	COPY	`ATTRIBUTION* LICENSE /workspace/`	07/16/2025 9:34 PM UTC
sha256:a56a8cab92569e394db865aa54bbc2926236e1efe83ad28d1a3b3f882e9f9068	RUN	`ARCH_ALT=x86_64 SGLANG_VERSION=0.4.9.post1 SGL_KERNEL_VERSION=0.2.4 uv pip install /workspace/benchmarks`	07/16/2025 9:34 PM UTC
sha256:356a799e1545fae3352e2c41d6ee6bf02524f0c2ec28e3c01e2a09b1a39a28e3	COPY	`examples /workspace/examples`	07/16/2025 9:34 PM UTC
sha256:576ee8768086929767e19d246eef38e4594957acc5ca0dfc300792fe3c1116c1	COPY	`benchmarks /workspace/benchmarks`	07/16/2025 9:34 PM UTC
sha256:62a8f1913a843dfcd185462705616ba9fa085cd81e11486cd996b737d82a4ff6	COPY	`tests /workspace/tests`	07/16/2025 9:34 PM UTC
sha256:605ed8bd382d16ba70b6213dbcacc04d507ae7cb044c88b89d35c5340b62c9c4	RUN	`ARCH_ALT=x86_64 SGLANG_VERSION=0.4.9.post1 SGL_KERNEL_VERSION=0.2.4 sed '/^#\s/d' /workspace/launch_message.txt > ~/.launch_screen && echo "cat ~/.launch_screen" >> ~/.bashrc`	07/16/2025 9:34 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`VLLM_KV_CAPI_PATH=/opt/dynamo/bindings/lib/libdynamo_llm_capi.so`	07/16/2025 9:34 PM UTC