Dynamo SGLang Runtime

NVIDIA

Container

NVIDIA

Dynamo SGLang Runtime

The Dynamo SGLang runtime image is a containerized build of Dynamo + SGLang which serves as the base runtime environment for sglang based inference with Dynamo's distributed inference framework.

Layer	Label		Created
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	CMD	`—`	09/17/2025 9:01 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENTRYPOINT	`/opt/nvidia/nvidia_entrypoint.sh`	09/17/2025 9:01 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`PYTHONPATH=/workspace/examples/sglang/utils:`	09/17/2025 9:01 PM UTC
sha256:31f36c2fb93a41f4b6ffedc46482b258157ce74c1dee2688a44a7b505dd4b0a1	COPY	`ATTRIBUTION* LICENSE /workspace/`	09/17/2025 9:01 PM UTC
sha256:f182d3e210878a1d7801fddf2f009293160eae3b3442da6fddc7d82686e8d605	RUN	`ARCH_ALT=x86_64 SGLANG_VERSION=0.5.0rc2 uv pip install /workspace/benchmarks`	09/17/2025 9:01 PM UTC
sha256:cefebc5e56a8e0fdc8ce4b539c6ff8ccb9600626c62e1561d13d45268a2e29c3	COPY	`examples /workspace/examples`	09/17/2025 9:01 PM UTC
sha256:0d274474122d08e3489e05066e3532a5d7e6d87da85039c5f4c1d2c87121a025	COPY	`benchmarks /workspace/benchmarks`	09/17/2025 9:01 PM UTC
sha256:f3b57a853154aebb3000cdff3af1b321efc2768e22cb058b22f2a43139e47085	COPY	`tests /workspace/tests`	09/17/2025 9:01 PM UTC
sha256:75b3494018137cb8b5b0582c788ced073460db49a2f104908bf2354b1614a151	COPY	`components/ /workspace/components/`	09/17/2025 9:01 PM UTC
sha256:a93c9b3185b97edd4f065f43fecb299ede90807273442b3685049c01feff69f0	RUN	`ARCH_ALT=x86_64 SGLANG_VERSION=0.5.0rc2 sed '/^#\s/d' /workspace/launch_message.txt > ~/.launch_screen && echo "cat ~/.launch_screen" >> ~/.bashrc`	09/17/2025 9:01 PM UTC