Dynamo SGLang Runtime

NVIDIA

Container

NVIDIA

Dynamo SGLang Runtime

The Dynamo SGLang runtime image is a containerized build of Dynamo + SGLang which serves as the base runtime environment for sglang based inference with Dynamo's distributed inference framework.

Layer	Label		Created
3aada749a21dc0069eb990e17d452d1d65942553e5b3a23ff409a7266ed71a22	CONFIG	`Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace`	09/17/2025 9:01 PM UTC
e0a2b6e2835b9db8f8f63c367a8e2fd9f8a2924d7d5f6f1090ec461c13514aae	ENTRYPOINT	`/opt/nvidia/nvidia_entrypoint.sh`	09/17/2025 9:01 PM UTC
8139a05b8328421f9524e59015757001ece0fc6cb11226882a8b07a338f8c1f2	ENV	`PYTHONPATH=/workspace/examples/sglang/utils:`	09/17/2025 9:01 PM UTC
4c8cee9cd3ddded371b3d5303770f8431a8e36363f0df9d9112517e602676b5a	COPY	`ATTRIBUTION* LICENSE /workspace/`	09/17/2025 9:01 PM UTC
57910b8afe4de4facb017974273eb38821210a579b1ed3ec1085ab68990cb8a6	RUN	`ARCH_ALT=x86_64 SGLANG_VERSION=0.5.0rc2 uv pip install /workspace/benchmarks`	09/17/2025 9:01 PM UTC
18388099bb5e11a82715a5e57958ec1508bcfe496a9c50aeaa23b8f04d2b66b7	COPY	`examples /workspace/examples`	09/17/2025 9:01 PM UTC
533cbd8bdd4248d5893f1748a49a08edeac0d29d769df68c595798aec34a96d0	COPY	`benchmarks /workspace/benchmarks`	09/17/2025 9:01 PM UTC
7350c6fede75e2ffdd83e2eba66a4c53317462f3860c07bf3c4798f7346a5c60	COPY	`tests /workspace/tests`	09/17/2025 9:01 PM UTC
ac6100c4fc88b8dc3feb01c857edd6a8f6dc22639c2d5f16cfab18c206e1619f	COPY	`components/ /workspace/components/`	09/17/2025 9:01 PM UTC
08fcbbc819b90a55d0c670da0aab4b35d366ef0a42d86fb4687727dd43a1b9c7	RUN	`ARCH_ALT=x86_64 SGLANG_VERSION=0.5.0rc2 sed '/^#\s/d' /workspace/launch_message.txt > ~/.launch_screen && echo "cat ~/.launch_screen" >> ~/.bashrc`	09/17/2025 9:01 PM UTC