Dynamo SGLang Runtime

NVIDIA

Container

NVIDIA

Dynamo SGLang Runtime

The Dynamo SGLang runtime image is a containerized build of Dynamo + SGLang which serves as the base runtime environment for sglang based inference with Dynamo's distributed inference framework.

Layer	Label		Created
378db7fec04f26fa893e85936152e02c9c6f7bfeac4b49570d455325ded8f87f	CONFIG	`Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace`	08/08/2025 11:42 PM UTC
8a5e4a63f9bf72c0a83a5e5ed93b449cb5870f83161fb0559e7958726f2842b3	ENTRYPOINT	`/opt/nvidia/nvidia_entrypoint.sh`	08/08/2025 11:42 PM UTC
f6dd8bad743a4a18c8861e39ddf5f356f667df4ece585d14e44b6bf98b3b715c	COPY	`ATTRIBUTION* LICENSE /workspace/`	08/08/2025 11:42 PM UTC
5f070cdf74528e1edef40856ac1fcfb05eec7b400d6f3454d7332cf489b8f620	RUN	`ARCH_ALT=x86_64 uv pip install /workspace/benchmarks`	08/08/2025 11:42 PM UTC
626fde3a7820b292dd88653bd2edf89fa953b250eafae10dfac1f1371d00a6e3	COPY	`examples /workspace/examples`	08/08/2025 11:42 PM UTC
1b47956b7cbd63a29da6410587d5c15c5a142d43c105ee4c5fd9a252ac8dcce2	COPY	`benchmarks /workspace/benchmarks`	08/08/2025 11:42 PM UTC
36385aa2689816466856f5bea2019f9549b479670fd584f8fd1d7965749e140d	COPY	`tests /workspace/tests`	08/08/2025 11:42 PM UTC
fc4fc995279428829727696b0f90fabb5fa91e5ee949093b748302928762286f	COPY	`components/ /workspace/components/`	08/08/2025 11:42 PM UTC
d6c4697611d7373848acb81b037cef75cbcbb270a09f1e380fc7e9d57ece8485	RUN	`ARCH_ALT=x86_64 sed '/^#\s/d' /workspace/launch_message.txt > ~/.launch_screen && echo "cat ~/.launch_screen" >> ~/.bashrc`	08/08/2025 11:42 PM UTC
6d31392ec02fdf929ebd349d823303f75d70f49d53c6c3f1c15aada9a1c2f349	RUN	`ARCH_ALT=x86_64 uv pip install --requirement /tmp/requirements.txt`	08/08/2025 11:42 PM UTC