Dynamo SGLang Runtime

NVIDIA

Container

NVIDIA

Dynamo SGLang Runtime

The Dynamo SGLang runtime image is a containerized build of Dynamo + SGLang which serves as the base runtime environment for sglang based inference with Dynamo's distributed inference framework.

Layer	Label		Created
02402c4419dcdf87c7436cd0afc1873d55d6527de1ddbd520f63b3cc632fecbc	CONFIG	`Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace`	07/16/2025 9:34 PM UTC
a2c40abbd833d03522d62e88c81fc5fbe1c6f7a3bd0f28676aa67b746b9a0eb1	ENTRYPOINT	`/opt/nvidia/nvidia_entrypoint.sh`	07/16/2025 9:34 PM UTC
49f593d44641cb96d265cb4fa8a2ee12f869c14fd9dfba8c2b067646d62b2e47	ENV	`PYTHONPATH=/workspace/examples/sglang/utils:`	07/16/2025 9:34 PM UTC
098d956c62816738af58a25fdd6a368eaea0a6ebe8037f13742ec6301077485f	COPY	`ATTRIBUTION* LICENSE /workspace/`	07/16/2025 9:34 PM UTC
8ab327e49257275af866c8eff98c6d4750f47d4ecd3d2253459b6046524fff13	RUN	`ARCH_ALT=x86_64 SGLANG_VERSION=0.4.9.post1 SGL_KERNEL_VERSION=0.2.4 uv pip install /workspace/benchmarks`	07/16/2025 9:34 PM UTC
a410c80ddbad02afdd9d79ebaad694a438398f79eb057db3d3daebd0936c9769	COPY	`examples /workspace/examples`	07/16/2025 9:34 PM UTC
023c2365cdb5dc76b0da4ac6bbd1d040d4f9725c9e03bc2ab55a00adadb60b1e	COPY	`benchmarks /workspace/benchmarks`	07/16/2025 9:34 PM UTC
78fc8b9973e6f779ec68f384f6a8efd52476dac49792136642ef84459058260f	COPY	`tests /workspace/tests`	07/16/2025 9:34 PM UTC
105fcd0073ccb82fd10ecd77851e86b16e5a74ee47fb820af6a1964368d684ba	RUN	`ARCH_ALT=x86_64 SGLANG_VERSION=0.4.9.post1 SGL_KERNEL_VERSION=0.2.4 sed '/^#\s/d' /workspace/launch_message.txt > ~/.launch_screen && echo "cat ~/.launch_screen" >> ~/.bashrc`	07/16/2025 9:34 PM UTC
12c03cec299ab82410ec9ac61f30244611288c25bae5125665f257e18b0397f5	ENV	`VLLM_KV_CAPI_PATH=/opt/dynamo/bindings/lib/libdynamo_llm_capi.so`	07/16/2025 9:34 PM UTC