Dynamo SGLang Runtime

NVIDIA

Container

NVIDIA

Dynamo SGLang Runtime

The Dynamo SGLang runtime image is a containerized build of Dynamo + SGLang which serves as the base runtime environment for sglang based inference with Dynamo's distributed inference framework.

Layer	Label		Created
b4d32a460fa39de373fdf5ac055780c0655dacebb18253fd5e6592748c47cab8	CONFIG	`Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace`	10/10/2025 8:53 PM UTC
d09005f9652212d90c779cf5a8d0f14fa16e01bf81509bb28c314e42fde54c59	ENTRYPOINT	`/opt/nvidia/nvidia_entrypoint.sh`	10/10/2025 8:53 PM UTC
8dddbaa64854c0083d824dee289a6619b47629bbbff041b92393d0f94df5dca7	ENV	`PYTHONPATH=/workspace/examples/sglang/utils:`	10/10/2025 8:53 PM UTC
f50cc8393ff1c92a89cd53c032315baed5719cced86574dbe3e01fb958e8cf13	COPY	`ATTRIBUTION* LICENSE /workspace/`	10/10/2025 8:53 PM UTC
6cbf463759162ef1532f2ba5bd4c8d6ef289c8ffe30e6ea7b6fa16fe7ec1bae9	COPY	`deploy /workspace/deploy`	10/10/2025 8:53 PM UTC
e14ea7b80e36fc2130fd9d2cd45add073a6da219e855c3380e6ac1d10568dd1b	COPY	`examples /workspace/examples`	10/10/2025 8:53 PM UTC
56d043250066b9c08065e3cf5aa1c8b96d46b33a059aa543c6544bdd810ec3f4	COPY	`benchmarks /workspace/benchmarks`	10/10/2025 8:53 PM UTC
9770fe76e0c9a31f1e280d5cae16e8960fb5f9bdabdf08480d571354c804f7ee	COPY	`tests /workspace/tests`	10/10/2025 8:53 PM UTC
0202a287486d6628775e0f90e456f01df20e6fcbca4e6b3234c9c6cf15370092	COPY	`components/ /workspace/components/`	10/10/2025 8:53 PM UTC
095aea0d3b5f8e548cea98a3fe9bbdafb559bdb7551e4822db9188b909f0e15f	RUN	`ARCH_ALT=x86_64 PYTHON_VERSION=3.12 PROM_VERSION=3.4.1 sed '/^#\s/d' /workspace/launch_message.txt > ~/.launch_screen && echo "cat ~/.launch_screen" >> ~/.bashrc`	10/10/2025 8:53 PM UTC