Dynamo SGLang Runtime

NVIDIA

Container

NVIDIA

Dynamo SGLang Runtime

The Dynamo SGLang runtime image is a containerized build of Dynamo + SGLang which serves as the base runtime environment for sglang based inference with Dynamo's distributed inference framework.

Layer	Label		Created
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	CMD	`—`	10/27/2025 5:09 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENTRYPOINT	`/opt/nvidia/nvidia_entrypoint.sh`	10/27/2025 5:09 PM UTC
sha256:95052f14b125ca092d27cef37e634de56b33da40d48a51fe545ea173b1a15390	COPY	`ATTRIBUTION* LICENSE /workspace/`	10/27/2025 5:09 PM UTC
sha256:50950db8a29062f96c78dd090fb6b54ca0b55149a92a1de6669e6856e7f4446e	COPY	`components/ /workspace/components/`	10/27/2025 5:09 PM UTC
sha256:259816ccd405b75c11a447484174c2a127d2a2d2a5fc19e5038f3efd024f7a54	COPY	`deploy /workspace/deploy`	10/27/2025 5:09 PM UTC
sha256:cfd2ed83edc55038dbcf6622fb2d68e2cfad6eda8273776aba3ccd344720dd64	COPY	`examples /workspace/examples`	10/27/2025 5:09 PM UTC
sha256:c1d607948d9a5c8339bb1012625d7bbb98fe3f6298c38013c8618fd9877c6171	COPY	`benchmarks /workspace/benchmarks`	10/27/2025 5:09 PM UTC
sha256:473e78798626eb317a8ce8e4567d24a6af4fb2097f4129092f78767e73d7d4db	COPY	`tests /workspace/tests`	10/27/2025 5:09 PM UTC
sha256:4fda3f35276d3a4a10e53284493496906c8273481b30d3ffecfaa2a12fe67adb	RUN	`ARCH_ALT=x86_64 PYTHON_VERSION=3.12 sed '/^#\s/d' /workspace/launch_message.txt > ~/.launch_screen && echo "cat ~/.launch_screen" >> ~/.bashrc`	10/27/2025 5:09 PM UTC
sha256:41e26a32818058dbc2f14abbe578c30cfa6af13e61012978b039285b8fe6facf	RUN	`ARCH_ALT=x86_64 PYTHON_VERSION=3.12 UV_GIT_LFS=1 uv pip install --no-cache --requirement /tmp/requirements.txt --requirement /tmp/requirements.test.txt`	10/27/2025 5:09 PM UTC