Dynamo SGLang Runtime

NVIDIA

Container

NVIDIA

Dynamo SGLang Runtime

The Dynamo SGLang runtime image is a containerized build of Dynamo + SGLang which serves as the base runtime environment for sglang based inference with Dynamo's distributed inference framework.

Layer	Label		Created
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	CMD	`—`	11/07/2025 1:36 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENTRYPOINT	`/opt/nvidia/nvidia_entrypoint.sh`	11/07/2025 1:36 AM UTC
sha256:9bbf8663b25b7dea06370b4d6012e760f3240950898f0533329c39951e3e450d	COPY	`components/ /workspace/components/`	11/07/2025 1:36 AM UTC
sha256:fff51b61557bd5592ab93d504625ccc666b1ae1530128ba4ef55eda746e597a8	COPY	`deploy /workspace/deploy`	11/07/2025 1:36 AM UTC
sha256:a8c00deaa1aa1490109c78fd6539bbfa1fc1dbd0788e96473cbb86d4caf2ec1e	COPY	`benchmarks /workspace/benchmarks`	11/07/2025 1:36 AM UTC
sha256:75d72515f65b2bc26332ca5abded0dade47b7d6b88c5fc6951c573db792bc273	COPY	`examples /workspace/examples`	11/07/2025 1:36 AM UTC
sha256:df590f522d5d389cc10dc6c381364b44a65baf78964917c5cd947708b4d04a90	COPY	`tests /workspace/tests`	11/07/2025 1:36 AM UTC
sha256:d6b516a0de911a9af5d017ea644bf65b9067d6b326f010fe7171627baeff9590	RUN	BUILD_TYPE=all DEEPEP_COMMIT=9af0e0d0e74f3577af1979c9b9e1ac2cad0104ee DEEPEP_GB_COMMIT=1b14ad661c7640137fcfe93cccb2694ede1220b0 CMAKE_BUILD_PARALLEL_LEVEL=2 FLASHMLA_COMMIT=1408756a88e52a25196b759eaf8db89d2b51b5a1 SGL_KERNEL_VERSION=0.3.15 SGLANG_COMMIT=0.5.3.post2 GDRCOPY_COMMIT=v2.4.4 NVSHMEM_VERSION=3.3.9 GRACE_BLACKWELL=false ARCH=amd64 ARCH_ALT=x86_64 PYTHON_VERSION=3.10 USE_SCCACHE=true SCCACHE_BUCKET=ai-dynamo-sccache SCCACHE_REGION=us-west-2 CARGO_BUILD_JOBS=16 CUDA_VERSION=12.9.1 ARCH=amd64 ARCH_ALT=x86_64 PYTHON_VERSION=3.10 sed '/^#\s/d' /workspace/launch_message.txt > ~/.launch_screen && echo "cat ~/.launch_screen" >> ~/.bashrc	11/07/2025 1:36 AM UTC
sha256:f85db63a72aaa2ab9f09620b9fc8dee706ac70061fb7cc9c3bdfe6acd944f7bd	COPY	`container/launch_message.txt /workspace/launch_message.txt`	11/07/2025 1:36 AM UTC
sha256:27e950f37aad0d54b2d2c73a01c91e4441420a2d94a1b300e48ec40ad69eadd5	COPY	`ATTRIBUTION* LICENSE /workspace/`	11/07/2025 1:36 AM UTC