Dynamo SGLang Runtime

NVIDIA

Container

NVIDIA

Dynamo SGLang Runtime

The Dynamo SGLang runtime image is a containerized build of Dynamo + SGLang which serves as the base runtime environment for sglang based inference with Dynamo's distributed inference framework.

Layer	Label		Created
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	CMD	`—`	11/06/2025 12:50 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENTRYPOINT	`/opt/nvidia/nvidia_entrypoint.sh`	11/06/2025 12:50 AM UTC
sha256:fe77017bcb863c3b1bb9515d5367f5fc29986bebfc4196f169cbb57fe5b26e1e	COPY	`components/ /workspace/components/`	11/06/2025 12:50 AM UTC
sha256:6e0c92fc45453af81b1c9685a376f1e500c7375e9f9ef0d7d7d9aec771d07b53	COPY	`deploy /workspace/deploy`	11/06/2025 12:50 AM UTC
sha256:a97329696925509857ad1fe78fcb97f00feb708490e3794a027f484698756259	COPY	`benchmarks /workspace/benchmarks`	11/06/2025 12:50 AM UTC
sha256:95b198a9175b231d38d91782af41a4f31847c34ebe2085fa7db5157f82389419	COPY	`examples /workspace/examples`	11/06/2025 12:50 AM UTC
sha256:5cb7031d1f36a8c2aa9d636f05a609027b709a06b77327ba387f07a7fe5a3fda	COPY	`tests /workspace/tests`	11/06/2025 12:50 AM UTC
sha256:da60286e4690117d6e50935b6d3c717d69a2cd511e2f71c518debe5ede71af5c	RUN	BUILD_TYPE=all DEEPEP_COMMIT=9af0e0d0e74f3577af1979c9b9e1ac2cad0104ee DEEPEP_GB_COMMIT=1b14ad661c7640137fcfe93cccb2694ede1220b0 CMAKE_BUILD_PARALLEL_LEVEL=2 FLASHMLA_COMMIT=1408756a88e52a25196b759eaf8db89d2b51b5a1 SGL_KERNEL_VERSION=0.3.15 SGLANG_COMMIT=0.5.3.post2 GDRCOPY_COMMIT=v2.4.4 NVSHMEM_VERSION=3.3.9 GRACE_BLACKWELL=false ARCH=amd64 ARCH_ALT=x86_64 PYTHON_VERSION=3.10 USE_SCCACHE=true SCCACHE_BUCKET=ai-dynamo-sccache SCCACHE_REGION=us-west-2 CARGO_BUILD_JOBS=16 CUDA_VERSION=12.9.1 ARCH=amd64 ARCH_ALT=x86_64 PYTHON_VERSION=3.10 sed '/^#\s/d' /workspace/launch_message.txt > ~/.launch_screen && echo "cat ~/.launch_screen" >> ~/.bashrc	11/06/2025 12:50 AM UTC
sha256:926c70df76bf79337c43ebb4f9ef56103a30665811b1da54d9ae7c1c9a4fe02f	COPY	`container/launch_message.txt /workspace/launch_message.txt`	11/06/2025 12:50 AM UTC
sha256:d0d92e34c9a5d39d43dcd604f9242d8c37d16a268b4d3c7f0ee1ae0cbc9794fb	COPY	`ATTRIBUTION* LICENSE /workspace/`	11/06/2025 12:50 AM UTC