Dynamo SGLang Runtime

NVIDIA

Container

NVIDIA

Dynamo SGLang Runtime

The Dynamo SGLang runtime image is a containerized build of Dynamo + SGLang which serves as the base runtime environment for sglang based inference with Dynamo's distributed inference framework.

Layer	Label		Created
sha256:76249c7cd50397d2e8c06a75106723d057deaba0ffbc7f4af1bb02bcf71d81cf	COPY	`legal/sglang/amd64_2/NOTICES-Rust.txt /workspace/ATTRIBUTIONS-Rust.md`	06/12/2026 1:19 PM UTC
sha256:401d11fb2a0945d50e4cbfd2cca983a3686804bd0f2f6ea8c088452bf7f203f9	COPY	`legal/sglang/amd64_2/NOTICES-Python.txt /workspace/ATTRIBUTIONS-Python.md`	06/12/2026 1:19 PM UTC
sha256:ab7341a40ee7a7ada312ea6e9ee4a4841239b34a65c90bcbd75e7913dc9b73bf	RUN	`rm /workspace/ATTRIBUTIONS-Rust.md /workspace/ATTRIBUTIONS-Python.md /workspace/ATTRIBUTIONS-container-frontend.md /workspace/ATTRIBUTIONS-Go.md`	06/12/2026 1:19 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	USER	`dynamo`	06/12/2026 8:49 AM UTC
sha256:d7913b78456aa0d9d7509d36fedb86528095b092d7e2a855b6fd6ac598459e84	COPY	`--chown=dynamo:0 --chmod=664 runtime/dynamo/sglang/request_handlers/llm/mm_disagg_utils.py /usr/local/lib/python3.12/dist-packages/dynamo/sglang/request_handlers/llm/mm_disagg_utils.py`	06/12/2026 8:49 AM UTC
sha256:c03b8ec8dd332435fbc4c1fe6eeb6f0e8e8da2dd9d5ddcb50ad14c4a7ebf8939	COPY	`--chown=dynamo:0 --chmod=664 runtime/dynamo/sglang/request_handlers/llm/prefill_handler.py /usr/local/lib/python3.12/dist-packages/dynamo/sglang/request_handlers/llm/prefill_handler.py`	06/12/2026 8:49 AM UTC
sha256:eea924c2c8fbc6f38044ddef8d512ccd3a113c4dd80a7a6cef0a4887f7dc2f87	COPY	`--chown=dynamo:0 --chmod=664 runtime/dynamo/sglang/request_handlers/llm/decode_handler.py /usr/local/lib/python3.12/dist-packages/dynamo/sglang/request_handlers/llm/decode_handler.py`	06/12/2026 8:49 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	USER	`root`	06/12/2026 8:49 AM UTC
sha256:c20926c422315586ddd491e0f4a91bb3f78437f3bb1601a49915bcff61a11672	COPY	`--chown=dynamo:0 --chmod=664 attributions-hiddentrails/sglang/amd64/ATTRIBUTIONS-Rust.txt /workspace/ATTRIBUTIONS-Rust.md`	06/12/2026 7:11 AM UTC
sha256:afcf80b4241685162d50efe2917dfda2363bd5ac1a9400e9def97a9dabda381c	COPY	`--chown=dynamo:0 --chmod=664 attributions-hiddentrails/sglang/amd64/ATTRIBUTIONS-Python.txt /workspace/ATTRIBUTIONS-Python.md`	06/12/2026 7:11 AM UTC