Dynamo SGLang Runtime

NVIDIA

Container

NVIDIA

Dynamo SGLang Runtime

The Dynamo SGLang runtime image is a containerized build of Dynamo + SGLang which serves as the base runtime environment for sglang based inference with Dynamo's distributed inference framework.

Layer	Label		Created
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	CMD	`—`	10/10/2025 8:53 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENTRYPOINT	`/opt/nvidia/nvidia_entrypoint.sh`	10/10/2025 8:53 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`PYTHONPATH=/workspace/examples/sglang/utils:`	10/10/2025 8:53 PM UTC
sha256:622cd61977458667b3e368e3c45fa00ebc3ed5177716f3b54af3763af4cb5523	COPY	`ATTRIBUTION* LICENSE /workspace/`	10/10/2025 8:53 PM UTC
sha256:cf07d59bbaee3a815dca29b2a951d9cd5ed77570d6559fe7a183e9a0052e4a1b	COPY	`deploy /workspace/deploy`	10/10/2025 8:53 PM UTC
sha256:80a21c39ca641ee3b2258a6ae70a6afd1ee35d561a81c08e5a762ad233ad8003	COPY	`examples /workspace/examples`	10/10/2025 8:53 PM UTC
sha256:2d86869c783c2acb11e36beb49652674f15b2c71a5412abe727099bbac4aec94	COPY	`benchmarks /workspace/benchmarks`	10/10/2025 8:53 PM UTC
sha256:6fb6bf339946aeb65c20d1f11e5da02e7ce146de769ca5c75ea86f99742ea873	COPY	`tests /workspace/tests`	10/10/2025 8:53 PM UTC
sha256:2dd7f1b964f324e62865bbe58b13746e7156121fdab976e86ab7e00876ab6404	COPY	`components/ /workspace/components/`	10/10/2025 8:53 PM UTC
sha256:2e5f66f5f252078fdb661071939d6ee80e27014908c202a78381c3644dbd0c0b	RUN	`ARCH_ALT=x86_64 PYTHON_VERSION=3.12 PROM_VERSION=3.4.1 sed '/^#\s/d' /workspace/launch_message.txt > ~/.launch_screen && echo "cat ~/.launch_screen" >> ~/.bashrc`	10/10/2025 8:53 PM UTC