Dynamo SGLang Runtime

NVIDIA

Container

NVIDIA

Dynamo SGLang Runtime

The Dynamo SGLang runtime image is a containerized build of Dynamo + SGLang which serves as the base runtime environment for sglang based inference with Dynamo's distributed inference framework.

Layer	Label		Created
10c89b7d956f31c7119a6146ca00343bfb14f88b4cbb0d71a5737721bf6cbf47	CONFIG	`Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace`	10/27/2025 5:09 PM UTC
c4959f095ba53ef0b5c23dff9b557aacdc61e4b9c63de1271ac6c44b27c04d7b	ENTRYPOINT	`/opt/nvidia/nvidia_entrypoint.sh`	10/27/2025 5:09 PM UTC
8c76c407721ffd5aab49a48b5bae2566fb39a7ec95535a0bae603c255e32f7f6	COPY	`ATTRIBUTION* LICENSE /workspace/`	10/27/2025 5:09 PM UTC
62ce23cc4dcaf127fd321845ba32842fcc577b417e008d722590321852b8a498	COPY	`components/ /workspace/components/`	10/27/2025 5:09 PM UTC
e00a9cbb5253543388b08863d7cd2fbc4fecc364f51ed3f6bffb84aa5d7d7e4e	COPY	`deploy /workspace/deploy`	10/27/2025 5:09 PM UTC
3945a7431439d8222c2c54d4b55d045ebfe4a5239cbefea2029e0f123f43eb05	COPY	`examples /workspace/examples`	10/27/2025 5:09 PM UTC
3f795ad0c9d8de858553e6cfa655e44db52eeb5b0eda012da083765d92b43fdd	COPY	`benchmarks /workspace/benchmarks`	10/27/2025 5:09 PM UTC
05460bb592c54d4c09b8b3a0c08eca6db759314bce721c73c126aafeaf6b8eb0	COPY	`tests /workspace/tests`	10/27/2025 5:09 PM UTC
046fdd87084a49128efd868b77d038ed23e3c3393097eb9ce034359b4cbe2ebf	RUN	`ARCH_ALT=x86_64 PYTHON_VERSION=3.12 sed '/^#\s/d' /workspace/launch_message.txt > ~/.launch_screen && echo "cat ~/.launch_screen" >> ~/.bashrc`	10/27/2025 5:09 PM UTC
2ceaa6f025f8a931fad844d3b96127ed64f38bd89af2349786dca764f20c8bf6	RUN	`ARCH_ALT=x86_64 PYTHON_VERSION=3.12 UV_GIT_LFS=1 uv pip install --no-cache --requirement /tmp/requirements.txt --requirement /tmp/requirements.test.txt`	10/27/2025 5:09 PM UTC