Dynamo SGLang Runtime

NVIDIA

Container

NVIDIA

Dynamo SGLang Runtime

The Dynamo SGLang runtime image is a containerized build of Dynamo + SGLang which serves as the base runtime environment for sglang based inference with Dynamo's distributed inference framework.

Layer	Label		Created
a336d5d2cf98c2d4c8ed130892a40d7520af4a63f0f64f22819a35190f959c10	CONFIG	`WorkingDir /workspace`	05/08/2026 8:35 PM UTC
da2a458854e2e59f08b94ac1bfcd2a965b7dc9e7672e62861936f16d3eb25b62	ENTRYPOINT	`—`	05/08/2026 8:35 PM UTC
498bfea13f2f2b8690325f936871db46f142ba6b1013ed97d8cf38ad917473de	WORKDIR	`/workspace`	05/08/2026 8:35 PM UTC
5fea9dbc728c5778c5d109ce677e54ef7e6cdb552c6c22bb7751a4f7bc13fa23	ENV	`SGLANG_JIT_DEEPGEMM_PRECOMPILE=0 SGLANG_JIT_DEEPGEMM_FAST_WARMUP=1`	05/08/2026 8:35 PM UTC
97e8985dd71c5b1e32bf316353f52257832ea24e93cffe617e753d81ea46602f	ENV	`PYTHONPATH=/workspace/sglang/python:/workspace/components/src`	05/08/2026 8:35 PM UTC
107de7f899766dc759db1757f8f04d283e53fbda194df4636fe895dea7c1ee05	COPY	`/workspace/ATTRIBUTIONS-Python.md /workspace/ATTRIBUTIONS-Rust.md /workspace/ATTRIBUTIONS.md /workspace/`	05/08/2026 8:35 PM UTC
4b00a91784719f72b317c51b6b18106e1ddcdcc7b6010254ea2d433bc560336b	COPY	`/workspace/components/src/dynamo /workspace/components/src/dynamo`	05/08/2026 8:35 PM UTC
a16933353c8f47006c3ee8890b155ca9fa8180384a3de1e47c9ea227e4475f87	RUN	`pip install --no-cache-dir --force-reinstall --no-deps /opt/dynamo/wheelhouse/ai_dynamo_runtime.whl /opt/dynamo/wheelhouse/ai_dynamo-.whl && python3 -c "from dynamo._core import get_tool_parser_names; assert 'deepseek_v4' in get_tool_parser_names(), 'V4 parser missing!'; print('V4 parser verified')"`	05/08/2026 8:35 PM UTC
7b17c1ebb76b8c916fc16da2d4239259f3dac3185d3a465a331644fdce7ef7d2	COPY	`/opt/dynamo/wheelhouse /opt/dynamo/wheelhouse`	05/08/2026 8:35 PM UTC
3fedbf41e2ab0370d0cc9d376708161621a3e5c2bac375e1288fa87bda52ec93	COPY	`/usr/local/lib/python3.12/dist-packages/nixl* /usr/local/lib/python3.12/dist-packages/`	05/08/2026 8:35 PM UTC