Dynamo SGLang Runtime

NVIDIA

Container

NVIDIA

Dynamo SGLang Runtime

The Dynamo SGLang runtime image is a containerized build of Dynamo + SGLang which serves as the base runtime environment for sglang based inference with Dynamo's distributed inference framework.

Layer	Label		Created
sha256:8fd756343d87359dd6c58de9ce70f6d021bed0f9268fd272a7d270964b85034e	COPY	`multi:55698c1a0b73f0179ed465a0f9b9c73849b5cd7377aa91954e6024af574f4419 in /workspace/`	04/30/2026 10:47 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	CMD	`bash`	04/29/2026 4:52 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENTRYPOINT	`—`	04/29/2026 4:51 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	WORKDIR	`/workspace`	04/29/2026 4:50 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`SGLANG_JIT_DEEPGEMM_PRECOMPILE=0 SGLANG_JIT_DEEPGEMM_FAST_WARMUP=1`	04/29/2026 4:49 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`PYTHONPATH=/workspace/sglang/python:/workspace/components/src`	04/29/2026 4:49 AM UTC
sha256:c7ba38867e8d046b206969939a5d345ebd47819cebd0cab2ebc03588a122bdbc	COPY	`dir:67c39ad3728e70304427514db3a6983cdf1b4564d16e78506191e20938f017d3 in /workspace/components/src/dynamo`	04/29/2026 4:48 AM UTC
sha256:c88eadd066162cb15485ec40863657a4c067ba748b3edd900c2538f45c76aeb5	RUN	`pip install --no-cache-dir --force-reinstall --no-deps /opt/dynamo/wheelhouse/ai_dynamo_runtime.whl /opt/dynamo/wheelhouse/ai_dynamo-.whl && python3 -c "from dynamo._core import get_tool_parser_names; assert 'deepseek_v4' in get_tool_parser_names(), 'V4 parser missing!'; print('V4 parser verified')"`	04/29/2026 4:47 AM UTC
sha256:fd2e70db770294d16caaf4d4d3ff37c95a6984755ba22b3bb82ffb2d54216847	COPY	`dir:22981c281e96c977e6a3da76b175a5c80e92e2f426366881ed08a98378c11846 in /opt/dynamo/wheelhouse`	04/29/2026 4:46 AM UTC
sha256:c03b8ec8dd332435fbc4c1fe6eeb6f0e8e8da2dd9d5ddcb50ad14c4a7ebf8939	COPY	`multi:b98443496556042d2aacb74e1d93f3229f4476654e460a82af69a3b53d6c3226 in /usr/local/lib/python3.12/dist-packages/`	04/29/2026 4:45 AM UTC