Dynamo SGLang Runtime

NVIDIA

Container

NVIDIA

Dynamo SGLang Runtime

The Dynamo SGLang runtime image is a containerized build of Dynamo + SGLang which serves as the base runtime environment for sglang based inference with Dynamo's distributed inference framework.

Layer	Label		Created
sha256:4a1b3157fefaa2615a6141f0090df747c17352b9dd9b08244111e7172ffc115d	COPY	`multi:55698c1a0b73f0179ed465a0f9b9c73849b5cd7377aa91954e6024af574f4419 in /workspace/`	04/30/2026 10:47 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	CMD	`bash`	04/29/2026 4:52 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENTRYPOINT	`—`	04/29/2026 4:51 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	WORKDIR	`/workspace`	04/29/2026 4:50 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`SGLANG_JIT_DEEPGEMM_PRECOMPILE=0 SGLANG_JIT_DEEPGEMM_FAST_WARMUP=1`	04/29/2026 4:49 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`PYTHONPATH=/workspace/sglang/python:/workspace/components/src`	04/29/2026 4:49 AM UTC
sha256:1bad58b40cf67c8c140a8234936e437795507f77185eecf8d5b1a074ab92ae5c	COPY	`dir:67c39ad3728e70304427514db3a6983cdf1b4564d16e78506191e20938f017d3 in /workspace/components/src/dynamo`	04/29/2026 4:48 AM UTC
sha256:e803731b1a45d3baad34d9851a0bdc20cac67df7c3e25b6ce278ad43a278d79d	RUN	`pip install --no-cache-dir --force-reinstall --no-deps /opt/dynamo/wheelhouse/ai_dynamo_runtime.whl /opt/dynamo/wheelhouse/ai_dynamo-.whl && python3 -c "from dynamo._core import get_tool_parser_names; assert 'deepseek_v4' in get_tool_parser_names(), 'V4 parser missing!'; print('V4 parser verified')"`	04/29/2026 4:47 AM UTC
sha256:a9ca3269f33f2f75f5d042fc1b20797ef02d28cb304b9d3b34d3250a1593cafc	COPY	`dir:22981c281e96c977e6a3da76b175a5c80e92e2f426366881ed08a98378c11846 in /opt/dynamo/wheelhouse`	04/29/2026 4:46 AM UTC
sha256:07ba5596cd66698a6ab91bc13ef73b237e9836cfc031d05b5322a54112646cad	COPY	`multi:b98443496556042d2aacb74e1d93f3229f4476654e460a82af69a3b53d6c3226 in /usr/local/lib/python3.12/dist-packages/`	04/29/2026 4:45 AM UTC