Dynamo SGLang Runtime

NVIDIA

Container

NVIDIA

Dynamo SGLang Runtime

The Dynamo SGLang runtime image is a containerized build of Dynamo + SGLang which serves as the base runtime environment for sglang based inference with Dynamo's distributed inference framework.

Layer	Label		Created
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	CMD	`bash`	05/06/2026 7:41 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENTRYPOINT	`—`	05/06/2026 7:41 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	WORKDIR	`/workspace`	05/06/2026 7:40 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`SGLANG_JIT_DEEPGEMM_PRECOMPILE=0 SGLANG_JIT_DEEPGEMM_FAST_WARMUP=1`	05/06/2026 7:39 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`PYTHONPATH=/workspace/sglang/python:/workspace/components/src`	05/06/2026 7:38 PM UTC
sha256:8aa38a85757a086d2ea92a8732cc4a0b16b59db6f5dbeb1ed987d5d8138ad3fe	COPY	`multi:75a299fe8868b30f7f58f84e03a3235d4facf4725c478d15ac17c007f2ae9e3a in /workspace/`	05/06/2026 7:37 PM UTC
sha256:4653a3b5117fd8eb982256e98b1e43988673efcb8b639ff2e54432cfab68e5a9	COPY	`dir:8aecc293b9167795bdaff6a7b28b0d9a8c4a85ae7fc57d6a42179166df563f21 in /workspace/components/src/dynamo`	05/06/2026 7:37 PM UTC
sha256:6492e1aeaec9f0f71d1d50a1a8ea4cebe3a8fa5bb1c9214e0f4b103a17e71321	RUN	`pip install --no-cache-dir --force-reinstall --no-deps /opt/dynamo/wheelhouse/ai_dynamo_runtime.whl /opt/dynamo/wheelhouse/ai_dynamo-.whl && python3 -c "from dynamo._core import get_tool_parser_names; assert 'deepseek_v4' in get_tool_parser_names(), 'V4 parser missing!'; print('V4 parser verified')"`	05/06/2026 7:36 PM UTC
sha256:981f1b8ac0d3124254b6a0f1a42981ec9d618da32844a035828cc5aee180c234	COPY	`dir:90f179a88b933509d25260cc39531ad607b6b92ceaa3253b69c527b86fa34a32 in /opt/dynamo/wheelhouse`	05/06/2026 7:35 PM UTC
sha256:c7e3b1f229f8319a7a945826aea94107cf160d28dd7018a978f2f619a56a03a6	COPY	`multi:b98443496556042d2aacb74e1d93f3229f4476654e460a82af69a3b53d6c3226 in /usr/local/lib/python3.12/dist-packages/`	05/01/2026 6:21 PM UTC