Dynamo SGLang Runtime

NVIDIA

Container

NVIDIA

Dynamo SGLang Runtime

The Dynamo SGLang runtime image is a containerized build of Dynamo + SGLang which serves as the base runtime environment for sglang based inference with Dynamo's distributed inference framework.

Layer	Label		Created
dff51441e4fe31dac3bcd99c3687fa35dd8863a7d1f442c47474db9405c4a4d4	CONFIG	`WorkingDir /workspace`	05/06/2026 7:41 PM UTC
1bd07a874ced2a3c427b40a66a28fc1ae3f561c5bd8a4fa4718185554c9b0480	ENTRYPOINT	`—`	05/06/2026 7:41 PM UTC
ba9f027586866d5c04d14bc6b15a58fd50eb05de5fcd562572ad7e7d40cfafb7	WORKDIR	`/workspace`	05/06/2026 7:40 PM UTC
419e8633d4398e1ad9d9abf72239c3bedd28afe94703a913218880319e880ac4	ENV	`SGLANG_JIT_DEEPGEMM_PRECOMPILE=0 SGLANG_JIT_DEEPGEMM_FAST_WARMUP=1`	05/06/2026 7:39 PM UTC
976d3a7ed82fe63f7fde2b45ad8d8ea5a0a4945d1d9327dc15d172aebe8bdc8c	ENV	`PYTHONPATH=/workspace/sglang/python:/workspace/components/src`	05/06/2026 7:38 PM UTC
8820a63ea0cb5983516debe7e4962946bcecc47165c326b2eee6bec615cd2a7b	COPY	`multi:75a299fe8868b30f7f58f84e03a3235d4facf4725c478d15ac17c007f2ae9e3a in /workspace/`	05/06/2026 7:37 PM UTC
38eafe419bd9935a1ce389776d29029c7c2e761ac4eb1b36e8f3cc30f8e2771d	COPY	`dir:8aecc293b9167795bdaff6a7b28b0d9a8c4a85ae7fc57d6a42179166df563f21 in /workspace/components/src/dynamo`	05/06/2026 7:37 PM UTC
a04b1559b5e5c784b6594386e94129209b77cc990beaa6ef43f3a4e615ab1c4c	RUN	`pip install --no-cache-dir --force-reinstall --no-deps /opt/dynamo/wheelhouse/ai_dynamo_runtime.whl /opt/dynamo/wheelhouse/ai_dynamo-.whl && python3 -c "from dynamo._core import get_tool_parser_names; assert 'deepseek_v4' in get_tool_parser_names(), 'V4 parser missing!'; print('V4 parser verified')"`	05/06/2026 7:36 PM UTC
e93e809ba09b57cdf503e8880d43fd8da6fa32e72ca051e0a37d4aedd5461eaf	COPY	`dir:90f179a88b933509d25260cc39531ad607b6b92ceaa3253b69c527b86fa34a32 in /opt/dynamo/wheelhouse`	05/06/2026 7:35 PM UTC
67d1dd21e0a287c87e6ec94d294d0232b4bfb5703844db76cb17379f1ef54884	COPY	`multi:b98443496556042d2aacb74e1d93f3229f4476654e460a82af69a3b53d6c3226 in /usr/local/lib/python3.12/dist-packages/`	05/01/2026 6:21 PM UTC