Dynamo SGLang Runtime

NVIDIA

Container

NVIDIA

Dynamo SGLang Runtime

The Dynamo SGLang runtime image is a containerized build of Dynamo + SGLang which serves as the base runtime environment for sglang based inference with Dynamo's distributed inference framework.

Layer	Label		Created
2a81f3c63f630c67534a2e49d88e7bcb4b0c1cae074dc1b2fe622d499ec049dd	CONFIG	`WorkingDir /workspace`	04/30/2026 10:30 PM UTC
4b515dcbb847a30b5546d971620a781b911606a5f06a988d399491a0f4b76f2d	CMD	`bash`	04/30/2026 7:57 PM UTC
a9dc9b13bf6ebd1ff9f9024b785276d201202cb2a738ac79d6a7eaf1dda3c90a	ENTRYPOINT	`—`	04/30/2026 7:57 PM UTC
502ab3faaf66128d2e6e5675428d2ec4e910401ddc7d71c0db6998b5f845b530	WORKDIR	`/workspace`	04/30/2026 7:57 PM UTC
63299caf59d7c8dd57c943825ed7f2143f2a97e21ea1ee3c97307627e8fdb854	RUN	`apt-get purge -y libx264-164 libx265-199 libde265-0 libavcodec60 libxvidcore4 && rm -rf /var/lib/apt/lists/*`	04/30/2026 7:57 PM UTC
19decee5d968d95fbe6587c99bffed9373113c48ab2cc3c33a96efdd9fb2de22	ENV	`SGLANG_JIT_DEEPGEMM_PRECOMPILE=0 SGLANG_JIT_DEEPGEMM_FAST_WARMUP=1`	04/29/2026 4:40 AM UTC
159c994e4f81822294b97f2765ee329d5a3eb6fc30466da5c90d1f0ed01e031c	ENV	`PYTHONPATH=/workspace/sglang/python:/workspace/components/src`	04/29/2026 4:40 AM UTC
0be4683af7ea228bd6c18d4b632279e0f0ab937fc353377cd572ca84ea2bdc39	COPY	`/workspace/components/src/dynamo /workspace/components/src/dynamo`	04/29/2026 4:40 AM UTC
2b4b5c4f60286fb3f5ade80237e2da187aee67123afe0500ead61512f96867ab	RUN	`pip install --no-cache-dir --force-reinstall --no-deps /opt/dynamo/wheelhouse/ai_dynamo_runtime.whl /opt/dynamo/wheelhouse/ai_dynamo-.whl && python3 -c "from dynamo._core import get_tool_parser_names; assert 'deepseek_v4' in get_tool_parser_names(), 'V4 parser missing!'; print('V4 parser verified')"`	04/29/2026 4:40 AM UTC
58c90b6d4d4d137068f3e052e764b7a03b469a72b04383339be759f7ec9504be	COPY	`/opt/dynamo/wheelhouse /opt/dynamo/wheelhouse`	04/29/2026 4:40 AM UTC