ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIAKit SDK - Windows (PB25h1)NVIDIAKit SDK - Linux (PB25h1)NVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Dynamo SGLang Runtime
Container
NVIDIA
NVIDIA
Dynamo SGLang Runtime

The Dynamo SGLang runtime image is a containerized build of Dynamo + SGLang which serves as the base runtime environment for sglang based inference with Dynamo's distributed inference framework.

LayerLabelCreated
e4607ca84165b73fa580681a9b552ef604ca059a798e5851bd6b4fe009263ae8CONFIG
WorkingDir /workspace
04/25/2026 5:45 AM UTC
b1beca7695949792f7cd541fba9645d0dab6812749d7699c8a91fcbb183f71d0ENTRYPOINT
—
04/25/2026 5:45 AM UTC
63cedb90d10f295a837eee497341cc3ec580a2ac9f0f80b308d554cb1a0c52d9WORKDIR
/workspace
04/25/2026 5:45 AM UTC
13ccef344682afaa1ba88983843fb12b12279b71428a59039e6617feabbac8deENV
SGLANG_JIT_DEEPGEMM_PRECOMPILE=0 SGLANG_JIT_DEEPGEMM_FAST_WARMUP=1
04/25/2026 5:45 AM UTC
60385632ed407dc7d398653145698e30d16e3db150ddd4fbcd80f2dc1d88cb4bENV
PYTHONPATH=/workspace/sglang/python:/workspace/components/src
04/25/2026 5:45 AM UTC
20ed76fe249eb19feff38bfaa4846f447b4fe98bcadd822aa613c2fa2bc6c726COPY
/workspace/components/src/dynamo /workspace/components/src/dynamo
04/25/2026 5:45 AM UTC
c8c5338b443f97014d1e7ba379f56582ffbd35c0b188cb5af516d688b9cefb86RUN
pip install --no-cache-dir --force-reinstall --no-deps /opt/dynamo/wheelhouse/ai_dynamo_runtime*.whl /opt/dynamo/wheelhouse/ai_dynamo-*.whl &&
  python3 -c "from dynamo._core import get_tool_parser_names; assert 'deepseek_v4' in get_tool_parser_names(), 'V4 parser missing!'; print('V4 parser verified')"
04/25/2026 5:45 AM UTC
d5877a2c4f073215b523c2174f3dd08f12bf95204523af29c4e29a5446784579COPY
/opt/dynamo/wheelhouse/ai_dynamo-*.whl /opt/dynamo/wheelhouse/
04/25/2026 5:45 AM UTC
12154cfc86426e4bf7a7f6c597da250012b2867c23dec28672d755ae7f558899COPY
/opt/dynamo/wheelhouse/ai_dynamo_runtime*.whl /opt/dynamo/wheelhouse/
04/25/2026 5:45 AM UTC
fc868d4aff30a84efefb2890bc8df2a1b611d6c7dd29ac8c1b0a2de281d69eb2COPY
--chown=dynamo:0 --chmod=664 /workspace/ATTRIBUTIONS.md /workspace/ATTRIBUTIONS-Rust.md /workspace/ATTRIBUTIONS-Python.md /workspace/LICENSE /workspace/
04/25/2026 5:42 AM UTC
...