NVIDIA
NVIDIA
Dynamo SGLang Runtime
Container
NVIDIA
NVIDIA
Dynamo SGLang Runtime

The Dynamo SGLang runtime image is a containerized build of Dynamo + SGLang which serves as the base runtime environment for sglang based inference with Dynamo's distributed inference framework.

LayerLabelCreated
955034f9f6f5a559e8653b0bcfc08e9c0ec33a789a7a930ced9ecb83e7393ce7CONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace
02/12/2026 1:03 AM UTC
e3e8fc5adfa236fa10b4314b00528884b7a2ff9e9ec8f9c1e3c5431b837092e2ENTRYPOINT
/opt/nvidia/nvidia_entrypoint.sh
02/12/2026 1:03 AM UTC
a2cf144ad199c6e73ebcc6f20bedc8af49dd9b1d3c901f1bda64e1555aa085a2ENV
DYNAMO_COMMIT_SHA=76c1889aeb078219eb4fbd2b0c0fc21df75d8d0b
02/12/2026 1:03 AM UTC
abc49c439b54936727f604eed6cfea68cf06c6c8a9d8eebc06085c46827471dbARG
DYNAMO_COMMIT_SHA=76c1889aeb078219eb4fbd2b0c0fc21df75d8d0b
02/12/2026 1:03 AM UTC
bf09eb8f535bd4abf5de57f8bdd87dc276efc40aaec146d67a3c40c0864a76c7USER
dynamo
02/12/2026 1:03 AM UTC
855ff07b926912df5fa92729b11f2aa53a12ececcf0e3052a637670bff32a8e1RUN
RUNTIME_IMAGE_TAG=v0.5.8-cu130-runtime ENABLE_GPU_MEMORY_SERVICE=true chmod 755 /opt/dynamo/.launch_screen &&
  echo 'cat /opt/dynamo/.launch_screen' >> /etc/bash.bashrc &&
  ln -s /workspace /sgl-workspace/dynamo
02/12/2026 1:03 AM UTC
31e448f79be42cfa1dfb6244fbbc551e5649a46c647e83e0095ebdaf6a404614USER
root
02/12/2026 1:03 AM UTC
06490cad418a3a5f0bc60be5684a087a52eb60cd392fb3c9d6d1f5821d14e6f7RUN
RUNTIME_IMAGE_TAG=v0.5.8-cu130-runtime ENABLE_GPU_MEMORY_SERVICE=true sed '/^#\s/d' /opt/dynamo/launch_message.txt > /opt/dynamo/.launch_screen
02/12/2026 1:03 AM UTC
e15b43b14086657e1098d68f9a473d3861d313439280d180255e8bb59cf74262ENV
SGLANG_FORCE_SHUTDOWN=1
02/12/2026 1:03 AM UTC
28273b309fc671fc1b6cd03017304c6429ce63e38ca75c4731d692185324ffeaCOPY
--chown=dynamo:0 --chmod=775 recipes/ /workspace/recipes/
02/12/2026 1:03 AM UTC
...