NVIDIA
NVIDIA
Dynamo SGLang Runtime
Container
NVIDIA
NVIDIA
Dynamo SGLang Runtime

The Dynamo SGLang runtime image is a containerized build of Dynamo + SGLang which serves as the base runtime environment for sglang based inference with Dynamo's distributed inference framework.

LayerLabelCreated
b6869041fdeb1a4d6ce292c8795f17a54c50a7fb72ab3bab00ba8720475abdc3CONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace
03/03/2026 11:52 AM UTC
7c4cc0d28014dd9313635327b5a6dd8ebdc85df7230b14699657011e20a736beENTRYPOINT
/opt/nvidia/nvidia_entrypoint.sh
03/03/2026 11:52 AM UTC
2230684c961d1f570b8b23b2fc715627c130a111614a39aadfc2d02333f9cb1eENV
DYNAMO_COMMIT_SHA=ebcbd617aa4dea3bf608a8f0d25d98f013549085
03/03/2026 11:52 AM UTC
9731e7db025e0aaac6a8b9e4dd8ef6ae26477cadfe5329b01f92efe7b5d36734ARG
DYNAMO_COMMIT_SHA=ebcbd617aa4dea3bf608a8f0d25d98f013549085
03/03/2026 11:52 AM UTC
7e2ad6af5c72b6f3eb6d4998c4fe6e056c477834bafee8ed3bf2c393edac6d1bUSER
dynamo
03/03/2026 11:52 AM UTC
229fb2115e856a29742cc32541960b9bf060155a1e208026ef5fb2c7d98e0d10RUN
RUNTIME_IMAGE_TAG=v0.5.8-cu130-runtime ENABLE_GPU_MEMORY_SERVICE=true chmod 755 /opt/dynamo/.launch_screen &&
  echo 'cat /opt/dynamo/.launch_screen' >> /etc/bash.bashrc &&
  ln -s /workspace /sgl-workspace/dynamo
03/03/2026 11:52 AM UTC
d4dcf7d39b30952cb2b60151434b891eae9ae8a1ec3085e6d49c1874c488d41dUSER
root
03/03/2026 11:52 AM UTC
9ad0ac0ac81720e491035157f8d71b816fdc17292404507a679a84389dd30ef9RUN
RUNTIME_IMAGE_TAG=v0.5.8-cu130-runtime ENABLE_GPU_MEMORY_SERVICE=true sed '/^#\s/d' /opt/dynamo/launch_message.txt > /opt/dynamo/.launch_screen
03/03/2026 11:52 AM UTC
9352e6a7739717fcdda6e1d43a6856240ef8b194dc55a216c2e9e3ee40768f12ENV
SGLANG_FORCE_SHUTDOWN=1
03/03/2026 11:52 AM UTC
f88a04ed2861e3b56fc56fb11cf2fd53fcc708ecb72e8b09e1543efdb3a95ffcCOPY
--chown=dynamo:0 --chmod=775 recipes/ /workspace/recipes/
03/03/2026 11:52 AM UTC
...