NVIDIA
NVIDIA
Dynamo SGLang Runtime
Container
NVIDIA
NVIDIA
Dynamo SGLang Runtime

The Dynamo SGLang runtime image is a containerized build of Dynamo + SGLang which serves as the base runtime environment for sglang based inference with Dynamo's distributed inference framework.

LayerLabelCreated
10c89b7d956f31c7119a6146ca00343bfb14f88b4cbb0d71a5737721bf6cbf47CONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace
10/27/2025 5:09 PM UTC
c4959f095ba53ef0b5c23dff9b557aacdc61e4b9c63de1271ac6c44b27c04d7bENTRYPOINT
/opt/nvidia/nvidia_entrypoint.sh
10/27/2025 5:09 PM UTC
8c76c407721ffd5aab49a48b5bae2566fb39a7ec95535a0bae603c255e32f7f6COPY
ATTRIBUTION* LICENSE /workspace/
10/27/2025 5:09 PM UTC
62ce23cc4dcaf127fd321845ba32842fcc577b417e008d722590321852b8a498COPY
components/ /workspace/components/
10/27/2025 5:09 PM UTC
e00a9cbb5253543388b08863d7cd2fbc4fecc364f51ed3f6bffb84aa5d7d7e4eCOPY
deploy /workspace/deploy
10/27/2025 5:09 PM UTC
3945a7431439d8222c2c54d4b55d045ebfe4a5239cbefea2029e0f123f43eb05COPY
examples /workspace/examples
10/27/2025 5:09 PM UTC
3f795ad0c9d8de858553e6cfa655e44db52eeb5b0eda012da083765d92b43fddCOPY
benchmarks /workspace/benchmarks
10/27/2025 5:09 PM UTC
05460bb592c54d4c09b8b3a0c08eca6db759314bce721c73c126aafeaf6b8eb0COPY
tests /workspace/tests
10/27/2025 5:09 PM UTC
046fdd87084a49128efd868b77d038ed23e3c3393097eb9ce034359b4cbe2ebfRUN
ARCH_ALT=x86_64 PYTHON_VERSION=3.12 sed '/^#\s/d' /workspace/launch_message.txt > ~/.launch_screen &&
  echo "cat ~/.launch_screen" >> ~/.bashrc
10/27/2025 5:09 PM UTC
2ceaa6f025f8a931fad844d3b96127ed64f38bd89af2349786dca764f20c8bf6RUN
ARCH_ALT=x86_64 PYTHON_VERSION=3.12 UV_GIT_LFS=1 uv pip install --no-cache --requirement /tmp/requirements.txt --requirement /tmp/requirements.test.txt
10/27/2025 5:09 PM UTC
...