NVIDIA
NVIDIA
Dynamo SGLang Runtime
Container
NVIDIA
NVIDIA
Dynamo SGLang Runtime

The Dynamo SGLang runtime image is a containerized build of Dynamo + SGLang which serves as the base runtime environment for sglang based inference with Dynamo's distributed inference framework.

LayerLabelCreated
4b60fff7a223fff2d9e94e320b8319e075d420398ff09c8f66c05e5d2c3ee13aCONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace
08/27/2025 3:31 AM UTC
41177b315eb343ebc71ca24ba6da7e8b77f7a7261637f52fff911f07fb098784ENTRYPOINT
/opt/nvidia/nvidia_entrypoint.sh
08/27/2025 3:31 AM UTC
1d11ebafadb32c7187b3eb491c104aa65486b2e43f8ad06e5cb4ee38eb8735ccENV
PYTHONPATH=/workspace/examples/sglang/utils:
08/27/2025 3:31 AM UTC
ef8452a56c3b4d60ac372706c171829203f4c7def638b96a7369fdfff36324beCOPY
ATTRIBUTION* LICENSE /workspace/
08/27/2025 3:31 AM UTC
b97f7bd8c2a9588cefb36a32427f4a06b394ef23925fff594691dc686e04bda5RUN
ARCH_ALT=x86_64 SGLANG_VERSION=0.5.0rc2 uv pip install /workspace/benchmarks
08/27/2025 3:31 AM UTC
988f9ccd2276eddbf99c1b70580f6b53413d69cce73cf5f58dc6e090f1207f47COPY
examples /workspace/examples
08/27/2025 3:31 AM UTC
2e7a52c796684ebde96c64ab547eadbc751bd64f25cef5a16c833d2524c65995COPY
benchmarks /workspace/benchmarks
08/27/2025 3:31 AM UTC
013f20e888eaf585acdb9c39f7b498cba9df8201cda1fe7fac8113e16a153c2aCOPY
tests /workspace/tests
08/27/2025 3:31 AM UTC
900f92dea4656fd2920b584d1041b0af5cb1f035ae2d52b7c9ae32e5610df13cCOPY
components/ /workspace/components/
08/27/2025 3:31 AM UTC
f66193e44ce45d46b53f816948bf50d8bca7cf1e55a67ae3eaab237c5e440f11RUN
ARCH_ALT=x86_64 SGLANG_VERSION=0.5.0rc2 sed '/^#\s/d' /workspace/launch_message.txt > ~/.launch_screen &&
  echo "cat ~/.launch_screen" >> ~/.bashrc
08/27/2025 3:31 AM UTC
...

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.