NVIDIA
NVIDIA
Dynamo SGLang Runtime
Container
NVIDIA
NVIDIA
Dynamo SGLang Runtime

The Dynamo SGLang runtime image is a containerized build of Dynamo + SGLang which serves as the base runtime environment for sglang based inference with Dynamo's distributed inference framework.

LayerLabelCreated
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4CMD
07/16/2026 4:29 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENTRYPOINT
/opt/nvidia/nvidia_entrypoint.sh
07/16/2026 4:29 AM UTC
sha256:ee039872b61ef73fcb3a3a441a220f81767678482705b6ae6a1d6e30553cc6ddCOPY
/legal /legal
07/16/2026 4:29 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4CMD
07/16/2026 4:29 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENTRYPOINT
/opt/nvidia/nvidia_entrypoint.sh
07/16/2026 4:29 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
DYNAMO_COMMIT_SHA=c3e49d6fc52263ffba467130091099aa946fa905
07/16/2026 4:29 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
DYNAMO_COMMIT_SHA=c3e49d6fc52263ffba467130091099aa946fa905
07/16/2026 4:29 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4USER
dynamo
07/16/2026 4:29 AM UTC
sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1RUN
MODELEXPRESS_VERSION=0.4.0 ENABLE_GPU_MEMORY_SERVICE=true set -eux; remaining="$(find /usr /opt /workspace /sgl-workspace -xdev         \( -type f -o -type l \)         \( -name ffmpeg -o -name ffprobe         -o -name 'libavcodec*.so*' -o -name 'libavdevice*.so*'         -o -name 'libavfilter*.so*' -o -name 'libavformat*.so*'         -o -name 'libavutil*.so*' -o -name 'libpostproc*.so*'         -o -name 'libswresample*.so*' -o -name 'libswscale*.so*'         -o -name 'libx264*.so*' -o -name 'libx265*.so*'         -o -name 'libopenh264*.so*' -o -name 'libfdk-aac*.so*'         -o -name 'libfaac*.so*' -o -name 'libvo-aacenc*.so*'         -o -name 'libaacplus*.so*' \) -print)"; if [ -n "${remaining}" ]; then echo "ERROR: codec-bearing files remain in the SGLang image:" >&2; echo "${remaining}" >&2; exit 1; fi; python3 -c 'import soundfile, torchaudio; from PIL import Image'
07/16/2026 4:29 AM UTC
sha256:5944f82fa9369e829c7f741d4e14e01342e0deb2e21a95e1d117ffdbdc0bce01RUN
MODELEXPRESS_VERSION=0.4.0 ENABLE_GPU_MEMORY_SERVICE=true SITE_PACKAGES="$(python3 -c 'import site; print(site.getsitepackages()[0])')" &&
  python3 -m compileall -q -j0 "$SITE_PACKAGES" &&
  (python3 -m compileall -q -j0 /sgl-workspace/sglang/python ||
  true)
07/16/2026 4:29 AM UTC
...