NVIDIA
NVIDIA
Dynamo SGLang Runtime
Container
NVIDIA
NVIDIA
Dynamo SGLang Runtime

The Dynamo SGLang runtime image is a containerized build of Dynamo + SGLang which serves as the base runtime environment for sglang based inference with Dynamo's distributed inference framework.

  • LayerLabelCreated
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4CMD
    11/07/2025 1:36 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENTRYPOINT
    /opt/nvidia/nvidia_entrypoint.sh
    11/07/2025 1:36 AM UTC
    sha256:9bbf8663b25b7dea06370b4d6012e760f3240950898f0533329c39951e3e450dCOPY
    components/ /workspace/components/
    11/07/2025 1:36 AM UTC
    sha256:fff51b61557bd5592ab93d504625ccc666b1ae1530128ba4ef55eda746e597a8COPY
    deploy /workspace/deploy
    11/07/2025 1:36 AM UTC
    sha256:a8c00deaa1aa1490109c78fd6539bbfa1fc1dbd0788e96473cbb86d4caf2ec1eCOPY
    benchmarks /workspace/benchmarks
    11/07/2025 1:36 AM UTC
    sha256:75d72515f65b2bc26332ca5abded0dade47b7d6b88c5fc6951c573db792bc273COPY
    examples /workspace/examples
    11/07/2025 1:36 AM UTC
    sha256:df590f522d5d389cc10dc6c381364b44a65baf78964917c5cd947708b4d04a90COPY
    tests /workspace/tests
    11/07/2025 1:36 AM UTC
    sha256:d6b516a0de911a9af5d017ea644bf65b9067d6b326f010fe7171627baeff9590RUN
    BUILD_TYPE=all DEEPEP_COMMIT=9af0e0d0e74f3577af1979c9b9e1ac2cad0104ee DEEPEP_GB_COMMIT=1b14ad661c7640137fcfe93cccb2694ede1220b0 CMAKE_BUILD_PARALLEL_LEVEL=2 FLASHMLA_COMMIT=1408756a88e52a25196b759eaf8db89d2b51b5a1 SGL_KERNEL_VERSION=0.3.15 SGLANG_COMMIT=0.5.3.post2 GDRCOPY_COMMIT=v2.4.4 NVSHMEM_VERSION=3.3.9 GRACE_BLACKWELL=false ARCH=amd64 ARCH_ALT=x86_64 PYTHON_VERSION=3.10 USE_SCCACHE=true SCCACHE_BUCKET=ai-dynamo-sccache SCCACHE_REGION=us-west-2 CARGO_BUILD_JOBS=16 CUDA_VERSION=12.9.1 ARCH=amd64 ARCH_ALT=x86_64 PYTHON_VERSION=3.10 sed '/^#\s/d' /workspace/launch_message.txt > ~/.launch_screen &&
      echo "cat ~/.launch_screen" >> ~/.bashrc
    11/07/2025 1:36 AM UTC
    sha256:f85db63a72aaa2ab9f09620b9fc8dee706ac70061fb7cc9c3bdfe6acd944f7bdCOPY
    container/launch_message.txt /workspace/launch_message.txt
    11/07/2025 1:36 AM UTC
    sha256:27e950f37aad0d54b2d2c73a01c91e4441420a2d94a1b300e48ec40ad69eadd5COPY
    ATTRIBUTION* LICENSE /workspace/
    11/07/2025 1:36 AM UTC
    ...