ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIAKit SDK - Windows (PB25h1)NVIDIAKit SDK - Linux (PB25h1)NVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Dynamo SGLang Runtime
Container
NVIDIA
NVIDIA
Dynamo SGLang Runtime

The Dynamo SGLang runtime image is a containerized build of Dynamo + SGLang which serves as the base runtime environment for sglang based inference with Dynamo's distributed inference framework.

LayerLabelCreated
0fb6b575c05d72b3d6d762f2e9e3f5b5a10cec8b5a85cfa8b066a6b59751d0b7CONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /sgl-workspace/dynamo/components/backends/sglang
09/10/2025 9:58 PM UTC
28945102d9e544c7f8f02d8d5726c3515ed333b5e402e371c8478834c8d30489ENV
SGL_FORCE_SHUTDOWN=1
09/10/2025 9:58 PM UTC
117b89770099f00a475e2130c373f2a63de9776e162b34f9d3cf1e52c5430b6bRUN
SGLANG_COMMIT=ff1f68252c2b5b343aa6ef2aa14e6d4753ae4871 BUILD_TYPE=blackwell DEEPEP_COMMIT=1b14ad661c7640137fcfe93cccb2694ede1220b0 CMAKE_BUILD_PARALLEL_LEVEL=2 SGL_KERNEL_VERSION=0.3.4 MODE=hopper ARCH=amd64 ARCH_ALT=x86_64 NIXL_UCX_REF=v1.19.0 NIXL_TAG=0.5.0 CMAKE_VERSION=3.31.8 RUST_VERSION=1.89.0 CARGO_BUILD_JOBS=16 cd dynamo/lib/bindings/python &&
  pip install --break-system-packages -e . &&
  cd /sgl-workspace/dynamo &&
  pip install --break-system-packages .
09/10/2025 9:58 PM UTC
2ed3f5f6e86b8442f083aad9bcb949249489f9227d05e4e276fe318187b7a5eaRUN
SGLANG_COMMIT=ff1f68252c2b5b343aa6ef2aa14e6d4753ae4871 BUILD_TYPE=blackwell DEEPEP_COMMIT=1b14ad661c7640137fcfe93cccb2694ede1220b0 CMAKE_BUILD_PARALLEL_LEVEL=2 SGL_KERNEL_VERSION=0.3.4 MODE=hopper ARCH=amd64 ARCH_ALT=x86_64 NIXL_UCX_REF=v1.19.0 NIXL_TAG=0.5.0 CMAKE_VERSION=3.31.8 RUST_VERSION=1.89.0 CARGO_BUILD_JOBS=16 cd dynamo &&
  cargo build --release
09/10/2025 9:57 PM UTC
dc79787a91dc974996816411e055dde7251cc0fb8900b656ef05d03a9aeb026cCOPY
. ./dynamo
09/10/2025 9:47 PM UTC
660098d67a7adb4c8d0ebd1fa033b5d09373c6856a2a4b1db6d9ee320c194524ENV
CARGO_BUILD_JOBS=16
09/10/2025 4:57 PM UTC
6b494514d21cc85eade15dfc573a784f18291016c843bd4329c19b79c43a371eARG
CARGO_BUILD_JOBS
09/10/2025 4:57 PM UTC
448215d87c09eff3adf6d4d0555394f73b849efd8656e67f220c7f2bb2be4118ENV
PATH=/usr/local/bin/etcd:/usr/local/cargo/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
09/10/2025 4:57 PM UTC
c380d4dd0ccc66f2af80fdc4c861a9da42542a23df0615c68b0369e6ccd6d350RUN
SGLANG_COMMIT=ff1f68252c2b5b343aa6ef2aa14e6d4753ae4871 BUILD_TYPE=blackwell DEEPEP_COMMIT=1b14ad661c7640137fcfe93cccb2694ede1220b0 CMAKE_BUILD_PARALLEL_LEVEL=2 SGL_KERNEL_VERSION=0.3.4 MODE=hopper ARCH=amd64 ARCH_ALT=x86_64 NIXL_UCX_REF=v1.19.0 NIXL_TAG=0.5.0 CMAKE_VERSION=3.31.8 RUST_VERSION=1.89.0 CARGO_BUILD_JOBS=16 wget --tries=3 --waitretry=5 https://github.com/etcd-io/etcd/releases/download/${ETCD_VERSION}/etcd-${ETCD_VERSION}-linux-arm64.tar.gz -O /tmp/etcd.tar.gz &&
  mkdir -p /usr/local/bin/etcd &&
  tar -xzf /tmp/etcd.tar.gz -C /usr/local/bin/etcd --strip-components=1 &&
  rm /tmp/etcd.tar.gz
09/10/2025 4:57 PM UTC
cc8de1f7c5fbc72a24ac23d2be88ab8db72bfdf626a9614d3052a91f720b3ac5ENV
ETCD_VERSION=v3.5.21
09/10/2025 4:57 PM UTC
...