ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Dynamo SGLang Runtime
Container
NVIDIA
NVIDIA
Dynamo SGLang Runtime

The Dynamo SGLang runtime image is a containerized build of Dynamo + SGLang which serves as the base runtime environment for sglang based inference with Dynamo's distributed inference framework.

LayerLabelCreated
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4CMD
—
11/07/2025 1:36 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENTRYPOINT
/opt/nvidia/nvidia_entrypoint.sh
11/07/2025 1:36 AM UTC
sha256:9bbf8663b25b7dea06370b4d6012e760f3240950898f0533329c39951e3e450dCOPY
components/ /workspace/components/
11/07/2025 1:36 AM UTC
sha256:fff51b61557bd5592ab93d504625ccc666b1ae1530128ba4ef55eda746e597a8COPY
deploy /workspace/deploy
11/07/2025 1:36 AM UTC
sha256:a8c00deaa1aa1490109c78fd6539bbfa1fc1dbd0788e96473cbb86d4caf2ec1eCOPY
benchmarks /workspace/benchmarks
11/07/2025 1:36 AM UTC
sha256:75d72515f65b2bc26332ca5abded0dade47b7d6b88c5fc6951c573db792bc273COPY
examples /workspace/examples
11/07/2025 1:36 AM UTC
sha256:df590f522d5d389cc10dc6c381364b44a65baf78964917c5cd947708b4d04a90COPY
tests /workspace/tests
11/07/2025 1:36 AM UTC
sha256:d6b516a0de911a9af5d017ea644bf65b9067d6b326f010fe7171627baeff9590RUN
BUILD_TYPE=all DEEPEP_COMMIT=9af0e0d0e74f3577af1979c9b9e1ac2cad0104ee DEEPEP_GB_COMMIT=1b14ad661c7640137fcfe93cccb2694ede1220b0 CMAKE_BUILD_PARALLEL_LEVEL=2 FLASHMLA_COMMIT=1408756a88e52a25196b759eaf8db89d2b51b5a1 SGL_KERNEL_VERSION=0.3.15 SGLANG_COMMIT=0.5.3.post2 GDRCOPY_COMMIT=v2.4.4 NVSHMEM_VERSION=3.3.9 GRACE_BLACKWELL=false ARCH=amd64 ARCH_ALT=x86_64 PYTHON_VERSION=3.10 USE_SCCACHE=true SCCACHE_BUCKET=ai-dynamo-sccache SCCACHE_REGION=us-west-2 CARGO_BUILD_JOBS=16 CUDA_VERSION=12.9.1 ARCH=amd64 ARCH_ALT=x86_64 PYTHON_VERSION=3.10 sed '/^#\s/d' /workspace/launch_message.txt > ~/.launch_screen &&
  echo "cat ~/.launch_screen" >> ~/.bashrc
11/07/2025 1:36 AM UTC
sha256:f85db63a72aaa2ab9f09620b9fc8dee706ac70061fb7cc9c3bdfe6acd944f7bdCOPY
container/launch_message.txt /workspace/launch_message.txt
11/07/2025 1:36 AM UTC
sha256:27e950f37aad0d54b2d2c73a01c91e4441420a2d94a1b300e48ec40ad69eadd5COPY
ATTRIBUTION* LICENSE /workspace/
11/07/2025 1:36 AM UTC
...