ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Dynamo SGLang Runtime
Container
NVIDIA
NVIDIA
Dynamo SGLang Runtime

The Dynamo SGLang runtime image is a containerized build of Dynamo + SGLang which serves as the base runtime environment for sglang based inference with Dynamo's distributed inference framework.

LayerLabelCreated
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4CMD
—
11/06/2025 12:50 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENTRYPOINT
/opt/nvidia/nvidia_entrypoint.sh
11/06/2025 12:50 AM UTC
sha256:fe77017bcb863c3b1bb9515d5367f5fc29986bebfc4196f169cbb57fe5b26e1eCOPY
components/ /workspace/components/
11/06/2025 12:50 AM UTC
sha256:6e0c92fc45453af81b1c9685a376f1e500c7375e9f9ef0d7d7d9aec771d07b53COPY
deploy /workspace/deploy
11/06/2025 12:50 AM UTC
sha256:a97329696925509857ad1fe78fcb97f00feb708490e3794a027f484698756259COPY
benchmarks /workspace/benchmarks
11/06/2025 12:50 AM UTC
sha256:95b198a9175b231d38d91782af41a4f31847c34ebe2085fa7db5157f82389419COPY
examples /workspace/examples
11/06/2025 12:50 AM UTC
sha256:5cb7031d1f36a8c2aa9d636f05a609027b709a06b77327ba387f07a7fe5a3fdaCOPY
tests /workspace/tests
11/06/2025 12:50 AM UTC
sha256:da60286e4690117d6e50935b6d3c717d69a2cd511e2f71c518debe5ede71af5cRUN
BUILD_TYPE=all DEEPEP_COMMIT=9af0e0d0e74f3577af1979c9b9e1ac2cad0104ee DEEPEP_GB_COMMIT=1b14ad661c7640137fcfe93cccb2694ede1220b0 CMAKE_BUILD_PARALLEL_LEVEL=2 FLASHMLA_COMMIT=1408756a88e52a25196b759eaf8db89d2b51b5a1 SGL_KERNEL_VERSION=0.3.15 SGLANG_COMMIT=0.5.3.post2 GDRCOPY_COMMIT=v2.4.4 NVSHMEM_VERSION=3.3.9 GRACE_BLACKWELL=false ARCH=amd64 ARCH_ALT=x86_64 PYTHON_VERSION=3.10 USE_SCCACHE=true SCCACHE_BUCKET=ai-dynamo-sccache SCCACHE_REGION=us-west-2 CARGO_BUILD_JOBS=16 CUDA_VERSION=12.9.1 ARCH=amd64 ARCH_ALT=x86_64 PYTHON_VERSION=3.10 sed '/^#\s/d' /workspace/launch_message.txt > ~/.launch_screen &&
  echo "cat ~/.launch_screen" >> ~/.bashrc
11/06/2025 12:50 AM UTC
sha256:926c70df76bf79337c43ebb4f9ef56103a30665811b1da54d9ae7c1c9a4fe02fCOPY
container/launch_message.txt /workspace/launch_message.txt
11/06/2025 12:50 AM UTC
sha256:d0d92e34c9a5d39d43dcd604f9242d8c37d16a268b4d3c7f0ee1ae0cbc9794fbCOPY
ATTRIBUTION* LICENSE /workspace/
11/06/2025 12:50 AM UTC
...