ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIAKit SDK - Windows (PB25h1)NVIDIAKit SDK - Linux (PB25h1)NVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Dynamo SGLang Runtime
Container
NVIDIA
NVIDIA
Dynamo SGLang Runtime

The Dynamo SGLang runtime image is a containerized build of Dynamo + SGLang which serves as the base runtime environment for sglang based inference with Dynamo's distributed inference framework.

LayerLabelCreated
4731005c2e5c7651be1f97df1c37889663550c7fa3e51736ac95c57ac4236385CONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace
12/05/2025 8:06 PM UTC
691c7d9711247b82502a2569cd8bc072b5b6676a01d9b3036626f6a61bb62da9ENTRYPOINT
/opt/nvidia/nvidia_entrypoint.sh
12/05/2025 8:06 PM UTC
3c35294653de011cff351ae98969eb4a10cc52ec021d8f721e3eed83c8505ca1COPY
--chown=dynamo: recipes/ /workspace/recipes/
12/05/2025 8:06 PM UTC
9db3769d6595528c8f4efdb9e3ffb9d6b83312cb34c60234e407eea1c2a063a8COPY
--chown=dynamo: components/ /workspace/components/
12/05/2025 8:06 PM UTC
3e3f02daaefe06d6ccbdcb13d65f752b8b198c8d0dd43dd6595d8e6434d8a756COPY
--chown=dynamo: deploy /workspace/deploy
12/05/2025 8:06 PM UTC
6eed83146bbd92effcc69027b02aa0426920a963aa4e477c2eda31a4aff95257COPY
--chown=dynamo: benchmarks /workspace/benchmarks
12/05/2025 8:06 PM UTC
1e016c0992cf1f655beff81d9960a6c4246f71256b1e0da54bfef0863373f33bCOPY
--chown=dynamo: examples /workspace/examples
12/05/2025 8:06 PM UTC
9849d4ceb6e3af84408994694198b851b16e3b99184cd869cb56be26e26b0397COPY
--chown=dynamo: tests /workspace/tests
12/05/2025 8:06 PM UTC
2f7522e18f08287094078ded1f67df69b6729789f7344b934c4ef4177d1ee411USER
dynamo
12/05/2025 8:06 PM UTC
f7ce539ebf12ec99adf3bfb1f29d2e2c3b0b9b54d0b6bce78ab86c8db9b98c04RUN
BUILD_TYPE=all DEEPEP_COMMIT=9af0e0d0e74f3577af1979c9b9e1ac2cad0104ee DEEPEP_GB_COMMIT=1b14ad661c7640137fcfe93cccb2694ede1220b0 CMAKE_BUILD_PARALLEL_LEVEL=2 SGL_KERNEL_VERSION=0.3.16.post5 SGLANG_COMMIT=0.5.4.post3 GDRCOPY_COMMIT=v2.4.4 NVSHMEM_VERSION=3.3.9 GRACE_BLACKWELL=false ARCH=amd64 ARCH_ALT=x86_64 PYTHON_VERSION=3.10 USE_SCCACHE=true SCCACHE_BUCKET=ai-dynamo-sccache SCCACHE_REGION=us-west-2 CARGO_BUILD_JOBS=16 CUDA_VERSION=12.9.1 ARCH=amd64 ARCH_ALT=x86_64 PYTHON_VERSION=3.10 DYNAMO_COMMIT_SHA=41a72ab36698ce3eba0fba9af1dfad124d9e71ea chmod 755 /opt/dynamo/.launch_screen &&
  echo 'source /opt/dynamo/venv/bin/activate' >> /etc/bash.bashrc &&
  echo 'cat /opt/dynamo/.launch_screen' >> /etc/bash.bashrc
12/05/2025 8:06 PM UTC
...