ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIAKit SDK - Windows (PB25h1)NVIDIAKit SDK - Linux (PB25h1)NVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
Dynamo SGLang Runtime
Container
NVIDIA
NVIDIA
Dynamo SGLang Runtime

The Dynamo SGLang runtime image is a containerized build of Dynamo + SGLang which serves as the base runtime environment for sglang based inference with Dynamo's distributed inference framework.

LayerLabelCreated
c137525151451af21f5e1a04547714fdb6e0202dbfb5181e1cd59b20387eb732CONFIG
Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /workspace
11/06/2025 12:50 AM UTC
7c36d0413d282808823c6b0c027726b2b82ded56d55f61a1267fddda58129541ENTRYPOINT
/opt/nvidia/nvidia_entrypoint.sh
11/06/2025 12:50 AM UTC
3dded455cc2f48b3a680c9fc43a99017c105b01a4e6648463f4a64e5004f86a1COPY
components/ /workspace/components/
11/06/2025 12:50 AM UTC
e8fcb766d4cbdf1f3bbdd1d4118ccb74298b8d2ea62dab2351d6c4292b259491COPY
deploy /workspace/deploy
11/06/2025 12:50 AM UTC
1ebef2e0a8c4a8ac642c7785d355f67996fec0ae461a00ea6105b47740aa6b51COPY
benchmarks /workspace/benchmarks
11/06/2025 12:50 AM UTC
3a84755719a527a80475906c0df011ab46e5b018607ee32d182d9a4f2bbd5e36COPY
examples /workspace/examples
11/06/2025 12:50 AM UTC
42bd32a2dddc80acac729caae79f7e6d5001dd71a5780af7c2a037e0f3f512b2COPY
tests /workspace/tests
11/06/2025 12:50 AM UTC
1369b5b9afdf7729ecfe99771517f80d1ff73b5a8b0aacb5b311e54448294f9eRUN
BUILD_TYPE=all DEEPEP_COMMIT=9af0e0d0e74f3577af1979c9b9e1ac2cad0104ee DEEPEP_GB_COMMIT=1b14ad661c7640137fcfe93cccb2694ede1220b0 CMAKE_BUILD_PARALLEL_LEVEL=2 FLASHMLA_COMMIT=1408756a88e52a25196b759eaf8db89d2b51b5a1 SGL_KERNEL_VERSION=0.3.15 SGLANG_COMMIT=0.5.3.post2 GDRCOPY_COMMIT=v2.4.4 NVSHMEM_VERSION=3.3.9 GRACE_BLACKWELL=false ARCH=amd64 ARCH_ALT=x86_64 PYTHON_VERSION=3.10 USE_SCCACHE=true SCCACHE_BUCKET=ai-dynamo-sccache SCCACHE_REGION=us-west-2 CARGO_BUILD_JOBS=16 CUDA_VERSION=12.9.1 ARCH=amd64 ARCH_ALT=x86_64 PYTHON_VERSION=3.10 sed '/^#\s/d' /workspace/launch_message.txt > ~/.launch_screen &&
  echo "cat ~/.launch_screen" >> ~/.bashrc
11/06/2025 12:50 AM UTC
63125e034dca7f5409a10ee3d8a2f86545d5865929a4591775d1052b1e45fecaCOPY
container/launch_message.txt /workspace/launch_message.txt
11/06/2025 12:50 AM UTC
f35a56df16c57e7aeda099a26323f0d94a8cb4e84ed8ceba301c7c8d600d2775COPY
ATTRIBUTION* LICENSE /workspace/
11/06/2025 12:50 AM UTC
...

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.