ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
  • NVIDIA
    NVIDIA
    Dynamo SGLang Runtime
    Container
    NVIDIA
    NVIDIA
    Dynamo SGLang Runtime

    The Dynamo SGLang runtime image is a containerized build of Dynamo + SGLang which serves as the base runtime environment for sglang based inference with Dynamo's distributed inference framework.

  • LayerLabelCreated
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4CMD
    —
    		11/06/2025 12:50 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENTRYPOINT
    /opt/nvidia/nvidia_entrypoint.sh
    		11/06/2025 12:50 AM UTC
    sha256:fe77017bcb863c3b1bb9515d5367f5fc29986bebfc4196f169cbb57fe5b26e1eCOPY
    components/ /workspace/components/
    		11/06/2025 12:50 AM UTC
    sha256:6e0c92fc45453af81b1c9685a376f1e500c7375e9f9ef0d7d7d9aec771d07b53COPY
    deploy /workspace/deploy
    		11/06/2025 12:50 AM UTC
    sha256:a97329696925509857ad1fe78fcb97f00feb708490e3794a027f484698756259COPY
    benchmarks /workspace/benchmarks
    		11/06/2025 12:50 AM UTC
    sha256:95b198a9175b231d38d91782af41a4f31847c34ebe2085fa7db5157f82389419COPY
    examples /workspace/examples
    		11/06/2025 12:50 AM UTC
    sha256:5cb7031d1f36a8c2aa9d636f05a609027b709a06b77327ba387f07a7fe5a3fdaCOPY
    tests /workspace/tests
    		11/06/2025 12:50 AM UTC
    sha256:da60286e4690117d6e50935b6d3c717d69a2cd511e2f71c518debe5ede71af5cRUN
    BUILD_TYPE=all DEEPEP_COMMIT=9af0e0d0e74f3577af1979c9b9e1ac2cad0104ee DEEPEP_GB_COMMIT=1b14ad661c7640137fcfe93cccb2694ede1220b0 CMAKE_BUILD_PARALLEL_LEVEL=2 FLASHMLA_COMMIT=1408756a88e52a25196b759eaf8db89d2b51b5a1 SGL_KERNEL_VERSION=0.3.15 SGLANG_COMMIT=0.5.3.post2 GDRCOPY_COMMIT=v2.4.4 NVSHMEM_VERSION=3.3.9 GRACE_BLACKWELL=false ARCH=amd64 ARCH_ALT=x86_64 PYTHON_VERSION=3.10 USE_SCCACHE=true SCCACHE_BUCKET=ai-dynamo-sccache SCCACHE_REGION=us-west-2 CARGO_BUILD_JOBS=16 CUDA_VERSION=12.9.1 ARCH=amd64 ARCH_ALT=x86_64 PYTHON_VERSION=3.10 sed '/^#\s/d' /workspace/launch_message.txt > ~/.launch_screen &&
  echo "cat ~/.launch_screen" >> ~/.bashrc
    		11/06/2025 12:50 AM UTC
    sha256:926c70df76bf79337c43ebb4f9ef56103a30665811b1da54d9ae7c1c9a4fe02fCOPY
    container/launch_message.txt /workspace/launch_message.txt
    		11/06/2025 12:50 AM UTC
    sha256:d0d92e34c9a5d39d43dcd604f9242d8c37d16a268b4d3c7f0ee1ae0cbc9794fbCOPY
    ATTRIBUTION* LICENSE /workspace/
    		11/06/2025 12:50 AM UTC
    ...

    NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.