ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
  • NVIDIA
    sglang-runtime-nightly
    Container
    NVIDIA
    sglang-runtime-nightly

    The Dynamo SGLang runtime nightly image is a containerized build of Dynamo + SGLang which serves as the base runtime environment for sglang based inference with Dynamo's distributed inference framework which is published every night.

  • LayerLabelCreated
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4USER
    dynamo
    		08/23/2026 8:26 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    EFA_VERSION=1.49.0
    		08/23/2026 8:26 AM UTC
    sha256:eaf27130cbf1b9241aeec3009b3fcc1d0c8ca88cb42ae8da5827e13870eb8144RUN
    MODELEXPRESS_VERSION=0.5.0 ENABLE_GPU_MEMORY_SERVICE=true DYNAMO_COMMIT_SHA=bee2a6eca3b5f23d1c05061a3cebe575a438cf5f EFA_VERSION=1.49.0 curl --retry 3 --retry-delay 2 -fsSL -o aws-efa-installer-${EFA_VERSION}.tar.gz https://efa-installer.amazonaws.com/aws-efa-installer-${EFA_VERSION}.tar.gz &&
  tar -xf aws-efa-installer-${EFA_VERSION}.tar.gz &&
  cd aws-efa-installer &&
  apt-get update &&
  ./efa_installer.sh -y --skip-kmod --skip-limit-conf --no-verify &&
  cd .. &&
  rm -rf aws-efa-installer* &&
  ldconfig
    		08/23/2026 8:26 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4USER
    root
    		08/23/2026 8:25 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ARG
    EFA_VERSION=1.49.0
    		08/23/2026 8:25 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4CMD
    —
    		08/23/2026 8:25 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENTRYPOINT
    /opt/nvidia/nvidia_entrypoint.sh
    		08/23/2026 8:25 AM UTC
    sha256:c7391934d3dbb6d635a78ce5d25afb106c640b79ad01bab7292687484761f1feCOPY
    /legal /legal
    		08/23/2026 8:25 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NVIDIA_DRIVER_CAPABILITIES=video,compute,utility
    		08/23/2026 8:25 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4CMD
    —
    		08/23/2026 8:25 AM UTC
    ...