Skip to main content
ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
  • NVIDIA
    Dynamo vLLM Runtime
    Container
    NVIDIA
    Dynamo vLLM Runtime

    The Dynamo vLLM runtime image is a containerized build of Dynamo + vLLM which serves as the base runtime environment for vLLM based inference with Dynamo's distributed inference framework.

  • LayerLabelCreated
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4CMD
    —
    		09/17/2025 8:54 PM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENTRYPOINT
    /opt/nvidia/nvidia_entrypoint.sh
    		09/17/2025 8:54 PM UTC
    sha256:37f63fe29fad8861ba4b02c7a5fc4327c7e397add37d4f6ec3fae12e82d78d8dRUN
    ARCH_ALT=x86_64 PYTHON_VERSION=3.12 PROM_VERSION=3.4.1 sed '/^#\s/d' /workspace/launch_message.txt > ~/.launch_screen &&
  echo "cat ~/.launch_screen" >> ~/.bashrc &&
  echo "source $VIRTUAL_ENV/bin/activate" >> ~/.bashrc
    		09/17/2025 8:54 PM UTC
    sha256:73e6eb295fa2b41815c48892fbe17cbcd20f796bdb0986e7ec4f70191e7856d5COPY
    ATTRIBUTION* LICENSE /workspace/
    		09/17/2025 8:54 PM UTC
    sha256:75d49c1ce0e9b68b8c9d05e543af38c5df092644d915a83db84f26271bf744d4COPY
    . /workspace/
    		09/17/2025 8:54 PM UTC
    sha256:bdafc53378e89ae9cf91a94aae88533176743aa91a112b1acf26881b0676af17RUN
    ARCH_ALT=x86_64 PYTHON_VERSION=3.12 PROM_VERSION=3.4.1 uv pip install --requirement /tmp/requirements.txt --requirement /tmp/requirements.test.txt
    		09/17/2025 8:54 PM UTC
    sha256:0ba98adf0251fc652c32870a64ee397e4cf222270783aea49c0a3a4294df55cbRUN
    ARCH_ALT=x86_64 PYTHON_VERSION=3.12 PROM_VERSION=3.4.1 uv pip install /opt/dynamo/wheelhouse/ai_dynamo_runtime*cp312*.whl /opt/dynamo/wheelhouse/ai_dynamo*any.whl /opt/dynamo/wheelhouse/nixl/nixl*.whl /opt/dynamo/benchmarks &&
  rm -rf /opt/dynamo/benchmarks
    		09/17/2025 8:54 PM UTC
    sha256:9929f75bfc42aff31a6813d6943adff28b24f50bf0041d30e4e35e5f9ef54701COPY
    /opt/dynamo/wheelhouse/ /opt/dynamo/wheelhouse/
    		09/17/2025 8:54 PM UTC
    sha256:02785a458e5098f825ff4866ec6f160959c68f8d2718525a12a5066ef00c10b6COPY
    benchmarks/ /opt/dynamo/benchmarks/
    		09/17/2025 8:54 PM UTC
    sha256:0af9b87ed0c6c13e7219f85fd34fd555ee6700a2e1a55f6e5822a40bdfa63b90COPY
    /opt/dynamo/venv /opt/dynamo/venv
    		09/17/2025 8:54 PM UTC
    ...