ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
  • NVIDIA
    DeepSeek-V3.1
    Container
    NVIDIA
    DeepSeek-V3.1

    NVIDIA NIM for GPU accelerated DeepSeek-V3.1 inference through OpenAI compatible APIs

  • LayerLabelCreated
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4CMD
    ["/bin/bash" "-c" "$SERVER_START_SCRIPT_PATH"]
    		09/09/2025 5:58 AM UTC
    sha256:49f64e560981c47466038b9f481c860cfc04d47f1b4ae89df27c96a184765089RUN
    RUN |3 TELEMETRY_MODE=0 TELEMETRY_ENDPOINT=0 PIP_INDEX_URL=https://pypi.org/simple /bin/sh -c touch $SERVER_START_SCRIPT_PATH &&
  chmod a+rx $SERVER_START_SCRIPT_PATH &&
  cat > $SERVER_START_SCRIPT_PATH <<-EOF #!/usr/bin/env bash set -eu # SPDX-FileCopyrightText: Copyright (c) 2024 NVIDIA CORPORATION & AFFILIATES. All rights reserved. # SPDX-License-Identifier: LicenseRef-NvidiaProprietary start_server EOF # buildkit
    		09/09/2025 5:58 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    SERVER_START_SCRIPT_PATH=/opt/nim/start_server.sh
    		09/09/2025 5:58 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4USER
    nvs:1000
    		09/09/2025 5:58 AM UTC
    sha256:18a737e179740af18b483de0ad1d981d92cfb9bdc867e4a7c0fea58672ddbe67RUN
    TELEMETRY_MODE=0 TELEMETRY_ENDPOINT=0 PIP_INDEX_URL=https://pypi.org/simple chmod +x /usr/local/bin/list-model-profiles /usr/local/bin/nim_list_model_profiles
    		09/09/2025 5:58 AM UTC
    sha256:178cf1b0a05312fe82296b77adba92923c961f9eff31d9bd68ffa65507dd4204COPY
    ./list-model-profiles-overwrite /usr/local/bin/nim_list_model_profiles
    		09/09/2025 5:58 AM UTC
    sha256:d2b16e79333329eda504505dca3c5b4f57891d6306c4b4e7b2c0d94e676cbfe0COPY
    ./list-model-profiles-overwrite /usr/local/bin/list-model-profiles
    		09/09/2025 5:58 AM UTC
    sha256:7184ada51c8648191113c5120cccf3d643de6d19104c45f6bfd728145fb1d2caCOPY
    ./h20-throughput.yaml /opt/nim/nim-config-throughput.yaml
    		09/09/2025 5:58 AM UTC
    sha256:e3998630b469a69a6bbc5a7dd70a649a40279e586d7370ac3df9734e51212e8bCOPY
    ./nim_api_models.py /opt/nim/nim_api_models.py
    		09/09/2025 5:58 AM UTC
    sha256:de2462bca606a3140075d3f51d39b7641dd7399086dceefe283e312e1aa1ff0aCOPY
    ./completion_api_models.py /opt/nim/completion_api_models.py
    		09/09/2025 5:58 AM UTC
    ...