NVIDIA
DeepSeek-V3.1
Container
NVIDIA
DeepSeek-V3.1

NVIDIA NIM for GPU accelerated DeepSeek-V3.1 inference through OpenAI compatible APIs

LayerLabelCreated
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4CMD
["/bin/bash" "-c" "$SERVER_START_SCRIPT_PATH"]
09/09/2025 5:58 AM UTC
sha256:49f64e560981c47466038b9f481c860cfc04d47f1b4ae89df27c96a184765089RUN
RUN |3 TELEMETRY_MODE=0 TELEMETRY_ENDPOINT=0 PIP_INDEX_URL=https://pypi.org/simple /bin/sh -c touch $SERVER_START_SCRIPT_PATH &&
  chmod a+rx $SERVER_START_SCRIPT_PATH &&
  cat > $SERVER_START_SCRIPT_PATH <<-EOF #!/usr/bin/env bash set -eu # SPDX-FileCopyrightText: Copyright (c) 2024 NVIDIA CORPORATION & AFFILIATES. All rights reserved. # SPDX-License-Identifier: LicenseRef-NvidiaProprietary start_server EOF # buildkit
09/09/2025 5:58 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
SERVER_START_SCRIPT_PATH=/opt/nim/start_server.sh
09/09/2025 5:58 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4USER
nvs:1000
09/09/2025 5:58 AM UTC
sha256:18a737e179740af18b483de0ad1d981d92cfb9bdc867e4a7c0fea58672ddbe67RUN
TELEMETRY_MODE=0 TELEMETRY_ENDPOINT=0 PIP_INDEX_URL=https://pypi.org/simple chmod +x /usr/local/bin/list-model-profiles /usr/local/bin/nim_list_model_profiles
09/09/2025 5:58 AM UTC
sha256:178cf1b0a05312fe82296b77adba92923c961f9eff31d9bd68ffa65507dd4204COPY
./list-model-profiles-overwrite /usr/local/bin/nim_list_model_profiles
09/09/2025 5:58 AM UTC
sha256:d2b16e79333329eda504505dca3c5b4f57891d6306c4b4e7b2c0d94e676cbfe0COPY
./list-model-profiles-overwrite /usr/local/bin/list-model-profiles
09/09/2025 5:58 AM UTC
sha256:7184ada51c8648191113c5120cccf3d643de6d19104c45f6bfd728145fb1d2caCOPY
./h20-throughput.yaml /opt/nim/nim-config-throughput.yaml
09/09/2025 5:58 AM UTC
sha256:e3998630b469a69a6bbc5a7dd70a649a40279e586d7370ac3df9734e51212e8bCOPY
./nim_api_models.py /opt/nim/nim_api_models.py
09/09/2025 5:58 AM UTC
sha256:de2462bca606a3140075d3f51d39b7641dd7399086dceefe283e312e1aa1ff0aCOPY
./completion_api_models.py /opt/nim/completion_api_models.py
09/09/2025 5:58 AM UTC
...

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.