DeepSeek-R1 | NVIDIA NGC

NVIDIA

DeepSeek-R1

Container

NVIDIA

DeepSeek-R1

NVIDIA NIM for GPU accelerated DeepSeek-R1 inference through OpenAI compatible APIs

NVIDIA NIM

Layer	Label		Created
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENTRYPOINT	`["/bin/bash" "-c" "$SERVER_START_SCRIPT_PATH"]`	01/31/2025 6:32 PM UTC
sha256:4d9cdbbe40cadbf0d50202ff108e73be3ebb151abd6c4dfce586fa89c75ef095	RUN	`RUN /bin/sh -c touch $SERVER_START_SCRIPT_PATH && chmod a+rx $SERVER_START_SCRIPT_PATH && cat > $SERVER_START_SCRIPT_PATH <<-EOF #!/usr/bin/env bash set -eu # SPDX-FileCopyrightText: Copyright (c) 2024 NVIDIA CORPORATION & AFFILIATES. All rights reserved. # SPDX-License-Identifier: LicenseRef-NvidiaProprietary start_server EOF # buildkit`	01/31/2025 6:32 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`SERVER_START_SCRIPT_PATH=/opt/nim/start_server.sh`	01/31/2025 6:32 PM UTC
sha256:35774d43dad03897d69373bd9ab71e23ebb34c2322f3a44c9da77869d692e084	COPY	`model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml`	01/31/2025 6:32 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	USER	`nvs:1000`	01/31/2025 6:32 PM UTC
sha256:7c45ddb80b75595c88401ff53add7eb2670f31bb304dc37dcbae13002aada65d	RUN	`groupadd --gid 1000 --non-unique nvs && useradd --create-home --shell /usr/sbin/nologin --uid 1000 --non-unique --gid 1000 nvs && chown 1000.1000 $NIM_DIR_PATH`	01/31/2025 6:32 PM UTC
sha256:15d0a420a9a5ccaf12ffdaa80edad5d8f5aa4e3a9209f948b0857cdf8386642a	COPY	`./banner.txt /opt/nim`	01/31/2025 6:32 PM UTC
sha256:0f8e2f8f2e703f2151ac1d44bb6633fc31f22afca94730b2c14731d39da21bae	COPY	`MODEL_LICENSE /opt/nim`	01/31/2025 6:32 PM UTC
sha256:02aa100681e406d6e3faafc273b9ec5dc5be1b37d8ae0143fa8f3e8185ed98a0	COPY	`./LICENSE ./VERSION /opt/nim`	01/31/2025 6:32 PM UTC
sha256:db6cfc443cd6cfbc204e0850b0749e9bb3d129ecfe41e164bc6c25361f0be3cc	COPY	`./inference.py /opt/nim`	01/31/2025 6:32 PM UTC