DeepSeek-R1 | NVIDIA NGC

NVIDIA

DeepSeek-R1

Container

NVIDIA

DeepSeek-R1

NVIDIA NIM for GPU accelerated DeepSeek-R1 inference through OpenAI compatible APIs

NVIDIA NIM

Layer	Label		Created
sha256:ae574af7e5df65fddac6ed2987381f37243152e53bf3f5907efae7a8c54b7ff6	COPY	`./CONTAINER_LICENSE /opt/nim/LICENSE`	04/30/2025 4:19 AM UTC
sha256:478fc2df21202ec067c258e87a81b51c48a7ac3258738a4eeceb05024fa37b9c	COPY	`./shm_broadcast /opt/nim/llm/.venv/lib/python3.12/site-packages/vllm/distributed/device_communicators/shm_broadcast.py`	04/30/2025 4:19 AM UTC
sha256:3ba787046f453fc735e5a91746928b1efa709deed592e169ae8fadb7b0300a49	COPY	`./NOTICES/* /opt/nim/`	04/30/2025 4:19 AM UTC
sha256:130ad00c0e95e7deef9a6af6999faef73ba7a973eef22b6a0fc4ac279e1be75c	COPY	`./banner.txt /opt/nvidia/entrypoint.d/31-model-license.txt`	04/30/2025 4:19 AM UTC
sha256:837c3f7a1992766f1a292cd7ab1369c621f5a0029bdf4f7de559bba03a365b00	COPY	`./MODEL_LICENSE /opt/nim/MODEL_LICENSE`	04/30/2025 4:19 AM UTC
sha256:260dc14886c270f21abcd29d8b0db1e5a8772180a0573c1b0255d3d3b676ade7	COPY	`./model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml`	04/30/2025 4:19 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`_NIM_FORCE_TRUST_REMOTE_CODE=1`	04/30/2025 4:19 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_MODEL_NAME=deepseek-ai/deepseek-r1`	04/30/2025 4:19 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_HTTP_API_PORT=8000`	04/30/2025 4:19 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`INFERENCE_MICROSERVICE_LLM_NIM_VERSION=1.7`	04/30/2025 4:19 AM UTC