Deepseek-R1-Distill-Qwen-32B | NVIDIA NGC

NVIDIA

Deepseek-R1-Distill-Qwen-32B

Container

NVIDIA

Deepseek-R1-Distill-Qwen-32B

NVIDIA NIM for GPU accelerated DeepSeek-R1-Distill-Qwen-32B inference through OpenAI compatible APIs

NVIDIA NIM

Layer	Label		Created
sha256:1470fa5db257dbba1bb31ccf7f9dde6d8fac88a4c1ea184fbe34a7f2211d6099	COPY	`./CONTAINER_LICENSE /opt/nim/LICENSE`	03/19/2025 10:38 AM UTC
sha256:9572f169fbd64174a106116b19cd083a0fe1570cdd3bf2e05c4b1622c5e260db	COPY	`./utils.py /opt/nim/llm/nim_llm_sdk/trtllm/utils.py`	03/19/2025 10:38 AM UTC
sha256:b518d5e2c3fe2430ba2f9c4e957af317a67493b048338f2ca4e87208068033da	COPY	`./NOTICES/* /opt/nim/`	03/19/2025 10:38 AM UTC
sha256:59a65fad822afe70a8559b72bde69cd9b6133f07bbbd47ef431ea1d9edff8003	COPY	`./banner.txt /opt/nvidia/entrypoint.d/31-model-license.txt`	03/19/2025 10:38 AM UTC
sha256:2ae07b38fee78720b7dde1117db96bed71f1eb7199384600867a4686f57ce846	COPY	`./MODEL_LICENSE /opt/nim/MODEL_LICENSE`	03/19/2025 10:38 AM UTC
sha256:cb83674e206a38fd94f0fe21c0d5eb229d777fb648d1407a2cbe69045bb2e08e	COPY	`./model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml`	03/19/2025 10:38 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_MAX_MODEL_LEN=32768`	03/19/2025 10:38 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_HTTP_API_PORT=8000`	03/19/2025 10:38 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`INFERENCE_MICROSERVICE_LLM_NIM_VERSION=1.8.0`	03/19/2025 10:38 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_MODEL_NSPECT_ID=`	03/19/2025 10:38 AM UTC