Deepseek-R1-Distill-Qwen-32B | NVIDIA NGC

NVIDIA

Deepseek-R1-Distill-Qwen-32B

Container

NVIDIA

Deepseek-R1-Distill-Qwen-32B

NVIDIA NIM for GPU accelerated DeepSeek-R1-Distill-Qwen-32B inference through OpenAI compatible APIs

NVIDIA NIM

Layer	Label		Created
sha256:83654d5af10c360ffafab73a2df36010db01e4069ba7f548a49468ec0b835904	COPY	`./CONTAINER_LICENSE /opt/nim/LICENSE`	02/13/2025 4:24 PM UTC
sha256:829eeb9354ae1167b76d00349baeb092c27f2b573afa55acfe8d6b00767bc92d	COPY	`./NOTICES/* /opt/nim/`	02/13/2025 4:24 PM UTC
sha256:3de7b698e139eb527250ec743a911a7770bf737100d16e279bc60c85a0e61dee	COPY	`./banner.txt /opt/nvidia/entrypoint.d/31-model-license.txt`	02/13/2025 4:24 PM UTC
sha256:07cf2c24bc38a27a7b23f10f53a6a047211cfa1c96adcc8fab1d9b72a60896b3	COPY	`./MODEL_LICENSE /opt/nim/MODEL_LICENSE`	02/13/2025 4:24 PM UTC
sha256:e7d8de0b4b88a6e4de0f2c806522199be6d00829d79894b9793744c5beb46c0e	COPY	`./model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml`	02/13/2025 4:24 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_HTTP_API_PORT=8000`	02/13/2025 4:24 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`INFERENCE_MICROSERVICE_LLM_NIM_VERSION=1.5.0`	02/13/2025 4:24 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_MODEL_NSPECT_ID=`	02/13/2025 4:24 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_NSPECT_ID=`	02/13/2025 4:24 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_SERVED_MODEL_NAME=deepseek-ai/deepseek-r1-distill-qwen-32b`	02/13/2025 4:24 PM UTC