Deepseek-R1-Distill-Qwen-7B

NVIDIA

Container

NVIDIA

Deepseek-R1-Distill-Qwen-7B

NVIDIA NIM for GPU accelerated DeepSeek-R1-Distill-Qwen-7B inference through OpenAI compatible APIs. This distill model is fine-tuned based on open-source Qwen2.5-Math-7B model, using samples generated by DeepSeek-R1.

NVIDIA NIM

Layer	Label		Created
sha256:a196a9caa4c215364a500f4e667909861983a41a42f1438d3082e0446ba71264	COPY	`./CONTAINER_LICENSE /opt/nim/LICENSE`	03/04/2025 10:30 AM UTC
sha256:c4a3d2d06ef2d1ed7bc38cb9a90ca1c4eddee5addbb5d51d0786869b3dbcdd57	COPY	`./NOTICES/* /opt/nim/`	03/04/2025 10:30 AM UTC
sha256:33b00784002d63174ed4254813d7a032df68967ca30479481931e030e27a9476	COPY	`./banner.txt /opt/nvidia/entrypoint.d/31-model-license.txt`	03/04/2025 10:30 AM UTC
sha256:31592e50839aa5b51dae791b9ad4743c042a337d28c643828dbd8cf9b553e155	COPY	`./MODEL_LICENSE /opt/nim/MODEL_LICENSE`	03/04/2025 10:30 AM UTC
sha256:6f91044be46e2ef91f5f8c5bb0adcffdc6b56f57f56781840c1ebd0f0cdd2844	COPY	`./model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml`	03/04/2025 10:30 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_HTTP_API_PORT=8000`	03/04/2025 10:30 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`INFERENCE_MICROSERVICE_LLM_NIM_VERSION=1.1.0`	03/04/2025 10:30 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_MODEL_NSPECT_ID=NSPECT-VQQE-TUUN`	03/04/2025 10:30 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_NSPECT_ID=NSPECT-GDRQ-XJ45`	03/04/2025 10:30 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_SERVED_MODEL_NAME=deepseek-ai/deepseek-r1-distill-qwen-7b`	03/04/2025 10:30 AM UTC