NVIDIA
Deepseek-R1-Distill-Qwen-14B
Container
NVIDIA
Deepseek-R1-Distill-Qwen-14B

NVIDIA NIM for GPU accelerated DeepSeek-R1-Distill-Qwen-14B inference through OpenAI compatible APIs

LayerLabelCreated
sha256:e19b9f00687a9589e6d3923529aa0c3f60c20a9dac2a0a943ffeb8bbcb9e21e9COPY
./CONTAINER_LICENSE /opt/nim/LICENSE
02/12/2025 12:48 PM UTC
sha256:f21367f20c33653d1eafb34a37e4c16a57f3add973befd5b3070b80ac6885dd0COPY
./NOTICES/* /opt/nim/
02/12/2025 12:48 PM UTC
sha256:6312194badcdc06197f24129bdb0fe2a9a322095c8382d4a086ec477a9ae1203COPY
./banner.txt /opt/nvidia/entrypoint.d/31-model-license.txt
02/12/2025 12:48 PM UTC
sha256:33bf220f2af32a7e8f801d681b00fe496c114dbe544b149710b8b933c198fe2fCOPY
./MODEL_LICENSE /opt/nim/MODEL_LICENSE
02/12/2025 12:48 PM UTC
sha256:ce48aa716d00b9e21f2b09b0fdd92d17c731a382e16ec9371fc190e25eee89a1COPY
./model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml
02/12/2025 12:48 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
NIM_HTTP_API_PORT=8000
02/12/2025 12:48 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
INFERENCE_MICROSERVICE_LLM_NIM_VERSION=1.6.0
02/12/2025 12:48 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
NIM_MODEL_NSPECT_ID=
02/12/2025 12:48 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
NIM_NSPECT_ID=
02/12/2025 12:48 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
NIM_SERVED_MODEL_NAME=deepseek-ai/deepseek-r1-distill-qwen-14b
02/12/2025 12:48 PM UTC
...