Qwen-2.5-7B-Instruct | NVIDIA NGC

NVIDIA

Qwen-2.5-7B-Instruct

Container

NVIDIA

Qwen-2.5-7B-Instruct

NVIDIA NIM for GPU accelerated Qwen-2.5-7B-Instruct inference through OpenAI compatible APIs

NVIDIA NIM

Layer	Label		Created
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_SERVED_MODEL_NAME=qwen/qwen-2.5-7b-instruct`	01/13/2025 7:11 AM UTC
sha256:1dfa5f70f87e638f6422ec56e311fec42b23cacceb327370c80a58380fbb52b6	COPY	`./CONTAINER_LICENSE /opt/nim/LICENSE`	01/13/2025 7:11 AM UTC
sha256:b6e7988132ff5a67d053822647e7cf4ec338ddd5a67f7db02b4475ef77e44105	COPY	`./NOTICES/* /opt/nim/`	01/13/2025 7:11 AM UTC
sha256:dd9528486aadef10f055b7f079e8a76cbf04d7237b006155481ec0ccbc7ff09a	COPY	`./banner.txt /opt/nvidia/entrypoint.d/31-model-license.txt`	01/13/2025 7:11 AM UTC
sha256:40c6cd9023a06e0b4ff408cc9f43548c7837919fdc29412381559c71e8b65695	COPY	`./MODEL_LICENSE /opt/nim/MODEL_LICENSE`	01/13/2025 7:11 AM UTC
sha256:23bd049fff5e551b00b520012d659533bf00b36756e79229668e2b614b456eef	COPY	`./model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml`	01/13/2025 7:11 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_HTTP_API_PORT=8000`	01/13/2025 7:11 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`INFERENCE_MICROSERVICE_LLM_NIM_VERSION=1.4.0`	01/13/2025 7:11 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_MODEL_NSPECT_ID=`	01/13/2025 7:11 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_NSPECT_ID=`	01/13/2025 7:11 AM UTC