Llama-3.2-3B-Instruct | NVIDIA NGC

NVIDIA

Llama-3.2-3B-Instruct

Container

NVIDIA

Llama-3.2-3B-Instruct

NVIDIA NIM for GPU accelerated Llama-3.2-3B-Instruct inference through OpenAI compatible APIs

NVIDIA NIM

Layer	Label		Created
sha256:634e6ebc8251d96ed8796bbfffeb32a14c2c22e85cf8be1f50f34e0fb84bd30f	COPY	`CONTAINER_LICENSE /opt/nim/LICENSE`	05/15/2025 3:34 AM UTC
sha256:83f6376e4186393d1ae08c41572fe3624037b14a26d7de82601cd4a1c425c6b1	COPY	`./NOTICES/* /opt/nim/`	05/15/2025 3:34 AM UTC
sha256:914a70be91342805ea1ee744a05e851e8aac75de70ffae368fd4fcf81978dc3f	COPY	`banner.txt /opt/nvidia/entrypoint.d/31-model-license.txt`	05/15/2025 3:34 AM UTC
sha256:b58285096e1a5c4f4c075b8b79470e9fcabd0876805cb721efbde87ca767231c	COPY	`MODEL_LICENSE /opt/nim/MODEL_LICENSE`	05/15/2025 3:34 AM UTC
sha256:37e64179b41055d13793dfebd887ade64ead2ca749b331090c1af91f0ef2bc75	COPY	`model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml`	05/15/2025 3:34 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_HTTP_API_PORT=8000`	05/15/2025 3:34 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`INFERENCE_MICROSERVICE_LLM_NIM_VERSION=1.8.4`	05/15/2025 3:34 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_MODEL_NSPECT_ID=NSPECT-11Z8-118P`	05/15/2025 3:34 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_NSPECT_ID=NSPECT-R8KF-MSNB`	05/15/2025 3:34 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_SERVED_MODEL_NAME=meta/llama-3.2-3b-instruct`	05/15/2025 3:34 AM UTC