Llama-3.2-3B-Instruct | NVIDIA NGC

NVIDIA

Llama-3.2-3B-Instruct

Container

NVIDIA

Llama-3.2-3B-Instruct

NVIDIA NIM for GPU accelerated Llama-3.2-3B-Instruct inference through OpenAI compatible APIs

NVIDIA NIM

Layer	Label		Created
sha256:d645723199f44fb4209a0ad183cc6028429c25f5b8c11eaccdc10e6eead2e2d6	COPY	`CONTAINER_LICENSE /opt/nim/LICENSE`	03/24/2025 4:53 AM UTC
sha256:705f3d5296f8365c0ff4e7572366a7de56deba77780b6b9e3f9b842cfc301d31	COPY	`./notices/* /opt/nim/`	03/24/2025 4:53 AM UTC
sha256:59dfbacf54d3001d4c7930cda3d26e8a9de9062a4bf5ae0ca526d558b533f4c0	COPY	`banner.txt /opt/nvidia/entrypoint.d/31-model-license.txt`	03/24/2025 4:53 AM UTC
sha256:8557960ee9103ac1922b89280dca97719d44d3fccb59989d710457a800e2d3dc	COPY	`CONTAINER_COPYRIGHT /opt/nvidia/entrypoint.d/15-container-copyright.txt`	03/24/2025 4:53 AM UTC
sha256:654fb74e1e6d21db7149d4ee96087622e388ad681a2cafe6e7dba759eec6f427	COPY	`MODEL_LICENSE /opt/nim/MODEL_LICENSE`	03/24/2025 4:53 AM UTC
sha256:04ca59deb02f13ca0f131a2292a99fa6607816d643f1ef905cff60b93fe90dd7	COPY	`model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml`	03/24/2025 4:53 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_HTTP_API_PORT=8000`	03/24/2025 4:53 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`INFERENCE_MICROSERVICE_LLM_NIM_VERSION=1.8.3`	03/24/2025 4:53 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_MODEL_NSPECT_ID=NSPECT-11Z8-118P`	03/24/2025 4:53 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_NSPECT_ID=NSPECT-R8KF-MSNB`	03/24/2025 4:53 AM UTC