Llama-3.2-3B-Instruct | NVIDIA NGC

NVIDIA

Llama-3.2-3B-Instruct

Container

NVIDIA

Llama-3.2-3B-Instruct

NVIDIA NIM for GPU accelerated Llama-3.2-3B-Instruct inference through OpenAI compatible APIs

NVIDIA NIM

Layer	Label		Created
sha256:ba93ee0a24e72e69078b5deef1105fedc89493459593f7af3f07fa8a7aa0d6d5	COPY	`CONTAINER_LICENSE /opt/nim/LICENSE`	04/30/2025 4:48 PM UTC
sha256:35e64252449d62b36d8865d82c7e1e3def83ecce5a4f6f10788dc1f0c2354004	COPY	`./NOTICES/* /opt/nim/`	04/30/2025 4:48 PM UTC
sha256:5d555aa1786e004047a14605931585449e6b05b16da237e059334dba4e5b5c99	COPY	`banner.txt /opt/nvidia/entrypoint.d/31-model-license.txt`	04/30/2025 4:48 PM UTC
sha256:2db7f3c7aa7a0c4809baaa14cbc55dc047efe1320d808db2239b0a5d1a966ea9	COPY	`MODEL_LICENSE /opt/nim/MODEL_LICENSE`	04/30/2025 4:48 PM UTC
sha256:fea9c856d8b532d732344cc17445c89317d31072b84140be7d9856c0641b76be	COPY	`model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml`	04/30/2025 4:48 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_HTTP_API_PORT=8000`	04/30/2025 4:48 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`INFERENCE_MICROSERVICE_LLM_NIM_VERSION=1.8.4`	04/30/2025 4:48 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_MODEL_NSPECT_ID=NSPECT-11Z8-118P`	04/30/2025 4:48 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_NSPECT_ID=NSPECT-R8KF-MSNB`	04/30/2025 4:48 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_SERVED_MODEL_NAME=meta/llama-3.2-3b-instruct`	04/30/2025 4:48 PM UTC