Llama-3.2-1B-Instruct

NVIDIA

Container

NVIDIA

Llama-3.2-1B-Instruct

This container houses the Llama-3.2-1B-Instruct, a compact 1B parameter model from Meta AI fine-tuned for dialogue. It's designed to be highly efficient and accessible, making it adept at question answering, summarization, and other instructions.

NVIDIA NIM

Layer	Label		Created
sha256:83ac36bd8120eb2f61b161cec174acc544328eb86971ab735814da61a53c696b	COPY	`./CONTAINER_LICENSE /opt/nim/LICENSE`	02/26/2025 2:47 AM UTC
sha256:6ee097543bcdce738f389c3ae68e2e02d94bdbc983eb4a8b5d9b8aab4e457baa	COPY	`./NOTICES/* /opt/nim/`	02/26/2025 2:47 AM UTC
sha256:9436dcafdd663ba06b19554838036ecbb2737fd95009255cbf605b8d902a49f4	COPY	`./banner.txt /opt/nvidia/entrypoint.d/31-model-license.txt`	02/26/2025 2:47 AM UTC
sha256:ee91ce0d1deaf4f4d447ab280f02dcea08d5923a742d00b89fd106634907c6ef	COPY	`./MODEL_LICENSE /opt/nim/MODEL_LICENSE`	02/26/2025 2:47 AM UTC
sha256:2161b6dcaa2e5dca3a8e437d32627bce8b81a0336c448f3e96d80663df0379a4	COPY	`./model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml`	02/26/2025 2:47 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_MODEL_NAME=meta/llama-3.2-1b-instruct`	02/26/2025 2:47 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_HTTP_API_PORT=8000`	02/26/2025 2:47 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`INFERENCE_MICROSERVICE_LLM_NIM_VERSION=1.6.0`	02/26/2025 2:47 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_MODEL_NSPECT_ID=NSPECT-GLV0-62BM`	02/26/2025 2:47 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_NSPECT_ID=NSPECT-B16X-9RUJ`	02/26/2025 2:47 AM UTC