NVIDIA
Llama-3.2-1B-Instruct
Container
NVIDIA
Llama-3.2-1B-Instruct

This container houses the Llama-3.2-1B-Instruct, a compact 1B parameter model from Meta AI fine-tuned for dialogue. It's designed to be highly efficient and accessible, making it adept at question answering, summarization, and other instructions.

  • LayerLabelCreated
    sha256:9d01d52d561c6a0dde1c2ba41143bfc1567be6585475aa72892fe0d4bd7f742aCOPY
    ./CONTAINER_LICENSE /opt/nim/LICENSE
    03/07/2025 1:50 AM UTC
    sha256:8ccd4030586f98256e94d83e2041d330434387a5007dfbc58d50adc502f4f82aCOPY
    ./NOTICES/* /opt/nim/
    03/07/2025 1:50 AM UTC
    sha256:13edf73190c0572983e7eb1337f8711c6b029f9195b684a45c89f2bcb0b02fd2COPY
    ./banner.txt /opt/nvidia/entrypoint.d/31-model-license.txt
    03/07/2025 1:50 AM UTC
    sha256:f3449f5859363806e211f53b2f8fd9df8c5b4093358875b737fb53361f9668cfCOPY
    ./MODEL_LICENSE /opt/nim/MODEL_LICENSE
    03/07/2025 1:50 AM UTC
    sha256:2315542249fce9d59009bc4ca8b41d76f8a491ad48467d4925d2c493716e50cbCOPY
    ./model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml
    03/07/2025 1:50 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NIM_MODEL_NAME=meta/llama-3.2-1b-instruct
    03/07/2025 1:50 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NIM_HTTP_API_PORT=8000
    03/07/2025 1:50 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    INFERENCE_MICROSERVICE_LLM_NIM_VERSION=1.8.1
    03/07/2025 1:50 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NIM_MODEL_NSPECT_ID=NSPECT-GLV0-62BM
    03/07/2025 1:50 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NIM_NSPECT_ID=NSPECT-B16X-9RUJ
    03/07/2025 1:50 AM UTC
    ...