NVIDIA
Llama-3.1-8B-Instruct
Container
NVIDIA
Llama-3.1-8B-Instruct

NVIDIA NIM for GPU accelerated Llama-3.1-8B-Instruct inference through OpenAI compatible APIs

  • LayerLabelCreated
    sha256:fa2e0b787aaa59555be345ee3d72cb6c7ac86e8294f04c1f218b290e7c6bde3eCOPY
    ./CONTAINER_LICENSE /opt/nim/LICENSE
    07/23/2024 9:29 AM UTC
    sha256:160151d7ae7f5bb82db8d9b9819cf9811f5c808e060f1a2d065317ba163db344COPY
    ./notices/* /opt/nim/
    07/23/2024 9:29 AM UTC
    sha256:659b21d9411d1e78aa7d5f5fec8b40a3e3445b7f7ec45037a59354578148f7cfCOPY
    ./banner.txt /opt/nvidia/entrypoint.d/31-model-license.txt
    07/23/2024 9:29 AM UTC
    sha256:dfedf8154b02d48d3039539124da1743aacf5bef561b511777024345e0168dbeCOPY
    ./MODEL_LICENSE /opt/nim/MODEL_LICENSE
    07/23/2024 9:29 AM UTC
    sha256:0372c9b9cb471626f4d41407dcb20116072f24ecd60e16d03779340fed40c807COPY
    ./model_manifest.yaml /etc/nim/config/model_manifest.yaml
    07/23/2024 9:29 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NIM_MODEL_NSPECT_ID=NSPECT-0DQP-LNLV
    07/23/2024 9:29 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NIM_NSPECT_ID=NSPECT-ZP6P-5LPY
    07/23/2024 9:29 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
    NIM_MODEL_NAME=nim/meta/llama-3_1-8b-instruct
    07/23/2024 9:29 AM UTC
    sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4USER
    1000
    07/23/2024 9:29 AM UTC
    sha256:7941e23182d81763cc790896fdcecab54924138e2788356cd071675988619ee3RUN
    NIM_MODEL_NAME=meta/llama-3_1-8b-instruct NIM_MODEL_NAME_ENV=nim/meta/llama-3_1-8b-instruct NIM_VERSION=1.1.0 NIM_CONTAINER_NSPECT_ID=NSPECT-ZP6P-5LPY NIM_MODEL_NSPECT_ID=NSPECT-0DQP-LNLV NIM_TYPE=llm NIM_USER_ID=1000 chown ${NIM_USER_ID}:${NIM_USER_ID} /.triton
    07/23/2024 9:29 AM UTC
    ...