NVIDIA
NVIDIA
Llama-3.1-8B-Instruct
Container
NVIDIA
NVIDIA
Llama-3.1-8B-Instruct

NVIDIA NIM for GPU accelerated Llama-3.1-8B-Instruct inference through OpenAI compatible APIs

LayerLabelCreated
sha256:fa2e0b787aaa59555be345ee3d72cb6c7ac86e8294f04c1f218b290e7c6bde3eCOPY
./CONTAINER_LICENSE /opt/nim/LICENSE
07/23/2024 9:29 AM UTC
sha256:160151d7ae7f5bb82db8d9b9819cf9811f5c808e060f1a2d065317ba163db344COPY
./notices/* /opt/nim/
07/23/2024 9:29 AM UTC
sha256:659b21d9411d1e78aa7d5f5fec8b40a3e3445b7f7ec45037a59354578148f7cfCOPY
./banner.txt /opt/nvidia/entrypoint.d/31-model-license.txt
07/23/2024 9:29 AM UTC
sha256:dfedf8154b02d48d3039539124da1743aacf5bef561b511777024345e0168dbeCOPY
./MODEL_LICENSE /opt/nim/MODEL_LICENSE
07/23/2024 9:29 AM UTC
sha256:0372c9b9cb471626f4d41407dcb20116072f24ecd60e16d03779340fed40c807COPY
./model_manifest.yaml /etc/nim/config/model_manifest.yaml
07/23/2024 9:29 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
NIM_MODEL_NSPECT_ID=NSPECT-0DQP-LNLV
07/23/2024 9:29 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
NIM_NSPECT_ID=NSPECT-ZP6P-5LPY
07/23/2024 9:29 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4ENV
NIM_MODEL_NAME=nim/meta/llama-3_1-8b-instruct
07/23/2024 9:29 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4USER
1000
07/23/2024 9:29 AM UTC
sha256:7941e23182d81763cc790896fdcecab54924138e2788356cd071675988619ee3RUN
NIM_MODEL_NAME=meta/llama-3_1-8b-instruct NIM_MODEL_NAME_ENV=nim/meta/llama-3_1-8b-instruct NIM_VERSION=1.1.0 NIM_CONTAINER_NSPECT_ID=NSPECT-ZP6P-5LPY NIM_MODEL_NSPECT_ID=NSPECT-0DQP-LNLV NIM_TYPE=llm NIM_USER_ID=1000 chown ${NIM_USER_ID}:${NIM_USER_ID} /.triton
07/23/2024 9:29 AM UTC
...