Llama-3.1-8B-Instruct | NVIDIA NGC

NVIDIA

Llama-3.1-8B-Instruct

Container

NVIDIA

Llama-3.1-8B-Instruct

NVIDIA NIM for GPU accelerated Llama-3.1-8B-Instruct inference through OpenAI compatible APIs

NVIDIA AI Enterprise Supported NVIDIA NIM

Layer	Label		Created
sha256:fa2e0b787aaa59555be345ee3d72cb6c7ac86e8294f04c1f218b290e7c6bde3e	COPY	`./CONTAINER_LICENSE /opt/nim/LICENSE`	07/23/2024 9:29 AM UTC
sha256:160151d7ae7f5bb82db8d9b9819cf9811f5c808e060f1a2d065317ba163db344	COPY	`./notices/* /opt/nim/`	07/23/2024 9:29 AM UTC
sha256:659b21d9411d1e78aa7d5f5fec8b40a3e3445b7f7ec45037a59354578148f7cf	COPY	`./banner.txt /opt/nvidia/entrypoint.d/31-model-license.txt`	07/23/2024 9:29 AM UTC
sha256:dfedf8154b02d48d3039539124da1743aacf5bef561b511777024345e0168dbe	COPY	`./MODEL_LICENSE /opt/nim/MODEL_LICENSE`	07/23/2024 9:29 AM UTC
sha256:0372c9b9cb471626f4d41407dcb20116072f24ecd60e16d03779340fed40c807	COPY	`./model_manifest.yaml /etc/nim/config/model_manifest.yaml`	07/23/2024 9:29 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_MODEL_NSPECT_ID=NSPECT-0DQP-LNLV`	07/23/2024 9:29 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_NSPECT_ID=NSPECT-ZP6P-5LPY`	07/23/2024 9:29 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_MODEL_NAME=nim/meta/llama-3_1-8b-instruct`	07/23/2024 9:29 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	USER	`1000`	07/23/2024 9:29 AM UTC
sha256:7941e23182d81763cc790896fdcecab54924138e2788356cd071675988619ee3	RUN	`NIM_MODEL_NAME=meta/llama-3_1-8b-instruct NIM_MODEL_NAME_ENV=nim/meta/llama-3_1-8b-instruct NIM_VERSION=1.1.0 NIM_CONTAINER_NSPECT_ID=NSPECT-ZP6P-5LPY NIM_MODEL_NSPECT_ID=NSPECT-0DQP-LNLV NIM_TYPE=llm NIM_USER_ID=1000 chown ${NIM_USER_ID}:${NIM_USER_ID} /.triton`	07/23/2024 9:29 AM UTC