Llama-3.1-70b-instruct | NVIDIA NGC

NVIDIA

Llama-3.1-70b-instruct

Container

NVIDIA

Llama-3.1-70b-instruct

This container houses the Llama-3.1-70B-Instruct, which is a multilingual large language model from the Meta Llama 3.1 collection of pretrained and instruction-tuned generative models.

NVIDIA AI Enterprise Supported NVIDIA NIM

Layer	Label		Created
sha256:cb94e02521915d917d85e7c355d27b71bb7f17277d127acfb997f9c9f68443f0	COPY	`./CONTAINER_LICENSE /opt/nim/LICENSE`	11/21/2024 4:20 AM UTC
sha256:02b95f37c0118dabadd27697a6e2a118e4d1105aa0c5e63c729f5658a71164cd	COPY	`./notices/* /opt/nim/`	11/21/2024 4:20 AM UTC
sha256:14044245a773d51bef8c47ca42aa215eb336ea301faf6a7afb62e682c92a2cdf	COPY	`./banner.txt /opt/nvidia/entrypoint.d/31-model-license.txt`	11/21/2024 4:20 AM UTC
sha256:c6253d0000017da5ddf37e90ab1d88b78f9e85c9ada93059958acb72332075b1	COPY	`./MODEL_LICENSE /opt/nim/MODEL_LICENSE`	11/21/2024 4:20 AM UTC
sha256:5d02acef57c2c7782f0627f338e2e6c60cc690124181d869b75423380437d753	COPY	`./model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml`	11/21/2024 4:20 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_HTTP_API_PORT=8000`	11/21/2024 4:20 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`INFERENCE_MICROSERVICE_LLM_NIM_VERSION=1.3.0`	11/21/2024 4:20 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_MODEL_NSPECT_ID=NSPECT-7S3F-QFG8`	11/21/2024 4:20 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_NSPECT_ID=NSPECT-X37N-G0O5`	11/21/2024 4:20 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_SERVED_MODEL_NAME=meta/llama-3.1-70b-instruct`	11/21/2024 4:20 AM UTC