Llama-3.1-70b-instruct | NVIDIA NGC

NVIDIA

Llama-3.1-70b-instruct

Container

NVIDIA

Llama-3.1-70b-instruct

This container houses the Llama-3.1-70B-Instruct, which is a multilingual large language model from the Meta Llama 3.1 collection of pretrained and instruction-tuned generative models.

NVIDIA AI Enterprise Supported NVIDIA NIM

Layer	Label		Created
sha256:9f2e637704171fd3be99443d5a636ee507afb6829d3967444f52b2d29f43c9b3	COPY	`./CONTAINER_LICENSE /opt/nim/LICENSE`	09/19/2024 2:06 AM UTC
sha256:23206310d60add44e8c7c9ce16d64ba3054bf4438efd14659680e8cb613029a3	COPY	`./notices/* /opt/nim/`	09/19/2024 2:06 AM UTC
sha256:bb19df910a21700cddb4e6e22d3c3868a74c562ab80f0bfd640c73aa6138480e	COPY	`./banner.txt /opt/nvidia/entrypoint.d/31-model-license.txt`	09/19/2024 2:06 AM UTC
sha256:262746fb9146fb51169d6d44a7d92b10abbb7034e7e4938c796cb8a93f3c6183	COPY	`./MODEL_LICENSE /opt/nim/MODEL_LICENSE`	09/19/2024 2:06 AM UTC
sha256:eecda1af886b1175b443aae91401d0d91a48f9822df16e9a41eb14c96c0ec8c8	COPY	`./model_manifest.yaml /etc/nim/config/model_manifest.yaml`	09/19/2024 2:06 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_HTTP_API_PORT=8000`	09/19/2024 2:06 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`INFERENCE_MICROSERVICE_LLM_NIM_VERSION=1.2.0`	09/19/2024 2:06 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_MODEL_NSPECT_ID=NSPECT-7S3F-QFG8`	09/19/2024 2:06 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_NSPECT_ID=NSPECT-X37N-G0O5`	09/19/2024 2:06 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_SERVED_MODEL_NAME=meta/llama-3.1-70b-instruct`	09/19/2024 2:06 AM UTC