Llama-3.1-70b-instruct | NVIDIA NGC

NVIDIA

Llama-3.1-70b-instruct

Container

NVIDIA

Llama-3.1-70b-instruct

This container houses the Llama-3.1-70B-Instruct, which is a multilingual large language model from the Meta Llama 3.1 collection of pretrained and instruction-tuned generative models.

NVIDIA AI Enterprise Supported NVIDIA NIM

Layer	Label		Created
sha256:305cabb14b47c52136fd30b175b481d915c2f8cf05be6f37dea23059eb5feecb	COPY	`CONTAINER_LICENSE /opt/nim/LICENSE`	05/22/2025 1:18 AM UTC
sha256:a323afe8f4a3eb430749a738a26ebe74eb4e8ff1b4c979a25dda5e7f5aaabd50	COPY	`./NOTICES/* /opt/nim/`	05/22/2025 1:18 AM UTC
sha256:afe001ca7293b388cc30001c7dec6373f1b5356a8493aa4b67c51bcde8df291b	COPY	`banner.txt /opt/nvidia/entrypoint.d/31-model-license.txt`	05/22/2025 1:18 AM UTC
sha256:67b8d4c9cc26850f636a67c414cb0cf689f1211b12c586566b7f6c69c1d9fbef	COPY	`MODEL_LICENSE /opt/nim/MODEL_LICENSE`	05/22/2025 1:18 AM UTC
sha256:94dd5e7935ee47787e6bb774bfbdb050ce4d6c5311655e05bae5789f2d5a7dda	COPY	`model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml`	05/22/2025 1:18 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_HTTP_API_PORT=8000`	05/22/2025 1:18 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`INFERENCE_MICROSERVICE_LLM_NIM_VERSION=1.8.4`	05/22/2025 1:18 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_MODEL_NSPECT_ID=NSPECT-7S3F-QFG8`	05/22/2025 1:18 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_NSPECT_ID=NSPECT-X37N-G0O5`	05/22/2025 1:18 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_SERVED_MODEL_NAME=meta/llama-3.1-70b-instruct`	05/22/2025 1:18 AM UTC