Llama-3.1-70b-instruct | NVIDIA NGC

NVIDIA

Llama-3.1-70b-instruct

Container

NVIDIA

Llama-3.1-70b-instruct

This container houses the Llama-3.1-70B-Instruct, which is a multilingual large language model from the Meta Llama 3.1 collection of pretrained and instruction-tuned generative models.

NVIDIA AI Enterprise Supported NVIDIA NIM

Layer	Label		Created
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	CMD	`/opt/nim/start_server.sh`	06/02/2026 4:17 PM UTC
sha256:1d119bfe0945ab87b9e6f56724decd5b234d90ec37b3ce785fe5f2c92323f936	COPY	`--chown=nim:nim NOTICE_2 /opt/nim/NOTICE_2`	06/02/2026 4:17 PM UTC
sha256:6c37cddd3cc69887c09d39f53474d52b27d6500be30dadddc76ee37f7fc7bb86	COPY	`--chown=nim:nim NOTICE /opt/nim/NOTICE`	06/02/2026 4:17 PM UTC
sha256:58cc215386f1f0927e4ff56c39a11343234ae36fa5d9883100f396a8e3494bd0	COPY	`--chown=nim:nim MODEL_LICENSE /opt/nim/MODEL_LICENSE`	06/02/2026 4:17 PM UTC
sha256:24996f5f46cad38326d57db1f7622989dfec65a47288a681030f4a983d248e5a	COPY	`--chown=nim:nim model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml`	06/02/2026 4:17 PM UTC
sha256:d89e86446b8f26786585e36543a613bb00d615b234ac22adc1eb6c32828ed31c	COPY	`--chown=nim:nim VERSION /opt/nim/VERSION`	06/02/2026 4:17 PM UTC
sha256:6153b45415d9d76e1c71e50fe47b8bc61d56fc531cfa2662ce57870702f02900	COPY	`--chown=nim:nim LICENSE /opt/nim/LICENSE`	06/02/2026 4:17 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`INFERENCE_MICROSERVICE_LLM_NIM_VERSION=2.0.6`	06/02/2026 4:17 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_SERVED_MODEL_NAME=meta/llama-3.1-70b-instruct`	06/02/2026 4:17 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_HTTP_API_PORT=8000`	06/02/2026 4:17 PM UTC