Llama-3.1-70b-instruct | NVIDIA NGC

NVIDIA

Llama-3.1-70b-instruct

Container

NVIDIA

Llama-3.1-70b-instruct

This container houses the Llama-3.1-70B-Instruct, which is a multilingual large language model from the Meta Llama 3.1 collection of pretrained and instruction-tuned generative models.

NVIDIA AI Enterprise Supported NVIDIA NIM

Layer	Label		Created
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	CMD	`/opt/nim/start_server.sh`	07/21/2026 11:52 AM UTC
sha256:ef024ce23e105001f662431c85bb33fc074d60962fd4b5f7dd68899370b72895	COPY	`--chown=nim:nim NOTICE_2 /opt/nim/NOTICE_2`	07/21/2026 11:52 AM UTC
sha256:1afe602617c0762fe0649f3fc90b00709f618195f4ae8507d9f9a16a745bdc51	COPY	`--chown=nim:nim NOTICE /opt/nim/NOTICE`	07/21/2026 11:52 AM UTC
sha256:eeb05afcf07ce2e3208d6a6799bf487aa4e1786008ba18cd80f52f92be56758e	COPY	`--chown=nim:nim MODEL_LICENSE /opt/nim/MODEL_LICENSE`	07/21/2026 11:52 AM UTC
sha256:ef9ba40e69281b0a07c931e3f00ba53384818b426920fdd9b26472253cde0284	COPY	`--chown=nim:nim model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml`	07/21/2026 11:52 AM UTC
sha256:b0cf5c4f52c5fdededd7c8b314506746f6163161ec2ea5e9752b9506f3103b25	COPY	`--chown=nim:nim VERSION /opt/nim/VERSION`	07/21/2026 11:52 AM UTC
sha256:861a142ec0e1734e78af0e49ca39f43e21f50463052d7f71cbd9d6ff23ff8cd9	COPY	`--chown=nim:nim LICENSE /opt/nim/LICENSE`	07/21/2026 11:52 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`INFERENCE_MICROSERVICE_LLM_NIM_VERSION=2.0.9`	07/21/2026 11:52 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_SERVED_MODEL_NAME=meta/llama-3.1-70b-instruct`	07/21/2026 11:52 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_HTTP_API_PORT=8000`	07/21/2026 11:52 AM UTC