Llama-3.1-70b-instruct | NVIDIA NGC

NVIDIA

Llama-3.1-70b-instruct

Container

NVIDIA

Llama-3.1-70b-instruct

This container houses the Llama-3.1-70B-Instruct, which is a multilingual large language model from the Meta Llama 3.1 collection of pretrained and instruction-tuned generative models.

NVIDIA AI Enterprise Supported NVIDIA NIM

Layer	Label		Created
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	CMD	`/opt/nim/start_server.sh`	05/19/2026 1:59 AM UTC
sha256:cc16a507accbe62dbbcf9d01f5f794830af7407dacd8d558473c5a7cf05dc806	COPY	`--chown=nim:nim NOTICE_2 /opt/nim/NOTICE_2`	05/19/2026 1:59 AM UTC
sha256:7915154b900b9b6fc87e3460551c6a495ca1739b9b45b96517032bac9c23483d	COPY	`--chown=nim:nim NOTICE /opt/nim/NOTICE`	05/19/2026 1:59 AM UTC
sha256:b839e07147b30b6603f672d9cea6f8386753aea0b24f38b0e52dd1d928e8d2d3	COPY	`--chown=nim:nim MODEL_LICENSE /opt/nim/MODEL_LICENSE`	05/19/2026 1:59 AM UTC
sha256:5cf941ba4631888f1c42a19526bb018b05440fcb4f6bf740c8a63ebd417e90a5	COPY	`--chown=nim:nim model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml`	05/19/2026 1:59 AM UTC
sha256:b0de51144a4a70d9f14f5c888bc29536782e6ae90e3c6d6919a06e87029ffd13	COPY	`--chown=nim:nim VERSION /opt/nim/VERSION`	05/19/2026 1:59 AM UTC
sha256:7c622300292323e2e723a847476c737615152d4745daa833bb3ed2b990e89965	COPY	`--chown=nim:nim LICENSE /opt/nim/LICENSE`	05/19/2026 1:59 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`INFERENCE_MICROSERVICE_LLM_NIM_VERSION=2.0.5`	05/19/2026 1:59 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_SERVED_MODEL_NAME=meta/llama-3.1-70b-instruct`	05/19/2026 1:59 AM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_HTTP_API_PORT=8000`	05/19/2026 1:59 AM UTC