Llama-3.1-70b-instruct | NVIDIA NGC

Skip to main content

NVIDIA

Llama-3.1-70b-instruct

Container

NVIDIA

Llama-3.1-70b-instruct

This container houses the Llama-3.1-70B-Instruct, which is a multilingual large language model from the Meta Llama 3.1 collection of pretrained and instruction-tuned generative models.

Layer	Label		Created
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	CMD	`/opt/nim/start_server.sh`	09/16/2026 4:16 PM UTC
sha256:384191ebf203bbeb67edf904f36b8fc0e775e23d9e7fa334c417eb2724399be5	COPY	`--chown=nim:nim NOTICE_2 /opt/nim/NOTICE_2`	09/16/2026 4:16 PM UTC
sha256:e1af8fc8077b41008b9a5bb5d45fdbbe48e6d7114ce2764bc8f3957be100251d	COPY	`--chown=nim:nim NOTICE /opt/nim/NOTICE`	09/16/2026 4:16 PM UTC
sha256:4072a1647667117951b147c3ea723ee777cc9842ebc8edb33ba85e8aad9f4d8f	COPY	`--chown=nim:nim MODEL_LICENSE /opt/nim/MODEL_LICENSE`	09/16/2026 4:16 PM UTC
sha256:ae2b644fe13ef7a036fc7277fb2c227c7b9139db92846bd02bc86222719d3977	COPY	`--chown=nim:nim model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml`	09/16/2026 4:16 PM UTC
sha256:7642d962bd5d5025ad18b097413b3fef422400667e1ea5e6cd2cd159fa30c7b1	COPY	`--chown=nim:nim VERSION /opt/nim/VERSION`	09/16/2026 4:16 PM UTC
sha256:af14f4902284bd96ef7c4de5d1b03201c602f4b3bb860bfca62fad7d8892ce68	COPY	`--chown=nim:nim LICENSE /opt/nim/LICENSE`	09/16/2026 4:16 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`INFERENCE_MICROSERVICE_LLM_NIM_VERSION=2.0.13`	09/16/2026 4:16 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_SERVED_MODEL_NAME=meta/llama-3.1-70b-instruct`	09/16/2026 4:16 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_HTTP_API_PORT=8000`	09/16/2026 4:16 PM UTC