Llama-3.1-70b-instruct | NVIDIA NGC

NVIDIA

Llama-3.1-70b-instruct

Container

NVIDIA

Llama-3.1-70b-instruct

This container houses the Llama-3.1-70B-Instruct, which is a multilingual large language model from the Meta Llama 3.1 collection of pretrained and instruction-tuned generative models.

Layer	Label		Created
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	CMD	`/opt/nim/start_server.sh`	08/17/2026 3:03 PM UTC
sha256:add03ff2b7e76930d24097cc5c7725f181fa26c243b9e8adb791aded131a0359	COPY	`--chown=nim:nim NOTICE_2 /opt/nim/NOTICE_2`	08/17/2026 3:03 PM UTC
sha256:1d8e60ca56b18e5b9220ee38161a3d32e69ea8190861f674f0fd332f23b6afb8	COPY	`--chown=nim:nim NOTICE /opt/nim/NOTICE`	08/17/2026 3:03 PM UTC
sha256:0e91c865f629f3f6630d9b46ef8298786b069727568268b487bf22dc07bfb818	COPY	`--chown=nim:nim MODEL_LICENSE /opt/nim/MODEL_LICENSE`	08/17/2026 3:03 PM UTC
sha256:2813dafa8225b2d040937a9b2e702befa8cbf344fdfa50ce9eb9cb222bbce1e2	COPY	`--chown=nim:nim model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml`	08/17/2026 3:03 PM UTC
sha256:07fc32147011713a2dd776b28196f9f28ad1b31ea031b568de69cb39328414f4	COPY	`--chown=nim:nim VERSION /opt/nim/VERSION`	08/17/2026 3:03 PM UTC
sha256:c4b6b883a06012b2586dea359fe05b1e9233b392f15c38100d14e266ff0a4cd0	COPY	`--chown=nim:nim LICENSE /opt/nim/LICENSE`	08/17/2026 3:03 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`INFERENCE_MICROSERVICE_LLM_NIM_VERSION=2.0.11`	08/17/2026 3:03 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_SERVED_MODEL_NAME=meta/llama-3.1-70b-instruct`	08/17/2026 3:03 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_HTTP_API_PORT=8000`	08/17/2026 3:03 PM UTC