Llama-3.1-70b-instruct | NVIDIA NGC

NVIDIA

Llama-3.1-70b-instruct

Container

NVIDIA

Llama-3.1-70b-instruct

This container houses the Llama-3.1-70B-Instruct, which is a multilingual large language model from the Meta Llama 3.1 collection of pretrained and instruction-tuned generative models.

Layer	Label		Created
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	CMD	`/opt/nim/start_server.sh`	04/09/2026 10:41 PM UTC
sha256:7fcb30a495dd6d88f63f96f2aaf8fdb399c4c5864d3dd3f7e59f7a2663a0bcc5	COPY	`--chown=nim:nim NOTICE_4 /opt/nim/NOTICE_4`	04/09/2026 10:41 PM UTC
sha256:b93cf7105752d1fde9fe2d3d8df2d9a19d301e93bba6d44078ac5f2e7a9f6f60	COPY	`--chown=nim:nim NOTICE_3 /opt/nim/NOTICE_3`	04/09/2026 10:16 PM UTC
sha256:c443656d77b161fba0cbd25750a3307d884e2cc9ab015fc327447549311a59fa	COPY	`--chown=nim:nim MODEL_LICENSE /opt/nim/MODEL_LICENSE`	04/09/2026 10:16 PM UTC
sha256:f7186a00653ccc17302b13e3591a3f090aa65e25ec6530a01e67e4227f587541	COPY	`--chown=nim:nim model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml`	04/09/2026 10:16 PM UTC
sha256:e8323433c723160839a632c733fe0afcdb7c0379ec62726baa714644dae627f3	COPY	`--chown=nim:nim VERSION /opt/nim/VERSION`	04/09/2026 10:16 PM UTC
sha256:fa876e56787e1fb1d49f7bb6b41361d94f1c07ce8c047c4b87c91d9c05183ddc	COPY	`--chown=nim:nim LICENSE /opt/nim/LICENSE`	04/09/2026 10:16 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`INFERENCE_MICROSERVICE_LLM_NIM_VERSION=2.0.2`	04/09/2026 10:16 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_SERVED_MODEL_NAME=meta/llama-3.1-70b-instruct`	04/09/2026 10:16 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_HTTP_API_PORT=8000`	04/09/2026 10:16 PM UTC