Llama-3.1-70b-instruct | NVIDIA NGC

NVIDIA

Llama-3.1-70b-instruct

Container

NVIDIA

Llama-3.1-70b-instruct

This container houses the Llama-3.1-70B-Instruct, which is a multilingual large language model from the Meta Llama 3.1 collection of pretrained and instruction-tuned generative models.

Layer	Label		Created
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	CMD	`/opt/nim/start_server.sh`	04/20/2026 7:40 PM UTC
sha256:9088623f06525c00c665b16e6951959f5eb915260a7a3c42b2aec2d20faa2eb9	COPY	`--chown=nim:nim NOTICE_2 /opt/nim/NOTICE_2`	04/20/2026 7:40 PM UTC
sha256:f847e17d25e027557a31e58ae8c234daae67c67c364b691b0f895ae6dd3066d8	COPY	`--chown=nim:nim NOTICE /opt/nim/NOTICE`	04/20/2026 7:40 PM UTC
sha256:a5d8757461380bdb2451042003891ca20be27ef66f24c3213b2b0baf5d7d1b68	COPY	`--chown=nim:nim MODEL_LICENSE /opt/nim/MODEL_LICENSE`	04/20/2026 7:40 PM UTC
sha256:928fd2ebe5206cb62c4660de8eabb849b330c1ee4d2a237636b841ae0862b2f4	COPY	`--chown=nim:nim model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml`	04/20/2026 7:40 PM UTC
sha256:cd9a279c9edd698a8c3f92158f0c53ce99bf0591b9a1ea42e60712d54458d574	COPY	`--chown=nim:nim VERSION /opt/nim/VERSION`	04/20/2026 7:40 PM UTC
sha256:9657454fa95694700701d5aafb33fc3caef0a58e4460acddf6e3737f61e4a40c	COPY	`--chown=nim:nim LICENSE /opt/nim/LICENSE`	04/20/2026 7:40 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`INFERENCE_MICROSERVICE_LLM_NIM_VERSION=2.0.3`	04/20/2026 7:40 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_SERVED_MODEL_NAME=meta/llama-3.1-70b-instruct`	04/20/2026 7:40 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_HTTP_API_PORT=8000`	04/20/2026 7:40 PM UTC