Llama-3.1-70b-instruct | NVIDIA NGC

NVIDIA

Llama-3.1-70b-instruct

Container

NVIDIA

Llama-3.1-70b-instruct

This container houses the Llama-3.1-70B-Instruct, which is a multilingual large language model from the Meta Llama 3.1 collection of pretrained and instruction-tuned generative models.

Layer	Label		Created
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	CMD	`/opt/nim/start_server.sh`	07/07/2026 12:49 PM UTC
sha256:e115d1d3b1f3f9e96508a513c9535b15441ca54900d65acf9f02cdba0813a814	COPY	`--chown=nim:nim NOTICE_2 /opt/nim/NOTICE_2`	07/07/2026 12:49 PM UTC
sha256:6827d26769e02f21732a75511e8626f08678d6c2d74eec585b73f29a43c6ad2d	COPY	`--chown=nim:nim NOTICE /opt/nim/NOTICE`	07/07/2026 12:49 PM UTC
sha256:80853c3747f1a3eb159b6bafaecf4e0f932563133ffe74e390651f17a149d4e9	COPY	`--chown=nim:nim MODEL_LICENSE /opt/nim/MODEL_LICENSE`	07/07/2026 12:49 PM UTC
sha256:1c65afcbaf6874283e4e1567141048412ea0d9acb62a9a35d1e07ddccbccf971	COPY	`--chown=nim:nim model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml`	07/07/2026 12:49 PM UTC
sha256:d96ca198ce29541c0759bff4ba7de581817e4a2faf00a733f8a615436094906e	COPY	`--chown=nim:nim VERSION /opt/nim/VERSION`	07/07/2026 12:49 PM UTC
sha256:7ac7f6a71761280cac3e45d36b47d646cb11b0abfef104864b6765a06e254a2c	COPY	`--chown=nim:nim LICENSE /opt/nim/LICENSE`	07/07/2026 12:49 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`INFERENCE_MICROSERVICE_LLM_NIM_VERSION=2.0.8`	07/07/2026 12:49 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_SERVED_MODEL_NAME=meta/llama-3.1-70b-instruct`	07/07/2026 12:49 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_HTTP_API_PORT=8000`	07/07/2026 12:49 PM UTC