Llama-3.1-70b-instruct | NVIDIA NGC

NVIDIA

Llama-3.1-70b-instruct

Container

NVIDIA

Llama-3.1-70b-instruct

This container houses the Llama-3.1-70B-Instruct, which is a multilingual large language model from the Meta Llama 3.1 collection of pretrained and instruction-tuned generative models.

Layer	Label		Created
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	CMD	`/opt/nim/start_server.sh`	06/23/2026 9:11 PM UTC
sha256:4df3c1c04be5a8484b00ac3a90c2248baeccf1423507fd641206ad7915187735	COPY	`--chown=nim:nim NOTICE_2 /opt/nim/NOTICE_2`	06/23/2026 9:11 PM UTC
sha256:869ebfafc7f5931089c4d163c5489e89f740f0095c7e2d2f04917a371f7d996e	COPY	`--chown=nim:nim NOTICE /opt/nim/NOTICE`	06/23/2026 9:11 PM UTC
sha256:c367542bba016eea41896b7ed6f539e6def502eff0b0f516e5f4fa3c63d6f052	COPY	`--chown=nim:nim MODEL_LICENSE /opt/nim/MODEL_LICENSE`	06/23/2026 9:11 PM UTC
sha256:b7330306dca2efd23fc2a29a68da1dbd397fb116f4ba3a992ff9a8e9f84a2cfb	COPY	`--chown=nim:nim model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml`	06/23/2026 9:11 PM UTC
sha256:28af7456f76fe6c7e108c003b35cdddf418e63ad8287ba1e01f9c0981ffc4609	COPY	`--chown=nim:nim VERSION /opt/nim/VERSION`	06/23/2026 9:11 PM UTC
sha256:a2c81b149fff7732e41b14f7b7f24d7b872bb3333ac02021054f760812a64122	COPY	`--chown=nim:nim LICENSE /opt/nim/LICENSE`	06/23/2026 9:11 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`INFERENCE_MICROSERVICE_LLM_NIM_VERSION=2.0.7`	06/23/2026 9:11 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_SERVED_MODEL_NAME=meta/llama-3.1-70b-instruct`	06/23/2026 9:11 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_HTTP_API_PORT=8000`	06/23/2026 9:11 PM UTC