Llama-3.1-70b-instruct | NVIDIA NGC

NVIDIA

Llama-3.1-70b-instruct

Container

NVIDIA

Llama-3.1-70b-instruct

This container houses the Llama-3.1-70B-Instruct, which is a multilingual large language model from the Meta Llama 3.1 collection of pretrained and instruction-tuned generative models.

NVIDIA AI Enterprise Supported NVIDIA NIM

Layer	Label		Created
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	CMD	`/opt/nim/start_server.sh`	05/06/2026 12:53 PM UTC
sha256:f9be7f0c8d7f76095758cd977614592b2e93c499f28f501d4ac0b5cd7d85668b	COPY	`--chown=nim:nim NOTICE_2 /opt/nim/NOTICE_2`	05/06/2026 12:53 PM UTC
sha256:49bb0e965feb30a147b744b45af14c3d6e5aafd1e26e4a3d21ac8e4b48f41bfc	COPY	`--chown=nim:nim NOTICE /opt/nim/NOTICE`	05/06/2026 12:53 PM UTC
sha256:952731b855121de0d4eff2da3091edfafdf1f3d20646c3e5e8022dd675805116	COPY	`--chown=nim:nim MODEL_LICENSE /opt/nim/MODEL_LICENSE`	05/06/2026 12:53 PM UTC
sha256:fb3850b59d1c9fc191a6f5be0e8b22c82cee5958e7b41c5f943e46ee7bee4ce2	COPY	`--chown=nim:nim model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml`	05/06/2026 12:53 PM UTC
sha256:07cb90b103ec7ca2f6c1540e2226339348400e252de159989ed50ca3ce498a08	COPY	`--chown=nim:nim VERSION /opt/nim/VERSION`	05/06/2026 12:53 PM UTC
sha256:79c2e2c6b786c13bb92c396a8b7d265b4fcb8aa84f62eeff462aee09161ac912	COPY	`--chown=nim:nim LICENSE /opt/nim/LICENSE`	05/06/2026 12:53 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`INFERENCE_MICROSERVICE_LLM_NIM_VERSION=2.0.4`	05/06/2026 12:53 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_SERVED_MODEL_NAME=meta/llama-3.1-70b-instruct`	05/06/2026 12:53 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_HTTP_API_PORT=8000`	05/06/2026 12:53 PM UTC