Llama-3.1-70b-instruct | NVIDIA NGC

NVIDIA

Llama-3.1-70b-instruct

Container

NVIDIA

Llama-3.1-70b-instruct

This container houses the Llama-3.1-70B-Instruct, which is a multilingual large language model from the Meta Llama 3.1 collection of pretrained and instruction-tuned generative models.

NVIDIA AI Enterprise Supported NVIDIA NIM

Layer	Label		Created
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	CMD	`/opt/nim/start_server.sh`	03/25/2026 12:00 PM UTC
sha256:257e00d94ce91e20a9f2c2fbf374ebb3ff746f2c7fa09965dded779c9823f3fb	COPY	`--chown=nim:nim NOTICE_1 /opt/nim/NOTICE_1`	03/25/2026 12:00 PM UTC
sha256:c5f247f08acd6784c89b2a9909bc3949e0ba94aedcd8eea64ca20516c9b8d12b	COPY	`--chown=nim:nim NOTICE_2 /opt/nim/NOTICE_2`	03/25/2026 12:00 PM UTC
sha256:7012df7f8eedaa6744d5f75b2f838bb6933fa82e35926743a615adf9f5cf3560	COPY	`--chown=nim:nim MODEL_LICENSE /opt/nim/MODEL_LICENSE`	03/25/2026 12:00 PM UTC
sha256:8e4474382a518883ab8ae879c8a839d56fa3c73ea2e48d1c2657a1f31816db9f	COPY	`--chown=nim:nim model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml`	03/25/2026 12:00 PM UTC
sha256:12cbc1ba085d3b123192442190360af5bfbce7ee43ef8138f0fe3e873d8a2ac5	COPY	`--chown=nim:nim VERSION /opt/nim/VERSION`	03/25/2026 12:00 PM UTC
sha256:e478fee0aa6879d7595f4405b057a4206af1728ca71ea85672db54487be89abf	COPY	`--chown=nim:nim LICENSE /opt/nim/LICENSE`	03/25/2026 12:00 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`INFERENCE_MICROSERVICE_LLM_NIM_VERSION=2.0.1`	03/25/2026 12:00 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_SERVED_MODEL_NAME=meta/llama-3.1-70b-instruct`	03/25/2026 12:00 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_HTTP_API_PORT=8000`	03/25/2026 12:00 PM UTC