Llama-3.1-70b-instruct | NVIDIA NGC

NVIDIA

Llama-3.1-70b-instruct

Container

NVIDIA

Llama-3.1-70b-instruct

This container houses the Llama-3.1-70B-Instruct, which is a multilingual large language model from the Meta Llama 3.1 collection of pretrained and instruction-tuned generative models.

NVIDIA AI Enterprise Supported NVIDIA NIM

Layer	Label		Created
a2bc16a8f0eec98d3922150c83ac069079c15c156e18730d40f9f980919aaabe	CONFIG	`Entrypoint /opt/nim/start_server.sh; WorkingDir /opt/nim; ExposedPorts 8000/tcp`	07/07/2026 12:49 PM UTC
950dae05f8e9c78f6e9797456291a8304c6c51627af74303d58fa2f1fdda5c25	COPY	`--chown=nim:nim NOTICE_2 /opt/nim/NOTICE_2`	07/07/2026 12:49 PM UTC
84f628b5f287c5d1f5187813bb5ff167030949638a99a334225b0c8de277eeb5	COPY	`--chown=nim:nim NOTICE /opt/nim/NOTICE`	07/07/2026 12:49 PM UTC
752f47521fc3ca986424684753056223dc3d82a71a78b4fec821bb8f540f7964	COPY	`--chown=nim:nim MODEL_LICENSE /opt/nim/MODEL_LICENSE`	07/07/2026 12:49 PM UTC
10bbc448f30ee7d96da3efcea56cea80741e36bc00a46064a73df872ba22aeb9	COPY	`--chown=nim:nim model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml`	07/07/2026 12:49 PM UTC
5d1fcc6d66b44426a1610f0b680d69c5ce040d6f9bb8e58f976528a2f5f4bc8c	COPY	`--chown=nim:nim VERSION /opt/nim/VERSION`	07/07/2026 12:49 PM UTC
1fb48f0bec5fb641cfd6163b7e388c64a365ee4f266b5cec5cbea16842bda650	COPY	`--chown=nim:nim LICENSE /opt/nim/LICENSE`	07/07/2026 12:49 PM UTC
a97a2864a24ff1b0730159c6ae144de391e470bed3ecadbef7987b04f383d3d6	ENV	`INFERENCE_MICROSERVICE_LLM_NIM_VERSION=2.0.8`	07/07/2026 12:49 PM UTC
18e5c53ce679e78b211a15898cbaeea63480a03221ffb72fdcbbc0ba58234695	ENV	`NIM_SERVED_MODEL_NAME=meta/llama-3.1-70b-instruct`	07/07/2026 12:49 PM UTC
df5f5c2ee1b86699281fd80f95cdec0d7e4194137ed558b71b597f716998ff35	ENV	`NIM_HTTP_API_PORT=8000`	07/07/2026 12:49 PM UTC