Llama-3.1-70b-instruct | NVIDIA NGC

NVIDIA

Llama-3.1-70b-instruct

Container

NVIDIA

Llama-3.1-70b-instruct

This container houses the Llama-3.1-70B-Instruct, which is a multilingual large language model from the Meta Llama 3.1 collection of pretrained and instruction-tuned generative models.

Layer	Label		Created
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	CMD	`/opt/nim/start_server.sh`	08/04/2026 1:07 PM UTC
sha256:1d66d3058bbf41976a0ad64eca717be2d4ebee15f1f8e5488d03e6191dae7d8b	COPY	`--chown=nim:nim NOTICE_2 /opt/nim/NOTICE_2`	08/04/2026 1:07 PM UTC
sha256:f23ceb2b3e7206ec933547fb3c7659a9d415a9ea7d1e9bda49661494fb43c512	COPY	`--chown=nim:nim NOTICE /opt/nim/NOTICE`	08/04/2026 1:07 PM UTC
sha256:7dd04f6db29e8c4e6c5377b4ea01102fb5887a8d40bde2c4b9923809a8c6f4c2	COPY	`--chown=nim:nim MODEL_LICENSE /opt/nim/MODEL_LICENSE`	08/04/2026 1:07 PM UTC
sha256:239a57a181153f49095d43b25151b56f0e0c9e6db9233481f8143f97b658c516	COPY	`--chown=nim:nim model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml`	08/04/2026 1:07 PM UTC
sha256:b6faa965c318f6d3da770a31d110de13e0bb69eb9a90a2a289ca7eca5a891f42	COPY	`--chown=nim:nim VERSION /opt/nim/VERSION`	08/04/2026 1:07 PM UTC
sha256:ee4509d74b092e1c0032b944b8a1c0c1cead4197e6c2565975346c8b0541b69c	COPY	`--chown=nim:nim LICENSE /opt/nim/LICENSE`	08/04/2026 1:07 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`INFERENCE_MICROSERVICE_LLM_NIM_VERSION=2.0.10`	08/04/2026 1:07 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_SERVED_MODEL_NAME=meta/llama-3.1-70b-instruct`	08/04/2026 1:07 PM UTC
sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4	ENV	`NIM_HTTP_API_PORT=8000`	08/04/2026 1:07 PM UTC