Llama-3.1-70b-instruct | NVIDIA NGC

NVIDIA

Llama-3.1-70b-instruct

Container

NVIDIA

Llama-3.1-70b-instruct

This container houses the Llama-3.1-70B-Instruct, which is a multilingual large language model from the Meta Llama 3.1 collection of pretrained and instruction-tuned generative models.

NVIDIA AI Enterprise Supported NVIDIA NIM

Layer	Label		Created
5ee2776f9d6b81d058de248be1fb6e37ab07231562ef00a74574a9453f3ab064	CONFIG	`Entrypoint /opt/nvidia/nvidia_entrypoint.sh; WorkingDir /`	06/26/2025 7:07 PM UTC
8c96c42ddb99254ba93178e6c1825e3dbd20605d000d2aa1ed9e840cbd34e743	COPY	`CONTAINER_LICENSE /opt/nim/LICENSE`	06/26/2025 7:07 PM UTC
0a4ed9bfc19aa345f76cc49d9a82720fef9053b1bf44d760651ecebf6ab76a45	COPY	`./notices/* /opt/nim/`	06/26/2025 7:07 PM UTC
7dd36d04561b9732c28df6fc06ab442220fb16d026e4d8195f37a8816daabc1e	COPY	`banner.txt /opt/nvidia/entrypoint.d/31-model-license.txt`	06/26/2025 7:07 PM UTC
0ad916fa17f7c9331ad29c07bdf76ed5d6302c14509392de8d582860046c4add	COPY	`MODEL_LICENSE /opt/nim/MODEL_LICENSE`	06/26/2025 7:07 PM UTC
66d5fac753d18dd92157d219ee38fdc4b741b97340a068169ee5782d5a5f3528	COPY	`model_manifest.yaml /opt/nim/etc/default/model_manifest.yaml`	06/26/2025 7:07 PM UTC
1ebc68af334d6015b42740699c5ff1e072382d6149a06403e3381843f8e9cd12	ENV	`NIM_HTTP_API_PORT=8000`	06/26/2025 7:07 PM UTC
76a1a5f8b331ae867e50a3c6764951f9dd7bd762db0627c64e2e1f1585b374d7	ENV	`NIM_MODEL_NSPECT_ID=NSPECT-7S3F-QFG8`	06/26/2025 7:07 PM UTC
e0defac9c9de6afd31ed3a13d57eeeaef6d752b4047dc9916fed81591aafa02b	ENV	`NIM_NSPECT_ID=NSPECT-X37N-G0O5`	06/26/2025 7:07 PM UTC
753187b7f80ee6247910dbce75c26051850e92f55ebe94891983d9fbd1a1904c	ENV	`NIM_SERVED_MODEL_NAME=meta/llama-3.1-70b-instruct`	06/26/2025 7:07 PM UTC