Llama-3.1-70b-instruct

NVIDIA

Container

NVIDIA

Llama-3.1-70b-instruct

This container houses the Llama-3.1-70B-Instruct, which is a multilingual large language model from the Meta Llama 3.1 collection of pretrained and instruction-tuned generative models.

NVIDIA AI Enterprise Supported
NVIDIA NIM

NIM MetadataTo verify your workspace, run the Verify CLI locally and compare the generated hash with the NGC-published hash shown here. Learn more in the NVIDIA Documentation.Get detailed NIM model metadata, including properties, deployment, and configuration, via the NIM Metadata API.

			Engine		Actions
—	—	bf16	vllm	1	Copy NIM CLI Verification
—	—	nvfp4	vllm	1	Copy NIM CLI Verification
—	—	fp8	vllm	4	Copy NIM CLI Verification
—	—	fp8	vllm	4	Copy NIM CLI Verification
—	—	nvfp4	vllm	8	Copy NIM CLI Verification
—	—	bf16	vllm	4	Copy NIM CLI Verification
—	—	bf16	vllm	8	Copy NIM CLI Verification
—	—	nvfp4	vllm	2	Copy NIM CLI Verification
—	—	fp8	vllm	8	Copy NIM CLI Verification
—	—	bf16	vllm	2	Copy NIM CLI Verification