Llama-3.1-8B-Instruct

NVIDIA

Container

NVIDIA

Llama-3.1-8B-Instruct

NVIDIA NIM for GPU accelerated Llama-3.1-8B-Instruct inference through OpenAI compatible APIs

NVIDIA AI Enterprise Supported
NVIDIA NIM

NIM MetadataTo verify your workspace, run the Verify CLI locally and compare the generated hash with the NGC-published hash shown here. Learn more in the NVIDIA Documentation.Get detailed NIM model metadata, including properties, deployment, and configuration, via the NIM Metadata API.

		Engine			Actions
—	bf16	vllm	1	1	Copy NIM CLI Verification
—	nvfp4	vllm	1	1	Copy NIM CLI Verification
—	fp8	vllm	1	1	Copy NIM CLI Verification
—	bf16	vllm	1	1	Copy NIM CLI Verification
NVIDIA-H200	fp8	vllm	1	1	Copy NIM CLI Verification
—	nvfp4	vllm	1	1	Copy NIM CLI Verification
—	fp8	vllm	1	1	Copy NIM CLI Verification
NVIDIA-B200	nvfp4	vllm	1	1	Copy NIM CLI Verification