Deepseek-R1-Distill-Llama-8B

NVIDIA

Container

NVIDIA

Deepseek-R1-Distill-Llama-8B

NVIDIA NIM for GPU accelerated DeepSeek-R1-Distill-Llama-8B inference through OpenAI compatible APIs

NVIDIA NIM

NIM MetadataTo verify your workspace, run the Verify CLI locally and compare the generated hash with the NGC-published hash shown here. Learn more in the NVIDIA Documentation.

			Profile	Engine		Actions
H100 NVL	2321:10de	fp8	throughput	tensorrt_llm	1	Copy NIM CLI Verification
H100 80GB HBM3	2330:10de	fp8	throughput	tensorrt_llm	1	Copy NIM CLI Verification
H200	2335:10de	fp8	latency	tensorrt_llm	2	Copy NIM CLI Verification
H100 80GB HBM3	2330:10de	bf16	latency	tensorrt_llm	2	Copy NIM CLI Verification
A10G	2237:10de	bf16	latency	tensorrt_llm	4	Copy NIM CLI Verification
L40S	26b9:10de	bf16	latency	tensorrt_llm	2	Copy NIM CLI Verification
H100 NVL	2321:10de	fp8	latency	tensorrt_llm	2	Copy NIM CLI Verification
—	—	bf16	generic	tensorrt_llm	2	Copy NIM CLI Verification
H100 80GB HBM3	2330:10de	bf16	throughput	tensorrt_llm	1	Copy NIM CLI Verification
—	—	bf16	generic	vllm	1	Copy NIM CLI Verification