NVIDIA
Granite-3.3-8b-instruct
Container
NVIDIA
Granite-3.3-8b-instruct

NVIDIA NIM for GPU accelerated Granite-3.3-8B-Instruct inference through OpenAI compatible APIs

NIM MetadataTo verify your workspace, run the Verify CLI locally and compare the generated hash with the NGC-published hash shown here. Learn more in the NVIDIA Documentation.
GPU Type
GPU Type
  • GPU Count
    GPU Count
  • Precision
    Precision
  • Profile
    Profile
  • LoRA
    LoRA
  • Engine
    Engine
  • TP
    TP
  • 3 Instances
    Columns
  • Profile
    LoRA
    Engine
    Profile ID
    Actions
    bf16genericvllm1
    bf16genericvllm2
    bf16genericvllm4