## Model Overview

### Description:

Nemotron-3-8B-QA is a 8 billion parameter generative language model based on the Nemotron-3-8B base model. The model has been further fine-tuned for instruction following using Supervised Fine-tuning (SFT) using a method by NVIDIA specifically for Question and Answer method, to give concise and reliable answers.
Nemotron-3-8B-QA is part of NV-GPT, a family of enterprise ready decoder-only generative text models compatible with [NeMo Framework](https://www.nvidia.com/en-us/ai-data-science/generative-ai/nemo-framework).
NVIDIA NeMo is an end-to-end, cloud-native framework to build, customize, and deploy generative AI models anywhere. It includes training and inferencing frameworks, guardrailing toolkits, data curation tools, and pretrained models, offering enterprises an easy, cost-effective, and fast way to adopt generative AI.

### Terms of use

The use of this model is governed by the NVIDIA NeMo Foundational Models Community License Agreement

### References(s):

* Announcement Blog coming soon

### Model Architecture:

**Architecture Type:** Transformer 
**Network Architecture:** GPT-3 
**Model version:** N/A 

### Input:

**Input Format:** Text 
**Input Parameters:** Temperature, TopP, TopK 
**Other Properties Related to Output:** None 

### Output:

**Output Format:** Text 
**Output Parameters:** Max output tokens 
**Other Properties Related to Output:** None 

### Software Integration:

**Runtime(s):** NVIDIA AI Enterprise 
**Toolkit:** NeMo Framework 
**Supported Hardware Platform(s):** Hopper, Ampere 
**Supported Operating System(s):** Linux 

## Training & Finetuning:

### Dataset:

NVIDIA models are trained on a diverse set of public and proprietary datasets. This model was trained on a dataset containing 3.5 Trillion tokens of text. The dataset contains 53 different human languages and 37 programming languages. NVIDIA is committed to the responsible development of large language models and conducts reviews of all datasets included in training.

### Inference:

**Engine:** [Triton](https://developer.nvidia.com/triton-inference-server) 
**Test Hardware:** Other

nemo-8b-qa

Nemotron-3-8B-QA is a 8 billion parameter generative language model based on the Nemotron-3-8B base model. The model has been further fine-tuned for instruction following by NVIDIA specifically for Question Answering.