## Model Overview

### Description:

Nemotron-3-8B-Chat-SteerLM is an 8 billion parameter generative language model based on the Nemotron-3-8B base model. It has been customized using the [SteerLM method](https://arxiv.org/abs/2310.05344) developed by NVIDIA to allow for user control of model outputs during inference.
Key capabilities enabled by SteerLM:
- Dynamic steering of responses by specifying desired attributes like quality, helpfulness, and toxicity `at inference time`.
- Simplified training compared to RLHF techniques like fine-tuning and bootstrapping.

NV-GPT-8B-SteerLM is part of NV-GPT, a family of enterprise ready decoder-only generative text models compatible with [NeMo Framework](https://www.nvidia.com/en-us/ai-data-science/generative-ai/nemo-framework).
NVIDIA NeMo is an end-to-end, cloud-native framework to build, customize, and deploy generative AI models anywhere. It includes training and inferencing frameworks, guardrailing toolkits, data curation tools, and pretrained models, offering enterprises an easy, cost-effective, and fast way to adopt generative AI.

### Terms of use

The use of this model is governed by the NVIDIA NeMo Foundational Models Community License Agreement

### References(s):

* Announcement Blog coming soon

### Model Architecture:

**Architecture Type:** Transformer 
**Network Architecture:** GPT-3 
**Model version:** N/A 

### Input:

**Input Format:** Text 
**Input Parameters:** Temperature, TopP, TopK 
**Other Properties Related to Output:** None 

### Output:

**Output Format:** Text 
**Output Parameters:** Max output tokens 
**Other Properties Related to Output:** None 

### Software Integration:

**Runtime(s):** NVIDIA AI Enterprise 
**Toolkit:** NeMo Framework 
**Supported Hardware Platform(s):** Hopper, Ampere 
**Supported Operating System(s):** Linux 

## Training & Finetuning:

### Dataset:

NVIDIA models are trained on a diverse set of public and proprietary datasets. This model was trained on a dataset containing 3.5 Trillion tokens of text. The dataset contains 53 different human languages and 37 programming languages. NVIDIA is committed to the responsible development of large language models and conducts reviews of all datasets included in training.

### Inference:

**Engine:** [Triton](https://developer.nvidia.com/triton-inference-server) 
**Test Hardware:** Other

nemo-8b-steerlm

Nemotron-3-8B-Chat-SteerLM is an 8 billion parameter generative language model based on the Nemotron-3-8B base model. It has been customized for user control of model outputs during inference using the SteerLM method developed by NVIDIA.

Nemotron-3-8B-Chat-SteerLM

Description

Publisher

Modified