## Model Overview

### Description:

The Yi series models are large language models trained from scratch by developers at 01.AI on English and Chinese text only.

### Terms of use

By accessing this model, you are agreeing to the terms and conditions of the [Yi Series Models Community License Agreement](https://github.com/01-ai/Yi/blob/main/MODEL_LICENSE_AGREEMENT.txt), the [Llama 2 community license agreement](https://github.com/facebookresearch/llama/blob/main/LICENSE), [acceptable use policy](https://l.facebook.com/l.php?u=https%3A%2F%2Fai.meta.com%2Fllama%2Fuse-policy&h=AT17YXIWa1dxwuzDq96w614_oshaUCWIQYHHHf9BgC0X5UK39DW2tpSP6NzkeadQVs0XBaNlFSo4nydTUcKB5r-Kn4OLs_5IbMEZYAf5hUvyzIwx8-mLom2ic1vw5rSPFUoc9A) and [Meta’s privacy policy](https://www.facebook.com/privacy/policy/)

### References(s):

* [01.ai](https://01.ai/) webpage 
* [Yi-34b HF Model Card](https://huggingface.co/01-ai/Yi-34B-Chat) webpage 

### Model Architecture:

**Architecture Type:** Transformer 
**Network Architecture:** Llama 2 
**Model version:** N/A 

### Input:

**Input Format:** Text 
**Input Parameters:** Temperature, TopP 
**Other Properties Related to Output:** None 

### Output:

**Output Format:** Text 
**Output Parameters:** Max output tokens 
**Other Properties Related to Output:** None 

### Software Integration:

**Runtime(s):** N/A 
**Supported Hardware Platform(s):** Hopper, Ampere/Turing 
**Supported Operating System(s):** Linux 

## Inference:

**Engine:** [Triton](https://developer.nvidia.com/triton-inference-server) 
**Test Hardware:** Other

yi-34b

The Yi-34B is a large language model trained from scratch by developers at 01.AI. Yi-34B has been finetuned for various chat usecases and has upto 200K context window.