## Speech Recognition: English N-Gram Language Models ==================================================

## Model Overview --------------

When deployed, the ASR engine can optionally condition the transcript output on n-gram language models.

## Model Architecture ------------------

These models are simple 3- and 4-gram language models trained with Kneser-Ney smoothing using [KenLM](https://github.com/kpu/kenlm).

## Intended Use ------------

Primary use case intended for these models is automatic speech recognition.

Input
Sequence of zero or more words.

Output
Likelihood of word sequence.

## How to Use This Model ---------------------

There are a variety of formats contained within this model archive:

**ARPA-formatted Language Models:**

-`3-gram.pruned.3e-7.arpa`
- `mixed_lm-lower.arpa`
- `4gram-pruned-0_2_7_9-en-lm-set-1.0.arpa`

**KenLM-formatted Binary Language Models**

- `mixed-lower.binary`
- `riva_asr_train_datasets_3gram.binary`
- `4gram-pruned-0_2_7_9-en-lm-set-1.0.bin`

**Rescoring Language Models**

- `G.mixed_lm.3-gram.pruned.3e-7.carpa`
- `G.mixed_lm.carpa`

**FST-formatted Language Models**

- `TLG.mixed_lm.3-gram.pruned.3e-7.fst`

**Vocabulary Files**

- `words.mixed_lm.3-gram.pruned.3e-7.fst`
- `words.mixed_lm.txt`

**Flashlight Decoder Vocabulary Files**

- `flashlight_decoder_vocab.txt`
- `en_4.0_dict_vocab.txt`

ARPA and KenLM binary formatted files can be used directly by the CTC CPU Decoder.
The GPU decoder uses a FST-formatted language model (derived from the pruned n-gram
model) and then optionally uses the `carpa`-formatted LMs for rescoring.

## Training Information --------------------

The mixed language model provided here is English-only and is trained on a mix of
transcriptions from LibriSpeech, Switchboard and Fisher datasets.

## Limitations -----------

Currently, TLT cannot train LMs for ASR inference. To train custom LMs for ASR inference,
use KenLM and consult the
[Riva Documentation](https://docs.nvidia.com/deeplearning/riva/user-guide/docs/index.html).

## License -------

By downloading and using the models and resources packaged with TLT Conversational AI, you would be accepting the terms of the Riva [license](https://developer.nvidia.com/riva/ga/license).

#### Ethical AI

## NVIDIA’s platforms and application frameworks enable developers to build a wide array of AI applications.

Consider potential algorithmic bias when choosing or creating the models being deployed.
Work with the model’s developer to ensure that it meets the requirements for the relevant industry and use case;
that the necessary instruction and documentation are provided to understand error rates, confidence intervals, and results; and that the model is being used under the conditions and in the manner intended. --------------------------------------------------


speechtotext_en_us_lm

Base English n-gram LM trained on LibriSpeech, Switchboard and Fisher

Riva ASR English(en-US) LM

Description

Publisher

Use Case

Framework

Latest Version

Modified

Size