When deployed, the ASR engine can optionally condition the transcript output on n-gram language models.
These models are simple 4-gram language models trained with Kneser-Ney smoothing using KenLM.
Primary use case intended for these models is automatic speech recognition.
Input Sequence of zero or more words.
Output Likelihood of word sequence.
There are a variety of formats contained within this model archive:
ARPA-formatted Language Models:
riva_de_asr_set_2.0_4gram.arpa
4gram-pruned-0_1_7_9-ru-lm-set-1.0.arpa
de-DE_default_3.0_pnc.arpa
(For de-DE Unified model)KenLM-formatted Binary Language Models
riva_de_asr_set_2.0_4gram.binary
4gram-pruned-0_1_7_9-ru-lm-set-1.0.bin
de-DE_default_3.0_pnc.bin
(For de-DE Unified model)Flashlight Decoder Vocabulary Files
dict_vocab.txt
de-DE_default_3.0_pnc_dict_vocab.txt
(For de-DE Unified model)ARPA and KenLM binary formatted files can be used directly by the CTC CPU Decoder.
NA
Currently, TLT cannot train LMs for ASR inference. To train custom LMs for ASR inference, use KenLM and consult the Riva Documentation.
By downloading and using the models and resources packaged with TLT Conversational AI, you would be accepting the terms of the Riva license.
Consider potential algorithmic bias when choosing or creating the models being deployed. Work with the model’s developer to ensure that it meets the requirements for the relevant industry and use case; that the necessary instruction and documentation are provided to understand error rates, confidence intervals, and results; and that the model is being used under the conditions and in the manner intended. --------------------------------------------------