NGC Catalog
CLASSIC
Welcome Guest
Models
RIVA Parakeet-CTC-XXL-1.1B ASR Multilingual Universal Tokenizer

RIVA Parakeet-CTC-XXL-1.1B ASR Multilingual Universal Tokenizer

For downloads and more information, please view on a desktop device.
Logo for RIVA Parakeet-CTC-XXL-1.1B ASR Multilingual Universal Tokenizer
Description
Multilingual Parakeet-CTC-XXL-1.1B ASR model with Universal Tokenizer trained on ASR set 1.0
Publisher
NVIDIA
Latest Version
deployable_v1.0
Modified
December 17, 2024
Size
2.93 GB

Speech Recognition: Parakeet

Description

RIVA Parakeet-CTC-XXL-1.1B ASR Multilingual with Universal Tokenizer (around 1.1B parameters) [1] is trained on ASR Set with over 90,000 hours of speech. A universal tokenizer is trained to support all languages. The model transcribes 25 languages (English (en-US, en-GB), Spanish (es-US, es-ES), German (de-DE), French (fr-FR, fr-CA), Italian (it-IT), Arabic (ar-AR), Japanese (ja-JP), Korean (ko-KR), Portuguese (pt-BR, pt-PT), Russian (ru-RU), Hindi (hi-IN), Dutch (nl-NL), Danish (da-DK), Norwegian Nynorsk (nn-NO), Norwegian Bokmal (nb-NO), Czech (cs-CZ), Polish (pl-PL), Swedish (sv-SE), Thai (th-TH), Turkish (tr-TR), Hebrew (he-IL)) in upper case and lower case alphabets along with punctuations, spaces, and apostrophes.

This model is ready for commercial use.

License/Terms of Use

NVIDIA AI Foundation Models Community License Agreement

References

[1] Fast Conformer with Linearly Scalable Attention for Efficient Speech Recognition
[2] Fast-Conformer-CTC Model
[3] Conformer: Convolution-augmented Transformer for Speech Recognition

Model Architecture

Architecture Type: Parakeet-CTC (also known as FastConformer-CTC) [1], [2] which is an optimized version of Conformer model [3] with 8x depthwise-separable convolutional downsampling with CTC loss
Network Architecture: Parakeet-CTC-XXL-1.1B

Input

Input Type(s): Audio
Input Format(s): wav
Input Parameters: 1-Dimension
Other Properties Related to Input: Maximum Length in seconds specific to GPU Memory, No Pre-Processing Needed, Mono channel is required

Output

Output Type(s): Text
Output Format: String
Output Parameters: 1-Dimension
Other Properties Related to Output: No Maximum Character Length, Does not handle special characters

How to Use this Model

The Riva Quick Start Guide is recommended as the starting point for trying out Riva models. For more information on using this model with Riva Speech Services, see the Riva User Guide.

Suggested Reading

Refer to the Riva documentation for more information.

Software Integration

Runtime Engine(s):

  • Riva 2.18.0 or higher

Supported Hardware Microarchitecture Compatibility:

  • NVIDIA Ampere
  • NVIDIA Hopper
  • NVIDIA Jetson
  • NVIDIA Turing
  • NVIDIA Volta

[Preferred/Supported] Operating System(s):

  • Linux
  • Linux 4 Tegra

Model Version(s):

Parakeet-CTC-XXL-1.1b_universal_spe8.5k_1.0

Training & Evaluation

Training Dataset

** Data Collection Method by dataset

  • Human

** Labeling Method by dataset

  • Human

Properties:

This model is trained on over 90,000 hours of speech in 25 languages (English(US, GB), Spanish(US, ES), German, French, Italian, Arabic, Japanese, Korean, Portuguese (Brazil), Russian, Hindi, French (Canada), Dutch, Danish, Norwegian Nynorsk, Norwegian Bokmal, Czech, Polish, Swedish, Thai, Turkish, Portuguese(Portugal), Hebrew) speech comprised of a dynamic blend of public and internal proprietary and customer datasets normalized to have upper-cased, lower-cased, punctuated, and spoken forms in text.

Evaluation Dataset

** Data Collection Method by dataset

  • Human

** Labeling Method by dataset

  • Human

Properties:

A dynamic blend of public and internal proprietary and customer datasets normalized to have upper-cased, lower-cased, punctuated, and spoken forms in text.

Inference

Engine: Triton
Test Hardware:

  • NVIDIA A10
  • NVIDIA A100
  • NVIDIA A30
  • NVIDIA H100
  • NVIDIA Jetson Orin
  • NVIDIA L4
  • NVIDIA L40
  • NVIDIA Turing T4
  • NVIDIA Volta V100

Ethical Considerations

NVIDIA believes Trustworthy AI is a shared responsibility and we have established policies and practices to enable development for a wide array of AI applications. When downloaded or used in accordance with our terms of service, developers should work with their supporting model team to ensure this model meets requirements for the relevant industry and use case and addresses unforeseen product misuse.

For more detailed information on ethical considerations for this model, please see the Model Card++ Explainability, Bias, Safety & Security, and Privacy Subcards here.

Please report security vulnerabilities or NVIDIA AI Concerns here.