RAD-TTS is a mel-spectrogram generator, designed to be used as the first part of a neural text-to-speech system in conjunction with a neural vocoder. This model uses the International Phonetic Alphabet (IPA) for inference and training, and it can output a female or a male voice for US English. It is also trained for six (6) emotions for the female voice, and four (4) emotions for the male voice, which can be mixed and regulated through SSML tags.
RAD-TTS is a parallel flow-based generative network for text-to-speech synthesis. It extends prior parallel approaches by additionally modeling speech rhythm as a separate generative distribution to facilitate variable token duration during inference.
Text Strings in English
Other Properties Related to Input: 400 Character Text String Limit
Mel spectrogram of shape (batch x mel_channels x time)
Runtime Engine(s): Riva 2.13.0 or greater
Supported Hardware Platform(s):
Supported Operating System(s):
RadTTSpp_Emo_mix_44k_EnglishUS_Emotion_IPA v2.16.0
** Data Collection Method by dataset
** Data Collection Method by dataset
RAD-TTS is intended to be used as the first part of a two stage speech synthesis pipeline. RAD-TTS takes text and produces a mel-spectrogram. The second stage takes the generated mel-spectrogram and returns audio.
Engine: Triton
Test Hardware:
[1] RAD-TTS: Parallel Flow-Based TTS with Robust Alignment Learning and Diverse Synthesis
Refer to the Riva documentation for more information.
NVIDIA believes Trustworthy AI is a shared responsibility and we have established policies and practices to enable development for a wide array of AI applications. When downloaded or used in accordance with our terms of service, developers should work with their supporting model team to ensure this model meets requirements for the relevant industry and use case and addresses unforeseen product misuse. For more detailed information on ethical considerations for this model, please see the Model Card++ Explainability, Bias, Safety & Security, and Privacy Subcards. Please report security vulnerabilities or NVIDIA AI Concerns here.
By downloading and using the models and resources packaged with Riva Conversational AI, you accept the terms of the Riva license.