NVIDIA
NVIDIA
TTS En Multispeaker FastPitch HiFiGAN
Model
NVIDIA
NVIDIA
TTS En Multispeaker FastPitch HiFiGAN

This collection contains two models: 1) Multi-speaker FastPitch (around 50M parameters) trained on HiFiTTS with over 291.6 hours of english speech and 10 speakers. 2) HiFiGAN trained on mel spectrograms produced by the Multi-speaker FastPitch in (1).

This model is backed by NVIDIA's Plus Plus (++) Promise
to learn more about the quality of the datasets used to train this model.
FieldResponse
Intended Application(s) & Domain(s):Speech Synthesis
Model Type:Speech Synthesis and Generative Adversarial Network
Intended Users:This model is intended for developers building interactive call centers, virtual assistants, language learning assistants to improve pronunciation, automatically generate voice-overs, narrate or comment on videos, provide audio alternatives for visually impaired users or people with light sensitivity.
Output:Audio (.wav)
Describe how the model works:Model transcribes input text characters into audio representation.
Technical Limitations:Model only has the capacity to produce a voice in the language, dialect and gender(s) in which it is trained including speech that includes technical terms, or vernacular that the model has not been trained on. The model might also perform worse for accented speech. This model makes no effort to moderate or modify input text.
Verified to have met prescribed NVIDIA standards:Yes
Performance Metrics:% preference when compared with available alternatives: Pitch (mean), Pitch_standard deviation (std) (mean), Pitch_kurtosis (mean), Pitch_skew (mean), Fundamental Frequency Ratio (f0_ratio) (mean), f0_ratio_std (mean), f0_ratio_kurtosis (mean), f0_ratio_skew (mean), Pitch (median), Pitch_std (median), Pitch_kurtosis (median), Pitch_skew (median), f0_ratio (median), f0_ratio_std (median), f0_ratio_kurtosis (median), f0_ratio_skew (median)
Potential Known Risks:May unnaturally synthesize vocabulary not included in pronunciation dictionary or omit phonetic symbols not used in training.
Licensing:https://www.developer.nvidia.com/riva/ga/license

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.