NVIDIA
NVIDIA
TTS En Multispeaker FastPitch HiFiGAN
Model
NVIDIA
NVIDIA
TTS En Multispeaker FastPitch HiFiGAN

This collection contains two models: 1) Multi-speaker FastPitch (around 50M parameters) trained on HiFiTTS with over 291.6 hours of english speech and 10 speakers. 2) HiFiGAN trained on mel spectrograms produced by the Multi-speaker FastPitch in (1).

This model is backed by NVIDIA's Plus Plus (++) Promise
to learn more about the quality of the datasets used to train this model.
FieldResponse
Intended Application(s) & Domain(s):Speech Synthesis
Model Type:Speech Synthesis and Generative Adversarial Network
Intended Users:This model is intended for developers building interactive call centers, virtual assistants, language learning assistants to improve pronunciation, automatically generate voice-overs, narrate or comment on videos, provide audio alternatives for visually impaired users or people with light sensitivity.
Output:Audio (.wav)
Describe how the model works:Model transcribes input text characters into audio representation.
Technical Limitations:Model only has the capacity to produce a voice in the language, dialect and gender(s) in which it is trained including speech that includes technical terms, or vernacular that the model has not been trained on. The model might also perform worse for accented speech. This model makes no effort to moderate or modify input text.
Verified to have met prescribed NVIDIA standards:Yes
Performance Metrics:% preference when compared with available alternatives: Pitch (mean), Pitch_standard deviation (std) (mean), Pitch_kurtosis (mean), Pitch_skew (mean), Fundamental Frequency Ratio (f0_ratio) (mean), f0_ratio_std (mean), f0_ratio_kurtosis (mean), f0_ratio_skew (mean), Pitch (median), Pitch_std (median), Pitch_kurtosis (median), Pitch_skew (median), f0_ratio (median), f0_ratio_std (median), f0_ratio_kurtosis (median), f0_ratio_skew (median)
Potential Known Risks:May unnaturally synthesize vocabulary not included in pronunciation dictionary or omit phonetic symbols not used in training.
Licensing:https://www.developer.nvidia.com/riva/ga/license