NGC | Catalog
Welcome Guest
CatalogModelsRIVA English Fastpitch Male 1

RIVA English Fastpitch Male 1

For downloads and more information, please view on a desktop device.
Logo for RIVA English Fastpitch Male 1

Description

Mel-Spectrogram prediction conditioned on input text with English US Male 1 voice.

Publisher

NVIDIA

Use Case

Text To Speech

Framework

NeMo

Latest Version

deployable_v1.0

Modified

April 19, 2022

Size

86.47 MB

Speech Synthesis: FastPitch 1.1 Model Card

Model overview

FastPitch is a mel-spectrogram generator, designed to be used as the first part of a neural text-to-speech system in conjunction with a neural vocoder.

Model architecture

FastPitch is a fully-parallel text-to-speech model based on FastSpeech, conditioned on fundamental frequency contours. The model predicts pitch contours during inference. By altering these predictions, the generated speech can be more expressive, better match the semantic of the utterance, and in the end more engaging to the listener. FastPitch is based on a fully-parallel Transformer architecture, with much higher real-time factor than Tacotron2 for mel-spectrogram synthesis of a typical utterance.

Training

Dataset

This model is trained on a proprietary dataset sampled at 44100Hz, and can be used to generate male English voices with an American accent.

How to use this model

FastPitch is intended to be used as the first part of a two stage speech synthesis pipeline. FastPitch takes text and produces a mel spectrogram. The second stage takes the generated mel spectrogram and returns audio.

Input

English text strings

Output

Mel spectrogram of shape (batch x mel_channels x time)

References

FastPitch paper: https://arxiv.org/abs/2006.06873

License

By downloading and using the models and resources packaged with Riva Conversational AI, you would be accepting the terms of the Riva license

Ethical AI

NVIDIA’s platforms and application frameworks enable developers to build a wide array of AI applications. Consider potential algorithmic bias when choosing or creating the models being deployed. Work with the model’s developer to ensure that it meets the requirements for the relevant industry and use case; that the necessary instruction and documentation are provided to understand error rates, confidence intervals, and results; and that the model is being used under the conditions and in the manner intended.