NVIDIA Deep Learning Examples
NVIDIA Deep Learning Examples
wav2vec 2.0 Base pre-trained
Model
NVIDIA Deep Learning Examples
NVIDIA Deep Learning Examples
wav2vec 2.0 Base pre-trained

wav2vec 2.0 Base PyTorch checkpoint pre-trained on LibriSpeech 960 h

1 Version
01/16/2023 11:54 AM UTC909.32 MBAccuracy: 00 EpochsBatch Size: 0GPU: A100
architecture
KeyValue
taskunsupervised pre-training
hourglass_transformer_shortening_rate4
typebase
performance
KeyValue
last_valid_accuracy0.622
training
KeyValue
max_update400000
max_tokens1400000
lr0.0005
gpus64
training_precisionAMP-BF16
datasetLibriSpeech 960 h