NVIDIA Deep Learning Examples
NVIDIA Deep Learning Examples
Transformer-XL Base TensorFlow checkpoint (AMP, Base)
Model
NVIDIA Deep Learning Examples
NVIDIA Deep Learning Examples
Transformer-XL Base TensorFlow checkpoint (AMP, Base)

Transformer-XL Base Base TensorFlow checkpoint trained with AMP

1 Version
20.06.1_ampSelected
09/22/2022 5:07 PM UTC2.97 GBAccuracy: 00 EpochsBatch Size: 256GPU: A100
architecture
KeyValue
typebase
performance
KeyValue
perplexity23.18
training_loss3.1
training
KeyValue
batch_size256
training_precisionAMP
datasetWikiText-103
iterations40000