NVIDIA Deep Learning Examples
NVIDIA Deep Learning Examples
Transformer en-de checkpoint
Model
NVIDIA Deep Learning Examples
NVIDIA Deep Learning Examples
Transformer en-de checkpoint

Transformer trained on wmt14_en_de_joined_dict. Trained in TF32 saved in FP32

1 Version
20.06.0_tf32Selected
09/22/2022 5:09 PM UTC2.62 GBAccuracy: 040 EpochsBatch Size: 10240GPU: A100
architecture
KeyValue
tasktranslation
typevaswani_wmt_en_de_big
performance
KeyValue
validation_loss3.8957
uncased_BLEU_score27.77
training
KeyValue
batch_size10240
seed3
lr0.00846
training_precisionTF32
datasetWMT14 EN-DE
epochs40