NVIDIA Deep Learning Examples
NVIDIA Deep Learning Examples
Transformer en-de checkpoint
Model
NVIDIA Deep Learning Examples
NVIDIA Deep Learning Examples
Transformer en-de checkpoint

Transformer trained on wmt14_en_de_joined_dict. Trained in TF32 saved in FP32

1 Version
20.06.0_tf32Selected
09/22/2022 5:09 PM UTC2.62 GBAccuracy: 040 EpochsBatch Size: 10240GPU: A100
architecture
KeyValue
tasktranslation
typevaswani_wmt_en_de_big
performance
KeyValue
validation_loss3.8957
uncased_BLEU_score27.77
training
KeyValue
batch_size10240
seed3
lr0.00846
training_precisionTF32
datasetWMT14 EN-DE
epochs40

NVIDIA uses cookies to improve your experience on our web site. We and our third-party partners also use cookies and other tools to collect and record information you provide as well as information about your interactions with our websites for performance improvement, analytics, and to assist in marketing efforts. By clicking "Accept All", you consent to our use of cookies and other tools as described in our Cookie Policy. You can manage your cookie settings by clicking on "Manage Settings." By continuing to use this site or by clicking one of the buttons below, you agree to our Terms of Service (which contains important waivers). Please see our Privacy Policy for more information on our privacy practices.