Model
Transformer trained on wmt14_en_de_joined_dict. Trained in TF32 saved in FP32
Use the NGC CLI to download:
Copied!
1 Version
20.06.0_tf32Selected09/22/2022 5:09 PM UTC2.62 GBAccuracy: 040 EpochsBatch Size: 10240GPU: A100 Copied!
20.06.0_tf32Selected
09/22/2022 5:09 PM UTC2.62 GBAccuracy: 040 EpochsBatch Size: 10240GPU: A100
Copied!
architecture
| Key | Value |
|---|---|
| task | translation |
| type | vaswani_wmt_en_de_big |
performance
| Key | Value |
|---|---|
| validation_loss | 3.8957 |
| uncased_BLEU_score | 27.77 |
training
| Key | Value |
|---|---|
| batch_size | 10240 |
| seed | 3 |
| lr | 0.00846 |
| training_precision | TF32 |
| dataset | WMT14 EN-DE |
| epochs | 40 |