Model
BERT Large PyTorch checkpoint finetuned on GLUE/SST-2 dataset using AMP
Use the NGC CLI to download:
Copied!
1 Version
21.11.0_ampSelected09/22/2022 5:40 PM UTC1.25 GBAccuracy: 92.773 EpochsBatch Size: 1024GPU: V100 Copied!
21.11.0_ampSelected
09/22/2022 5:40 PM UTC1.25 GBAccuracy: 92.773 EpochsBatch Size: 1024GPU: V100
Copied!
architecture
| Key | Value |
|---|---|
| task | SST-2 |
| type | Large |
performance
| Key | Value |
|---|---|
| accuracy | 92.77 |
training
| Key | Value |
|---|---|
| batch_size | 1024 |
| LR | 1e-05 |
| training_precision | AMP |
| max_seq_length | 128 |
| epochs | 3 |
| dataset | sst-2 |
| warmup_proportion | 0.1 |