Model
Electra-Base TensorFlow2 checkpoint finetuned on Squad1.1 using seqLen=384
Use the NGC CLI to download:
Copied!
1 Version
20.07.0_ampSelected09/22/2022 6:29 PM UTC1.23 GBAccuracy: 02 EpochsBatch Size: 16GPU: V100 Copied!
20.07.0_ampSelected
09/22/2022 6:29 PM UTC1.23 GBAccuracy: 02 EpochsBatch Size: 16GPU: V100
Copied!
architecture
| Key | Value |
|---|---|
| task | QA |
| type | base |
performance
| Key | Value |
|---|---|
| training_loss | 0.558 |
| f1 score | 92.77 |
training
| Key | Value |
|---|---|
| batch_size | 16 |
| LR | 0.0004 |
| training_precision | AMP |
| dataset | SQuAD 1.1 |
| epochs | 2 |