NVIDIA Deep Learning Examples
BERT PyTorch checkpoint (Large, QA, SQuAD1.1, AMP)
Model
NVIDIA Deep Learning Examples
BERT PyTorch checkpoint (Large, QA, SQuAD1.1, AMP)

BERT-Large PyTorch checkpoint finetuned for QA on SQuAD v1.1

1 Version
19.09.0_ampSelected
09/22/2022 5:42 PM UTC639.34 MBAccuracy: 91.53 EpochsBatch Size: 24GPU: V100
architecture
KeyValue
typeLarge
performance
KeyValue
accuracy91.5
F191.5
training
KeyValue
bs24
batch_size24
LR3e-05
training_precisionAMP
epochs3
datasetSQuAD 1.1
warmup_proportion0.01