NVIDIA Deep Learning Examples
NVIDIA Deep Learning Examples
BERT PyTorch checkpoint (Large, QA, SQuAD1.1, AMP)
Model
NVIDIA Deep Learning Examples
NVIDIA Deep Learning Examples
BERT PyTorch checkpoint (Large, QA, SQuAD1.1, AMP)

BERT-Large PyTorch checkpoint finetuned for QA on SQuAD v1.1

1 Version
19.09.0_ampSelected
09/22/2022 5:42 PM UTC639.34 MBAccuracy: 91.53 EpochsBatch Size: 24GPU: V100
architecture
KeyValue
typeLarge
performance
KeyValue
accuracy91.5
F191.5
training
KeyValue
bs24
batch_size24
LR3e-05
training_precisionAMP
epochs3
datasetSQuAD 1.1
warmup_proportion0.01