NVIDIA Deep Learning Examples
NVIDIA Deep Learning Examples
BERT PaddlePaddle checkpoint (Large, QA, SQuAD1.1, AMP)
Model
NVIDIA Deep Learning Examples
NVIDIA Deep Learning Examples
BERT PaddlePaddle checkpoint (Large, QA, SQuAD1.1, AMP)

BERT-Large PaddlePaddle checkpoint finetuned for QA on SQuAD v1.1

1 Version
22.08.0_ampSelected
11/23/2022 12:48 AM UTC3.75 GBAccuracy: 90.952 EpochsBatch Size: 32GPU: A100
architecture
KeyValue
typeLarge
performance
KeyValue
accuracy90.95
F190.95
training
KeyValue
bs32
batch_size32
LR4.6e-05
training_precisionAMP
epochs2
datasetSQuAD 1.1
warmup_proportion0.2