NVIDIA Deep Learning Examples
NVIDIA Deep Learning Examples
Electra-Base checkpoint (TensorFlow2, AMP, Squad1.0, seqLen384)
Model
NVIDIA Deep Learning Examples
NVIDIA Deep Learning Examples
Electra-Base checkpoint (TensorFlow2, AMP, Squad1.0, seqLen384)

Electra-Base TensorFlow2 checkpoint finetuned on Squad1.1 using seqLen=384

1 Version
20.07.0_ampSelected
09/22/2022 6:29 PM UTC1.23 GBAccuracy: 02 EpochsBatch Size: 16GPU: V100
architecture
KeyValue
taskQA
typebase
performance
KeyValue
training_loss0.558
f1 score92.77
training
KeyValue
batch_size16
LR0.0004
training_precisionAMP
datasetSQuAD 1.1
epochs2