NVIDIA Deep Learning Examples
NVIDIA Deep Learning Examples
BERT-Base checkpoint (PyTorch, AMP, SST-2, seqLen128)
Model
NVIDIA Deep Learning Examples
NVIDIA Deep Learning Examples
BERT-Base checkpoint (PyTorch, AMP, SST-2, seqLen128)

BERT-Base PyTorch checkpoint finetuned on GLUE/SST-2 using seqLen=128

1 Version
20.12.0_ampSelected
09/22/2022 5:35 PM UTC417.75 MBAccuracy: 0.91744 EpochsBatch Size: 64GPU: V100
architecture
KeyValue
taskfinetuning
typebase
performance
KeyValue
accuracy0.9174
training
KeyValue
batch_size64
LR3e-05
training_precisionAMP
datasetSST-2
epochs4