ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA Deep Learning Examples
NVIDIA Deep Learning Examples
BERT PyTorch checkpoint (Dist-4L-288D, SQuAD1, seqLen384, AMP)
Model
NVIDIA Deep Learning Examples
NVIDIA Deep Learning Examples
BERT PyTorch checkpoint (Dist-4L-288D, SQuAD1, seqLen384, AMP)

BERT Distilled 4L-288D PyTorch checkpoint distilled on SQuAD v1.1 dataset using AMP

1 Version
21.11.0_ampSelected
07/07/2022 2:25 PM UTC49.6 MBAccuracy: 010 EpochsBatch Size: 256GPU: V100
architecture
KeyValue
attn_heads12
taskSQuAD v1.1
hidden_size288
layers4
typeDist-4L-288D
performance
KeyValue
F183.09
training
KeyValue
batch_size256
LR3e-05
training_precisionAMP
max_seq_length384
epochs10
datasetSQuAD v1.1
warmup_proportion0.1