NVIDIA Deep Learning Examples

BERT PyTorch checkpoint (Dist-6L-768D, Pretraining, AMP)

BERT Distilled 6L-768D PyTorch Phase2 checkpoint pretrained using 67K steps on seqLen128 and 6k steps on seqLen512