NVIDIA Deep Learning Examples
NVIDIA Deep Learning Examples
BERT for PyTorch
Resource
NVIDIA Deep Learning Examples
NVIDIA Deep Learning Examples
BERT for PyTorch

BERT is a method of pre-training language representations which obtains state-of-the-art results on a wide array of NLP tasks.

Changelog

September 2019

  • Scripts to support multi-node launch
  • Update pretraining loss results based on the latest data preparation scripts

August 2019

  • Pre-training support with LAMB optimizer
  • Updated Data download and Preprocessing

July 2019

  • Initial release

Known issues

There are no known issues with this model.