NVIDIA Deep Learning Examples
NVIDIA Deep Learning Examples
BERT for TensorFlow1
Resource
NVIDIA Deep Learning Examples
NVIDIA Deep Learning Examples
BERT for TensorFlow1

BERT is a method of pre-training language representations which obtains state-of-the-art results on a wide array of NLP tasks.

Changelog

June 2020

  • Results obtained using 20.06 and on DGX A100 40GB

Janurary 2020

  • Added inference with TensorRT

November 2019

  • Pre-training and Finetuning on BioMedical tasks and corpus

October 2019

  • Disabling Grappler Optimizations for improved performance

September 2019

  • Pre-training using LAMB
  • Multi Node support
  • Fine Tuning support for GLUE (CoLA, MNLI, MRPC)

July 2019

  • Results obtained using 19.06
  • Inference Studies using Triton Inference Server

March 2019

  • Initial release

Known issues

There are no known issues with this model.