NVIDIA Deep Learning Examples
NVIDIA Deep Learning Examples
BERT for TensorFlow1
Resource
NVIDIA Deep Learning Examples
NVIDIA Deep Learning Examples
BERT for TensorFlow1

BERT is a method of pre-training language representations which obtains state-of-the-art results on a wide array of NLP tasks.

  • Changelog

    June 2020

    • Results obtained using 20.06 and on DGX A100 40GB

    Janurary 2020

    • Added inference with TensorRT

    November 2019

    • Pre-training and Finetuning on BioMedical tasks and corpus

    October 2019

    • Disabling Grappler Optimizations for improved performance

    September 2019

    • Pre-training using LAMB
    • Multi Node support
    • Fine Tuning support for GLUE (CoLA, MNLI, MRPC)

    July 2019

    • Results obtained using 19.06
    • Inference Studies using Triton Inference Server

    March 2019

    • Initial release

    Known issues

    There are no known issues with this model.