NVIDIA Deep Learning Examples
NVIDIA Deep Learning Examples
ELECTRA for TensorFlow2
Resource
NVIDIA Deep Learning Examples
NVIDIA Deep Learning Examples
ELECTRA for TensorFlow2

ELECTRA is method of pre-training language representations which outperforms existing techniques on a wide array of NLP tasks.

  • Changelog

    July 2020

    • Initial release.

    October 2020

    • Data preparation scripts for pre-training.
    • Pre-training support.
    • Mixed precision support with Keras AMP policy.
    • Update beam size in SQuAD fine-tuning from 4 to 5 for higher accuracy.
    • T4 inference performance.

    Known issues

    There are no known issues with this model.