ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA Deep Learning Examples
NVIDIA Deep Learning Examples
ELECTRA for TensorFlow2
Resource
NVIDIA Deep Learning Examples
NVIDIA Deep Learning Examples
ELECTRA for TensorFlow2

ELECTRA is method of pre-training language representations which outperforms existing techniques on a wide array of NLP tasks.

Changelog

July 2020

  • Initial release.

October 2020

  • Data preparation scripts for pre-training.
  • Pre-training support.
  • Mixed precision support with Keras AMP policy.
  • Update beam size in SQuAD fine-tuning from 4 to 5 for higher accuracy.
  • T4 inference performance.

Known issues

There are no known issues with this model.