ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
BERT for TensorFlow
Resource
NVIDIA
NVIDIA
BERT for TensorFlow

BERT is a method of pre-training language representations which obtains state-of-the-art results on a wide array of NLP tasks.

Changelog

Janurary 2020

  • Added inference with TensorRT

November 2019

  • Pre-training and Finetuning on BioMedical tasks and corpus

October 2019

  • Disabling Grappler Optimizations for improved performance

September 2019

  • Pre-training using LAMB
  • Multi Node support
  • Fine Tuning support for GLUE (CoLA, MNLI, MRPC)

July 2019

  • Results obtained using 19.06
  • Inference Studies using Triton Inference Server

March 2019

  • Initial release

Known issues

  • There is a known performance regression with the 19.08 release on Tesla V100 boards with 16 GB memory, smaller batch sizes may be a better choice for this model on these GPUs with the 19.08 release. 32 GB GPUs are not affected.