ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA
NVIDIA
BERT for TensorFlow
Resource
NVIDIA
NVIDIA
BERT for TensorFlow

BERT is a method of pre-training language representations which obtains state-of-the-art results on a wide array of NLP tasks.

Changelog

September 2019

  • Pre-training using LAMB
  • Multi Node support
  • Fine Tuning support for GLUE (CoLA, MNLI, MRPC)

July 2019

  • Results obtained using 19.06
  • Inference Studies using TensorRT Inference Server

March 2019

  • Initial release

Known issues

  • There is a known performance regression with the 19.08 release on Tesla V100 boards with 16 GB memory, smaller batch sizes may be a better choice for this model on these GPUs with the 19.08 release. 32 GB GPUs are not affected.