ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA Deep Learning Examples
NVIDIA Deep Learning Examples
BERT TF checkpoint (Large, pretraining, AMP, LAMB)
Model
NVIDIA Deep Learning Examples
NVIDIA Deep Learning Examples
BERT TF checkpoint (Large, pretraining, AMP, LAMB)

BERT Large TensorFlow checkpoint pretrained using AMP and LAMB optimizer

1 Version
19.03.1_amp_optim-lambSelected
09/22/2022 5:34 PM UTC5.03 GBAccuracy: 00 EpochsBatch Size: 0GPU: V100
architecture
KeyValue
purposePretraining
typeLarge
performance
KeyValue
training_loss1.57?
training
KeyValue
optimizerLAMB
training_precisionAMP
datasetWikipedia;BookCorpus