Resource
NVIDIA's BERT leverages mixed precision arithmetic and Tensor Cores on A100, V100 and T4 GPUs for faster training while maintaining target accuracy. This notebook demonstrates BERT Question Answering Fine-Tuning with Mixed Precision on SQuaD 2.0 Dataset.
Use the NGC CLI to download:
Copied!
Main repository which contains the dockerfile and the notebooks: https://github.com/NVIDIA/DeepLearningExamples/tree/master/TensorFlow/LanguageModeling/BERT
BERT+SQuAD TF Finetuning Notebook: https://github.com/NVIDIA/DeepLearningExamples/blob/master/TensorFlow/LanguageModeling/BERT/notebooks/bert_squad_tf_finetuning.ipynb
You can also download the main repository as a zip file and the jupyter notebook from the "File Browser" section.