BERT-Large(fine-tuning) for TensorFlow

Pretrained weights for the BERT-Large(fine-tuning) model. (Large, SQuAD 2.0, seqLen=384)

Using the Model

Training

Model-scripts available in the NGC model scripts registry.

Re-training

The model was generated using BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding paper, from the NGC model scripts registry. For researchers aiming to improve upon or tailor the model, we recommend starting with information in README. It captures details about the architecture, accuracy and performance result, and corresponding scripts.

Inferencing

For a quick start follow the sections on inference in the model-scripts quick start guide

Datasets

• SQuAD 2.0. Dataset available online: https://rajpurkar.github.io/SQuAD-explorer/