Resource
BERT is a method of pre-training language representations which obtains state-of-the-art results on a wide array of NLP tasks.
Use the NGC CLI to download:
Copied!
Setup
The following section list the requirements in order to start training the BERT model.
Requirements
This repository contains Dockerfile which extends the TensorFlow NGC container and encapsulates some dependencies. Aside from these dependencies, ensure you have the following components:
- NVIDIA Docker
- TensorFlow 19.03-py3 NGC container
- NVIDIA Volta based GPU
For more information about how to get started with NGC containers, see the following sections from the NVIDIA GPU Cloud Documentation and the Deep Learning Documentation: