TAO Classification-tf2 Notebook

NVIDIA TAO Toolkit on Google Vertex AI

The NVIDIA TAO Toolkit, an AI training toolkit which simplifies the model training and inference optimization process using pretrained models and simple CLI interface. The result is an ultra-streamlined workflow. Bring your own models or use NVIDIA pre-trained models and adapt them to your own real or synthetic data, then optimize for inference throughput. All without needing AI expertise or large training datasets.

TAO Toolkit workflows can be deployed on Google Vertex AI using the Quick Deploy.

About Quick Deploy

The quick deploy feature automatically sets up the Vertex AI instance with an optimal configuration, preloads the dependencies, runs the software from NGC without any need to set up the infrastructure.

TAO Classification-tf2

In this workflow, you will train and optimize an action recognition model using Classification-tf2 pretrained model and TAO. Object detection is a popular computer vision technique that can detect one or multiple objects in a frame. Object detection will recognize the individual objects in an image and places bounding boxes around the object. This model card contains pre-trained weights for the backbones that may be used as a starting point with the efficientdet object detection networks in Train Adapt Optimize (TAO) Toolkit to facilitate transfer learning. These models are trained on a subset of the Google OpenImages dataset.More information about this model can be found in Classification-tf2 model card.

Get Started with TAO:

To help you get started, we have created a few Jupyter Notebooks that can be easily deployed on Vertex AI using NGC’s quick deploy feature. This feature automatically sets up the Vertex AI instance with an optimal configuration needed for training the model.

Learning Objective

This resource has four notebooks including two training notebooks(classification and classification_16bit) and two deploy notebooks(classification_deploy and classification_16bit_deploy). Two training notebooks show an example use case for classification using the Train Adapt Optimize (TAO) Toolkit. We will be using the pascal VOC dataset for the tutorial.We train, prune, finetune and inference the model in this notebook.

Simply click on the button that reads “Deploy to Vertex AI” and follow the instructions.

Note: A customized kernel for the Jupyter Notebook is used as the primary mechanism for deployment. This kernel has been built on the TAO Toolkit container. For more information on the container itself, please refer to this link for more information:

https://catalog.ngc.nvidia.com/orgs/nvidia/teams/tao/containers/tao-toolkit

The container version for this notebooks is nvcr.io/nvidia/tao/tao-toolkit:4.0.0-tf2.9.1

Two deploy notebooks can be run inside nvcr.io/nvidia/tao/tao-toolkit:4.0.0-deploy

Follow the following commands to open jupyter notebook inside the container:

docker run -it --rm --gpus all -v /path/to/notebooks:/workspace/tao --net=host nvcr.io/nvidia/tao/tao-toolkit:4.0.0-tao-toolkit:4.0.0-deploy /bin/bash

Pip3 install notebook

Pip3 install jupyterlab

cd /workspace

jupyter notebook --ip 0.0.0.0 --port 8888 --allow-root

License

By pulling and using the TAO Toolkit container, you accept the terms and conditions of these licenses.

Technical blogs

• Train like a ‘pro’ without being an AI expert using TAO AutoML
• Developing and Deploying AI-powered Robots with NVIDIA Isaac Sim and NVIDIA TAO
• Learn endless ways to adapt and supercharge your AI workflows with TAO - Whitepaper