NGC | Catalog
Welcome Guest
CatalogModelsTAO Pretrained Classification

TAO Pretrained Classification

For downloads and more information, please view on a desktop device.
Logo for TAO Pretrained Classification

Description

Pretrained weights to facilitate transfer learning using TAO Toolkit.

Publisher

-

Use Case

Classification

Framework

Transfer Learning Toolkit

Latest Version

cspdarknet_tiny

Modified

November 23, 2021

Size

28.57 MB

What is Train Adapt Optimize (TAO) Toolkit?

Train Adapt Optimize (TAO) Toolkit is a python based AI toolkit for taking purpose-built pre-trained AI models and customizing them with your own data. TAO adapts popular network architectures and backbones to your data, allowing you to train, fine tune, prune and export highly optimized and accurate AI models for edge deployment.

The pre-trained models accelerate the AI training process and reduce costs associated with large scale data collection, labeling, and training models from scratch. Transfer learning with pre-trained models can be used for AI applications in smart cities, retail, healthcare, industrial inspection and more.

Build end-to-end services and solutions for transforming pixels and sensor data to actionable insights using TAO, DeepStream SDK and TensorRT. The models are suitable for object detection and classification.

TAO Image Classification

Image Classification is a popular computer vision technique in which an image is classified into one of the designated classes based on the image features. This model card contains pretrained weights of most of the popular classification models. These weights that may be used as a starting point with the classification app in Train Adapt Optimize (TAO) Toolkit to facilitate transfer learning.

It is trained on a subset of the Google OpenImages dataset. Following backbones are supported with these detection networks.

Supported Backbone:

  • resnet10/resnet18/resnet34/resnet50/resnet101
  • vgg16/vgg19
  • googlenet
  • mobilenet_v1/mobilenet_v2
  • squeezenet
  • darknet19/darknet53
  • efficientnet_b0
  • cspdarknet19/cspdarknet53

To see the full list of all the backbones, scroll over to the version history tab.

Note: These are unpruned models with just the feature extractor weights, and may not be used without retraining to deploy in a classification application.

Note: Please make sure to set the all_projections field to False in the spec file when training a ResNet101 model. For more information about this parameter please refer to the TAO Getting Started Guide.

To learn more about object detection using YOLOV3, YOLOV4, FasterRCNN, SSD, DSSD, and RetinaNet, click here

To learn more about object detection using DetectNet_v2, click here

To learn more about instance segmentation using MaskRCNN, click here

Running Image classification Models Using TAO

The image classification apps in TAO expect data in KITTI file format. TAO provides a simple command line interface to train a deep learning model for image classification.

The models in this model area are only compatible with TAO Toolkit. For more information about TAO please refer to the Getting Started Guide.

  1. Install the NGC CLI from ngc.nvidia.com

  2. Configure the NGC CLI using the following command

ngc config set
  1. To view all the backbones for classification that are supported by TAO:
ngc registry model list nvidia/tao_pretrained_classification:*
  1. Download the model:
ngc registry model download-version nvidia/tao_pretrained_classification: --dest 

Instructions to run the sample notebook

  1. Get the NGC API key from the SETUP tab on the left. Please store this key for future use. Detailed instructions can be found here

  2. Configure the NGC command line interface using the command mentioned below and follow the prompts.

ngc config set
  1. Download the sample notebooks from NGC using the command below
ngc registry resource download-version "nvidia/tao_cv_samples:v1.0.2"
  1. Invoke the jupyter notebook using the following command
jupyter notebook --ip 0.0.0.0 --port 8888 --allow-root
  1. Open an internet browser and type in the following URL to start running the notebooks when running on a local machine.
http://0.0.0.0:8888

If you wish to run view the notebook from a remote client, please modify the URL as follows:

http://a.b.c.d:8888

Where, the a.b.c.d is the IP address of the machine running the container.

Other TAO Pre-trained Models

License

This work is licensed under the Creative Commons Attribution 4.0 International License. To view a copy of this license, please visit this link, or send a letter to Creative Commons, PO Box 1866, Mountain View, CA 94042, USA.

Technical blogs

Suggested reading

Ethical AI

NVIDIA’s platforms and application frameworks enable developers to build a wide array of AI applications. Consider potential algorithmic bias when choosing or creating the models being deployed. Work with the model’s developer to ensure that it meets the requirements for the relevant industry and use case; that the necessary instruction and documentation are provided to understand error rates, confidence intervals, and results; and that the model is being used under the conditions and in the manner intended.