We're constantly refining and improving our performance on AI and HPC workloads even on the same hardware with frequent updates to our software stack. For our latest performance data please refer to these pages for AI and HPC benchmarks.

Changelog

February 2021

• Added DALI data-processing pipeline for on-the-fly data processing and augmentation on CPU or GPU
• Revised training recipe: ~10% relative improvement in Word Error Rate (WER)
• Updated Triton scripts for compatibility with Triton V2 API, updated Triton inference results
• Refactored codebase
• Updated performance results for the PyTorch 20.10-py3 NGC container

June 2020

• Updated performance tables to include A100 results

December 2019

• Inference support for TRT 6 with dynamic shapes
• Inference support for TensorRT Inference Server with acoustic model backends in ONNX, PyTorch JIT, TensorRT
• Jupyter notebook for inference with TensorRT Inference Server

November 2019

• Google Colab notebook for inference with native TensorRT

September 2019

• Inference support for TensorRT 6 with static shapes
• Jupyter notebook for inference

August 2019

• Initial release

Known issues

There are no known issues in this release.