What Is Riva Speech Skills?

NVIDIA Riva is a GPU-accelerated SDK for building Speech AI applications that are customized for your use case and deliver real-time performance. Riva offers pre-trained speech models in NVIDIA NGC that can be fine-tuned with NVIDIA NeMo on a custom data set, accelerating the development of domain-specific models.

Supported NeMo models can be easily exported, optimized, and deployed as a speech service on premises or in the cloud with a single command using Helm charts.

Riva’s high performance inference is powered by NVIDIA TensorRT optimizations and served using the NVIDIA Triton Inference Server.

Riva services are available as gRPC-based microservices for low-latency streaming, as well as high-throughput offline use cases.

Riva is fully containerized and can easily scale to hundreds and thousands of parallel streams.

Running Riva Speech Skills

Procedure

1. Select the Tags tab and locate the container image release that you want to run.

2. In the Pull Tag column, click the icon to copy the docker pull command.

3. Open a command prompt and paste the pull command. The pulling of the container image begins. Ensure the pull completes successfully before proceeding to the next step.

4. Run the container image.

   If you have Docker 19.03 or later, a typical command to launch the container is:

   docker run --gpus all -it --rm -v local_dir:container_dir nvcr.io/nvidia/riva/riva-speech:x.x.x
   

   If you have Docker 19.02 or earlier, a typical command to launch the container is:

   nvidia-docker run -it --rm -v local_dir:container_dir nvcr.io/nvidia/riva/riva-speech:x.x.x
   

   Where:

   • -it means run in interactive mode
   • --rm will delete the container when finished
   • -v is the mounting directory
   • local_dir is the directory or file from your host system (absolute path) that you want to access from inside your container.
   • container_dir is the target directory when you are inside your container.
   • x.x.x is the version of Riva Speech Skills. For example, 2.12.0.

For more information about using NGC, refer to the NGC Catalog User Guide.

Suggested Reading

For the latest release specific documentation, refer to the Release Notes.

For a full list of the supported hardware and software, refer to the Support Matrix.

For all other documentation, refer to the User Guide.

License

By downloading and using Riva software, you accept the terms and conditions of this license.