End of Support — "This artifact is no longer supported. NVIDIA strongly recommends artifacts that are up to date and supported"

Custom evaluation benchmark container

Overview

This image is a container to run custom evaluation benchmarks. The NeMo Evaluator microservice uses this container to run custom benchmarks. As part of the evaluation, the container downloads a dataset, performs inference, and uploads the results and logs to the datastore.

To get started with NeMo Evaluator, refer to Evaluation Tutorials.

Note: Use, distribution or deployment of this microservice in production requires an NVIDIA AI Enterprise License.

Note: NeMo microservices has been sunset as of October 1, 2026. There will be no new releases.

Governing Terms

The software and materials are governed by the NVIDIA Software License Agreement and the Product-Specific Terms for NVIDIA AI Products.

Get Help

NVIDIA Developer Community Forum

For support, Visit the NVIDIA Developer Community Forum