Tools for NVIDIA Neural Reconstruction (NuRec): auxiliary data generation and mask annotation.
Neural Reconstruction Tools
NuRec 26.10 is the last release of NVIDIA Neural Reconstruction (NuRec) published on NGC. Future releases, including source code, container images and release notes, will be published on GitHub at github.com/NVIDIA/NuRec.
Overview
The NVIDIA Neural Reconstruction (NuRec) Tools container provides data preprocessing and annotation utilities that prepare recorded sensor data for use with the NuRec reconstruction pipeline. This container is a companion to the main NuRec container and is intended to be used upstream in the reconstruction workflow.
Tools
NCore Auxiliary Data Preprocessor
Generates auxiliary data products from NCore dataset shards, including depth maps, segmentation masks, and feature embeddings. These derived outputs are consumed by the NuRec reconstruction pipeline to improve scene quality.
Mask Annotator
An interactive GUI tool for reviewing and editing segmentation masks on recorded camera frames. Requires an X11 display or equivalent forwarding configuration.
Use Cases
- Data Preparation — Preprocess raw sensor recordings into the auxiliary data products required by the NuRec reconstruction pipeline.
- Annotation & QA — Visually inspect and refine segmentation masks before reconstruction.
System Requirements
| Component | Requirement |
|---|---|
| GPU | NVIDIA GPU with CUDA compute capability |
| GPU Architectures | Ampere (A100, A10, A40, RTX A6000), Ada Lovelace (L20, L40, L40S), Hopper (H20, H100), Blackwell (RTX Pro 6000D) |
| OS | Linux x86_64 |
| CUDA | 12.8 or higher |
| NVIDIA Driver | R580+ |
| Docker | 23.0.1 or later |
| NVIDIA Container Toolkit | 1.13.5 or later |
| Display | X11 forwarding required for Mask Annotator |
Supported Input Data
- Camera: images from pinhole, fisheye, and f-theta camera models; optional windshield distortion modeling.
- Lidar: Structured spinning lidar data (e.g., Hesai Pandar, AT128).
- Dataset Formats: NCore V3/V4
Data Handling
All processing occurs locally within the container. Sensor data is read from and written to user-specified storage volumes. No data is transmitted externally by the container.
Documentation
Comprehensive documentation is available at https://docs.nvidia.com/nurec/
Governing Terms
Your use of the software and materials is governed by the NVIDIA Software License Agreement (found at https://www.nvidia.com/en-us/agreements/enterprise-software/nvidia-software-license-agreement/) and the Product-Specific Terms for NVIDIA Omniverse (found at https://www.nvidia.com/en-us/agreements/enterprise-software/product-specific-terms-for-omniverse/).