NGC | Catalog

Isaac Sim

Logo for Isaac Sim
Features
Description
NVIDIA Isaac Sim™ is a robotics and AI simulation application framework built on NVIDIA Omniverse™.
Publisher
NVIDIA
Latest Tag
2023.1.1
Modified
December 18, 2023
Compressed Size
8.42 GB
Multinode Support
No
Multi-Arch Support
No
2023.1.1 (Latest) Security Scan Results

Linux / amd64

Sorry, your browser does not support inline SVG.

Isaac Sim

NVIDIA Omniverse™ Isaac Sim, is a scalable robotics simulation application and synthetic data generation tool, built on the NVIDIA Omniverse™ platform. It leverages Omniverse Kit powerful simulation technologies including advanced GPU-enabled physics simulation with PhysX 5 and photorealism with real-time ray tracing.

Isaac Sim is a physically accurate virtual environment to develop, test, and manage AI-based robots, and provides the essential features for building virtual robotics experiments including:

  • Tools for importing and simulating robot models, and simulating sensors such as RGB-D, PhysX-Lidar, RTX-Lidar, Radar, contact and IMU

  • Support for various robotics applications including navigation, manipulation, and AI applications through Python and ROS

  • Extensive tools for AI applications such as Isaac Replicator for synthetic data generation and domain randomization and Isaac Gym for reinforcement learning

  • Extensions for building a warehouse such as sim-ready assets, conveyor tools, peoples and CuOpt for logistics and route optimization

  • Development tools

    • Isaac Core API is a robotics abstraction layer which hides the USD complexity

Current release: 2023.1.1

This release is offered as a container that runs locally or on RTX equipped Amazon Web Services (AWS), Microsoft Azure or Google cloud (GCP) with streaming to the user’s desktop. This cloud-based delivery provides the latest RTX graphics and performance to any desktop system without requiring local NVIDIA RTX GPUs.

What's New in Isaac Sim 2023.1.1

General

  • Kit SDK 105.1.2
  • Python 3.10
  • Supported platforms: Ubuntu 20.04, 22.04 and Windows 10
  • Many minor bugs fixed (refer to release notes for details)
  • Added collider compatibility table
  • Added Joint gains tuning guide

Sensors

  • RTX Lidar has corrected some outputs, including objectId, velocity and hitPointNormal
  • Added ZED sensor

Isaac Core

  • Added On Physics Step node

ROS

  • New ROS1/ROS2 Clock publisher and subscriber tutorials

Gym

  • Added support for viewport recording during training/inferencing Added video tutorial for extension workflow

Replicator

  • Added DataVisualizationWriter example writer to omni.replicator.isaac to write labeled annotator data to disk

  • Added custom event trigger example to Replicator → Useful Snippets

  • First release of the Omni.Replicator.Character extension suite. Designed to generate synthetic data across a variety of environments. It provides controls over environments, cameras, agents through the use of configuration and command files.

  • First release of the omni.replicator.object extension. Description file based object simulation. Cameras, lights and geometry are defined as mutables that randomize per frame, while harmonizers are defined to coordinate randomization. Extensions

Prerequisites

Requirements for local deployment:

Running Isaac Sim

Steps:

  1. Run the command below to confirm your GPU driver version is 525.85 or later.

    $ nvidia-smi
    
  2. Follow the steps in Generate Your NGC API Key. Use command line to login into NGC to download the Isaac Sim container.

    $ docker login nvcr.io
     Username: $oauthtoken
     Password: 
     WARNING! Your password will be stored unencrypted in /home/username/.docker/config.json.
     Configure a credential helper to remove this warning. See
     https://docs.docker.com/engine/reference/commandline/login/#credentials-store
     Login Succeeded
    
  3. Pull the Isaac Sim container.

    $ docker pull nvcr.io/nvidia/isaac-sim:2023.1.1
    
  4. Run the Isaac Sim container with an interactive Bash session.

    $ docker run --name isaac-sim --entrypoint bash -it --gpus all -e "ACCEPT_EULA=Y" --rm --network=host \
         -e "PRIVACY_CONSENT=Y" \
         -v ~/docker/isaac-sim/cache/kit:/isaac-sim/kit/cache:rw \
         -v ~/docker/isaac-sim/cache/ov:/root/.cache/ov:rw \
         -v ~/docker/isaac-sim/cache/pip:/root/.cache/pip:rw \
         -v ~/docker/isaac-sim/cache/glcache:/root/.cache/nvidia/GLCache:rw \
         -v ~/docker/isaac-sim/cache/computecache:/root/.nv/ComputeCache:rw \
         -v ~/docker/isaac-sim/logs:/root/.nvidia-omniverse/logs:rw \
         -v ~/docker/isaac-sim/data:/root/.local/share/ov/data:rw \
         -v ~/docker/isaac-sim/documents:/root/Documents:rw \
         nvcr.io/nvidia/isaac-sim:2023.1.1
    
  5. Start Isaac Sim.

    $ ./runheadless.native.sh -v
    

This will download and launch the Isaac Sim container in headless mode.

Note:

  • By using the -e "ACCEPT_EULA=Y" flag, you are accepting the NVIDIA Omniverse License Agreement of the image.
  • By using the -e "PRIVACY_CONSENT=Y flag, you opt-in to the data collection agreement found at Omniverse Data Collection & Use FAQ. You may opt-out by not setting this flag.
  • The -e "PRIVACY_USERID= flag can optionally be set for tagging the session logs.

Refer to our Isaac Sim User Guide and Isaac Sim Setup FAQ for more information.

Livestreaming Isaac Sim Remotely

See Livestream Clients in our User Guide to connect to Isaac Sim using your desktop. The default livestream client is Omniverse Streaming Client.

License

By pulling and using the container, you accept the terms and conditions of the NVIDIA Omniverse License Agreement.

Suggested readings: