NGC | Catalog
CatalogContainersIP Over Infiniband (IPoIB) CNI Plugin

IP Over Infiniband (IPoIB) CNI Plugin

For copy image paths and more information, please view on a desktop device.
Logo for IP Over Infiniband (IPoIB) CNI Plugin

Description

IP Over Infiniband (IPoIB) CNI plugin with allows user to create IPoIB child link and move it to the pod.

Publisher

NVIDIA

Latest Tag

v1.1.0

Modified

November 1, 2022

Compressed Size

4.84 MB

Multinode Support

No

Multi-Arch Support

No

v1.1.0 (Latest) Scan Results

Linux / amd64

IP Over Infiniband (IPoIB) CNI plugin

IPoIB CNI sources coud be found in the official GitHub repository.

Overview

Allow user to create IPoIB child link and move it to the pod.

Example configuration

{
    "name": "mynet",
    "type": "ipoib",
    "master": "ib0",
    "ipam": {
        "type": "host-local",
        "subnet": "192.168.2.0/24",
        "rangeStart": "192.168.2.10",
        "rangeEnd": "192.168.2.216",
        "routes": [{"dst": "0.0.0.0/0"}],
        "gateway": "192.168.2.1"
    }
}

Network configuration reference

  • name (string, required): the name of the network
  • type (string, required): "ipoib"
  • master (string, required): name of the host interface to create the link from
  • ipam (dictionary, required): IPAM configuration to be used for this network. For interface only without ip address, create empty dictionary, dhcp type is not supported.

Limitations

Traffic between PODs on the same host may not work if you are using inbox driver from the Linux Kernel older than 5.8 or Mellanox OFED older than 5.1.

You can apply a workaround by disabling IPoIB Enhanced mode if you need to stay on a driver version with this limitation.

For inbox drivers:

  • compile kernel with CONFIG_MLX5_CORE_IPOIB=n

For Mellanox OFED:

  • set ipoib_enhanced=0 param for ib_ipoib module (add options ib_ipoib ipoib_enhanced=0 to /etc/modprobe.d/ib_ipoib.conf)

Note: disabling IPoIB Enhanced mode can have these implications:

  • larger memory consumption by the Kernel
  • lower traffic bandwidth on IPoIB interfaces (compared to when enhanced mode is enabled)