End of Support — "This artifact is no longer supported. NVIDIA strongly recommends artifacts that are up to date and supported"

IP Over Infiniband (IPoIB) CNI plugin

IPoIB CNI sources coud be found in the official GitHub repository.

Overview

Allow user to create IPoIB child link and move it to the pod.

Example configuration

{
	"name": "mynet",
	"type": "ipoib",
	"master": "ib0",
	"ipam": {
        "type": "host-local",
        "subnet": "192.168.2.0/24",
        "rangeStart": "192.168.2.10",
        "rangeEnd": "192.168.2.216",
        "routes": [{"dst": "0.0.0.0/0"}],
        "gateway": "192.168.2.1"
    }
}

Network configuration reference

• name (string, required): the name of the network
• type (string, required): "ipoib"
• master (string, required): name of the host interface to create the link from
• ipam (dictionary, required): IPAM configuration to be used for this network. For interface only without ip address, create empty dictionary, dhcp type is not supported.

Limitations

Traffic between PODs on the same host may not work if you are using inbox driver from the Linux Kernel older than 5.8 or Mellanox OFED older than 5.1.

You can apply a workaround by disabling IPoIB Enhanced mode if you need to stay on a driver version with this limitation.

For inbox drivers:

• compile kernel with CONFIG_MLX5_CORE_IPOIB=n

For Mellanox OFED:

• set ipoib_enhanced=0 param for ib_ipoib module (add options ib_ipoib ipoib_enhanced=0 to /etc/modprobe.d/ib_ipoib.conf)

Note: disabling IPoIB Enhanced mode can have these implications:

• larger memory consumption by the Kernel
• lower traffic bandwidth on IPoIB interfaces (compared to when enhanced mode is enabled)

Get Help

NVIDIA Developer Community Forum

For support, Visit the NVIDIA Developer Community Forum