7–RoCE Configuration
Planning for RoCE
128
BC0154501-00 P
Planning for RoCE
As you prepare to implement RoCE, consider the following limitations:
If you are using the inbox OFED, the operating system should be the same
on the server and client systems. Some of the applications may work
between different operating systems, but there is no guarantee. This is an
OFED limitation.
For OFED applications (most often perftest applications), server and client
applications should use the same options and values. Problems can arise if
the operating system and the perftest application have different versions. To
confirm the perftest version, issue the following command:
#
ib_send_bw --version
Building libqedr in inbox OFED requires installing libibverbs-devel.
Running user space applications in inbox OFED requires installing the
InfiniBand
®
Support group, by yum groupinstall “InfiniBand Support” that
contains libibcm, libibverbs, and more.
OFED and RDMA applications that depend on libibverbs also require the
QLogic RDMA user space library, libqedr. Install libqedr using the libqedr
RPM or source packages. If the OS or OFED contains the RDMA-Core
package, installation of libqedr may not be required or allowed.
RoCE supports only little endian.
RoCE does not work over a VF in an SR-IOV environment.
SLES 12 SP3
RoCE v1, RoCE v2, iWARP, iSER
RoCE v1, RoCE v2, iWARP
SLES 12 SP4
RoCE v1, RoCE v2, iWARP, iSER
No
SLES 15
RoCE v1, RoCE v2, iWARP, iSER
No
CentOS 7.5
RoCE v1, RoCE v2, iWARP, iSER
No
CentOS 7.6
RoCE v1, RoCE v2, iWARP, iSER
No
Ubuntu 16.04 LTS
RoCE v1, RoCE v2 (4.5 + kernel),
iWARP, iSER
No
Ubuntu 18.04 LTS
RoCE v1, RoCE v2, iWARP, iSER
No
Table 7-1. OS Support for RoCE v1, RoCE v2, iWARP, iSER, and OFED (Continued)
Operating System
Inbox OFED
OFED 4.8-2 GA
