7–RoCE Configuration
Configuring RoCE on the Adapter for Linux
151
AH0054602-00 J
To verify RoCE v2 through different subnets:
1.
Set the route configuration for the server and client using the DCBX-PFC
configuration.
System Settings:
Server VLAN IP
: 192.168.100.3 and
Gateway :
192.168.100.1
Client VLAN IP
:
192.168.101.3 and
Gateway :
192.168.101.1
Server Configuration:
#
/sbin/ip link add link p4p1 name p4p1.100 type vlan id 100
#
ifconfig p4p1.100 192.168.100.3/24 up
#
ip route add 192.168.101.0/24 via 192.168.100.1 dev p4p1.100
Client Configuration:
#
/sbin/ip link add link p4p1 name p4p1.101 type vlan id 101
#
ifconfig p4p1.101 192.168.101.3/24 up
#
ip route add 192.168.100.0/24 via 192.168.101.1 dev p4p1.101
2.
Set the switch settings using the following procedure.
Use any flow control method (Pause, DCBX-CEE, or DCBX-IEEE),
and enable IP routing for RoCE v2. See
for RoCE v2 configuration, or refer to the vendor
switch documents.
If you are using PFC configuration and L3 routing, run RoCE v2 traffic
over the vLAN using a different subnet, and use the RoCE v2 vLAN
GID index.
Server#
ib_send_bw -d qedr0 -F -x 5
Client#
ib_send_bw -d qedr0 -F -x 5 192.168.100.3
