7–RoCE Configuration
Configuring RoCE on the Adapter for Linux
149
BC0154501-00 P
port: 1
state: PORT_ACTIVE (1)
max_mtu: 4096 (5)
active_mtu: 1024 (3)
sm_lid: 0
port_lid: 0
port_lmc: 0x00
link_layer: Ethernet
7.
Verify the L2 and RoCE connectivity between all servers: one server acts as
a server, another acts as a client.
Verify the L2 connection using a simple
ping
command.
Verify the RoCE connection by performing an RDMA ping on the
server or client:
On the server, issue the following command:
ibv_rc_pingpong -d <ib-dev> -g 0
On the client, issue the following command:
ibv_rc_pingpong -d <ib-dev> -g 0 <server L2 IP address>
The following are examples of successful ping pong tests on the server and the
client.
Server Ping:
root@captain:~#
ibv_rc_pingpong -d qedr0 -g 0
local address: LID 0x0000, QPN 0xff0000, PSN 0xb3e07e, GID
fe80::20e:1eff:fe50:c7c0
remote address: LID 0x0000, QPN 0xff0000, PSN 0x934d28, GID
fe80::20e:1eff:fe50:c570
8192000 bytes in 0.05 seconds = 1436.97 Mbit/sec
1000 iters in 0.05 seconds = 45.61 usec/iter
Client Ping:
root@lambodar:~#
ibv_rc_pingpong -d qedr0 -g 0 192.168.10.165
local address: LID 0x0000, QPN 0xff0000, PSN 0x934d28, GID
fe80::20e:1eff:fe50:c570
remote address: LID 0x0000, QPN 0xff0000, PSN 0xb3e07e, GID
fe80::20e:1eff:fe50:c7c0
8192000 bytes in 0.02 seconds = 4211.28 Mbit/sec
1000 iters in 0.02 seconds = 15.56 usec/iter
