Physcial Port
Label
Logical Port
Connection
Onboard NIC 3 (MGT
Nodes)
3
eth3
Unused
Data Network Port I
I
IBS 1
Data network connection
Data Network Port II
II
IBS 2
Data network connection
SAS ports
A, B, C, D
SAS connections (6Gbit/s or 12Gbit/s)
16.3.5 Internal Rack Cabling - Local Management Network
●
Lustre 24-Port Management Network Interconnect List - Base Rack
●
Lustre 24-Port Management Network Interconnect List - Storage Rack with Optional MMU
●
Lustre 48-Port Management Network Interconnect List - Base Rack
●
On the Ethernet switches, the ISL link connects to:
○
port 13 on each 24-port switch
○
port 37 on each 48-port switch
●
Connections from the management switches to fabric switches are for managed fabric switches only. Do not
connect to Mellanox SB7790 switches, which are not managed.
●
Port 17 on the base rack 24-port management switch is reserved for connection to a storage rack. Ports 5, 7,
and 19 are also available. When all available ports are used for connecting storage racks, the system may
consist of from 1 to 5 racks total.
●
Ports 13, 16 through 24, 29, 31, 41, and 43 on the base rack 48-port management switch are reserved for
connections to storage racks 1 through 14. Ports 1 through 12, 14, and 15 are also available. When all
available ports are used for connecting storage racks, the system may consist of from 1 to 29 racks total.
Table 10. Lustre 24-Port Management Network Interconnect List - Base Rack
Loom
Label
Component
Side/Port
Switch
Port
Blue LH Side
1
SSU0
A 2
Eth SW1
2
Blue LH Side
2
SSU1
A 2
Eth SW1
4
Blue LH Side
3
SSU2
A 2
Eth SW1
6
Blue LH Side
4
SSU3
A 2
Eth SW1
8
Blue LH Side
5
SSU4
A 2
Eth SW1
1
Blue LH Side
6
SSU5
A 2
Eth SW1
3
Blue LH Side
7
Unused
Unused
Blue LH Side
8
Unused
Unused
Blue LH Side
9
MMU / AMMU
A 2
Eth SW1
10
Blue LH Side
10
SMU
A 2
Eth SW1
9
White LH Side
11
SSU0
A 1
Eth SW0
2
Reference
102
