InfiniBand FDR Switch Platform Hardware User Manual
Mellanox Technologies
41
5. Check that the leaf status LEDs, fan status LED, and spine status LED in the spines
are all green.
Figure 32: Spine Module
1.9
InfiniBand QSFP Cable Installation
The switch uses industry standard QSFP InfiniBand cables which are available from
Mellanox Technologies. The Mellanox proprietary QSFP cables support full 56+56Gb/s
(FDR), 40+40Gb/s (FDR10), 40+40Gb/s (QDR), 20+20Gb/s (DDR) and 10+10Gb/s
(SDR) bidirectional wire speed of the switch ports. All InfiniBand QSFP connections are
made to the leaf boards. Each leaf has 18 InfiniBand QSFP connectors in two rows,
which are numbered 1-18. See Section 2.1.6 for port numbering.
All cables can be inserted or removed with the unit powered on. To insert a cable, press
the connector onto the port receptacle until the connector is firmly seated. The orange
LED indicator above the port will light when the physical connection is established
(when both ends of the cable are properly connected to working devices). Allow 15 sec-
The maximum number of connections from each leaf is 2. If the (number of leafs x the
maximum number of connections per leaf) is less than 36 then some of the leaf to spine
connection LEDs may be OFF.
If maximum cable lengths are exceeded data transfer will be reduced and the bit error
rate will increase.
To raise link at FDR (56Gb/s) with 3rd party FDR cables, managed switch systems
must be programmed with management software MLNX-OS 3.3.4304 or higher, and
unmanaged switch systems need SwitchX firmware version 9.2.6000 or higher.
FDR and FDR10 are only guaranteed to work with approved Mellanox Cables.
1 3 5 7 9 11 13 15 17
2 4 6 8 10 12 14 16 18
19 21 23 25 27 29 31 33 35
20 22 24 26 28 30 32 34 36
!
!
UID
Leaf connection LEDs
Status, Fan, Bad Port and UID LEDs
