background image

SwitchX®-2 18-Port QSFP FDR InfiniBand System Hardware User Manual

Rev 1.1

Mellanox Technologies

53

 5. 

Select the image to boot.

  2. SX_PPC_M460EX 3.2.0000-dev-HA 2013-04-11 14:05:39 ppc

  3. U-Boot prompt

  Choice:

Downloaded from

Arrow.com.

Downloaded from

Arrow.com.

Downloaded from

Arrow.com.

Downloaded from

Arrow.com.

Downloaded from

Arrow.com.

Downloaded from

Arrow.com.

Downloaded from

Arrow.com.

Downloaded from

Arrow.com.

Downloaded from

Arrow.com.

Downloaded from

Arrow.com.

Downloaded from

Arrow.com.

Downloaded from

Arrow.com.

Downloaded from

Arrow.com.

Downloaded from

Arrow.com.

Downloaded from

Arrow.com.

Downloaded from

Arrow.com.

Downloaded from

Arrow.com.

Downloaded from

Arrow.com.

Downloaded from

Arrow.com.

Downloaded from

Arrow.com.

Downloaded from

Arrow.com.

Downloaded from

Arrow.com.

Downloaded from

Arrow.com.

Downloaded from

Arrow.com.

Downloaded from

Arrow.com.

Downloaded from

Arrow.com.

Downloaded from

Arrow.com.

Downloaded from

Arrow.com.

Downloaded from

Arrow.com.

Downloaded from

Arrow.com.

Downloaded from

Arrow.com.

Downloaded from

Arrow.com.

Downloaded from

Arrow.com.

Downloaded from

Arrow.com.

Downloaded from

Arrow.com.

Downloaded from

Arrow.com.

Downloaded from

Arrow.com.

Downloaded from

Arrow.com.

Downloaded from

Arrow.com.

Downloaded from

Arrow.com.

Downloaded from

Arrow.com.

Downloaded from

Arrow.com.

Downloaded from

Arrow.com.

Downloaded from

Arrow.com.

Downloaded from

Arrow.com.

Downloaded from

Arrow.com.

Downloaded from

Arrow.com.

Downloaded from

Arrow.com.

Downloaded from

Arrow.com.

Downloaded from

Arrow.com.

Downloaded from

Arrow.com.

Downloaded from

Arrow.com.

Downloaded from

Arrow.com.

Summary of Contents for SwitchX-2 MSX6015F-1BRS

Page 1: ...SwitchX 2 18 Port QSFP FDR InfiniBand System Hardware User Manual P N MSX6018F 1SFS MSX6018T 1SFS MSX6018F 1BRS MSX6018T 1BRS MSX6015F 1SFS MSX6015T 1SFS MSX6015F 1BRS MSX6015T 1BRS Rev 1 0 Downloade...

Page 2: ...PURPOSE OF AIDING THE CUSTOMER IN TESTING APPLICATIONS THAT USE THE PRODUCTS IN DESIGNATED SOLUTIONS THE CUSTOMER S MANUFACTURING TEST ENVIRONMENT HAS NOT MET THE STANDARDS SET BY MELLANOX TECHNOLOGI...

Page 3: ...udget Classification 22 2 5 Interfaces 22 Chapter 3 Installation 27 3 1 Installation Safety Warnings 27 3 2 Package Contents 29 3 3 Grounding the Switch 30 3 4 Power Connections and Initial Power On 3...

Page 4: ...ng 51 Appendix A Specification 54 A 1 Approved Cables 57 A 2 EMC Certifications 57 A 3 China CCC Warning Statement 58 Appendix B QSFP Interface 60 Appendix C RJ 45 CONSOLE and I2C Interface 62 Appendi...

Page 5: ...Ds 19 Figure 15 Component Air Flow 21 Figure 16 Component Airflow Mismatch Wrong 21 Figure 17 Port Numbering 22 Figure 18 Interface for Internally Managed Switches 23 Figure 19 Interface for Externall...

Page 6: ...irection 22 Table 11 Serial Terminal Program Configuration 33 Table 12 Configuration Wizard Session IP Configuration by DHCP 34 Table 13 Configuration Wizard Session IP Zeroconf Configuration 35 Table...

Page 7: ...ies 7 Revision History Table 1 Revision History Table Date Revision Description March 2013 1 0 Initial release Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded...

Page 8: ...Table 2 Reference Documents and Web Sites Document Name Description InfiniBand Architecture Specifica tion Volume 1 Release 1 2 1 The InfiniBand Architecture Specification that is provided by IBTA Me...

Page 9: ...er Protocol 6 InfiniBand R Size of box 0 1U 1 1 5U 2 2U FF Management Capabilities 15 18 Ports externally managed 18 18 Ports internally managed 25 36 Ports externally managed 36 36 Ports internally m...

Page 10: ...static routing adap tive routing and advanced congestion management These features ensure the maximum effec tive fabric bandwidth by eliminating congestion hot spots Figure 1 Connector Side View of th...

Page 11: ...effective band width of 40Gb s FDR10 supports 20 more bandwidth over QDR using the same QSFP cables connectors Both FDR and FDR10 support Forward Error Correction FEC as described in IEEE 802 3ap cha...

Page 12: ...only run in an IB fabric Externally managed switches cannot run Ethernet protocol Table 3 Switch Management Family Externally Internally Managed Management Connections SX6015 Externally Managed Unman...

Page 13: ...Connector Side Panels Figure 4 QSFP Switch System Connector Side All connectivity except for power cords is via the connector side panel All connectors can sup port fiber cables 2 2 Status LEDs 2 2 1...

Page 14: ...PS unit is installed in the switch the PS2 LED will be off the FAN LED should light up green If the FAN LED shows red troubleshoot the fan module See Troubleshooting on page 51 OK OK OK OK 12C SX6015...

Page 15: ...able 4 System Status LED Assignments LED Configuration STATUS System Health LED Solid Green OK The system is up and running Flashing Green The system is booting up This assignment is valid on managed...

Page 16: ...properly The system should be powered down and troubleshoot the fan module Off Off The fan unit is not receiving any power Check that the fan unit is properly and completely inserted RST UID PS2 PS1 T...

Page 17: ...or LED on the right side of the PS unit that indicates the internal status of the unit All fans must be operating while the power supply is plugged in If the switch shuts down due to over temperature...

Page 18: ...he system neither PS unit is receiving power If one PS unit is showing green and the second PS unit is unplugged it will show a red indication This is a two color LED Power supply fan air flow directi...

Page 19: ...een received in last few seconds Flashing Orange Error One or possibly more ports have just received a symbol error Possible causes are Bad cable Bad connection Bad connector Table 8 Port Connector Ph...

Page 20: ...ponents need to have the same air flow A mismatch in the air flow will affect the heat dissipation Table 9 Connector Physical and Logical Link Assignments for IB LED Status LED Description Off No powe...

Page 21: ...connector side outlet OK OK OK OK 12C These air flow labels must be the same Any mismatch of these labels will affect the switch temperature Downloaded from Arrow com Downloaded from Arrow com Downlo...

Page 22: ...e inlet to power side outlet F Power side inlet to connector side outlet 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Down...

Page 23: ...nection to the management module This is used the first time the switch is connected A harness is included in the package to connect to a DB9 connection on a host PC Connecting to a local host PC and...

Page 24: ...ets connected to Ethernet switches These switches must be configured to 100M 1G auto negotiation Use only FCC compliant Ethernet cables The externally managed switches are Plug and Play and all firmwa...

Page 25: ...s interface is for Debug and Troubleshooting only This interface is for FAEs and advanced users only DO NOT use a sharp pointed object such as needle or push pin for pressing the Reset button Sharp ob...

Page 26: ...t button resets the CPU of the switch device Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com...

Page 27: ...structions before connecting the equipment to the power source This equipment should not be operated in an area with an ambient temperature exceed ing the maximum recommended 45 C 113 F Moreover to gu...

Page 28: ...onal laws and regula tions This equipment should be installed in compliance with local and national electrical codes Caution Use of controls or adjustment or performance of procedures other than those...

Page 29: ...length of 1 5m six feet but no longer than 4 5m For European connection select a power supply cord that is internationally harmonized and marked HAR 3 conductor minimum 0 75 mm2 wire rated at 300 V wi...

Page 30: ...alid ground connection between the chassis of the switch and the rack Test the ground using an Ohm meter If anything is damaged or missing contact your customer representative immediately For customer...

Page 31: ...wn status Do not hot swap the power supply if your switch has only one power supply You must power down the system to replace the power supply unit when there is only one PS unit in the switch CAUTION...

Page 32: ...ion For more information on how to get the current firmware version see Section 8 4 1 Current Firm ware Revision For Externally Managed Switches on page 50 3 8 Managed Internally Managed Switches Inte...

Page 33: ...one Flow Control None SX6018 CONSOLE MGT 18 Connect the host PC to this port Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arr...

Page 34: ...word characters are not printed You have entered the following information 1 Hostname switch name 2 Use DHCP on mgmt0 interface yes 3 Enable IPv6 yes 4 Enable IPv6 autoconfig SLAAC on mgmt0 interface...

Page 35: ...n answer enter the step number to return to Otherwise hit enter to save changes and exit Choice Configuration changes saved To return to the wizard from the CLI enter the configuration jump start comm...

Page 36: ...10 1 7 Primary DNS server 8 Domain name 9 Enable IPv6 yes 10 Enable IPv6 autoconfig SLAAC on mgmt0 interface no 11 Admin password Enter to leave unchanged unchanged To change an answer enter the step...

Page 37: ...is installed on this device Use the CLI to get the currently installed revision and then go to Mellanox com to check the revision of the latest version show version sx 43 standalone master enable sx...

Page 38: ...t Password Last login March 13 2013 from 192 168 10 1 Mellanox Switch sx 43 standalone master Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Do...

Page 39: ...ent from the fan module airflow direction the switch internal temper ature will be affected OK OK OK PS unit Air flow direction Fan Air flow direction OK OK OK Latch release Push Here Downloaded from...

Page 40: ...tor should light If not repeat the whole procedure to extract the PS unit and re insert it This unit is intended for installation in a Restricted Access Location A restricted access area can be access...

Page 41: ...ow that matches the model number An air flow opposite to the switch design will cause the switch to operate at a higher less than optimal temperature OK OK OK These air flow labels must be the same Th...

Page 42: ...d from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com D...

Page 43: ...nfigurable with this switch is 56 Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded...

Page 44: ...Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from A...

Page 45: ...ide of the chassis before bending upward or downward in the rack 56Gb s and 40Gb s are only guaranteed to work with approved Mellanox Cables Downloaded from Arrow com Downloaded from Arrow com Downloa...

Page 46: ...Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Download...

Page 47: ...ve 2002 96 EC all waste electrical and electronic equipment EEE should be collected separately and not disposed of with regular household waste Dispose of this product and all of its parts in a respon...

Page 48: ...ading SwitchX 2 firmware Upgrading software Monitoring of AC power to the PSUs DC power out from the PSUs Board temperature Fan module status Chassis failures The Ethernet ports for remote management...

Page 49: ...pdating of the software on your switch system 8 4 Externally Managed Switch In order to get information regarding the externally managed switch you need to download the Mellanox MFT tools from the Mel...

Page 50: ...aged switches are Plug and Play and all firmware updates should be done in band This interface is for Debug and Troubleshooting only This interface is for FAEs and advanced users only Downloaded from...

Page 51: ...the locks on the ends are secured 3 Make sure that the latest firmware version is installed on all of the HCA cards and the switch 4 If media adapters are used check that the all connections are good...

Page 52: ...eth0 ppc_4xx_eth1 Hit Ctrl B to stop autoboot 0 Mellanox MLNX OS Boot Menu 1 SX_PPC_M460EX 3 2 0000 dev HA 2013 04 10 12 02 49 ppc Downloaded from Arrow com Downloaded from Arrow com Downloaded from A...

Page 53: ...row com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded...

Page 54: ...ETSI EN 300 019 2 2 1999 09 Humidity Operating 5 95 non condensing Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Dow...

Page 55: ...from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Dow...

Page 56: ...09 Humidity Operating 5 95 non condensing Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Do...

Page 57: ...ability Features Hot swapability Redundancy Hot Swappable 1 1 Redundant Fan Module Power Supplies Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow co...

Page 58: ...om Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from...

Page 59: ...om Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from...

Page 60: ...x3p Transmitter Non Inverted Data Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded...

Page 61: ...om Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from...

Page 62: ...rom Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Down...

Page 63: ...rom Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Down...

Page 64: ...chant des connecteurs Consultez le fab ricant des c bles pour conna tre les mises en garde et les instructions sp ciales Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com D...

Page 65: ...par du personnel form et qualifi L limination de ce mat riel doit s effectuer dans le respect de toutes les l gislations et r glementations nationales en vigueur Downloaded from Arrow com Downloaded f...

Page 66: ...s inter nationalement et marqu HAR 3 conducteurs d un diam tre de fil minimum de 0 75 mm2 d une tension nominale de 300 V avec une gaine isol e en PVC Le cordon doit avoir une fiche moul e d une tensi...

Page 67: ...oaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow c...

Page 68: ...nt Disconnect all power supplies to ensure a powered down state inside of the switch platform Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Do...

Page 69: ...inem PVC Mantel isoliert Das Kabel muss eine angespritztem Stecker bewertet bei 250 V 10 A Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downl...

Page 70: ...m Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from...

Page 71: ...rom Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Down...

Page 72: ...ownloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arrow com Downloaded from Arr...

Page 73: ...los EE UU y del C digo El ctrico de Canad Conforme a la Directiva 2002 96 CE sobre RAEE todos los residuos de equipos el c tricos y electr nicos EEE se deben recolectar por separado y no se deben elim...

Reviews: