background image

www.mellanox.com

InfiniScale® IV 36-Port QSFP 40 Gb/s 

InfiniBand Switch User Manual

P/N:

 IS5025D-1BRC, IS5025Q-1BFC, IS5025Q-1SRC, IS5025Q-1SFC, IS5025Q-1BRC, IS5025Q-2SRC, 

IS5025Q-2BRC, IS5030Q-1BFC, IS5030Q-1SFC, IS5030Q-1BRC, IS5030Q-2BFC, IS5030Q-2SFC, 

IS5030Q-2BRC, IS5035Q-1BFC, IS5035Q-1BRC, IS5035Q-2BFC, IS5035Q-2BRC, IS5035Q-1SFC, 

IS5035Q-2SFC

Rev 2.9

Содержание InfiniScale IV

Страница 1: ...User Manual P N IS5025D 1BRC IS5025Q 1BFC IS5025Q 1SRC IS5025Q 1SFC IS5025Q 1BRC IS5025Q 2SRC IS5025Q 2BRC IS5030Q 1BFC IS5030Q 1SFC IS5030Q 1BRC IS5030Q 2BFC IS5030Q 2SFC IS5030Q 2BRC IS5035Q 1BFC IS...

Страница 2: ...ALL FAULTS OF ANY KIND AND SOLELY FOR THE PURPOSE OF AIDING THE CUSTOMER IN TESTING APPLICATIONS THAT USE THE PRODUCTS IN DESIGNATED SOLUTIONS THE CUSTOMER S MANUFACTURING TEST ENVIRONMENT HAS NOT MET...

Страница 3: ...stallation and Operation 24 3 6 1 Installation Safety Warnings 24 3 6 2 Mechanical Installation 26 3 6 3 Grounding the Switch 32 3 6 4 Power Connections and Initial Power On 32 3 6 5 Extracting and In...

Страница 4: ...SFP Interface 68 Appendix D RJ45 CONSOLE Interface 70 Appendix E Replacement Parts Ordering Numbers 71 Appendix F Avertissements de s curit d installation French 72 Appendix G Installation Sicherheits...

Страница 5: ...nectors 29 Figure 15 Making Room for the Power Cord 30 Figure 16 Screwing on the Bracket 30 Figure 17 Screwing on the Rail 31 Figure 18 Inserting the Caged Nuts 31 Figure 19 Connect Bracket to Rack Ve...

Страница 6: ...9 Inserting the Caged Nuts 63 Figure 40 Put the Cables Through the 1U Space 64 Figure 41 Placing the Power Cords 64 Figure 42 Power Cord Through the Rail Slide 65 Figure 43 Screwing on the Bracket 65...

Страница 7: ...nector Physical and Logical Link Indications 16 Table 6 PSU Status LED Configurations 17 Table 7 PSU Status LED Configurations 18 Table 8 Fan Status LED Configurations 18 Table 9 Air Flow Direction 20...

Страница 8: ...changed to 2 0W level 2 July 2010 Rev 1 9 1 Added QSFP Cable Power Budget Classification June 2010 Rev 1 9 Added section Getting the License Added Note Each Ethernet connector gets connected to Ethern...

Страница 9: ...appendix Fixed Status Fan LED info on page 13 Added to Troubleshooting section Updated power numbers Added IS5025Q 2SRC IS5025Q 2BRC model numbers September 2009 Rev 1 2 Added Spec sheets for IS5025...

Страница 10: ...nfiniScale IV switch device Mellanox OFED Stack for Linux User s Manual See http www mellanox com Support InfiniBand Software and Drivers Click Mellanox OpenFabrics Enterprise Distribution for Linux M...

Страница 11: ...ox Part Numbering Legend Place Field Decoder M Mellanox Technologies IS System Type InfiniScale Switch 50 Model Family FF Form factor 25 36 Ports Unmanaged 30 36 Ports and Chassis Management 31 18 por...

Страница 12: ...the usual precautions for installation and to connect the switch to the HCAs Once connected the Subnet Management software automatically configures and begins utilizing the switch It is recommended t...

Страница 13: ...switches need an initial configura tion before they will start working See the Installation Guide for initial configuration instructions See Table 3 for details Table 3 Switch Management Family Manag...

Страница 14: ...e cables 3 1 1 Status LEDs 3 1 1 1 System Status Indicators The System Status Indicators are located to the left of the QSFP connectors on the connector side panel and labeled STATUS and on the power...

Страница 15: ...ates a problem with the power supplies Only run the switch if at least one of the PSU LEDs is green Figure 3 Power Fan and System LEDs As long as there is power to the switch one PSU is connected and...

Страница 16: ...the LED indication Table 5 Connector Physical and Logical Link Indications Table 4 System Status LED Configurations LED Configuration STATUS System Health LED Green OK The system is up and running Ye...

Страница 17: ...r side panel with PSU2 on the left side Each PSU has a single 2 color LED on the right side of the PSU that indi cates the internal status of the unit Figure 6 PSU Status LEDs Table 6 PSU Status LED C...

Страница 18: ...system neither PSU is receiving power If one PSU is showing green and the second PSU is unplugged it will show a red indication LED Configuration FAN LED Green OK The system is up and running Red Erro...

Страница 19: ...be able to enter without a pass word and make a new password for the user admin In the externally managed switch the reset button resets the CPU of the switch device 3 2 Air Flow These switches can co...

Страница 20: ...3 4 Interfaces 3 4 1 Port Connector Interfaces 3 4 1 1 36 Port Switches The Connector side of the switch has 36 QSFP ports These are placed in two rows 18 ports to a row The ports are labelled as show...

Страница 21: ...NSOLE Use this connector to connect to the host PC Figure 10 Management Interfaces 3 4 2 1 RJ 45 Connector CONSOLE Internally Managed Switches only The port labelled CONSOLE is for a local host connec...

Страница 22: ...nterface An HAR 000022 harness is included in the MTUSB 1 package to connect the switch for updating FW The I2C connection provides access to Flash and EEPROMs This connection allows access to the swi...

Страница 23: ...Check the parts for visible damage that may have occurred during shipping The switch comes packed with the following items 1 switch 1 power cable for each PSU Type B 6ft US 125V 10A chord See Replacem...

Страница 24: ...allows for internally managing the switch through a host PC or remotely through the Ethernet 3 6 1 Installation Safety Warnings For Safety Warnings in French see Section F Avertissements de s curit d...

Страница 25: ...ot work on the equipment or connect or dis connect cables Copper InfiniBand cables are heavy and not flexible as such they should be carefully attached to or detached from the connectors Refer to the...

Страница 26: ...C connections for all possible PSUs The installer should use a rack capable of supporting the mechanical and environmental character istics of a fully populated platform 3 6 2 1 Minimum and Maximum Ra...

Страница 27: ...o be used for racks from 50cm to 80cm deep and rail kit MIS00079 is to be used for racks from 38cm to 50cm deep including the iDataPlex rack For standard depth switches rail kit MIS00085 is to be used...

Страница 28: ...he ESD strap is touching your skin and that the other end is connected to a verified ground 2 Choose which side of the switch you want even with the rack vertical support Either the side with the powe...

Страница 29: ...ding radius Will the connector side be recessed past other equipment in the rack and will this be prob lematic 3 Screw the brackets onto the switch Use the flat head screws to connect the bracket Ther...

Страница 30: ...through the bracket also using the slot in the rail slide See Passing the Power Cord From the Connector Side to the Power Side in a Full Rack on page 57 for detailed instructions on routing the power...

Страница 31: ...slide install the rail slides 8 Tighten the bolts to 9 2 Nm or 81 5 pound inches If the power cable is on this side of the switch feed the power cable into the slot in the rail slide before screwing...

Страница 32: ...itial Power On The switch platform ships with one or two Power Supply Units For switches with only one unit installed a second PSU may be installed at a later time Each supply has a separate AC recept...

Страница 33: ...o replace the power supply unit when there is only one PSU in the switch Make sure that the PSU that you are NOT replacing is showing all green for both the PSU and status indicators Power supply unit...

Страница 34: ...the new unit is free of any dirt and or obstacles 2 Insert the PSU by sliding it into the opening until a slight resistance is felt 3 Continue pressing the PSU until it seats completely The latch will...

Страница 35: ...red the yellow light will blink Figure 24 Top and Bottom Ports To remove disengage the locks and slowly pull the connector away from the port receptacle Both LED indicators will turn off when the cabl...

Страница 36: ...any dirt and or obstacles 2 Insert the fan unit by sliding it into the opening until slight resistance is felt Continue press ing the fan unit until it seats completely 3 7 Disassembly of the Switch f...

Страница 37: ...Remove the eight caged nuts 3 8 Disposal For proper disassembly instructions to comply with the WEEE Directive 2002 96 EC see the Mel lanox website Support the weight of the switch when you remove the...

Страница 38: ...witches come standard with management software module for chassis manage ment IS5030 1 switches are pre installed with a license of up to 108 nodes IS5035 switch is pre installed with a license of up...

Страница 39: ...atch or for recovery from damaged firmware querying for and changing system GUIDs checking for duplicate or bad GUIDs 4 2 2 Fabric Management with UFM For an added licensing fee you can purchase Mella...

Страница 40: ...to the Switch 4 2 4 1 Accessing the CPU via the Ethernet Connector Once the initial configuration is completed the management tools can be accessed through SSH Telnet the WEB 4 2 5 Downloading Firmwar...

Страница 41: ...W version for your switch is available Download the latest FW from http www mellanox com Downloads Firmware For instructions on downloading FW see http www mellanox com Downloads Firmware Tools Be sur...

Страница 42: ...A_MT25418_sw005_HCA 1_lid 0x0001 dev mst SW_MT47396_lid 0x0011 dev mst SW_MT48438_lid 0x0003 Identify the switch you want to update according to its description or its LID in the examples below we wil...

Страница 43: ...r to RJ45 male Use the cable that matches your switch The other is a USB cable with one type A host connection to be connected to the server or PC and a type B connection to be connected to the MTUSB...

Страница 44: ...lanox Open Fabrics from http www mellanox com Downloads InfiniBandSW Drivers Be sure to read and follow all of the instructions regarding the installation and use of these tools Each InfiniBand subnet...

Страница 45: ...ite and con firm that the firmware is the latest If not reburn the latest firmware from the download site New firmware versions will be posted on the Mellanox firmware download page http www mellanox...

Страница 46: ...ont or rear of the chassis and that the fan mod ules and ventilation holes are not blocked especially dust over the holes 3 If you find dust blocking the holes it is recommended to clean the fan unit...

Страница 47: ...I to determine the cause of the shutdown The last software update did not succeed 1 Connect the RS232 connector CONSOLE to a laptop 2 Push the reset button on the switch or management module 3 You wil...

Страница 48: ...ev 2 9 Mellanox Technologies 48 Mellanox FabricIT Boot Menu 1 EFM_PPC_M460EX EFM_1 1 1000 2010 06 24 16 32 03 ppc 2 EFM_PPC_M460EX EFM_1 1 1200 2010 06 25 18 00 03 ppc 3 U Boot prompt Choice 5 Select...

Страница 49: ...Max Power per port for active cables Temperature Humidity Shock and Vibration 100 240 VAC 50 60Hz Typ ical Max 127 94 136 35W 200 23 232 74W For second power supply add 7 6 W 2 0W 10 to 45 Celsius 10...

Страница 50: ...lity and Serviceability Features Switching Perfor mance Switching Capacity Simultaneous wire speed any port to any port 1 44Tb s for 36 ports QDR 720 Gb s for 36 ports DDR 720 Gb s for 18 ports QDR 36...

Страница 51: ...es Temperature Humidity Shock and Vibration 100 240 VAC 50 60Hz Typical Max in W 118 30 147 46 190 59 243 86 For second power supply add 7 6 W 2 0W 10 to 45 Celsius 10 90 non condensing ETSI EN 300 01...

Страница 52: ...lity and Serviceability Features Switching Perfor mance Switching Capacity Simultaneous wire speed any port to any port 1 44Tb s for 36 ports QDR 720 Gb s for 36 ports DDR 720 Gb s for 18 ports QDR 36...

Страница 53: ...s Temperature Humidity Shock and Vibration 100 240 VAC 50 60Hz Typical Max in W 122 85 153 02 196 14 249 41 For second power supply add 7 6 W 2 0W 10 to 45 Celsius 10 90 non condensing ETSI EN 300 019...

Страница 54: ...ellanox Technologies could void the user s authority to operate the equipment 15 105 a Statement NOTE This equipment has been tested and found to comply with the limits for a Class A digital device pu...

Страница 55: ...pense A 2 2 EN Statements Europe EN55022 Class A Statement A 2 3 ICES Statements Canada Class A Statement This Class A digital apparatus complies with Canadian ICES 003 Cet appareil num rique de la cl...

Страница 56: ...ication of Information and Communication Equipment requires EMC testing and certification for many electronic products Korean EMC certifications are issued by Radio Research Laboratory RRL which is or...

Страница 57: ...to bring the power cords from the connector side of the switch to the power side of the switch in a full rack Tools and Customer Supplied Parts Parts included in the installation kit Figure 30 Rack In...

Страница 58: ...e immediately Procedure 1 Place the ESD mat on the floor where you will be working and put on the ESD strap Make sure the ESD strap is touching your skin and that the other end is connected to a verif...

Страница 59: ...head screws for each rail slide There are two sets of holes in the rail slide Select the set of holes to either mount the switch closer or farther away from the rack vertical sup port Tighten the scre...

Страница 60: ...place and screw the bolts into the nuts from step 4 Tighten the bolts to 9 2 Nm or 81 5 pound inches 9 Tighten all of the screws 10 Plug in the power cables 11 Check the Status LEDs and confirm that...

Страница 61: ...ur skin and that the other end is connected to a verified ground 2 Choose which side of the switch you want close to the rack vertical support Either the side with the power supply units or the side w...

Страница 62: ...the connector side recessed in the rack to allow for a larger cable bending radius Will the connector side be recessed past other equipment in the rack and will this be prob lematic The figure above...

Страница 63: ...which side of the rack left or right will need the power cord Note The primary PSU is on the right side of the power side of the switch 4 Put the power cables through the 1U space for the switch Figu...

Страница 64: ...Rev 2 9 Mellanox Technologies 64 Figure 40 Put the Cables Through the 1U Space 6 Install the rail slides placing the power cords through the slots Figure 41 Placing the Power Cords...

Страница 65: ...ackets on the switch so that they extend forward of the switch Figure 43 Screwing on the Bracket Slot in the rail slide In this position you will use 4 flat head screws In this position you will use 3...

Страница 66: ...g on the Rail 11 Clip 4 more caged nuts into the holes in the rack you will be using to connect the brackets Check that both sides of the switch power side and connector side are at the same level in...

Страница 67: ...port 15 Ground the switch 16 Plug in the power cables 17 Check the Status LEDs and confirm that all of the LEDs show status lights consistent with normal operation 18 You can start connecting all of t...

Страница 68: ...tL Module Reset 10 Vcc Rx 3 3 V Power supply receiver 11 SCL 2 wire serial interface clock 12 SDA 2 wire serial interface data 13 GND Ground 14 Rx3p Receiver Non Inverted Data Output 15 Rx3n Receiver...

Страница 69: ...3 3 3 3 3 3 3 3 RX4p GND GND GND RX4n RX2p RX2n TX1n GND TX1p GND TX3n TX3p GND IntL ModPrsL VccTx Vcc1 LPMode 18 35 8 50 Top ResetL SDA SCL ModSelL RX3p TX2n GND VccRx 1 2 3 4 5 6 7 8 9 1 0 1 2 3 4...

Страница 70: ...TR RJ45_TXD GND GND RJ45_RXD GND GND J34 Pin 1 Pin 8 Looking into the Socket CONSOLE TXD TXD RXD GND GND RXD GND GND RJ45_SDA GND GND GND GND RJ45_SCL GND GND J34 Pin 1 Pin 8 Looking into the Socket I...

Страница 71: ...503X Rack installation kit standard MIS000083 IS503X Rack installation kit short MIS000079 IS503X Fan Unit for Power side to Connector side air flow MIS000051 IS503X Fan Unit for Connector side to Pow...

Страница 72: ...ion Le ch ssis ne doit pas tre empil sur un autre mat riel Si le ch ssis tombe il peut provoquer des blessures corporelles et des d gradations de biens Ce produit comporte un couvercle transparent sur...

Страница 73: ...lectriques locaux et nationaux Ce mat riel ne doit tre install remplac ou entretenu que par du personnel form et qualifi L limination de ce mat riel doit s effectuer dans le respect de toutes les l g...

Страница 74: ...pelt werden Wenn das Chassis herunterf llt kann es zu Verletzungen und Besch digungen an Ger ten f hren Dieses Produkt verf gt ber eine Abdeckung ber dem Bereich f r die redun dante Stromversorgung Be...

Страница 75: ...Ger teentsorgung 10 Regionale und nationale elektrische Bestimmungen Die Entsorgung dieses Ger ts sollte unter Beachtung aller nationalen Gesetze Bestimmungen erfolgen Dieses Ger t sollte unter Beacht...

Страница 76: ...recomendada 45 C Adem s para garantizar una circulaci n de aire adecuada se debe dejar como m nimo un espacio de 8 cm 3 pulgadas alrededor de las aberturas de ventilaci n Los chasis no se deben apila...

Страница 77: ...nforme a todas las leyes y reglamentaciones nacionales Este equipo se debe instalar conforme a los c digos el ctricos locales y nacio nales En conexiones de Am rica del Norte seleccionar un cable de a...

Страница 78: ...ICO DE SERVICIO se encar gar de instalar un CONDUCTOR DE CONEXI N A TIERRA DE PROTEC CI N del terminal de puesta a tierra de protecci n separado al conductor de tierra de protecci n del edificio El eq...

Страница 79: ...al electrical codes in Denmark The AC cord shall have an integral ground wire and can only be plugged into a fully grounded outlet Finland Norway Sweden Do not connect this unit to any outlet that is...

Отзывы: