background image

www.mellanox.com

216-Port InfiniBand QDR SwitchX®

Switch Platform Hardware Installation Guide

PN:MIS5200Q-4DNC

Rev 1.6

Содержание MIS5100Q-3DNC

Страница 1: ...www mellanox com 216 Port InfiniBand QDR SwitchX Switch Platform Hardware Installation Guide PN MIS5200Q 4DNC Rev 1 6...

Страница 2: ...Document Number 3268 Mellanox Technologies 2...

Страница 3: ...tform 33 1 8 InfiniBand QSFP Cable Installation 34 1 8 1 Supported Approved Cables 35 1 8 2 Cable Power Classes 35 1 9 Hot Swap Insertion and Extraction 35 1 9 1 Power Supply Units 36 1 9 2 Leaf Board...

Страница 4: ...er 5 Resetting the Switch RST 74 Chapter 6 Troubleshooting 75 6 1 Power Supply Unit 75 6 2 Leaf Board 75 6 3 Management Module 76 6 4 Spine Board 77 6 5 Software 77 Chapter 7 Disassembly and Disposal...

Страница 5: ...55 Table 8 LEDs Display for Normal Operation 56 Table 9 LEDs Display for Normal Operation 57 Table 10 Management Module PSU LED Configurations 57 Table 11 Management Module S Fan LED Configurations 5...

Страница 6: ...Raising the Chassis Using a Mechanical Lift 30 Figure 16 Put on the Rail Slide 30 Figure 17 IS5200 Chassis on the Shelf 31 Figure 18 Face Plate Mounting Bolt Locations 31 Figure 19 Ground Connectio n...

Страница 7: ...Status Indications 55 Figure 48 Management Module Status Indications 56 Figure 49 Management Module LEDs 57 Figure 50 Port Numbering 58 Figure 51 Top and Bottom Ports 58 Figure 52 Management Module I...

Страница 8: ...on page 15 Section 1 6 1 5 Installing the Shelf on page 21 Section 1 6 2 Installing the Cable Holder on page 25 Section 1 9 Hot Swap Insertion and Extraction on page 35 Section 7 1 Disassembling the C...

Страница 9: ...Architecture Specification that is provided by IBTA Switch Product Release Notes For possible hardware issues see the switch support product page This requires a customer support login Look up the re...

Страница 10: ...nstructions to make the initial configuration 1 1 Installation Safety Warnings These safety warnings are in English For French German Spanish Russian and Roma nian see the Appendixes 1 Installation In...

Страница 11: ...an ambient temperature exceed ing the maximum recommended 45 C 113 F Moreover to guarantee proper air flow allow at least 8cm 3 inches of clearance around the ventilation openings The chassis should n...

Страница 12: ...arnings instructions When this product is mounted or serviced in a rack special precautions must be taken to ensure that the system remains stable In general you should fill the rack with equip ment s...

Страница 13: ...rminal screws of this device must be connected to the protective earth in the building installation GND Connection Information The building installation shall provide a means for a connection to prote...

Страница 14: ...echanical and fire enclosure shall be provided by the end prod uct manufacturer and or the end user Caution Slide rail mounted equipment is not to be used as a shelf or a work space The rails are not...

Страница 15: ...stalled in the rack 1 installation guide 1 box containing various other parts It is highly recommended that the installation sites be as isolated as possible from all sources of radio transmissions an...

Страница 16: ...tandard 19 rack 9U for the chassis and 1U for the shelf The switch ships from the factory with mounting holes on the spine side There are upper brackets to connect the leaf side to the rack near the t...

Страница 17: ...ure that this is a tight fit 1 6 1 1 Installation ProcedureRequirements You will need Choose a rack which is able to support the mechanical and environmental characteris tics of a fully populated swit...

Страница 18: ...M6 bolts for the caged nuts 4 caged nuts 2 Shelf rail slides 4 lock washers 2 long 2 hole flat washers 2 chassis rail slides 4 handles 8 M 5 pan head bolts 8 allen head screws 2 flat 4 hole metal spa...

Страница 19: ...roughly handled Upon receipt of the container look for and inspect the shock and tilt stickers to confirm that they have not tripped If one or more are red notify the shipper and Mellanox This on its...

Страница 20: ...strap on and connect it to a valid ground 2 Open the crate by unscrewing the sides and top of the crate HANDLE WITH CARE HANDLE WITH CARE G G I I N N N N R R W WA A G G I I N N N N R R W WA A HANDLE W...

Страница 21: ...not using a mechanical lift to install the chassis reduce the weight of the chassis by removing all of the spines power supply units management modules and fan units and put aside for reinstallation a...

Страница 22: ...onnect the shelf brackets Check that both sides of the shelf are at the same level in the rack Figure 6 Inserting the Caged Nuts for the Shelf 4 Insert 2 caged nuts for the filler panel 5 Using two of...

Страница 23: ...nto the nuts from step 3 8 Extend the rail slides to the rack vertical support and screw them to the rack using the 2 hole washers and lock washers See Figure 7 9 Tighten all of the screws to 7 7 Nm o...

Страница 24: ...s 24 Figure 8 Inserting the Caged Nuts for the FaceplateChassis on Shelf with Filler Panel Shelf 1 6 5 4 3 2 7 8 9 Filler panel Shelf 1 5 4 3 2 7 8 9 6 Place the caged nuts here Spine Side Leaf Side P...

Страница 25: ...or side of the chassis and iden tify the holes where the caged nuts are to be placed Now is the time to install the cable holder The cable holders should go to the outside of the vertical supports Rig...

Страница 26: ...teps 1 3 for the second cable holder 5 Install the shelves The cable support shelves just sit on the cable holders 6 Use the holes in the shelves to tie down the cables individually or in bundles If t...

Страница 27: ...s 1 Screw the handles onto the chassis Use the 8 allen head screws and the allen wrench provided Two handles go on the connector side and two go on the sides of the chas sis Do not use the locknuts Th...

Страница 28: ...28 Figure 12 Installing the Handles Figure 13 Screw the Handles Onto the Chassis Do not use the locknuts They are extras not needed for this installation Do not use the handles on the fans for liftin...

Страница 29: ...legs bend your knees and not your back 2 Lift the chassis and slide it onto the shelf Use a mechanical lift or enough people to safely lift the chassis A full chassis weighs 120 kgs an empty chassis w...

Страница 30: ...the chassis into the rack until the faceplate is 20cm 8 from the vertical support 5 Put the rail slides onto the rails Figure 16 Put on the Rail Slide 6 Slide the chassis further into the rack 7 Slid...

Страница 31: ...use 12 Ground the switch 13 Install all of the spines leafs and management modules 14 Install any power supply units and fan units removed at the start of the installation procedure 15 Insert all lea...

Страница 32: ...nding post Make sure the connections are solid and permanent If you choose to not use the ground screw make sure that the rack is properly grounded and that there is a valid ground con nection between...

Страница 33: ...nsumption will then be divided by the remaining working PSUs When the failed PSU is hot swapped the new PSU will ramp up and pass its share of current so that the total current is always divided by th...

Страница 34: ...All cables can be inserted or removed with the unit powered on To insert a cable press the connector onto the port receptacle until the connector is firmly seated The orange LED indicator above the po...

Страница 35: ...your wrist and connect to the IS5200 chassis This switch platform supports hot swap capabilities for the parts listed below Power supply units Leaf boards Spine boards Leaf fan module Spine fan module...

Страница 36: ...ch power cord it is according to the AC numbering Figure 22 Power Cord Numbering Figure 23 PSU Locations 3 On the spine side of the chassis remove the cover to the power supply unit for the non workin...

Страница 37: ...the chassis 5 Replace the cover over the PSUs 1 9 2 Leaf Boards The leaf boards are numbered from top to bottom with corresponding numbers dis played to the outside of the leafs vertically along the s...

Страница 38: ...Figure 26 Ejector Handle 5 Pull out the module half way through the guiding rails using the ejector handle 6 Lock the ejector handle 7 Hold the body of the leaf on both sides and remove it from the ch...

Страница 39: ...r any broken signal dividers or any deviations from the pass criterion shown in Figure 28 Figure 28 Intact vs Defected Signal Connectors When hot swapping any of the units it is necessary to wait 1 mi...

Страница 40: ...the front panel of the leaf 6 Holding the leaf by its sides carefully set the leaf board into the chassis 7 Applying equal pressure on both sides of the leaf board slowly slide the board into the chas...

Страница 41: ...sed replacement parts within a SwitchX based chas sis and vice versa All Replacement modules must be consistent with the Chassis fam ily and switch chip generation When hot swapping any of the units i...

Страница 42: ...he ejector handles to unlock the ejectors from the chassis Removing spine 1 causes management module 1 to reset Removing spine 2 causes management module 2 to reset Warning If the spine you want to ho...

Страница 43: ...spine board 1 Check for foreign objects in or mechanical damage to the chassis spine slots 2 Check spine mechanics for any noticeable damage or deviations from the pass crite rion shown in Figure 32 F...

Страница 44: ...teria shown in Figure 33 and Figure 34 Figure 33 Intact vs Defected Side Signal Connectors Figure 34 Intact vs Defected Middle Signal Connectors 4 Check power connector s integrity Look for any damage...

Страница 45: ...ioning the status LED on the fan will light up Each spine has an individual fan module that contains two individual fans Should a sin gle fan fail the Fan Status LED on the spine and the S Fan LED on...

Страница 46: ...with two individual fans built in When a fan mod ule is not functioning the Fan Status LED on the spine will light up Figure 38 Spine Fan Module When a fan module is removed the indicator light will...

Страница 47: ...anagement module has a pair of ejectors that lock the board in place and serve as a lever for seating or extracting see Figure 40 When hot swapping any of the units it is necessary to wait 1 minute af...

Страница 48: ...or mechanical damage to the chassis management slots 2 Check management mechanics for any noticeable damage 3 Check back signal connectors integrity Look for any broken signal dividers or any deviati...

Страница 49: ...Switch Shut Down Procedures To shut down the chassis run the following command twice once for each MM Do not apply excessive force to slide in the management board If you feel resistance remove the ma...

Страница 50: ...own a leaf run the following command To shut down a spine run the following command To shut down a management module run the following command The chassis cannot be restarted remotely To restart the c...

Страница 51: ...it has the following indicator LEDs Figure 43 Power Supply Unit Status Indications AC When lit this LED indicates input voltage between 100 and 240 Volts DC FAIL When lit this LED indicates a fault in...

Страница 52: ...44 PSU Cover On and Off S1 S2 S3 S4 S5 S6 IS5200 PS3 PS1 PS4 PS2 L R FAN FAN FAN FAN FAN FAN Fan 1 Fan 2 Fan 3 Fan 4 Mellanox S1 S2 S3 S4 S5 S6 IS5200 DC AC OK FAIL OK DC AC OK FAIL OK DC AC OK FAIL O...

Страница 53: ...t will light orange when the physical connection is established that is when the unit is powered on and a cable is plugged into the port with the other end of the connector plugged into a functioning...

Страница 54: ...um number of connections per leaf is less than 36 then some of the leaf to spine connection LEDs may be OFF The status LEDs for the spine and their descriptions are shown in Table 5 The LEDs indicate...

Страница 55: ...spine Table 7 shows the leaf to spine status according to the LED condition 2 1 4 Spine Side Panel Display LED Indicators The spine side panel display has LEDs that show the chassis condition Figure 4...

Страница 56: ...S fault detected User should check individual power supplies for fault indications Green SPINE FANS STATUS Off No power to fan Green Nominal operational Red One or more of the spine fans is bad User s...

Страница 57: ...S fault detected User should check individual power supplies for fault indications Green SPINE FANS STATUS Off No power to fan Green Nominal operational Red One or more of the spine fans is bad User s...

Страница 58: ...ed from the top row See Figure 51 Figure 50 Port Numbering Figure 51 Top and Bottom Ports Table 11 Management Module S Fan LED Configurations LED Condition Description Green OK All Spine fans are work...

Страница 59: ...They are 1 I2C port 1 CONSOLE port this is an RS232 connector for connecting to a host machine 1 MGT this is an Ethernet connector 1 USB port 1 RST reset button Figure 52 Management Module Interfaces...

Страница 60: ...he other management module becomes the master If there is only one management module in the chassis all of the leafs and ports are reset by bringing them down and powering them up when the reset butto...

Страница 61: ...plies Leaf fan modules Spine fan modules 2 Insert all leafs that you plan to use in the chassis Start at the bottom of the chassis and work your way up 3 Insert the first two spines in the top two slo...

Страница 62: ...d 3 Spine Board indicators will display status of internal links to the installed leaf boards All PHY links to existing leaf Boards should be ON 4 Check the Spine LEDs and make sure they coincide with...

Страница 63: ...xamples Figure 56 Console Ports for SX60xx SX65xx Managed Systems On SX65xx systems when having dual management systems first connect the cable and configure the master card and only then configure th...

Страница 64: ...esetting the switch to the factory defaults Type y and then press Enter Step1 Hostname switch 1 If you wish to accept the default hostname then press Enter Otherwise type a different hostname and pres...

Страница 65: ...se DHCP on mgmt0 interface yes 3 Enable IPv6 yes 4 Enable IPv6 autoconfig SLAAC on mgmt0 interface yes 5 Admin password Enter to leave unchanged CHANGED To change an answer enter the step number to re...

Страница 66: ...Enable IPv6 autoconfig SLAAC on mgmt0 interface no no Step 9 Admin password Enter to leave unchanged You have entered the following information 1 Hostname switch 112126 2 Use DHCP on mgmt0 interface...

Страница 67: ...name Step 9 Enable IPv6 yes yes Step 10 Enable IPv6 autoconfig SLAAC on mgmt0 interface no no Step 11 Admin password Enter to leave unchanged You have entered the following information 1 Hostname swi...

Страница 68: ...s 169 254 15 134 Netmask 255 255 0 0 IPv6 enabled yes Autoconf enabled yes Autoconf route yes Autoconf privacy no IPv6 addresses 1 IPv6 address fe80 202 c9ff fe11 a1b2 64 Speed 1000Mb s auto Duplex fu...

Страница 69: ...upplied at the time of purchase To generate the License Key enter the License Entitlement Number and the Switch Serial Number into the Mellanox online license tool at http license mella nox com The Sw...

Страница 70: ...5 Print the generated license key PDF document is generated Step 6 Go to the FabricIT page and click on Setup Licensing Figure 59 FabricIT Status Licensing Step 7 Input the generated License key Step...

Страница 71: ...h using the command ssh l user name switch ip address Step 3 Login to the switch default username is admin password admin Step 4 Read and accept the EULA when prompted Step 5 Once you get the prompt y...

Страница 72: ...f the switch or its DNS name in the format http switch_IP_address Step 4 Login to the switch default user name is admin password admin Figure 60 MLNX OS Login Window Step 5 Read and accept the EULA if...

Страница 73: ...InfiniBand Switch Platform Hardware User Manual Mellanox Technologies 73 After login a default status summary window is displayed as shown in Figure 62 Figure 62 Display After Login...

Страница 74: ...e this management module is reset becoming the slave and the other management module becomes the mas ter If there is only one management module in the chassis when the reset button is pushed all of th...

Страница 75: ...DC OK 2 Uninstall and reinstall the Leaf board 3 When the Yellow LED is on this indicates a fault in the board uninstall and reinstall the Leaf board 4 If uninstalling and reinstalling the Leaf board...

Страница 76: ...ent Module is Lit 1 Check the MLNX OS management for confirmation and possible explanation of the alert 2 Make sure that there is nothing blocking the front or rear of the chassis and that the fan mod...

Страница 77: ...he MLNX OS management for confirmation and possible explanation of the alert 2 Make sure that there is nothing blocking the front or rear of the chassis and that the fan modules and ventilation holes...

Страница 78: ...k 2 Remove the screws holding the chassis to the rack These screws are located in the faceplate on the spine side of the chassis 3 Remove the upper brackets from the chassis 4 Remove the lock down bar...

Страница 79: ...to the Mellanox website for detailed instructions for disassembly according to the WEEE Directive According to the WEEE Directive 2002 96 EC all waste electrical and electronic equipment EEE should be...

Страница 80: ...equipment is very heavy and should be moved using a mechanical lift to avoid injuries This unit is intended for installation in a Restricted Access Location Risk of Electric Shock With the fan module...

Страница 81: ...duct or touching any internal parts Risk of electric shock and energy hazard The PSUs are all independent Disconnect all power supplies to ensure a powered down state inside of the switch platform Dur...

Страница 82: ...ical Code and the Canadian Electrical Code Warning Replace only with UL Recognized battery certified for maximum abnormal charging current not less than 4mA There is a risk of explosion should the bat...

Страница 83: ...ommunication centre or a dedicated computer room This device must be installed according to the latest version of the country national electrical codes For North America equipment must be installed in...

Страница 84: ...all waste electrical and electronic equipment EEE should be collected separately and not disposed of with regular household waste Dispose of this product and all of its parts in a responsible and env...

Страница 85: ...InfiniBand Switch Platform Hardware User Manual Mellanox Technologies 85 5 6 7 8 9 10 11 45 C 113 F 8 3 PSU...

Страница 86: ...InfiniBand Switch Platform Hardware User Manual Mellanox Technologies 86 12 InfiniBand 13 14 15 16 17 18 InfiniBand UL 4mA...

Страница 87: ...User Manual Mellanox Technologies 87 19 UL CSA 20 21 GND 22 23 24 25 UL CSA 16 AWG 125 V 13 A 1 5 4 5 HAR 1 0 300 V PVC 250 V 10 A GND RS232 UL DP 1 DP 2 LPS 20 A CLASS 1 IEC 60 825 1 1993 A1 1997 A2...

Страница 88: ...InfiniBand Switch Platform Hardware User Manual Mellanox Technologies 88 26 27 WEEE 28 WEEE 2002 96 EC EEE TN IT...

Страница 89: ...nual Mellanox Technologies 89 29 China CCC Warning Statement A 3 Avertissements de s curit pour l installation French 1 Instructions d installation Veuillez lire la totalit des instructions d installa...

Страница 90: ...odule de ventilation est retir les broches d alimentation sont expos es dans l emplacement du module NE PAS ins rer d outils ou la main dans l emplacement du module Cet quipement ne doit pas tre en se...

Страница 91: ...ors tension d branchez toutes les alimen tations Pendant un orage ne pas travailler sur l quipement ni brancher ou d brancher des c bles Les c bles InfiniBand en cuivre sont lourds et peu flexibles Pa...

Страница 92: ...16 AWG avec une prise moul e 125 V 13 A faisant au moins 1 5 m de long six pieds et au plus 4 5 m Pour le branchement lectrique en Europe utiliser un cordon d alimentation au format international harm...

Страница 93: ...Attention l utilisation de commandes l ajustement ou la conduite de proc dures autres que celles indiqu es ici pourraient conduire une exposition dangereuse des rayonnements Pour les produits disposa...

Страница 94: ...erletzungen zu vermeiden Diese Ger t ist f r die Installation in einem Bereich mit beschr nktem Zugang vorge sehen Stromschlagrisiko Bei abgenommenem Ventilatormodul sind die Stromkontakte in der Modu...

Страница 95: ...eile Risiko eines Stromschlags und Stomgefahr Alle Stromversorgungseinheiten sind unabh ngig Trennen Sie alle Stomversorgungen um einen abgeschalteten Zustand im Inneren der Switch Plattform sicherzus...

Страница 96: ...anerkannten Akkus ersetzen die f r maximalen anor malen Ladestrom von nicht weniger als 4mA zertifiziert sind Es besteht Explosiionsgefahr wenn der Akku durch einen Akku eines falschen Typs ersetzt w...

Страница 97: ...e Verkabelung Achtung Nutzung von Steuerungen oder Einstellungen oder Ausf hrung von Proze duren die hier nicht spezifiziert sind kann zu gef hrlichem Strahlenkontakt f hren Klasse 1 Laserprodukt und...

Страница 98: ...ver nicamente mediante un elevador mec nico para evitar lesiones Esta unidad ha sido ideada para instalar en lugares de acceso restringido Riesgo de descarga el ctrica Con el m dulo del ventilador qui...

Страница 99: ...neutro Quitar los cables de corriente antes de abrir la tapa de este producto o tocar cualquier componente interno Riesgo de descarga el ctrica y peligro de corriente Todas las fuentes de alimentaci...

Страница 100: ...ciones vigentes del C digo El ctrico Nacional de los EE UU y del C digo El ctrico de Canad II y a danger d explosion s il y a remplacement incorrect de la batterie Remplacer uniquement avec une batter...

Страница 101: ...ificio El equipo se instalar en un rea donde haya conexi n equipotencial como por ejemplo un centro de telecomunicaciones o una sala de computadoras dedicada Este dispositivo se debe instalar conforme...

Страница 102: ...a unidad hacia afuera del bastidor Sirven solo para la instalaci n permanente en el lugar de destino final no para fines de servicio o mantenimiento Conforme a la Directiva 2002 96 CE sobre RAEE todos...

Страница 103: ...InfiniBand Switch Platform Hardware User Manual Mellanox Technologies 103 4 5 6 7 8 9 10 45 C 113 F 8 3...

Страница 104: ...InfiniBand Switch Platform Hardware User Manual Mellanox Technologies 104 11 12 InfiniBand 13 14 15 16 17 InfiniBand...

Страница 105: ...InfiniBand Switch Platform Hardware User Manual Mellanox Technologies 105 18 19 UL CSA 20 21 22 UL 4 UL CSA 3 16 AWG 1 5 6 4 5 125 13 HAR 3 1 0 300 250 10...

Страница 106: ...24 25 26 27 WEEE A 7 Avertismente privind siguran a la instalare Romanian 1 Instruc iuni de instalare RS232 Ethernet DP 1 DP 2 UL 20 1 IEC 60 825 1 1993 A1 1997 A2 2001 EN 60825 1 1994 A1 1996 A2 2001...

Страница 107: ...ndep rtat pinii electrici sunt accesibili n cavitatea modulului NU introduce i instrumente sau p r i din corp n cavitatea modulului ventilator Acest echipament nu trebuie s fie ac ionat ntr o zon und...

Страница 108: ...ele de alimentare cu energie pentru a asigura decuplarea n inte riorul platformei de comutare n timpul perioadelor cu desc rc ri electrice luminoase nu lucra i cu echipamentul sau nu conecta i sau dec...

Страница 109: ...4 5 m Pentru conectarea la o surs de alimentare n Europa selecta i un cordon de alimentare care este armonizat la nivel interna ional i marcat HAR cu 3 conductoare cu minimum 2 fire de 1 0 mm cu pute...

Страница 110: ...20 A trebuie s fie integrat n cablajul cl dirii Aten ie Utilizarea elementelor de comand sau ajustarea sau executarea altor proce duri dec t a celor indicate n acest document poate avea ca rezultat e...

Страница 111: ...je vrlo te ka i treba se premje tati pomo u mehani kog dizala kako bi se izbjegle ozljede Ovaj ure aj je namijenjen za instaliranje na lokaciju s ograni enim pristupom Rizik od strujnog udara S uklon...

Страница 112: ...li ako nije dobro pri vr en Ovaj sustav raspola e dvopolnim neutralnim osigura ima Uklonite sve kabele napa janja prije otvaranja poklopca proizvoda ili dodirivanja unutarnjih dijelova Rizik od strujn...

Страница 113: ...ma navedenim u US National Electrical Code i Canadian Electrical Code Upozorenje Bateriju zamijenite samo baterijom iz serije UL koja je certifici rana za maksimalnu nepravilnu struju punjenja ne manj...

Страница 114: ...ure aj mora instalirati sukladno najnovijoj verziji nacionalnih elektri nih kodova dr ave U Sjevernoj Americi oprema se mora instalirati sukladno va e im zahtjevima navedenim u US National Electrical...

Страница 115: ...002 96 EZ sav elektri ni i elektroni ki otpad EEE trebao bi se prikupljati zasebno i ne bi se trebao odlagati kao obi an ku anski otpad Odlaganje ovog proizvoda i svih njegovih dijelova vr ite na odgo...

Страница 116: ...mail info mellanox com Map and Directions Tech Support 408 916 0055 8 00AM to 5 00 PM Pacfic Mellanox Technologies Ltd Beit Mellanox PO Box 586 Yokneam 20692 Israel Tel 972 0 4 909 7200 972 0 74 723 7...

Страница 117: ...InfiniBand Switch Platform Hardware User Manual Mellanox Technologies 117 216 Port InfiniBand QDR Switch Platform Installation Guide...

Отзывы: