Mellanox Technologies MIS5100Q-3DNC Hardware Installation Manual Download

Page: 1 / 117

www.mellanox.com

216-Port InfiniBand QDR SwitchX®

Switch Platform Hardware Installation Guide

PN:MIS5200Q-4DNC

Rev 1.6

Summary of Contents for MIS5100Q-3DNC

Page 1: ...www mellanox com 216 Port InfiniBand QDR SwitchX Switch Platform Hardware Installation Guide PN MIS5200Q 4DNC Rev 1 6...

Page 2: ...Document Number 3268 Mellanox Technologies 2...

Page 3: ...tform 33 1 8 InfiniBand QSFP Cable Installation 34 1 8 1 Supported Approved Cables 35 1 8 2 Cable Power Classes 35 1 9 Hot Swap Insertion and Extraction 35 1 9 1 Power Supply Units 36 1 9 2 Leaf Board...

Page 4: ...er 5 Resetting the Switch RST 74 Chapter 6 Troubleshooting 75 6 1 Power Supply Unit 75 6 2 Leaf Board 75 6 3 Management Module 76 6 4 Spine Board 77 6 5 Software 77 Chapter 7 Disassembly and Disposal...

Page 5: ...55 Table 8 LEDs Display for Normal Operation 56 Table 9 LEDs Display for Normal Operation 57 Table 10 Management Module PSU LED Configurations 57 Table 11 Management Module S Fan LED Configurations 5...

Page 6: ...Raising the Chassis Using a Mechanical Lift 30 Figure 16 Put on the Rail Slide 30 Figure 17 IS5200 Chassis on the Shelf 31 Figure 18 Face Plate Mounting Bolt Locations 31 Figure 19 Ground Connectio n...

Page 7: ...Status Indications 55 Figure 48 Management Module Status Indications 56 Figure 49 Management Module LEDs 57 Figure 50 Port Numbering 58 Figure 51 Top and Bottom Ports 58 Figure 52 Management Module I...

Page 8: ...on page 15 Section 1 6 1 5 Installing the Shelf on page 21 Section 1 6 2 Installing the Cable Holder on page 25 Section 1 9 Hot Swap Insertion and Extraction on page 35 Section 7 1 Disassembling the C...

Page 9: ...Architecture Specification that is provided by IBTA Switch Product Release Notes For possible hardware issues see the switch support product page This requires a customer support login Look up the re...

Page 10: ...nstructions to make the initial configuration 1 1 Installation Safety Warnings These safety warnings are in English For French German Spanish Russian and Roma nian see the Appendixes 1 Installation In...

Page 11: ...an ambient temperature exceed ing the maximum recommended 45 C 113 F Moreover to guarantee proper air flow allow at least 8cm 3 inches of clearance around the ventilation openings The chassis should n...

Page 12: ...arnings instructions When this product is mounted or serviced in a rack special precautions must be taken to ensure that the system remains stable In general you should fill the rack with equip ment s...

Page 13: ...rminal screws of this device must be connected to the protective earth in the building installation GND Connection Information The building installation shall provide a means for a connection to prote...

Page 14: ...echanical and fire enclosure shall be provided by the end prod uct manufacturer and or the end user Caution Slide rail mounted equipment is not to be used as a shelf or a work space The rails are not...

Page 15: ...stalled in the rack 1 installation guide 1 box containing various other parts It is highly recommended that the installation sites be as isolated as possible from all sources of radio transmissions an...

Page 16: ...tandard 19 rack 9U for the chassis and 1U for the shelf The switch ships from the factory with mounting holes on the spine side There are upper brackets to connect the leaf side to the rack near the t...

Page 17: ...ure that this is a tight fit 1 6 1 1 Installation ProcedureRequirements You will need Choose a rack which is able to support the mechanical and environmental characteris tics of a fully populated swit...

Page 18: ...M6 bolts for the caged nuts 4 caged nuts 2 Shelf rail slides 4 lock washers 2 long 2 hole flat washers 2 chassis rail slides 4 handles 8 M 5 pan head bolts 8 allen head screws 2 flat 4 hole metal spa...

Page 19: ...roughly handled Upon receipt of the container look for and inspect the shock and tilt stickers to confirm that they have not tripped If one or more are red notify the shipper and Mellanox This on its...

Page 20: ...strap on and connect it to a valid ground 2 Open the crate by unscrewing the sides and top of the crate HANDLE WITH CARE HANDLE WITH CARE G G I I N N N N R R W WA A G G I I N N N N R R W WA A HANDLE W...

Page 21: ...not using a mechanical lift to install the chassis reduce the weight of the chassis by removing all of the spines power supply units management modules and fan units and put aside for reinstallation a...

Page 22: ...onnect the shelf brackets Check that both sides of the shelf are at the same level in the rack Figure 6 Inserting the Caged Nuts for the Shelf 4 Insert 2 caged nuts for the filler panel 5 Using two of...

Page 23: ...nto the nuts from step 3 8 Extend the rail slides to the rack vertical support and screw them to the rack using the 2 hole washers and lock washers See Figure 7 9 Tighten all of the screws to 7 7 Nm o...

Page 24: ...s 24 Figure 8 Inserting the Caged Nuts for the FaceplateChassis on Shelf with Filler Panel Shelf 1 6 5 4 3 2 7 8 9 Filler panel Shelf 1 5 4 3 2 7 8 9 6 Place the caged nuts here Spine Side Leaf Side P...

Page 25: ...or side of the chassis and iden tify the holes where the caged nuts are to be placed Now is the time to install the cable holder The cable holders should go to the outside of the vertical supports Rig...

Page 26: ...teps 1 3 for the second cable holder 5 Install the shelves The cable support shelves just sit on the cable holders 6 Use the holes in the shelves to tie down the cables individually or in bundles If t...

Page 27: ...s 1 Screw the handles onto the chassis Use the 8 allen head screws and the allen wrench provided Two handles go on the connector side and two go on the sides of the chas sis Do not use the locknuts Th...

Page 28: ...28 Figure 12 Installing the Handles Figure 13 Screw the Handles Onto the Chassis Do not use the locknuts They are extras not needed for this installation Do not use the handles on the fans for liftin...

Page 29: ...legs bend your knees and not your back 2 Lift the chassis and slide it onto the shelf Use a mechanical lift or enough people to safely lift the chassis A full chassis weighs 120 kgs an empty chassis w...

Page 30: ...the chassis into the rack until the faceplate is 20cm 8 from the vertical support 5 Put the rail slides onto the rails Figure 16 Put on the Rail Slide 6 Slide the chassis further into the rack 7 Slid...

Page 31: ...use 12 Ground the switch 13 Install all of the spines leafs and management modules 14 Install any power supply units and fan units removed at the start of the installation procedure 15 Insert all lea...

Page 32: ...nding post Make sure the connections are solid and permanent If you choose to not use the ground screw make sure that the rack is properly grounded and that there is a valid ground con nection between...

Page 33: ...nsumption will then be divided by the remaining working PSUs When the failed PSU is hot swapped the new PSU will ramp up and pass its share of current so that the total current is always divided by th...

Page 34: ...All cables can be inserted or removed with the unit powered on To insert a cable press the connector onto the port receptacle until the connector is firmly seated The orange LED indicator above the po...

Page 35: ...your wrist and connect to the IS5200 chassis This switch platform supports hot swap capabilities for the parts listed below Power supply units Leaf boards Spine boards Leaf fan module Spine fan module...

Page 36: ...ch power cord it is according to the AC numbering Figure 22 Power Cord Numbering Figure 23 PSU Locations 3 On the spine side of the chassis remove the cover to the power supply unit for the non workin...

Page 37: ...the chassis 5 Replace the cover over the PSUs 1 9 2 Leaf Boards The leaf boards are numbered from top to bottom with corresponding numbers dis played to the outside of the leafs vertically along the s...

Page 38: ...Figure 26 Ejector Handle 5 Pull out the module half way through the guiding rails using the ejector handle 6 Lock the ejector handle 7 Hold the body of the leaf on both sides and remove it from the ch...

Page 39: ...r any broken signal dividers or any deviations from the pass criterion shown in Figure 28 Figure 28 Intact vs Defected Signal Connectors When hot swapping any of the units it is necessary to wait 1 mi...

Page 40: ...the front panel of the leaf 6 Holding the leaf by its sides carefully set the leaf board into the chassis 7 Applying equal pressure on both sides of the leaf board slowly slide the board into the chas...

Page 41: ...sed replacement parts within a SwitchX based chas sis and vice versa All Replacement modules must be consistent with the Chassis fam ily and switch chip generation When hot swapping any of the units i...

Page 42: ...he ejector handles to unlock the ejectors from the chassis Removing spine 1 causes management module 1 to reset Removing spine 2 causes management module 2 to reset Warning If the spine you want to ho...

Page 43: ...spine board 1 Check for foreign objects in or mechanical damage to the chassis spine slots 2 Check spine mechanics for any noticeable damage or deviations from the pass crite rion shown in Figure 32 F...

Page 44: ...teria shown in Figure 33 and Figure 34 Figure 33 Intact vs Defected Side Signal Connectors Figure 34 Intact vs Defected Middle Signal Connectors 4 Check power connector s integrity Look for any damage...

Page 45: ...ioning the status LED on the fan will light up Each spine has an individual fan module that contains two individual fans Should a sin gle fan fail the Fan Status LED on the spine and the S Fan LED on...

Page 46: ...with two individual fans built in When a fan mod ule is not functioning the Fan Status LED on the spine will light up Figure 38 Spine Fan Module When a fan module is removed the indicator light will...

Page 47: ...anagement module has a pair of ejectors that lock the board in place and serve as a lever for seating or extracting see Figure 40 When hot swapping any of the units it is necessary to wait 1 minute af...

Page 48: ...or mechanical damage to the chassis management slots 2 Check management mechanics for any noticeable damage 3 Check back signal connectors integrity Look for any broken signal dividers or any deviati...

Page 49: ...Switch Shut Down Procedures To shut down the chassis run the following command twice once for each MM Do not apply excessive force to slide in the management board If you feel resistance remove the ma...

Page 50: ...own a leaf run the following command To shut down a spine run the following command To shut down a management module run the following command The chassis cannot be restarted remotely To restart the c...

Page 51: ...it has the following indicator LEDs Figure 43 Power Supply Unit Status Indications AC When lit this LED indicates input voltage between 100 and 240 Volts DC FAIL When lit this LED indicates a fault in...

Page 52: ...44 PSU Cover On and Off S1 S2 S3 S4 S5 S6 IS5200 PS3 PS1 PS4 PS2 L R FAN FAN FAN FAN FAN FAN Fan 1 Fan 2 Fan 3 Fan 4 Mellanox S1 S2 S3 S4 S5 S6 IS5200 DC AC OK FAIL OK DC AC OK FAIL OK DC AC OK FAIL O...

Page 53: ...t will light orange when the physical connection is established that is when the unit is powered on and a cable is plugged into the port with the other end of the connector plugged into a functioning...

Page 54: ...um number of connections per leaf is less than 36 then some of the leaf to spine connection LEDs may be OFF The status LEDs for the spine and their descriptions are shown in Table 5 The LEDs indicate...

Page 55: ...spine Table 7 shows the leaf to spine status according to the LED condition 2 1 4 Spine Side Panel Display LED Indicators The spine side panel display has LEDs that show the chassis condition Figure 4...

Page 56: ...S fault detected User should check individual power supplies for fault indications Green SPINE FANS STATUS Off No power to fan Green Nominal operational Red One or more of the spine fans is bad User s...

Page 57: ...S fault detected User should check individual power supplies for fault indications Green SPINE FANS STATUS Off No power to fan Green Nominal operational Red One or more of the spine fans is bad User s...

Page 58: ...ed from the top row See Figure 51 Figure 50 Port Numbering Figure 51 Top and Bottom Ports Table 11 Management Module S Fan LED Configurations LED Condition Description Green OK All Spine fans are work...

Page 59: ...They are 1 I2C port 1 CONSOLE port this is an RS232 connector for connecting to a host machine 1 MGT this is an Ethernet connector 1 USB port 1 RST reset button Figure 52 Management Module Interfaces...

Page 60: ...he other management module becomes the master If there is only one management module in the chassis all of the leafs and ports are reset by bringing them down and powering them up when the reset butto...

Page 61: ...plies Leaf fan modules Spine fan modules 2 Insert all leafs that you plan to use in the chassis Start at the bottom of the chassis and work your way up 3 Insert the first two spines in the top two slo...

Page 62: ...d 3 Spine Board indicators will display status of internal links to the installed leaf boards All PHY links to existing leaf Boards should be ON 4 Check the Spine LEDs and make sure they coincide with...

Page 63: ...xamples Figure 56 Console Ports for SX60xx SX65xx Managed Systems On SX65xx systems when having dual management systems first connect the cable and configure the master card and only then configure th...

Page 64: ...esetting the switch to the factory defaults Type y and then press Enter Step1 Hostname switch 1 If you wish to accept the default hostname then press Enter Otherwise type a different hostname and pres...

Page 65: ...se DHCP on mgmt0 interface yes 3 Enable IPv6 yes 4 Enable IPv6 autoconfig SLAAC on mgmt0 interface yes 5 Admin password Enter to leave unchanged CHANGED To change an answer enter the step number to re...

Page 66: ...Enable IPv6 autoconfig SLAAC on mgmt0 interface no no Step 9 Admin password Enter to leave unchanged You have entered the following information 1 Hostname switch 112126 2 Use DHCP on mgmt0 interface...

Page 67: ...name Step 9 Enable IPv6 yes yes Step 10 Enable IPv6 autoconfig SLAAC on mgmt0 interface no no Step 11 Admin password Enter to leave unchanged You have entered the following information 1 Hostname swi...

Page 68: ...s 169 254 15 134 Netmask 255 255 0 0 IPv6 enabled yes Autoconf enabled yes Autoconf route yes Autoconf privacy no IPv6 addresses 1 IPv6 address fe80 202 c9ff fe11 a1b2 64 Speed 1000Mb s auto Duplex fu...

Page 69: ...upplied at the time of purchase To generate the License Key enter the License Entitlement Number and the Switch Serial Number into the Mellanox online license tool at http license mella nox com The Sw...

Page 70: ...5 Print the generated license key PDF document is generated Step 6 Go to the FabricIT page and click on Setup Licensing Figure 59 FabricIT Status Licensing Step 7 Input the generated License key Step...

Page 71: ...h using the command ssh l user name switch ip address Step 3 Login to the switch default username is admin password admin Step 4 Read and accept the EULA when prompted Step 5 Once you get the prompt y...

Page 72: ...f the switch or its DNS name in the format http switch_IP_address Step 4 Login to the switch default user name is admin password admin Figure 60 MLNX OS Login Window Step 5 Read and accept the EULA if...

Page 73: ...InfiniBand Switch Platform Hardware User Manual Mellanox Technologies 73 After login a default status summary window is displayed as shown in Figure 62 Figure 62 Display After Login...

Page 74: ...e this management module is reset becoming the slave and the other management module becomes the mas ter If there is only one management module in the chassis when the reset button is pushed all of th...

Page 75: ...DC OK 2 Uninstall and reinstall the Leaf board 3 When the Yellow LED is on this indicates a fault in the board uninstall and reinstall the Leaf board 4 If uninstalling and reinstalling the Leaf board...

Page 76: ...ent Module is Lit 1 Check the MLNX OS management for confirmation and possible explanation of the alert 2 Make sure that there is nothing blocking the front or rear of the chassis and that the fan mod...

Page 77: ...he MLNX OS management for confirmation and possible explanation of the alert 2 Make sure that there is nothing blocking the front or rear of the chassis and that the fan modules and ventilation holes...

Page 78: ...k 2 Remove the screws holding the chassis to the rack These screws are located in the faceplate on the spine side of the chassis 3 Remove the upper brackets from the chassis 4 Remove the lock down bar...

Page 79: ...to the Mellanox website for detailed instructions for disassembly according to the WEEE Directive According to the WEEE Directive 2002 96 EC all waste electrical and electronic equipment EEE should be...

Page 80: ...equipment is very heavy and should be moved using a mechanical lift to avoid injuries This unit is intended for installation in a Restricted Access Location Risk of Electric Shock With the fan module...

Page 81: ...duct or touching any internal parts Risk of electric shock and energy hazard The PSUs are all independent Disconnect all power supplies to ensure a powered down state inside of the switch platform Dur...

Page 82: ...ical Code and the Canadian Electrical Code Warning Replace only with UL Recognized battery certified for maximum abnormal charging current not less than 4mA There is a risk of explosion should the bat...

Page 83: ...ommunication centre or a dedicated computer room This device must be installed according to the latest version of the country national electrical codes For North America equipment must be installed in...

Page 84: ...all waste electrical and electronic equipment EEE should be collected separately and not disposed of with regular household waste Dispose of this product and all of its parts in a responsible and env...

Page 85: ...InfiniBand Switch Platform Hardware User Manual Mellanox Technologies 85 5 6 7 8 9 10 11 45 C 113 F 8 3 PSU...

Page 86: ...InfiniBand Switch Platform Hardware User Manual Mellanox Technologies 86 12 InfiniBand 13 14 15 16 17 18 InfiniBand UL 4mA...

Page 87: ...User Manual Mellanox Technologies 87 19 UL CSA 20 21 GND 22 23 24 25 UL CSA 16 AWG 125 V 13 A 1 5 4 5 HAR 1 0 300 V PVC 250 V 10 A GND RS232 UL DP 1 DP 2 LPS 20 A CLASS 1 IEC 60 825 1 1993 A1 1997 A2...

Page 88: ...InfiniBand Switch Platform Hardware User Manual Mellanox Technologies 88 26 27 WEEE 28 WEEE 2002 96 EC EEE TN IT...

Page 89: ...nual Mellanox Technologies 89 29 China CCC Warning Statement A 3 Avertissements de s curit pour l installation French 1 Instructions d installation Veuillez lire la totalit des instructions d installa...

Page 90: ...odule de ventilation est retir les broches d alimentation sont expos es dans l emplacement du module NE PAS ins rer d outils ou la main dans l emplacement du module Cet quipement ne doit pas tre en se...

Page 91: ...ors tension d branchez toutes les alimen tations Pendant un orage ne pas travailler sur l quipement ni brancher ou d brancher des c bles Les c bles InfiniBand en cuivre sont lourds et peu flexibles Pa...

Page 92: ...16 AWG avec une prise moul e 125 V 13 A faisant au moins 1 5 m de long six pieds et au plus 4 5 m Pour le branchement lectrique en Europe utiliser un cordon d alimentation au format international harm...

Page 93: ...Attention l utilisation de commandes l ajustement ou la conduite de proc dures autres que celles indiqu es ici pourraient conduire une exposition dangereuse des rayonnements Pour les produits disposa...

Page 94: ...erletzungen zu vermeiden Diese Ger t ist f r die Installation in einem Bereich mit beschr nktem Zugang vorge sehen Stromschlagrisiko Bei abgenommenem Ventilatormodul sind die Stromkontakte in der Modu...

Page 95: ...eile Risiko eines Stromschlags und Stomgefahr Alle Stromversorgungseinheiten sind unabh ngig Trennen Sie alle Stomversorgungen um einen abgeschalteten Zustand im Inneren der Switch Plattform sicherzus...

Page 96: ...anerkannten Akkus ersetzen die f r maximalen anor malen Ladestrom von nicht weniger als 4mA zertifiziert sind Es besteht Explosiionsgefahr wenn der Akku durch einen Akku eines falschen Typs ersetzt w...

Page 97: ...e Verkabelung Achtung Nutzung von Steuerungen oder Einstellungen oder Ausf hrung von Proze duren die hier nicht spezifiziert sind kann zu gef hrlichem Strahlenkontakt f hren Klasse 1 Laserprodukt und...

Page 98: ...ver nicamente mediante un elevador mec nico para evitar lesiones Esta unidad ha sido ideada para instalar en lugares de acceso restringido Riesgo de descarga el ctrica Con el m dulo del ventilador qui...

Page 99: ...neutro Quitar los cables de corriente antes de abrir la tapa de este producto o tocar cualquier componente interno Riesgo de descarga el ctrica y peligro de corriente Todas las fuentes de alimentaci...

Page 100: ...ciones vigentes del C digo El ctrico Nacional de los EE UU y del C digo El ctrico de Canad II y a danger d explosion s il y a remplacement incorrect de la batterie Remplacer uniquement avec une batter...

Page 101: ...ificio El equipo se instalar en un rea donde haya conexi n equipotencial como por ejemplo un centro de telecomunicaciones o una sala de computadoras dedicada Este dispositivo se debe instalar conforme...

Page 102: ...a unidad hacia afuera del bastidor Sirven solo para la instalaci n permanente en el lugar de destino final no para fines de servicio o mantenimiento Conforme a la Directiva 2002 96 CE sobre RAEE todos...

Page 103: ...InfiniBand Switch Platform Hardware User Manual Mellanox Technologies 103 4 5 6 7 8 9 10 45 C 113 F 8 3...

Page 104: ...InfiniBand Switch Platform Hardware User Manual Mellanox Technologies 104 11 12 InfiniBand 13 14 15 16 17 InfiniBand...

Page 105: ...InfiniBand Switch Platform Hardware User Manual Mellanox Technologies 105 18 19 UL CSA 20 21 22 UL 4 UL CSA 3 16 AWG 1 5 6 4 5 125 13 HAR 3 1 0 300 250 10...

Page 106: ...24 25 26 27 WEEE A 7 Avertismente privind siguran a la instalare Romanian 1 Instruc iuni de instalare RS232 Ethernet DP 1 DP 2 UL 20 1 IEC 60 825 1 1993 A1 1997 A2 2001 EN 60825 1 1994 A1 1996 A2 2001...

Page 107: ...ndep rtat pinii electrici sunt accesibili n cavitatea modulului NU introduce i instrumente sau p r i din corp n cavitatea modulului ventilator Acest echipament nu trebuie s fie ac ionat ntr o zon und...

Page 108: ...ele de alimentare cu energie pentru a asigura decuplarea n inte riorul platformei de comutare n timpul perioadelor cu desc rc ri electrice luminoase nu lucra i cu echipamentul sau nu conecta i sau dec...

Page 109: ...4 5 m Pentru conectarea la o surs de alimentare n Europa selecta i un cordon de alimentare care este armonizat la nivel interna ional i marcat HAR cu 3 conductoare cu minimum 2 fire de 1 0 mm cu pute...

Page 110: ...20 A trebuie s fie integrat n cablajul cl dirii Aten ie Utilizarea elementelor de comand sau ajustarea sau executarea altor proce duri dec t a celor indicate n acest document poate avea ca rezultat e...

Page 111: ...je vrlo te ka i treba se premje tati pomo u mehani kog dizala kako bi se izbjegle ozljede Ovaj ure aj je namijenjen za instaliranje na lokaciju s ograni enim pristupom Rizik od strujnog udara S uklon...

Page 112: ...li ako nije dobro pri vr en Ovaj sustav raspola e dvopolnim neutralnim osigura ima Uklonite sve kabele napa janja prije otvaranja poklopca proizvoda ili dodirivanja unutarnjih dijelova Rizik od strujn...

Page 113: ...ma navedenim u US National Electrical Code i Canadian Electrical Code Upozorenje Bateriju zamijenite samo baterijom iz serije UL koja je certifici rana za maksimalnu nepravilnu struju punjenja ne manj...

Page 114: ...ure aj mora instalirati sukladno najnovijoj verziji nacionalnih elektri nih kodova dr ave U Sjevernoj Americi oprema se mora instalirati sukladno va e im zahtjevima navedenim u US National Electrical...

Page 115: ...002 96 EZ sav elektri ni i elektroni ki otpad EEE trebao bi se prikupljati zasebno i ne bi se trebao odlagati kao obi an ku anski otpad Odlaganje ovog proizvoda i svih njegovih dijelova vr ite na odgo...

Page 116: ...mail info mellanox com Map and Directions Tech Support 408 916 0055 8 00AM to 5 00 PM Pacfic Mellanox Technologies Ltd Beit Mellanox PO Box 586 Yokneam 20692 Israel Tel 972 0 4 909 7200 972 0 74 723 7...

Page 117: ...InfiniBand Switch Platform Hardware User Manual Mellanox Technologies 117 216 Port InfiniBand QDR Switch Platform Installation Guide...

Search results

Summary of Contents for MIS5100Q-3DNC

Reviews:

Related manuals for MIS5100Q-3DNC

Brands by name

Popular brands

Mellanox Technologies MIS5100Q-3DNC, Hardware Installation Manual

Search results

Summary of Contents for MIS5100Q-3DNC

Reviews:

Related manuals for MIS5100Q-3DNC

Brands by name

Popular brands