Mellanox Technologies SX6710 Hardware User Manual Download

Page: 9 / 112

Mellanox Technologies

About this Manual

This manual describes the installation and basic use of the Mellanox InfiniBand systems.

Intended Audience

This manual is intended for IT managers and system administrators.

References

Table 2 - References

Document

Description

InfiniBand Architecture Specifica-
tion, Volume 1, Release 1.2.1, and
Volume 2, Release 1.3

The InfiniBand Architecture Specification that is provided by IBTA

MLNX-OS® User Manual

This document contains information regarding configuring and managing
MLNX-OS software- see http://www.mellanox.com/page/mlnx_os.

Conventions

The following icons are used throughout this document to indicate information that is important
to the user.

This icon makes recommendations to the user.

This icon indicates information that is helpful to the user.

This icon indicates a situation that can potentially cause damage to hardware or
software.

This icon indicates a situation that can potentially cause personal injury.

Summary of Contents for SX6710

Page 1: ...Mellanox SX67X0 1U Switch Systems Hardware User Manual Rev 1 4 www mellanox com...

Page 2: ...OLELY FOR THE PURPOSE OF AIDING THE CUSTOMER IN TESTING APPLICATIONS THAT USE THE PRODUCTS IN DESIGNATED SOLUTIONS THE CUSTOMER S MANUFACTURING TEST ENVIRONMENT HAS NOT MET THE STANDARDS SET BY MELLAN...

Page 3: ...5 1 19 Systems Mounting Static Rail Kit 14 2 5 2 19 Systems Mounting Telescopic Rail Kit 19 2 6 Cable Installation 24 2 6 1 Using a Breakout Cable 25 2 7 Initial Power On 28 2 8 Bring Up of Managed S...

Page 4: ...endix D Disassembly and Disposal 56 D 1 Disassembly Procedure 56 D 2 Disposal 56 Appendix E Safety Warnings Multiple Languages 57 E 1 Nordic Countries Notices 57 E 2 Installation Safety Warnings Engli...

Page 5: ...Brackets to the Chassis 17 Figure 15 Attaching the Brackets to the Rack 17 Figure 16 Sliding the Blades in the Rails 18 Figure 17 Rack Rail Kit Parts 20 Figure 18 Rails Separation 20 Figure 19 Mountin...

Page 6: ...Mellanox Technologies 2 Figure 36 Pull out Tab 47 Figure 37 QSFP Connector Male and Female Views 54 Figure 38 RJ45 to DB9 Harness Pinout 55...

Page 7: ...tion Wizard Session 31 Table 12 Configuration Wizard Session Static IP Configuration 32 Table 13 LEDs Symbols 41 Table 14 System Status LED Assignments 42 Table 15 Fan Status Front LED Assignments 43...

Page 8: ...August 2015 1 4 Ordering Information updated May 2015 1 3 Added Hebrew safety warnings Added BBU safety warnings in all languages April 2015 1 2 Added 19 Systems Mounting Telescopic Rail Kit on page...

Page 9: ...re Specification that is provided by IBTA MLNX OS User Manual This document contains information regarding configuring and managing MLNX OS software see http www mellanox com page mlnx_os Conventions...

Page 10: ...omputing with features such as static routing adaptive routing and advanced congestion management These features ensure the maximum effective fabric bandwidth by eliminating congestion The managed sys...

Page 11: ...s SX6790 N A 36 4 032Tb s The system can support 1Gb s and 10Gb s interfaces using QSFP to SFP adapters Up to 64x10GbE interfaces 1 3 Management Interfaces and FRUs Table 4 lists the various managemen...

Page 12: ...d FDR10 InfiniBand 1U Switch 36 QSFP ports 2 Power Supplies AC x86 dual core short depth C2P airflow Rail Kit RoHS6 MSX6710 TS2F2 SwitchX 2 based FDR10 InfiniBand 1U Switch 36 QSFP ports 2 Power Suppl...

Page 13: ...afety Warnings Prior to the installation please review the safety warnings as follows For Nordic Countries Notices see Section E 1 Nordic Countries Notices on page 57 For Safety Warnings in English se...

Page 14: ...pplies fans FRUs handles as shown in figure Figure 6 All servers and systems in the same rack should be planned with the same airflow direction All FRU components need to have the same air flow direct...

Page 15: ...check against the parts list below that all the parts have been sent Check the parts for visible damage that may have occurred during shipping The SX6710 package content is as follows 1 System 1 Rail...

Page 16: ...cable is required Such a cable is not included in the basic package and should be ordered separately If anything is damaged or missing contact your sales representative at support mella nox com Insta...

Page 17: ...time A new Battery Back up Unit BBU will be approximately 50 charged when you receive it In case of a power outage only a fully charged BBU can supply power of up to 5 minutes to the sys tem 2 4 1 1...

Page 18: ...Installation Mellanox Technologies 12 Figure 8 Unlocking the Latches and Extracting the PSU Figure 9 BBU Location...

Page 19: ...Mellanox Technologies 13 Figure 10 BBU Insertion Left and Extraction Right...

Page 20: ...unting Static Rail Kit At least two people are required to safely mount the system in the rack Table 7 Installation Kit Kit OPN Rack Size and Rack Depth Range MTEF KIT A Short 17 24 or Standard 24 34...

Page 21: ...s Make sure the system air flow is compatible with your installation selection It is important to keep the airflow within the rack in the same direction Note that the part of the system to which you c...

Page 22: ...e chassis in the rails screwing 2 flat head Phillips screws E in the designated points See Figure 13 Figure 13 Attaching the Rails to the Chassis Step 5 Attach the left and right rack mount brackets B...

Page 23: ...ile your installation partner is supporting the system s weight perform Steps 4 5 and 6 Step 7 Mount the system into the rack enclosure and attach the brackets installed on the system to the rack s po...

Page 24: ...disconnect it from peripherals and from the electrical outlet While your installation partner is supporting the system s weight Step 2 Loosen the screws attaching the brackets to the rack Do not remov...

Page 25: ...ion Kit Kit OPN Rack Size Rack Depth Range MTEF KIT B Short 17 24 MTEF KIT S Standard long 24 38 The following parts are included in the rail kit rack see Figure 17 1x Right inner rail A 1x Left inner...

Page 26: ...rate the rails 1 Extend the rail assembly by pulling the extension outwards D 2 Extract rail A from rail C by pushing it outside from the rear part of the assembly by pushing it outside from the rear...

Page 27: ...ils The FRU side is extractable Mounting the sliding rail inverted to the system will allow you to slide the FRU side of the system in and out Step 1 Install 10 cage nuts into the desired 1U slot of t...

Page 28: ...e Chassis in the Inner Rails Step 6 Slide the switch into the rack by carefully pushing the inner rails into the outer rails installed on the rack Step 7 When fully inserted fix the switch by closing...

Page 29: ...rew the two M6 screws securing the front of the inner rails ears to the outer rails and to the rack Step 3 Pull the unit out until braking is felt For safety purposes the locking mechanism will not al...

Page 30: ...the physical connection is established When a logical connection is made the relevant port LED will turn on To remove a cable disengage the locks and slowly pull the connector away from the port recep...

Page 31: ...tream A 40GbE port can be split to 4 or less 10GbE ports by using a Mellanox breakout cable When using a port to split a data stream into four 10 Gb s data streams and one of the other ports on the sw...

Page 32: ...Options Table 9 Port Splitting Options Port Can be split to 4 Can be split to 2 Port Can be split to 4 Can be split to 2 1 No No 19 No No 2 Yes disables port 1 Yes 20 Yes disables port 19 Yes 3 No No...

Page 33: ...2 Yes disables port 11 Yes 30 Yes disables port 23 Yes 13 No No 31 No No 14 Yes disables port 13 Yes 32 Yes disables port 31 Yes 15 No No 33 No No 16 No No 34 No Yes 17 No No 35 No No 18 Yes disables...

Page 34: ...on before plugging in a power cable Step 1 Plug in the first power cable Step 2 Plug in the second power cable Step 3 Wait for the system upload process It may take up to five minutes to turn on the s...

Page 35: ...n des Netzsteckers elnes Netz teils spannungsfrei Um alle Einhieten spannungs frei zu machen sind die Netzstecker aller Netzteile zu entfernen ATTENTION Risque de choc et de danger e lectriques Le de...

Page 36: ...Configuration To perform initial configuration of the system Step 1 Connect a host PC to the Console RJ45 port of the system using the supplied harness cable DB9 to RJ45 Make sure to connect to the Co...

Page 37: ...o no IPv6 you will automatically be referred to Step 6 Step 4 Enable IPv6 auto config SLAAC on mgmt0 interface no This turns on auto configuration of the IPv6 addresses This is unsuitable for DHCPv6 S...

Page 38: ...y IP address for example 192 168 10 4 10 10 10 10 Mask length may not be zero if address is not zero interface eth0 Step 5 Netmask 0 0 0 0 255 255 255 0 Step 6 Default gateway for example 192 168 10 1...

Page 39: ...5 5A RX bytes 968810197 TX bytes 1172590194 RX packets 10982099 TX packets 10921755 RX mcast packets 0 TX discards 0 RX discards 0 TX errors 0 RX errors 0 TX overruns 0 RX overruns 0 TX carrier 0 RX f...

Page 40: ...acing is showing all green for both the power supply unit and System Status LEDs Power supply units have directional air flows similar to the fan module The fan mod ule airflow must coincide with the...

Page 41: ...r installation Step 4 Insert the power cord into the supply connector Step 5 Insert the other end of the power cord into an outlet of the correct voltage The green power supply unit indicator should l...

Page 42: ...t gently pull out its black handle while pus latch release with your thumb To insert a fan unit Step 1 Make sure the mating connector of the new unit is free of any dirt and or obstacles Step 2 Insert...

Page 43: ...ox s Unified Fabric Manager UFM software package Each subnet needs one subnet manager to discover activate and manage the subnet Each network requires a Subnet Manager to be running in either the syst...

Page 44: ...er Manual section Upgrading MLNX OS Software Be sure to read and follow all of the instructions regarding the updating of the software on your system Managed systems do not require Firmware updating F...

Page 45: ...ers High Power LR4 transceivers support in all ports 4 1 2 Speed InfiniBand speed is auto adjusted by the infiniBand protocol Mellanox systems support FDR FDR10 InfiniBand FDR is an InfiniBand data ra...

Page 46: ...net cables 4 1 5 USB The USB interface is USB 2 0 compliant and can be used by MLNX OS software to connect to an external disk for software upgrade or file management The connector comes in a standard...

Page 47: ...vice 4 2 LEDs 4 2 1 LED Notifications The system s LEDs are an important tool for hardware event notification and troubleshooting Table 13 LEDs Symbols Symbol Name Description Normal Conditions System...

Page 48: ...D Behavior Description Action Required Solid Green The system is up and running normally N A Flashing Green The system is booting up This assignment is valid on managed systems only Wait up to five mi...

Page 49: ...uld be replaced Off System boot N A Fan Status Rear LED Assignments One LED per Fan Risk of Electric Shock With the fan module removed power pins are accessible within the module cavity DO NOT insert...

Page 50: ...lty and should then be replaced Off N A N A The power supply status LEDs on the rear side of the system are located on the PSUs themselves Each PSU has one LED of its own Table 18 Power Supply Unit St...

Page 51: ...No symbol errors have been received in last few seconds normal condition N A Flashing Amber Error one or more ports have received symbol errors Possible causes are Bad cable Bad connection Bad connect...

Page 52: ...se Check that the SM is up Flashing Orange A problem with the physical link Check that the SM is up Port LEDs in InfiniBand System Mode In InfiniBand system mode the LED indicator corresponding to eac...

Page 53: ...Inventory Pull out Tab The system s inventory parameters such as serial number part number GUID and MAC address can be extracted from the Inventory pull out tab on the lower right side of the front p...

Page 54: ...if the MLNX OS software did not load properly System Status LED is red This state can indicate a number of problems Critical system fault CPU error bad firmware Over Temperature To overcome it Check E...

Page 55: ...enter to boot this image or any other key for boot menu Booting default image in 3 seconds Boot Menu 0 SX_X86_64 SX_3 4 0008 2014 11 10 20 07 51 x86_64 1 SX_X86_64 SX_3 4 0007 2014 10 23 17 27 34 x86_...

Page 56: ...er port Connector cage 36 QSFP Air flow 100 CFM Environmental Temperature Operating 0 to 45 C Storage 40 to 70 C Humidity Operating 10 85 non condensing Storage 10 90 non condensing Altitude Operating...

Page 57: ...by the MLNX OS management SW indicating to system administration that the switch has crossed the Warning threshold Note that this temperature threshold does not require nor lead to any action by hardw...

Page 58: ...SF AC B 400W battery backup ready AC Power Supply w rear to front air flow MTEF PSF DC A 800W DC Power Supply rear to front air flow NEBS lv3 certified MTEF PSR AC A 460W AC Power Supply w front to re...

Page 59: ...setL Module Reset 10 Vcc Rx 3 3 V Power supply receiver 11 SCL 2 wire serial interface clock 12 SDA 2 wire serial interface data 13 GND Ground 14 Rx3p Receiver Non Inverted Data Output 15 Rx3n Receive...

Page 60: ...RX2p RX2n TX1n GND TX1p GND TX3n TX3p GND IntL ModPrsL VccTx Vcc1 LPMode 18 35 8 50 Top ResetL SDA SCL ModSelL RX3p TX2n GND VccRx 1 2 3 4 5 6 7 8 9 10 1 2 3 4 5 6 7 8 9 TX2p GND TX4n TX4p GND 1 1 1 1...

Page 61: ...RJ 45 CONSOLE and I C Pinout Signal Pin Color Not connected 1 G W I C_SCL 2 G TXD 3 O W Not connected 4 Bl GND 5 Bl W RXD 6 O I C_SDA 7 Br W Not connected 8 Br C 3 RJ45 to DB9 Harness Pinout In order...

Page 62: ...tem does not fall 5 Slide the system from the rack 6 Remove the rail slides from the rack 7 Remove the caged nuts D 2 Disposal According to the WEEE Directive 2002 96 EC all waste electrical and elect...

Page 63: ...ower source 2 Bodily Injury Due to Weight Use enough people to safely lift this product 3 Heavy Equipment This equipment is heavy and should be moved using a mechanical lift to avoid injuries 4 Risk o...

Page 64: ...ts Risk of electric shock and energy hazard The PSUs are all independent Disconnect all power supplies to ensure a powered down state inside of the switch platform 10 During Lightning Electrical Hazar...

Page 65: ...Code and the Canadian Electrical Code 17 Battery Replacement Warning Replace only with UL Recognized battery certified for maximum abnormal charging current not less than 4mA There is a risk of explo...

Page 66: ...n area where equi potential bonding exists such as a telecommunication centre or a dedicated computer room 20 Installation codes This device must be installed according to the latest version of the co...

Page 67: ...em and an IT power system of Norway only 26 BBU If the BBU is deformed leaking corroded or visually damaged replace it immedi ately Do not use a BBU that was not provided by Mellanox Technologies A BB...

Page 68: ...Mellanox Technologies 62 2 3 4 5 6 7 8...

Page 69: ...Mellanox Technologies 63 9 10 11 12 13 14 15...

Page 70: ...Mellanox Technologies 64 16 17 18 19 20 21 WEEE...

Page 71: ...Mellanox Technologies 65 22 23 BBU E 4 Chinese 1 2 40 lbs 18 kgs 40 70 lbs 18 32 kgs 70 121 lbs 32 55 kgs 121 lbs 55 kgs...

Page 72: ...Mellanox Technologies 66 3 4 5 6 7 8 9 45 C 113 F 8 3 PSU...

Page 73: ...Mellanox Technologies 67 10 11 InfiniBand 12 13 14 15 16 InfiniBand...

Page 74: ...Mellanox Technologies 68 17 18 UL CSA 19 20 GND SX6730 21 22 23 UL 4mA UL CSA 16 AWG 125 V 13 A 1 5 4 5 HAR 1 0 300 V PVC 250 V 10 A GND RS232 UL DP 1 DP 2 LPS 20 A...

Page 75: ...Mellanox Technologies 69 24 WEEE 25 26 BBU BBU Mellanox Technologies BBU WEEE 2002 96 EC EEE TN IT BBU...

Page 76: ...Mellanox Technologies 70 27 China CCC Warning Statement...

Page 77: ...our viter les blessures 4 Danger d lectrocution Danger d lectrocution Lorsque le module de ventilation est retir les broches d alimentation sont expos es dans l emplacement du module NE PAS ins rer d...

Page 78: ...s alimen tations 10 En cas d orage danger d lectrocution Pendant un orage ne pas travailler sur l quipement ni brancher ou d brancher des c bles 11 Connexion et d connexion du c ble InfiniBand en cuiv...

Page 79: ...nt de charge anormal maximal sup rieur ou gal 4 mA Si la batterie n est pas remplac e par un type correct il y a un risque d explosion Les batteries usag es doivent tre mises au rebut conform ment aux...

Page 80: ...que nationaux En Am rique du Nord l quipement doit tre install en respectant les exigences de l US National Electrical Code et du Code canadien de l lectricit 22 Interconnexion des unit s Les c bles d...

Page 81: ...lus depuis la date de fabrication imprim e est inutilisable E 6 Installation Sicherheitshinweise German 1 Installationsanleitungen Lesen Sie alle Installationsanleitungen bevor Sie das Ger t an die St...

Page 82: ...gs ffnungen sein um einen einwandfreien Luftstrom zu gew hrleisten 6 Stapeln des Chassis Das Chassis sollte nicht auf andere Ger te gestapelt werden Wenn das Chassis herunt erf llt kann es zu Verletzu...

Page 83: ...cht oder gewartet werden 12 Ger teentsorgung Die Entsorgung dieses Ger ts sollte unter Beachtung aller nationalen Gesetze Bestim mungen erfolgen 13 Regionale und nationale elektrische Bestimmungen Die...

Page 84: ...eiter in der Geb udeinstallation 19 Installationscodes Dieses Ger t muss installiert sein entsprechend auf die neueste Version des Landes National Electrical Code F r Nordamerika m ssen in bereinstimm...

Page 85: ...BBUs Batterie Backup Einheit verwenden die ein Originalprodukt von Mellanox Technolgies sind E 7 Advertencias de seguridad de instalaci n Spanish 1 Instrucciones de instalaci n Antes de conectar el eq...

Page 86: ...entilaci n 6 Apilamiento del chasis Los chasis no se deben apilar sobre otros equipos La ca da del chasis podr a causar lesiones corporales as como da os al equipo 7 Conexi n redundante de fuente de a...

Page 87: ...nga estable En general en un bastidor los equipos se deben instalar comenzando desde abajo hacia arriba 13 Instalaci n del equipo La instalaci n el reemplazo y el mantenimiento de este equipo estar n...

Page 88: ...D Antes de conectar el dispositivo a la l nea de alimentaci n los tornillos del terminal de la puesta a tierra de protecci n del dispositivo se deben conectar a la puesta a tierra de protecci n de la...

Page 89: ...r de destino final no para fines de servicio o mantenimiento 25 Directiva WEEE Conforme a la Directiva 2002 96 CE sobre RAEE todos los residuos de equipos el c tricos y electr nicos EEE se deben recol...

Page 90: ...Mellanox Technologies 84 E 8 Rus sian 1 2 40 lbs 18 kgs 40 70 lbs 18 32 kgs 70 121 lbs 32 55 kgs 121 lbs 55 kgs 3 4 5 45 C 113 F 8 3 6...

Page 91: ...Mellanox Technologies 85 7 8 9 10 11 InfiniBand InfiniBand 12 13...

Page 92: ...Mellanox Technologies 86 14 15 16 17 UL 4 18 UL CSA UL CSA 3 16 AWG 1 5 6 4 5 125 13 HAR 3 1 0 300 250 10 19...

Page 93: ...Mellanox Technologies 87 20 SX6730 21 22 RS232 Ethernet DP 1 DP 2 UL 20 23 24 WEEE 2002 96 EC WEEE 25 BBU...

Page 94: ...de instalare nainte de a conecta 2 Accidentare cauzat de greutate Apela i la un num r suficient de persoane pentru a ridica n siguran acest produs 40 lbs 18 kgs 40 70 lbs 18 32 kgs 70 121 lbs 32 55 k...

Page 95: ...tare electric suplimentar pericol electric Acest produs include o surs de alimentare suplimentar sau un spa iu gol n locul acesteia n cazul n care spa iul pentru sursa de alimentare este gol nu opera...

Page 96: ...lificat 14 Eliminarea echipamentului Eliminarea acestui echipament trebuie s se realizeze n conformitate cu toate legile i regulamentele na ionale 15 Codurile electrice locale i na ionale Acest echipa...

Page 97: ...la ia cl dirii va asigura un mijloc de conectare la priza de p m nt iar echipamen tul va fi n mod permanent conectat la priza de p m nt de un agent de ntre inere UN AGENT DE NTRE INERE va verifica dac...

Page 98: ...i toate componentele sale n mod responsabil i ecologic 25 RestrictionsRestric ii electrice pentru Norvegia This unit is intended for connection to a TN power system and an IT power system of Norway o...

Page 99: ...kog dizala kako bi se izbjegle ozljede 4 Rizik od strujnog udara Rizik od strujnog udara S uklonjenim modulom ventilatora perima napajanja se mo e pristupiti u otvoru mod ula NEMOJTE umetati alat ili...

Page 100: ...biste osigurali stanje bez napajanja unutar platforme preklopnika 10 Tijekom udara munje Opasnost od elektri ne energije Tijekom djelovanja munja nemojte raditi na opremi ili spajati ili odspajati ka...

Page 101: ...ertifici rana za maksimalnu nepravilnu struju punjenja ne manju od 4 mA Postoji rizik od eksplozije ako se baterija zamijeni neodgovaraju om vrstom Odlo ite prazne baterije sukladno uputama 18 UL CSA...

Page 102: ...ih elektri nih kodova dr ave U Sjevernoj Americi oprema se mora instalirati sukladno va e im zahtjevima navedenim u US National Electrical Code i Canadian Electrical Code 22 Interkonekcija ure aja Kab...

Page 103: ...E 11 Avvertenze di sicurezza per l installazione italiano 1 Istruzioni di installazione Leggere tutte le istruzioni di installazione prima di collegare l apparecchiatura all alimentazione 2 Lesioni a...

Page 104: ...alle aperture di ventilazione 6 Impilare lo chassis Ku i te se ne bi trebalo slagati na drugu opremu Ako ku i te padne mo e izazvati tje lesne ozljede i o te enje opreme 7 Collegamento di alimentazion...

Page 105: ...tabile In generale il rack va riempito con apparecchiature procedendo dal basso verso l alto 13 Installazione dell apparecchiatura Questa apparecchiatura va installata sostituita e o sottoposta a manu...

Page 106: ...mento a terra SX6730 Prima di collegare questo dispositivo alla linea di alimentazione le viti del terminale di terra protettivo di questo dispositivo devono essere collegate al terminale di terra pro...

Page 107: ...lo switch come scaffale o piano di lavorol Attenzione un apparecchiatura scorrevole o montata su binari non va utilizzata come scaffale o piano di lavoro I binari non sono progettati per far scorrere...

Page 108: ...Technol ogies E 12 Montaj G venlik Uyar lar T rk e 1 Montaj Talimatlar Ekipman g kayna na ba lamadan nce t m montaj talimatlar n okuyun 2 A rl k Nedeniyle Fiziksel Yaralanma 40 lbs 18 kgs 40 70 lbs 18...

Page 109: ...k b rak lmal d r 6 asi stif asinin di er herhangi bir ekipman n zerine istiflenmemesi gerekir asi d erse fiziksel yaralanmalara ve ekipmanda hasara neden olabilir 7 Yedekli G Kayna Ba lant s Elektrik...

Page 110: ...temin sabit kalmas i in zel nlemler al nmal d r Genelde ekipmanlar iskeleye a a dan yukar do ru doldurman z gerekir 13 Ekipman Montaj Ekipman n yaln zca e itimli ve nitelikli personel taraf ndan monte...

Page 111: ...m 20 GND ba lant s bilgisinin eklenmesi SX6730 Bu cihaz g hatt na ba lamadan nce cihaz n koruyucu topraklama u lar n n bina tesisat ndaki koruyucu topraklamaya ba lanmas gereklidir GND Ba lant s Bilgi...

Page 112: ...Y nergesi 2002 96 EC uyar nca t m elektrikli ve elektronik ekipman at klar EEE ayr olarak toplanmal ve evsel at klarla birlikte pe at lmamal d r Bu r n ve t m par alar evreye dost ve sorumlu bir ekild...

Search results

Summary of Contents for SX6710

Reviews:

Related manuals for SX6710

Brands by name

Popular brands

Mellanox Technologies SX6710, Hardware User Manual

Search results

Summary of Contents for SX6710

Reviews:

Related manuals for SX6710

Brands by name

Popular brands