background image

Rev 1.2

Mellanox Technologies

60

5.  

תולמשחתה

 

תנכס

!

6.

רתי

 

תוממחתה

 

7.  

תכרעמה

 

תמירע

8.  

.

 

למשח

 

תנכס

ףסונ

 

חוכ

 

קפס

 

רוביח

9.   

םיילמשח

 

םיעקש

 

רפסמ

10.  

למשח

 

תנכס

 - 

םיקרב

 

תופוס

 

תעב

Summary of Contents for SB7700

Page 1: ...www mellanox com Mellanox 1U EDR 100Gb s InfiniBand Switch Systems Hardware User Manual Models SB7700 SB7790 Rev 1 2...

Page 2: ...TECHNOLOGIES AS IS WITH ALL FAULTS OF ANY KIND AND SOLELY FOR THE PURPOSE OF AIDING THE CUSTOMER IN TESTING APPLICATIONS THAT USE THE PRODUCTS IN DESIGNATED SOLUTIONS THE CUSTOMER S MANUFACTURING TEST...

Page 3: ...c Rail Kit 20 2 5 Cable Installation 26 2 6 Initial Power On 27 2 7 Bring Up of Managed Systems 28 2 7 1 Configuring Network Attributes 28 2 7 2 Remote Connection 31 2 8 FRU Replacements 32 2 8 1 Powe...

Page 4: ...isassembly and Disposal 55 D 1 Disassembly Procedure 55 D 2 Disposal 55 Appendix E Safety Warnings Multiple Languages 56 E 1 Nordic Countries Notices 56 E 2 Installation Safety Warnings English 56 E 3...

Page 5: ...ure 13 Rails Separation 21 Figure 14 Mounting the Outer Rails into the Rack 22 Figure 15 Attaching the Inner Rails to the Chassis 23 Figure 16 Securing the Chassis in the Inner Rails 23 Figure 17 Slid...

Page 6: ...Session 29 Table 11 Configuration Wizard Session Static IP Configuration 30 Table 12 LEDs Symbols 40 Table 13 System Status LED Assignments 41 Table 14 Fan Status Front LED Assignments 42 Table 15 Fa...

Page 7: ...able 1 Revision History Table Date Revision Description July 2015 1 2 Changed document s title June 2015 1 1 Added Hebrew safety warnings Updated Figure 1 SB7700 and SB7790 Front Side View Table 21 SB...

Page 8: ...chitecture Specification that is provided by IBTA MLNX OS User Manual This document contains information regarding configuring and managing MLNX OS software see http www mellanox com page mlnx_os Conv...

Page 9: ...n ideal choice for top of rack leaf connectivity or for building small to extremely large sized clusters These systems enable efficient computing with features such as static routing adaptive routing...

Page 10: ...d Switching Capabilities System Model EDR 100Gb s QSFP28 Interfaces Max Throughput SB7700 36 7 2Tb s SB7790 36 7 2Tb s 1 3 Management Interfaces and FRUs Table 4 lists the various management interface...

Page 11: ...s OPNs System Model OPN Description SB7700 MSB7700 ES2F Switch IB based EDR InfiniBand 1U Switch 36 QSFP28 ports 2 Power Supplies AC x86 dual core standard depth P2C airflow Rail Kit RoHS6 MSB7700 ES2...

Page 12: ...ring up see Bring Up of Managed Systems on page 28 FRU replacements are described in Section 2 8 on page 32 2 1 Safety Warnings Prior to the installation please review the safety warnings as follows F...

Page 13: ...inlet to connector side outlet marked with blue power supplies fans FRUs handles as shown in Figure 5 All servers and systems in the same rack should be planned with the same airflow direction All FR...

Page 14: ...ack it and check against the parts list below that all the parts have been sent Check the parts for visible damage that may have occurred during shipping The SB77X0 package content is as follows 1 x S...

Page 15: ...ting Static Rail Kit At least two people are required to safely mount the system in the rack Table 7 Installation Kit Kit OPN Rack Size and Rack Depth Range MTEF KIT A Short 17 24 or Standard 24 34 Th...

Page 16: ...wing points Make sure the system air flow is compatible with your installation selection It is important to keep the airflow within the rack in the same direction Note that the part of the system to w...

Page 17: ...chassis in the rails screwing 2 flat head Phillips screws E in the designated points See Figure 8 Figure 8 Attaching the Rails to the Chassis Step 2 Attach the left and right rack mount brackets B to...

Page 18: ...es only While your installation partner is supporting the system s weight perform Steps 4 5 and 6 Step 4 Mount the system into the rack enclosure and attach the brackets installed on the system to the...

Page 19: ...connect it from peripherals and from the electrical outlet While your installation partner is supporting the system s weight Step 2 Loosen the screws attaching the brackets to the rack Do not remove t...

Page 20: ...Installation Kit Kit OPN Rack Size Rack Depth Range MTEF KIT B Short 17 24 MTEF KIT S Standard long 24 38 The following parts are included in the rail kit rack see Figure 12 1x Right inner rail A 1x...

Page 21: ...e rails Step 1 Extend the rail assembly by pulling the extension outwards D Step 2 Extract rail A from rail C by pushing it outside from the rear part of the assembly by pushing it outside from the re...

Page 22: ...system s rails The FRU side is extractable Mounting the sliding rail inverted to the system will allow you to slide the FRU side of the system in and out Step 1 Install 10 cage nuts into the desired 1...

Page 23: ...Chassis in the Inner Rails Step 6 Slide the switch into the rack by carefully pushing the inner rails into the outer rails installed on the rack Step 7 When fully inserted fix the switch by closing th...

Page 24: ...tep 2 Unscrew the two M6 screws securing the front of the inner rails ears to the outer rails and to the rack Step 3 Pull the unit out until braking is felt For safety purposes the locking mechanism w...

Page 25: ...Rev 1 2 Mellanox Technologies 25 Figure 19 Locking Mechanism...

Page 26: ...is established When a logical connection is made the relevant port LED will turn on To remove a cable disengage the locks and slowly pull the connector away from the port receptacle The LED indicator...

Page 27: ...ore plugging in a power cable Step 1 Plug in the first power cable Step 2 Plug in the second power cable Step 3 Wait for the system upload process It may take up to five minutes to turn on the system...

Page 28: ...ation stabilise e ne de branch uniquement qu un module Alimentation Stabilise e Pour isoler completement le module en cause Il faut de brancher toutes les alimen tations stabilise es PSU 2 7 Bring Up...

Page 29: ...shown in Table 10 Table 10 Configuration Wizard Session Wizard Session Display Comments Mellanox configuration wizard Do you want to use the wizard for initial configuration yes You must perform this...

Page 30: ...exit Choice Configuration changes saved To return to the wizard from the CLI enter the configuration jump start command from configure mode Launching CLI Step 5 Enable DHCPv6 on mgmt0 interface no To...

Page 31: ...968810197 TX bytes 1172590194 RX packets 10982099 TX packets 10921755 RX mcast packets 0 TX discards 0 RX discards 0 TX errors 0 RX errors 0 TX overruns 0 RX overruns 0 TX carrier 0 RX frame 0 TX coll...

Page 32: ...replacing is showing all green for both the power supply unit and System Status LEDs Power supply units have directional air flows similar to the fan module The fan mod ule airflow must coincide with...

Page 33: ...roper installation Step 4 Insert the power cord into the supply connector Step 5 Insert the other end of the power cord into an outlet of the correct voltage The green power supply unit indicator shou...

Page 34: ...it gently pull out its black handle while pus latch release with your thumb To insert a FAN Unit Step 1 Make sure the mating connector of the new unit is free of any dirt and or obstacles Step 2 Inser...

Page 35: ...ellanox s Unified Fabric Manager UFM software package Each subnet needs one subnet manager to discover activate and manage the subnet Each network requires a Subnet Manager to be running in either the...

Page 36: ...ver to the switch port 2 Non typical Via the I C port of the switch using a Mellanox MTUSB 1 device connecting to a server s USB port on the one end and to the I C port of the switch on the other Firm...

Page 37: ...scover and search for the row starting with the word Switch and indicates the GUID of the system Step c Mark the displayed LID on that row a decimal number Step 2 Run the following command from a host...

Page 38: ...QDR FDR10 FDR EDR InfiniBand FDR10 is a non standard InfiniBand data rate where each lane of a 4X port runs a bit rate of 10 3125 Gb s with a 64b 66b encoding resulting in an effective bandwidth of 4...

Page 39: ...erface is USB 2 0 compliant and can be used by MLNX OS software to connect to an external disk for software upgrade or file management The connector comes in a standard USB shape To view the full matr...

Page 40: ...t button resets the device 4 2 LEDs 4 2 1 LED Notifications The system s LEDs are an important tool for hardware event notification and troubleshooting Table 12 LEDs Symbols Symbol Name Description No...

Page 41: ...ntative for assistance Table 13 System Status LED Assignments LED Behavior Description Action Required Solid Green The system is up and running normally N A Flashing Green The system is booting up Thi...

Page 42: ...fans are missing or not operating properly The faulty FRUs should be replaced Off System boot N A Table 15 LED Behavior Description Action Required Solid Green Specific fan unit is operating N A Soli...

Page 43: ...at indicates the status of the unit Figure 28 Rear Side Panel The primary power supply PS unit is located on the left side and the secondary unit is located on the right side Table 16 Power Supply Uni...

Page 44: ...the power supply continues to operate high temp high power high current slow fan Call your Mellanox representative for assistance Off No AC power to all power supplies Call your Mellanox representativ...

Page 45: ...se Check that the SM is up Flashing Red A problem with the physical link Check that the SM is up Port LEDs in InfiniBand System Mode In InfiniBand system mode the LED indicator corresponding to each d...

Page 46: ...ogies 46 4 3 Inventory Pull out Tab The system s inventory parameters such as serial number part number and GUID address can be extracted from the inventory pull out tab on the lower right side of the...

Page 47: ...MLNX OS software did not load properly System Status LED is Red This state can indicate a number of problems Critical system fault CPU error bad firmware Over Temperature To overcome it Check Environm...

Page 48: ...86_64 Press enter to boot this image or any other key for boot menu Booting default image in 3 seconds Boot Menu 0 SX_X86_64 SX_3 4 0008 2014 11 10 20 07 51 x86_64 1 SX_X86_64 SX_3 4 0007 2014 10 23 1...

Page 49: ...on Operational 40 to 70 C Relative Humidity Operational 10 85 non condensing Non Operational 10 90 non condensing Altitude Operational 3050m Non Operational 3050m Power Input Voltage 100 240 VAC 50 60...

Page 50: ...MTEF KIT S Telescopic Rack installation kit for standard depth 1U systems to be mounted into standard depth racks MTEF PSF AC A 460W AC Power Supply w rear to front air flow MTEF PSR AC A 460W AC Pow...

Page 51: ...ll be issued by the MLNX OS management SW indicating to system administration that the switch has crossed the Warning threshold Note that this temperature threshold does not require nor lead to any ac...

Page 52: ...9 ResetL Module Reset 10 Vcc Rx 3 3 V Power supply receiver 11 SCL 2 wire serial interface clock 12 SDA 2 wire serial interface data 13 GND Ground 14 Rx3p Receiver Non Inverted Data Output 15 Rx3n Rec...

Page 53: ...X4n RX2p RX2n TX1n GND TX1p GND TX3n TX3p GND IntL ModPrsL VccTx Vcc1 LPMode 18 35 8 50 Top ResetL SDA SCL ModSelL RX3p TX2n GND VccRx 1 2 3 4 5 6 7 8 9 10 1 2 3 4 5 6 7 8 9 TX2p GND TX4n TX4p GND 1 1...

Page 54: ...23 RJ 45 CONSOLE and I C Pinout Signal Pin Color Not connected 1 G W I C_SCL 2 G TXD 3 O W Not connected 4 Bl GND 5 Bl W RXD 6 O I C_SDA 7 Br W Not connected 8 Br C 3 RJ45 to DB9 Harness Pinout In or...

Page 55: ...system does not fall 5 Slide the system from the rack 6 Remove the rail slides from the rack 7 Remove the caged nuts D 2 Disposal According to the WEEE Directive 2002 96 EC all waste electrical and e...

Page 56: ...he power source 2 Bodily Injury Due to Weight Use enough people to safely lift this product 3 Heavy Equipment This equipment is heavy and should be moved using a mechanical lift to avoid injuries 4 Ri...

Page 57: ...the switch platform 9 During Lightning Electrical Hazard During periods of lightning activity do not work on the equipment or connect or dis connect cables 10 Copper InfiniBand Cable Connecting Disco...

Page 58: ...have a molded plug rated at 250 V 10 A 16 Installation codes This device must be installed according to the latest version of the country national electrical codes For North America equipment must be...

Page 59: ...ipment EEE should be collected separately and not disposed of with regular household waste Dispose of this product and all of its parts in a responsible and environmentally friendly way 21 Country of...

Page 60: ...Rev 1 2 Mellanox Technologies 60 5 6 7 8 9 10...

Page 61: ...Rev 1 2 Mellanox Technologies 61 11 12 13 14 15 16...

Page 62: ...Rev 1 2 Mellanox Technologies 62 17 18 19 20 21 WEEE 22...

Page 63: ...Rev 1 2 Mellanox Technologies 63 E 4 Chinese 1 2 3 4 5 6 45 C 113 F 8 3 40 lbs 18 kgs 40 70 lbs 18 32 kgs 70 121 lbs 32 55 kgs 121 lbs 55 kgs...

Page 64: ...Rev 1 2 Mellanox Technologies 64 7 8 9 10 InfiniBand 11 12 13 PSU InfiniBand...

Page 65: ...Rev 1 2 Mellanox Technologies 65 14 15 UL CSA 16 17 18 19 UL CSA 16 AWG 125 V 13 A 1 5 4 5 HAR 1 0 300 V PVC 250 V 10 A RS232 UL DP 1 DP 2 LPS 20 A...

Page 66: ...s d installation avant de relier l quipement au secteur 2 Blessures cause du poids Pr voyez assez de personnel pour soulever ce produit en toute s curit 40 lbs 18 kgs 40 70 lbs 18 32 kgs 70 121 lbs 32...

Page 67: ...res 7 Connexion de l alimentation redondante danger d lectrocution Ce produit est quip d une alimentation redondante ou d un cache si elle est absente Dans ce dernier cas ne pas faire fonctionner le p...

Page 68: ...reil doit tre install conform ment la version la plus r cente des codes lec trique nationaux En Am rique du Nord l quipement doit tre install en respectant les exigences de l US National Electrical Co...

Page 69: ...re coulisser l unit hors du rack Ils sont destin s une installation permanente l emplacement final pas pour l entretien ni la maintenance 20 Directive DEEE Selon la Directive 2002 96 CE DEEE tous les...

Page 70: ...ratur Dieses Ger t sollte nicht in einem Bereich mit einer Umgebungstemperatur ber der maximal empfohlenen Temperatur von 45 C 113 F betrieben werden Es ist ein Luft strom von 200 LFM bei maximaler Um...

Page 71: ...Systems zu gew hrleisten Im Allgemeinen sollten Sie das Gestell von unten nach oben mit Ger ten f llen 11 Ger teinstallation Diese Ger t sollte nur von geschultem und qualifiziertem Personal installi...

Page 72: ...ften in der US amerikanischen National Electrical Code und dem Canadian Electrical Code 18 Verbindung der Ger te untereinander Kabel f r den Anschluss an das Ger t RS232 und Ethernet Schnittstellen m...

Page 73: ...4 Riesgo de descarga el ctrica Riesgo de descarga el ctrica Con el m dulo del ventilador quitado se obtiene acceso a las clavijas de alimentaci n desde dentro de la cavidad del m dulo NO introducir he...

Page 74: ...de rayos 10 Cable de conexi n y desconexi n InfiniBand de cobre Dado que los cables de cobre InfiniBand son pesados y no son flexibles su conexi n a los conectores y su desconexi n se deben efectuar...

Page 75: ...armonizado internacionalmente y marcado HAR de tres conductores hilo de 1 0 mm2 como m nimo 300 voltios nominal con cobertura protectora aislante de PVC El cable debe tener un enchufe moldeado con ca...

Page 76: ...stalaci n permanente en el lugar de destino final no para fines de servicio o mantenimiento 21 Directiva WEEE Conforme a la Directiva 2002 96 CE sobre RAEE todos los residuos de equipos el c tricos y...

Page 77: ...Rev 1 2 Mellanox Technologies 77 4 5 45 C 113 F 8 3 6 7 8 9 10 InfiniBand InfiniBand...

Page 78: ...Rev 1 2 Mellanox Technologies 78 11 12 13 14 15 16 UL CSA UL CSA 3 16 AWG 1 5 6 4 5 125 13 HAR 3 1 0 300 250 10...

Page 79: ...nologies 79 17 18 RS232 Ethernet DP 1 DP 2 UL 20 19 20 WEEE 2002 96 EC WEEE E 9 Avertismente privind siguran a la instalare Romanian 1 Instruc iuni de instalare Citi i toate instruc iunile de instalar...

Page 80: ...lui ventilator 5 Temperatur n exces Acest echipament nu trebuie s fie ac ionat ntr o zon unde temperatura ambiant dep e te valoarea maxim recomandat 45 C 113 F n plus pentru a asigura un flux de aer a...

Page 81: ...ie ata ate sau deta ate de conectori cu grij Consulta i produc torul de cabluri pentru avertis mente instruc iuni speciale 11 Montarea sau depanarea ntr un rack C nd acest produs este montat sau depan...

Page 82: ...e nominal egal cu 250 V 10 A 17 Curent de scurgere de nalt frecven Avertisment Curent de scurgere de nalt frecven mp m ntarea este esen ial nainte de a conecta sursa de alimentare 18 Interconectarea u...

Page 83: ...ani kog dizala kako bi se izbjegle ozljede 4 Rizik od strujnog udara Rizik od strujnog udara S uklonjenim modulom ventilatora perima napajanja se mo e pristupiti u otvoru mod ula NEMOJTE umetati alat...

Page 84: ...munja nemojte raditi na opremi ili spajati ili odspajati kabele 10 Spajanje Odspajanje bakrenog kabela InfiniBand Bakreni kabeli InfiniBand su te ki i nesavitljivi i kao takvi se moraju pa ljivo prikl...

Page 85: ...je me unarodno uskla en i ozna en HAR 3 ilni s najmanje 1 0 mm2 ice nazivnog napona od 300 V s PVC izolacijom Kabel mora imati lijevani utika nazivnog napona od 250 V nazivne struje od 10 A 17 Veliko...

Page 86: ...lektri ni sustav s TN uzemljenjem i na elektri ni sustav s IT uzemljenjem dr ave Norve ke E 11 Avvertenze di sicurezza per l installazione italiano 1 Istruzioni di installazione Leggere tutte le istru...

Page 87: ...Collegamento di alimentazione ridondante Pericoli elettrici Questo prodotto dotato di un alimentatore ridondante o qualora esso non sia installato di uno spazio vuoto Qualora l alimentatore non sia in...

Page 88: ...tallato in conformit con l ultima versione dei codici elettrici nazionali del Paese Per il Nord America l apparecchiatura va installata in conformit con i requisiti applicabili del codice elettrico na...

Page 89: ...su binari non va utilizzata come scaffale o piano di lavoro I binari non sono progettati per far scorrere e allontanare l unit dal rack Essi sono destinati all installazione permanente solo nel luogo...

Page 90: ...kanik asans r kullan larak ta nmas gerekir 4 Elektrik arpmas Riski Bu ekipman nerilen maksimum ortam s cakl n a an alanlarda al t r lmamal d r 45 C 113 F Ayr ca d zg n hava ak sa lamak i in havaland r...

Page 91: ...kablo ba lamay n ya da kablo ba lant s kesmeyin 10 Bak r nfiniband Kablo Ba lama Ba lant y Kesme Bak r nfiniband kablolar a rd r ve esnemezler Bu nedenle ba lant lara ok dikkatli bir ekilde tak lmala...

Page 92: ...mlu ve HAR i aretli 3 iletken en az 1 0 mm2 tel 300 V de erinde ve PVC yal t ml bir g kayna kablosu se in Kablonun 250 V 10 A de erinde bir kal planm fi i olmas gerekmektedir 17 Y ksek Ka ak Ak m Uyar...

Page 93: ...ve elektronik ekipman at klar EEE ayr olarak toplanmal ve evsel at klarla birlikte pe at lmamal d r Bu r n ve t m par alar evreye dost ve sorumlu bir ekilde imha edilmelidir 21 Norve G K s tlamalar Bu...

Reviews: