manualshive.com logo in svg

Mellanox Technologies MT51336-EN-EVB, User Manual

Share
Download
Mellanox Technologies MT51336-EN-EVB User Manual Download Page 38

Installing the PCIE/1GbE Server Side board

Rev 1.5

Mellanox Technologies

38

Figure 25: Server Side Card

The PCB server board has 3 interfaces:

Interface

For PCIE

CX4

clocking and reset

QSFP

for connection to the server side board

QSFP

for connection to the server side board

PCIE SERVER TX

PCIE SERVER RX

CX4 connector

Power 

connection

Summary of Contents for MT51336-EN-EVB

Page 1: ...www mellanox com SwitchX Evaluation Board Hardware User Manual PN MT51336 EN EVB MT51336 VPI EVB Rev 1 5...

Page 2: ...IND AND SOLELY FOR THE PURPOSE OF AIDING THE CUSTOMER IN TESTING APPLICATIONS THAT USE THE PRODUCTS IN DESIGNATED SOLUTIONS THE CUSTOMER S MANUFACTURING TEST ENVIRONMENT HAS NOT MET THE STANDARDS SET...

Page 3: ...22 4 4 2 Management and Firmware Updating Interfaces 23 4 5 Switch Platform Installation and Operation 25 4 5 1 Installation Safety Warnings 25 4 5 2 Mechanical Installation 27 4 6 Package Contents a...

Page 4: ...setting the Switch 49 5 11 Configuring the Switch for the First Time 50 Chapter 6 Connecting to the Switch Platform 52 6 1 I2C Connector 52 6 2 How to Get Mellanox Firmware Tools MFT 52 6 3 Updating F...

Page 5: ...ck Rail Kit Parts 29 Figure 16 Mounting Options 30 Figure 17 Screwing on the Rail 31 Figure 18 Inserting the Caged Nuts 31 Figure 19 Slide the Rail into the Rail Slide 32 Figure 20 Power Supply Unit E...

Page 6: ...echnologies 6 Figure 36 Reset Button 49 Figure 37 Management Interfaces 50 Figure 38 Transfer Power Cord 59 Figure 39 Install the Switch Slide 60 Figure 40 Transfer Power Cord Finished 60 Figure 41 Co...

Page 7: ...cal and Logical Link Indications 18 Table 4 PSU Status LED Configurations 19 Table 5 Fan Status LED Configurations 20 Table 6 Bad Port LED Configurations 21 Table 7 Port Connector Numbering 46 Table 8...

Page 8: ...Description 1 5 Fixed Figure 35 and Table 7 Added Power up sequence to Section 5 5 1 4 Added Appendix B Thermal Definitions 1 3 Decision to include I2C power side interface 1 2 Changes recommended by...

Page 9: ...ack mounted standard 19 rack and in a tabletop setup for Signal Integrity evaluation Figure 1 Connector and Power Side Panels Full Feature List Reference traces SMA and mini SMP Compliance ports SMA a...

Page 10: ...er PC is removed the switch EVB becomes unmanaged and does NOT need Initial configuration Interface Description CX4 connector for clocking and reset 2 QSFP connectors one is blue one is green The gree...

Page 11: ...ey are designed to have an insertion loss of 5 5dB as defined in SFF 8431 See Figure 12 on page 22 for identifying the trace and compliance ports See Figure 35 on page 45 and Table 7 on page 46 for lo...

Page 12: ...Overview Rev 1 5 Mellanox Technologies 12 Figure 2 Pull Out Tab S N MT1117X00014 P N MT51336 EN EVB MAC 0002C927051C Made in IL MGT 1 00 02 C9 11 A2 01 MGT 2 00 02 C9 11 A2 02 Rev A1...

Page 13: ...cept for the Reference ports can run at 10GigE 1GigE Ports 1 and 2 and 35 and 36 are not connected to the chip All ports are capable of virtual switching VEPA All usable virtual switching ports are gr...

Page 14: ...ferent block types deskew mechanism and framing rules SwitchX also supports FDR10 a non standard InfiniBand data rate where each lane of a 4X port runs a bit rate of 10 3125Gb s with a 64b 66b encodin...

Page 15: ...connectors 1 RJ45 connector for connecting to a host PC CONSOLE 1 USB connector 24 QSFP ports 12 SFP ports various switch port fan and power status LEDs Figure 4 Power Side Panel 1 hot swap fan module...

Page 16: ...b lem with the power supply The switch is operational only if the PSU LED is green The FAN LED should light up green If the FAN LED shows red troubleshoot the fan module As long as there is power to t...

Page 17: ...ports are two LEDs one for the upper port and one for the lower port The fol lowing table shows the port status according to the LED indication Table 2 System Status LED Configurations LED Configurat...

Page 18: ...r LED on the right side of the PSU that indicates the internal status of the unit Table 3 Connector Physical and Logical Link Indications LED Status LED Description Off No power to the port Solid Gree...

Page 19: ...dicator on the Fan Module is on the right side of the module Table 4 PSU Status LED Configurations LED Color Status Solid Green OK The Power supply is delivering the correct voltage 12VDC Solid Red Er...

Page 20: ...The system is up and running Solid Red Error One or more fans is not operating properly The system should be powered down and troubleshoot the fan module Off Off The fan unit is not receiving any pow...

Page 21: ...t module It thereby resets all of the ports by bringing them down and powering them up when the button is pushed A quick push of this button performs this reset When the button is held down for 15 sec...

Page 22: ...the switch EVB has 24 QSFP ports and 12 SFP ports These are placed in two rows 18 ports to a row The ports are labelled as shown in Figure 12 The bottom row ports are flipped from the top row See Figu...

Page 23: ...The port labelled CONSOLE is for a local host connection to the management module This is used the first time the switch is connected An HAR 000028 harness is included in the package to connect to a...

Page 24: ...in I2C interfaces on the board Access to these connectors is only available with the top cover removed 4 4 2 5 Internal I2C Interface There is an I2C connector 3 pin type at connector number 19 on Fig...

Page 25: ...on page 64 for German see Section H Installation Sicherheitshinweise German on page 68 and for Spanish see Section G Advertencias de seguridad para la instalaci n Span ish on page 77 1 Installation I...

Page 26: ...gs and instructions Support the weight of copper by tying them to the rack or to a cable management system When this product is mounted or serviced in a rack special precautions must be taken to ensur...

Page 27: ...ment or performance of procedures other than those specified herein may result in hazardous radiation exposure CLASS 1 LASER PRODUCT and reference to the most recent laser standards IEC 60 825 1 1993...

Page 28: ...kit 1 a kit that replaces the management module and allows for external man agement Power cable 1 Type B 6ft US 125V 10A chord See Replacement Parts Ordering Num bers on page 58 to order power cords...

Page 29: ...he IB connectors can be even with one of the vertical rack supports Things to consider before choosing where to mount the rails and rail slides The distance between the rack and the door can be as lit...

Page 30: ...other equipment in the rack and will this be problematic The installation kit allows for a 2 recess of the switch past the vertical support Figure 16 Mounting Options 3 Decide which mounting option yo...

Page 31: ...itch power side and connector side are at the same level in the rack 6 Clip 4 more caged nuts into the holes on the opposite side of the rack Check that both sides of the switch left and right are the...

Page 32: ...f the cables to the switch 4 6 2 Grounding the Switch Check to determine if your local or national electrical codes require an external ground to all IT components If so connect a ground wire to one o...

Page 33: ...cal codes when installing this equipment Caution The switch platform will automatically power on when AC power is applied There is no power switch Check all boards power supplies and fan tray modules...

Page 34: ...ap into place confirming the proper installation 4 Insert the power cord into the supply connector 5 Insert the other end of the power cord into an outlet of the correct voltage 4 6 5 Cable Installati...

Page 35: ...the side of the chassis before bending upward or downward in the rack 4 6 6 Extracting and Inserting the Fan Unit This switch can operate indefinitely with one of the three fans in the fan module ino...

Page 36: ...ding it into the opening until slight resistance is felt Continue press ing the fan unit until it seats completely The green fan status indicator should light If not extract the fan unit and reinsert...

Page 37: ...An alternative is to select to use the RJ45 1GbE connection to the SwitchX EVB The user can connect this RJ45 connector to any Ethernet 10 100 1000 port for management 5 1 PCIE 1GbE Extender Kit parts...

Page 38: ...ogies 38 Figure 25 Server Side Card The PCB server board has 3 interfaces Interface For PCIE CX4 clocking and reset QSFP for connection to the server side board QSFP for connection to the server side...

Page 39: ...he ESD strap Make sure the ESD strap is touching your skin and that the other end is connected to a verified ground 2 Remove the 6 screws from the power side of the top 3 Slide the top towards the pow...

Page 40: ...Installing the PCIE 1GbE Server Side board Rev 1 5 Mellanox Technologies 40 Figure 27 Screw Locations Figure 28 Slide the Top CONSOLE MGT MT51136 RST UID PS2 PS1 CONSOLE MGT MT51136 RST UID PS2 PS1...

Page 41: ...e User Manual Rev 1 5 Mellanox Technologies 41 5 3 Removing the Management CPU Figure 29 Management Board Installed Figure 30 Unscrew the Management Board CONSOLE MGT MT51136 RST UID PS2 PS1 CONSOLE M...

Page 42: ...king and put on the ESD strap Make sure the ESD strap is touching your skin and that the other end is connected to a verified ground 2 Put the connectors for the extender daughter board through the ho...

Page 43: ...1000Mb Ethernet management RJ45 Ethernet cable Connect the RJ45 cable to a switch or server Ethernet port This is 10 100 1000Mb interface For PCIE control 1 CX4 cable 2 QSFP cables blue to blue and g...

Page 44: ...sert the server side board into a X8 or X16 PCIE slot in the server Figure 34 Connecting the EVB to the Server Side Board 3 Connect the QSFP cables from the daughter board to the server board connect...

Page 45: ...s Numbering and Locations Figure 35 EVB Board Connections View 1 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 31 34 35 36 37 38 39 29 30 32 33 46 47 48 49 50 51 52 53 54...

Page 46: ...Connects to Port 2 Ref to compliance port 4 10 SMA Reference Connects to Port 2 Ref to compliance port 4 11 Mini SMP Data SX HW Port 27 RX lane C Negative 12 Mini SMP Data SX HW Port 27 RX lane C Pos...

Page 47: ...gth X 42 CX4 Clock and Reset 43 QSFP RX Data 44 QSFP TX Data 45 RJ45 Ethernet management connection 46 SMA Clock Option for ext clock 106 25MHz 47 SMA Calibration Calibration of length X 48 SMA Calibr...

Page 48: ...rt 36 RX lane A Positive 65 Mini SMP Data SX HW Port 36 RX lane C Negative 66 Mini SMP Data SX HW Port 36 RX lane C Positive 67 Mini SMP Data SX HW Port 36 TX lane A Positive 68 Mini SMP Data SX HW Po...

Page 49: ...button This reset button requires a tool to be pressed Figure 36 Reset Button This button resets the switch when the button is pushed A quick push of this button resets the whole switch When the butto...

Page 50: ...l terminal program for example HyperTerminal minicom or Tera Term on your host PC with the settings described in Table 8 When the Power PC is removed the switch EVB becomes unmanaged and does NOT need...

Page 51: ...the output Parity None Flow Control None sx 43 standalone master enable sx 43 standalone master show interfaces mgmt0 Interface mgmt0 state Admin up yes Link up yes IP address 192 168 10 43 Netmask 2...

Page 52: ...ur switch is available Download the latest firmware from http www mellanox com Support Firmware Download For instructions on downloading firmware see http www mellanox com mellanox com Products Adapte...

Page 53: ...mware versions will be posted on the Mellanox firmware download page http www mellanox com Support Firmware Download You will also need to download and unzip the firmware binary image This is provided...

Page 54: ...ion holes are not blocked especially dust over the holes 3 If you find dust blocking the holes it is recommended to clean the fan unit and remove the dust from the front and rear panels of the switch...

Page 55: ...s 55 5 Check the temperature 6 Check the Fan status The switch is not working and unresponsive 1 Reset the switch If resetting the switch does not work 2 Unplug the switch 3 Wait 5 minutes 4 Plug in t...

Page 56: ...x H Weight Air Flow 629 mm x 428 mm x 43 6 mm 24 76 in x 16 85 in x 1 71 in 9 31kg 20 52 lbs 62CFM Voltage Typ Typ 50 40GigE Active Cables Passive cables Typ Typ 40GigE Active Cables Passive cables Ma...

Page 57: ...g the switch has crossed the Warning threshold The administrator should deal with the overheating At this point the switch will not shut down Critical 120O C At this temperature the firmware will auto...

Page 58: ...r side air flow MSX60 FF Fan module with connector side to power supply side air flow MSX60 FR 300W Power Supply w Power Supply Side to Connector side air flow MSX60 PF 300W Power Supply w Connector s...

Page 59: ...power cord you want to transfer 1 Once you have decided which side of the switch will be next to the vertical support 2 Make sure that you place the cord so that the correct end of the cord will be at...

Page 60: ...Rev 1 5 Mellanox Technologies 60 Figure 39 Install the Switch Slide Figure 40 Transfer Power Cord Finished 6 Return to step 4 on page 36 and continue the installation...

Page 61: ...PCIe1_Tx2_p 9 GP_LV 39 I2C1_DAT 69 GBE1_MDI0 TX0 99 PCIe1_Rx2_n 10 3 3V 40 I2C0_DAT 70 GBE0_MDI0 TX0 100 PCIe1_Tx2_n 11 GP_HV 41 PWR_OK 71 GBE1_MDI0 TX0 101 GND 12 3 3V 42 USB_0_OC 72 GBE0_MDI0 TX0 1...

Page 62: ...esent 112 PCIe1_Tx0_n 23 GND 53 GBE1_MDI3 83 GND 113 GND 24 RS232_TX 54 GBE0_MDI3 84 GND 114 GND 25 CPU_TCK 55 GND 85 PCIE_CLK_REF1 115 PCIe0_Rx0_p 26 RS232_DTR 56 GND 86 PCIE_CLK_REF0 116 PCIe0_Tx0_p...

Page 63: ...D GND GND RXD GND GND RJ45_RTS RJ45_DTR RJ45_TXD GND GND RJ45_RXD GND GND J34 Pin 1 Pin 8 Looking into the Socket CONSOLE TXD TXD RXD GND GND RXD GND GND RJ45_SDA GND GND GND GND RJ45_SCL GND GND J34...

Page 64: ...le est n cessaire En outre pour garantir un bon coulement de l air laissez au moins 8 cm 3 pouces d espace libre autour des ouver tures de ventilation Le ch ssis ne doit pas tre empil sur un autre mat...

Page 65: ...faut de brancher toutes les alimentations stabilise es Risk of electric shock and energy hazard The PSUs are all independent Disconnect all power supplies to ensure a powered down state inside of the...

Page 66: ...Nord l quipement doit tre install conform ment aux sp cifications du Code Electrique National Am ricain et du Code Electrique Canadien Les c bles de branchement l unit RS232 et les interfaces Ethernet...

Page 67: ...le de 1 5 m 6 pieds et d une longueur maxi male de 4 5 m 18 pieds Pour les prises lectriques en Europe choisissez un cordon lectrique harmonis inter nationalement et marqu HAR 3 conducteurs d un diam...

Page 68: ...s ffnungen sein um einen einwandfreien Luftstrom zu gew hrleisten Das Chassis sollte nicht auf andere Ger te gestapelt werden Wenn das Chassis herun terf llt kann es zu Verletzungen und Besch digungen...

Page 69: ...estell von unten nach oben mit Ger ten f llen Diese Ger t sollte nur von geschultem und qualifiziertem Personal installiert ausge tauscht oder gewartet werden Die Entsorgung dieses Ger ts sollte unter...

Page 70: ...indung von wesentlicher Bedeutung werden Bevor Sie dieses Ger t an das Stromnetz die Schutzerde Terminal Schrauben dieses Ger t muss an den Schutzleiter in der Geb udeinstallation Dieses Ger t muss in...

Page 71: ...itch EVB Hardware User Manual Rev 1 5 Mellanox Technologies 71 20 Bodily Injury Due to Weight Use enough people to safely lift this product 40 lbs 18 kgs 40 70 lbs 18 32 kgs 70 121 lbs 32 55 kgs 121 l...

Page 72: ...ical lift to avoid injuries No se debe utilizar el equipo en un rea con una temperatura ambiente superior a la m xima recomendada 45 C Adem s para garantizar una circulaci n de aire adec uada se debe...

Page 73: ...nstrucciones especiales consultar al fabricante del cable Al instalar o realizar el mantenimiento de este aparato en un bastidor es preciso adop tar precauciones especiales para garantizar que el sist...

Page 74: ...n con la puesta a tierra de protecci n y un t cnico de servicio deber conectar permanentemente el equipo a dicho medio de conexi n Un T CNICO DE SERVICIO comprobar si la toma el ctrica de la que se su...

Reviews:

No comments

Brands by name

Popular brands

Load more brands