Mellanox Technologies MHQH19B-XSR User Manual Download Page 1

Page: 1 / 63

www.mellanox.com

ConnectX®-2 VPI Single and Dual Port QSFP

InfiniBand and Ethernet Adapter Card User

Manual

P/N:

MHRH29B-XTR, MHRH29B-XSR, MHQH29B-XTR, MHQH29B-XSR, MHQH29C-XTR, MHQH29C-

XSR, MHRH19C-XTR, MHRH19C-XSR, MHQH19C-XTR, MHQH19C-XSR, MHQH19B-XSR,

MHQH19B-XTR, MHRH19B-XSR, MHRH19B-XTR

Rev 1.6

Summary of Contents for MHQH19B-XSR

Page 1: ...Dual Port QSFP InfiniBand and Ethernet Adapter Card User Manual P N MHRH29B XTR MHRH29B XSR MHQH29B XTR MHQH29B XSR MHQH29C XTR MHQH29C XSR MHRH19C XTR MHRH19C XSR MHQH19C XTR MHQH19C XSR MHQH19B XSR...

Page 2: ...L FAULTS OF ANY KIND AND SOLELY FOR THE PURPOSE OF AIDING THE CUSTOMER IN TESTING APPLICATIONS THAT USE THE PRODUCTS IN DESIGNATED SOLUTIONS THE CUSTOMER S MANUFACTURING TEST ENVIRONMENT HAS NOT MET T...

Page 3: ...nterface 16 2 1 2 Ethernet Interface 17 2 1 3 VPI Port Configuration 17 2 1 4 PCI Express Interface 17 2 1 5 LED Assignment 18 2 1 6 I2C compatible Interface 18 2 2 Power 19 2 3 QSFP Power Level 19 2...

Page 4: ...ations 44 A 2 MHRH19B X ST R Specifications 45 A 3 MHQH19B X ST R Specifications 46 A 4 MHQH29C X ST R Specifications 47 A 5 MHRH29B X ST R Specifications 48 A 6 MHQH29B X ST R Specifications 49 A 7 B...

Page 5: ...Flash Jumper 19 Figure 8 PCI Device 28 Figure 9 Connector Orientation example 31 Figure 10 Device Manager 36 Figure 11 Support Download Assistant 42 Figure 12 Schematic of the Dual Port Adapter Card...

Page 6: ...al Link Indications 18 Table 9 Jumper Configuration 19 Table 10 MHQH 12 9B XTR 20 Table 11 MHRH 12 9B XT CR 21 Table 12 MH QR H19C X STN R VPD 22 Table 13 MHRH19B X ST R 23 Table 14 MHQH19B X ST R 24...

Page 7: ...10 1 4 Added MHQH29C X ST R Oct 27th 2010 1 3 Added Technical Support and Firmware and Software sections to the Preface sections Added KCC statement Added GPUDirect Added CORE Direct Added RoCE Added...

Page 8: ...e http www mellanox com Firmware Downloads Download Firmware Tools Or http www mellanox com Support Download Firmware Tools IBTA Specification Release 1 2 1 InfiniBand Architecture Specification IEEE...

Page 9: ...Technical Support Customers who purchased Mellanox products through a Mellanox approved reseller should first seek assistance through their reseller Firmware and Software Updates The Mellanox support...

Page 10: ...xpress 2 0 1 1 compatible through an x8 edge connector up to 5GT s Single and Dual Port options available Compatible with copper cables and optical cables with the use of QSFP connectors Support for S...

Page 11: ...r MHRH19C XSR PCIe Gen2 5 0 GT s 40 Gb s QDR 1 port Short R 6 MT25414B0 FCCR QI MHRH19C XTR PCIe Gen2 5 0 GT s 40 Gb s QDR 1 port Tall R 6 MT25414B0 FCCR QI MHQH19C XSR PCIe Gen2 5 0 GT s 40 Gb s QDR...

Page 12: ...R Dual port Tall R 6 MT25408B0 FCCR GI MHQH29B XSR PCIe Gen2 5 0 GT s 40Gb s QDR Dual port Short R 6 MT25408B0 FCCR QI MHQH29B XTR PCIe Gen2 5 0 GT s 40Gb s QDR Dual port Tall R 6 MT25408B0 FCCR QI MH...

Page 13: ...ation B C generation C Separator X Memory Size X MemFree 1 128MB 2 256MB 3 512MB B Bracket S Short T Tall N None R RoHS blank non RoHS C RoHS R 5 w Exemption R RoHS R 6 Lead Free For example the part...

Page 14: ...abel Port 1 uses the GUID or MAC ID described on the label For Port 2 GUID or MAC add 1 to Port 1 s respective values 1 4 Safety Warnings For safety warnings in French see Avertissements de s curit d...

Page 15: ...work on the equipment or connect or dis connect cables 4 Copper Cable Connecting Disconnecting Some copper cables are heavy and not flexible as such they should be carefully attached to or detached f...

Page 16: ...connector for debug For dual port cards port 1 connects to connector 1 of the device while port 2 connects to connec tor 2 of the device Figure 4 Port 2 Port 1 Dual Port Numbering 2 1 1 InfiniBand Int...

Page 17: ...sts the configurations supported by dual port VPI adapter cards Table 6 Supported Port Configurations Port 1 Port 2 Ethernet Ethernet IB IB auto sensing auto sensing IB Ethernet IB auto sensing auto s...

Page 18: ...then the physical link has not been established Yellow Logical data activity link A constant yellow indicates a valid logical data activity link without data transfer A blinking yellow indicates a va...

Page 19: ...information and packet data on the system memory 2 4 2 SPI Flash Each of the adapter cards includes one 16MB SPI Flash device M25P16 VME6G device by ST Microelectronics accessible via the Flash interf...

Page 20: ...19 PN PN STR_SPC 40 VPD Keyword EC STR Engineering Change Level of the card rev 42 Length 0x2 43 Revision RV STR PCB revision 45 VPD Keyword SN STR Serial Number 47 Length 0x18 48 SerialNumber STR_SPC...

Page 21: ...r 47 Length 0x18 48 SerialNumber STR_SPC 00 00XXXX XX 72 VPD Keyword V0 STR Misc Information 74 Length 0x10 75 Data PCIe Gen2 x8 STR_SPC 91 VPD Keyword RV STR 93 Length 0x1 94 Data 0 93 CS0 95 Large R...

Page 22: ...on 50 VPD Keyword SN STR Serial Number 52 Length 0x18 53 SerialNumber STR_SPC 00 00XXXX XX 77 VPD Keyword V0 STR Misc Information 79 Length 0x10 80 Data PCIe Gen2 x8 STR_SPC 96 VPD Keyword RV STR 98 L...

Page 23: ...r 48 Length 0x18 49 SerialNumber STR_SPC 00 00XXXX XX 73 VPD Keyword V0 STR Misc Information 75 Length 0x10 76 Data PCIe Gen2 x8 STR_SPC 92 VPD Keyword RV STR 94 Length 0x1 95 Data 0 94 CS0 96 Large R...

Page 24: ...6 VPD Keyword SN STR Serial Number 48 Length 0x18 49 SerialNumber STR_SPC 00 00XXXX XX 73 VPD Keyword V0 STR Misc Information 75 Length 0x10 76 Data PCIe Gen2 x8 STR_SPC 92 VPD Keyword RV STR 94 Lengt...

Page 25: ...er 47 Length 0x18 48 SerialNumber STR_SPC 00 00XXXX XX 72 VPD Keyword V0 STR Misc Information 74 Length 0x10 75 Data PCIe Gen2 x8 STR_SPC 91 VPD Keyword RV STR 93 Length 0x1 94 Data 0 93 CS0 95 Large...

Page 26: ...45 VPD Keyword SN STR Serial Number 47 Length 0x18 48 SerialNumber STR_SPC 00 00XXXX XX 72 VPD Keyword V0 STR Misc Information 74 Length 0x10 75 Data PCIe Gen2 x8 STR_SPC 91 VPD Keyword RV STR 93 Leng...

Page 27: ...ter cards listed in Table 3 on page 11 and Table 4 on page 12 are standard PCI Express cards each with a standard x8 edge connector Please consult the host machine documentation for instructions on ho...

Page 28: ...ter card s is correctly installed in the PCI slot or try installing the adapter card into a different PCI slot Figure 8 PCI Device 5 In the Value display box check the fields VEN and DEV fields are se...

Page 29: ...ox com Products Cables for certified and approved cable recommenda tions 3 4 1 Optical Modules for QSFP These cards support optical modules for active fiber optical cables The part ordering number for...

Page 30: ...le disengage the locks and slowly pull the connector away from the port receptacle Both LED indicators will turn off when the cable is unseated Cables especially long copper cables can weigh a substan...

Page 31: ...nector Orientation example 3 4 3 2 Removing a Cable from the Adapter Card 1 Pull on the latch release mechanism thereby unlatching the connector and pull the connector out of the cage 2 Do not apply t...

Page 32: ...m the download page To ensure that communication has been established follow the instructions below Check the link status First check the network interface name by running the ifconfig a command run e...

Page 33: ...type MT26428 Number of ports 2 Firmware version 2 9 1000 Hardware version b0 Node GUID 0x0002c903000e9c5e System image GUID 0x0002c903000e9c61 Port 1 State Active Physical state LinkUp Rate 40 Base l...

Page 34: ...lsmod to verify that the module is listed Example Host lsmod grep mlx4_en mlx4_en 114184 0 mlx4_core 156512 2 mlx4_ib mlx4_en If you don t see the mlx4_en driver run modprobe mlx4_en Another option i...

Page 35: ...owing line should be added to the file etc modprobe conf options mlx4_en param_name value param_name value Ethernet Network Tuning To improve network performance by tuning your network see the Mellano...

Page 36: ...vice To enable it enter at the command line sc start opensm Whereas in Ethernet interfaces there is no need to run OpenSM 4 2 Port Type Management Via Driver SW 4 2 1 Linux If you wish to change the p...

Page 37: ...cally At the next stage the user will be prompted for the desired mode for each port The desired port configuration will then be set for the selected device Note This utility also has a non interactiv...

Page 38: ...esired port protocol for the available port s and b activate or deactivate the WSD ND and or SDP ULPs Note IB must be always the first port in Port 1 If you choose ETH as your first port in Port 1 the...

Page 39: ...later Mellanox OFED with GPUDirect support NVIDIA Development Driver for Linux version 195 36 15 or later Hardware Mellanox ConnectX 2 adapter card NVIDIA Tesla series 4 4 2 Installation For installa...

Page 40: ...Engine CORE Direct Collectives Offload Resource Engine provides the most advanced solution for handling collectives operations ensures maximum scalability minimizes the CPU overhead and provides the...

Page 41: ...sion of qualified firmware at the time of manufacturing Firmware is updated occasionally and the most recent firmware can be obtained from Support Download Center Check that the firmware on your card...

Page 42: ...mmand mst status The mst device name will be of the form dev mst mt dev_id _pci _cr0 conf0 d Get the PSID firmware identification and programmed firmware version using the command flint d dev mst mt23...

Page 43: ...for your adapter card update the firmware a Download the firmware image zip file from the Download Center see Step 2a above b Unzip the firmware image c Burn the firmware image Enter flint d device_n...

Page 44: ...0 C to 55 C Protocol Support Regulatory InfiniBand QoS Data Rate PCI Express IBTA v1 2 1 Auto Negotiationb b The auto negotiation protocol is proprietary of Mellanox Technologies and compliant with t...

Page 45: ...Active Cables 9 34W 0 C to 55 C Protocol Support Regulatory InfiniBand QoS RDMA Support Data Rate PCI Express IBTA v1 2 1 Auto Negotiationb b The auto negotiation protocol is proprietary of Mellanox T...

Page 46: ...rt Regulatory InfiniBand QoS RDMA Support Data Rate PCI Express IBTA v1 2 1 Auto Negotiationb b The auto negotiation protocol is proprietary of Mellanox Technologies and compliant with the InfiniBand...

Page 47: ...Cables 13 36W 0 C to 55 C Protocol Support Regulatory InfiniBand QoS Data Rate PCI Express IBTA v1 2 1 Auto Negotiationb b The auto negotiation protocol is proprietary of Mellanox Technologies and com...

Page 48: ...gulatory InfiniBand QoS Data Rate PCI Express IBTA v1 2 1 Auto Negotiationb b The auto negotiation protocol is proprietary of Mellanox Technologies and compliant with the InfiniBand Architec ture Spec...

Page 49: ...Cables 13 36W 0 C to 55 C Protocol Support Regulatory InfiniBand QoS Data Rate PCI Express IBTA v1 2 1 Auto Negotiationb b The auto negotiation protocol is proprietary of Mellanox Technologies and com...

Page 50: ...1 6 Mellanox Technologies 50 A 7 Board Mechanical Drawing and Dimensions All dimensions are in millimeters All the mechanical tolerances are 0 1mm Figure 12 Schematic of the Dual Port Adapter Card MHQ...

Page 51: ...v 1 2 Mellanox Technologies 51 Figure 13 Schematic of the Dual Port Adapter Card MH RQ H29B X ST R 167 65 68 40 56 15 96 30 57 15 15 00 33 35 56 97 64 40 J1 I2C Connector J3 Flash jumper Figure 14 Sch...

Page 52: ...6 Mellanox Technologies 52 A 8 Regulatory Statements For regulatory statements for all ConnectX 3 cards please refer to http www mellanox com related docs user_manuals Regulatory_and_Compliance_Guide...

Page 53: ...ompatible Connector Pinout Figure 15 Compatible Connector Plug and Pinout 5 1 2 3 4 5 1 2 3 4 Table 24 I2C Compatible Connector Connector Pin Number Signal Name 1 SPSDA 2 SPSCL 3 GND 4 NC 5 NC B 2 PCI...

Page 54: ...or Pin Name and Number to Signal Name Correspondence Connector Pin Number Connector Pin Name Port A Signal Name 1 GND GND 2 TXN_2 Tx2n 3 TXP_2 Tx2p 4 GND GND 5 TXN_4 Tx4n 6 TXP_4 Tx4p 7 GND GND 8 ModS...

Page 55: ...GND 21 RXN_2 Rx2n 22 RXP_2 Rx2p 23 GND GND 24 RXN_4 Rx4n 25 RXP_4 Rx4p 26 GND GND 27 ModPrsl_Port0 Mod PrsL 28 IntL IntL 29 VccTx 30 Vcc1 31 LPMode_Port0 LPMode 32 GND GND 33 TXP_3 Tx3p 34 TXN_3 Tx3n...

Page 56: ...Mellanox Tech nologies adapter card and replace it with a short one It includes the following sections Removing a bracket Installing a new bracket To replace the bracket you will need the following pa...

Page 57: ...ts LEDs Screws Gasket LEDs 1 Remove the two screws holding the bracket in place 2 The bracket comes loose from the card Be careful not to put stress on the LEDs 3 Save the two screws and the two fiber...

Page 58: ...et per port is used Figure 18 Gasket Installation 4 Place the bracket onto the card until the screw holes line up Do not force the bracket onto the card You may have to gently push the LEDs using a sm...

Page 59: ...et Adapter Card User Manual Rev 1 6 Mellanox Technologies 59 Figure 19 Placing the Bracket on the Card Gaskets in place on the bracket 6 Make sure that the LEDs are aligned onto the bracket holes 7 Us...

Page 60: ...espace libre autour des ouver tures de ventilation 3 Orages dangers lectriques Pendant un orage il ne faut pas utiliser le mat riel et il ne faut pas brancher ou d brancher les c bles 4 Branchement d...

Page 61: ...t des codes lectriques locaux et nationaux 8 Exposition au rayonnement grave Mise en garde l utilisation de commandes ou de r glages ou l ex cution de proc dures autres que ce qui est sp cifi dans les...

Page 62: ...reiraum um die Bel f tungs ffnungen sein um einen einwandfreien Luftstrom zu gew hrleisten 3 Bei Gewitter Elektrische Gefahr Arbeiten Sie w hrend eines Gewitters und Blitzschlag nicht am Ger t 4 Ger t...

Page 63: ...na circulaci n de aire adecuada se debe dejar como m nimo un espacio de 8 cm 3 pulgadas alrededor de las aberturas de ventilaci n 3 Cuando hay rayos peligro de descarga el ctrica No utilizar el equipo...

Search results

Summary of Contents for MHQH19B-XSR

Reviews:

Related manuals for MHQH19B-XSR

Brands by name

Popular brands

Mellanox Technologies MHQH19B-XSR, User Manual

Search results

Summary of Contents for MHQH19B-XSR

Reviews:

Related manuals for MHQH19B-XSR

Brands by name

Popular brands