background image

www.mellanox.com

Dell and the Dell logo are 

 

trademarks of Dell Inc.

ConnectX

®

-2 Dual Port I/O Card for Dell C6100

User Manual

MCQH29-XDR

Rev 1.0

Summary of Contents for ConnectX MCQH29-XDR

Page 1: ...www mellanox com Dell and the Dell logo are trademarks of Dell Inc ConnectX 2 Dual Port I O Card for Dell C6100 User Manual MCQH29 XDR Rev 1 0 ...

Page 2: ... PURPOSE OF AIDING THE CUSTOMER IN TESTING APPLICATIONS THAT USE THE PRODUCTS IN DESIGNATED SOLUTIONS THE CUS TOMER S MANUFACTURING TEST ENVIRONMENT HAS NOT MET THE STANDARDS SET BY MELLANOX TECHNOLOGIES TO FULLY QUALIFY THE PRODUCTO S AND OR THE SYSTEM USING IT THEREFORE MELLANOX TECHNOLOGIES CAN NOT AND DOES NOT GUARANTEE OR WARRANT THAT THE PRODUCTS WILL OPERATE WITH THE HIGHEST QUALITY ANY EXP...

Page 3: ...12 2 5 EEPROMVPD 12 Chapter 3 Driver Software and Firmware 14 3 1 DriverSoftware 14 3 1 1 Linux 14 3 1 2 Windows 14 3 2 Updating Card Firmware 14 3 3 FlexBoot 14 Chapter 4 I O Card Installation 15 4 1 Hardware and Software Requirements 15 4 2 InstallationKit 15 4 3 InstallationInstructions 16 4 4 SafetyWarnings 19 Chapter 5 Cables and Modules 21 5 1 CableInstallation 21 5 1 1 Inserting a Cable int...

Page 4: ...Kit Parts 16 Figure 6 Removing From the Server 17 Figure 7 Top View 17 Figure 8 Install the Plastic Leg onto the Board 18 Figure 9 Installing the Connector Board into the HCA Card 18 Figure 10 Dell Card Installed 18 Figure 11 Front Panel 19 Figure 12 Top View 19 Figure 13 Connector Orientation 22 Figure 14 Mechanical Drawing 23 Figure 15 QSFP Connector Male and Female Views 28 ...

Page 5: ...tory Table 6 Table 2 Documents List 7 Table 3 ConnectX 2 I O Card Details 8 Table 4 VPI Support 10 Table 5 Jumper Configuration 12 Table 6 MCQH29 XDR VPD 12 Table 7 Hardware and Software Requirements 15 Table 8 ConnectX Dual Port InfiniBand I O Card Installation Kit 16 Table 9 ConnectX 2 MCQH29 XDR Specifications 26 ...

Page 6: ...Rev 1 0 Mellanox Technologies 6 Revision History This document was first printed on 5 6 10 Table 1 Revision History Table Date Rev Comments Changes April 2010 1 0 Initial release ...

Page 7: ...band architecture specifications Related Documentation Table 2 Documents List Online Resources Mellanox Technologies Web pages http www mellanox com Dell Support Web pages http support dell com Document Conventions When discussing memory sizes MB and MBytes are used in this document to mean size in mega bytes The use of Mb or Mbits small b indicates size in mega bits InfiniBand Architecture Specif...

Page 8: ... or 40Gb s InfiniBand or 10GigE per port CPU offload of transport operations End to end QoS and congestion control Hardware based I O virtualization PCI Express 2 0 up to 5GT s TCP UDP IP stateless offload Fibre Channel encapsulation FCoIB or FCoE 1 1 I O Card Table 3 ConnectX 2 I O Card Details Ordering Part Number OPN PCI Express SERDES Speed IB Data Transmission Rate Eth Data Transmission Rate ...

Page 9: ... have a label on the printed side of the card that has the card serial number the card MAC for Ethernet protocol and the card GUID for InfiniBand protocol VPI Cards have both a MAC and a GUID Figure 1 Card Product Labels IL 0JR3P1 74031 980 0001 REV A00 Made in IL P N 0JR3P1 REV X1 Made in IL GUID 0024E89097FF24DC MAC 0002C9011226 FC Model No MCQH29 XDR ...

Page 10: ... ConnectX 2 VPI adapter card is compliant with the InfiniBand Architecture Specification Release 1 2 1 It has two compliant QSFP InfiniBand ports with four Tx Rx pairs of SerDes con nected to QSFP connectors 2 1 2 Ethernet Interface The ConnectX 2 VPI adapter card is compliant with the IEEE Std 802 3ae Specification Each port can be connected to a 10 Gigabit Ethernet switch through the use of QSFP...

Page 11: ...ompati ble interfaces 2 4 1 System Memory The I O card utilizes the PCI Express interface to store and access fabric connection information on the system memory Table 5 Physical and Logical Link Indications Figure 3 Front Panel Port Number LED Name Port 1 Physical Link Green Constant on indicates a good physical link Blinking indicates a problem with the Physical link Data Activity Yellow Blinking...

Page 12: ... EEPROM that is accessible through the I2C compatible interface The EEPROM is used for storing the Vital Product Data VPD and FRU The VPD format adheres to the PCI Local Bus specification rev 2 3 VPD definition The EEPROM capacity is 4Kb Table 6 Jumper Configuration Description Option Card Default Configuration Comments Flash present not present connection open Flash present connection shorted Fla...

Page 13: ...Checksum 91 Large Resource Type VPD W Tag 0x11 0x91 Read Write Area 92 Length 0xA1 94 VPD Keyword V1 Driver version 96 Length 0x6 97 Data N A Number 103 VPD Keyword YA Asset Tag 105 Length 0x20 106 Data N A Alphanumeric 138 VPD Keyword RW Remaining read write area 140 Length 0x72 141 Data Reserved 0x00 255 Small Resource Type END Tag 0x11 0x78 256 Mellanox Read Only Mask 0x0 0 Numbers 350 Mellanox...

Page 14: ...e Firmware can be updated on the stand alone single card using the flint tool of the Mellanox Firm ware Tools MFT package This package is available for download along with its user manual from the Mellanox Firmware Tools page See http www mellanox com Downloads Firm ware Tools A firmware binaries table lists a binary file per card The file name of each such binary is com posed by combining the fir...

Page 15: ... and Software Requirements 4 2 Installation Kit Make sure all of the parts are in the kit before you start the installation If any parts are damaged or missing call your supplier immediately Table 8 Hardware and Software Requirements Requirement Description Hardware Used with Dell C6100 chassis Software Operating Systems Distributions Refer to the C6100 chassis Manuals Software Stacks Mellanox Ope...

Page 16: ...nstallation Instructions Remove the server from the chassis 1 Connect an ESD strap to your wrist and to a valid ESD ground 2 Push the latch and pull on the handle Table 9 ConnectX Dual Port InfiniBand I O Card Installation Kit 1 I O Card 1 connector board 3 flathead screws 1 plastic leg 3 panhead screws x3 x3 ...

Page 17: ...server and place on a work bench 4 Above the handle are screws holding on the faceplate 5 Remove these screws and discard 6 Remove the two screws on the top side of the server and discard Figure 7 Top View 7 Remove the faceplate 8 Push the plastic leg onto the board Push here Pull handle Screws holding the faceplate Screws in top ...

Page 18: ...ure 9 Installing the Connector Board into the HCA Card 10 Put the card into place in the server catching the cages into the front panel of the server The metal leg must go inside of the server and line up with the hole in the side of the server Also push the connector board into the socket in the server 11 Screw in a flat head screw for the metal leg Figure 10 Dell Card Installed Install a flathea...

Page 19: ...anel Figure 11 Front Panel 13 Screw in two flathead screws on the top of the server into the HCA card Figure 12 Top View 14 Slide the server in the chassis 4 4 Safety Warnings 1 Installation Instructions Read all installation instructions before connecting the equipment to the power source Screws holding the faceplate Screws in top ...

Page 20: ...eding the maximum recommended 55 C 131 F To guarantee proper air flow allow at least 8cm 3 inches of clearance around the ventilation openings During periods of lightning activity do not work on the equipment This equipment should be installed replaced or serviced only by trained and qualified personnel Disposal of this equipment should be in accordance to all national laws and regulations This eq...

Page 21: ...Note Always install and remove cables by pushing or pulling the cable and connector in a straight line with the card Care should be taken not to impede the air exhaust flow through the ventilation holes Cable lengths should be used which allow for routing horizontally around to the side of the chassis before bending upward or downward in the rack To remove a cable disengage the locks and slowly pu...

Page 22: ...2 Removing a Cable from the Card 1 Pull on the latch release mechanism thereby unlatching the connector and pull the connector out of the cage 2 Do not apply torque to the connector when removing it from the card 3 Remove any cable supports that were used to support the cable s weight 180o ...

Page 23: ...ons The ConnectX 2 I O card mechanical drawing is depicted in Figure 14 Figure 14 Mechanical Drawing Note All dimensions are in millimeters J1 is the flash jumper J2 is the I2C Connector J2 J3 J5 J4 J6 Q1 Q2 U9 U1 U13 H1 H2 H3 J1 L14 U8 U10 U3 U5 U6 U7 111 90 34 40 59 70 16 60 79 30 10 80 63 90 10 03 57 15 2 60 4 60 I2C interface J2 Flash Jumper J1 ...

Page 24: ...al envi ronment This equipment generates uses and can radiate radio frequency energy and if not installed and used in accordance with the instruction manual may cause harmful interference to radio communications Operation of this equipment in a residential area is likely to cause harmful interference in which case the user will be required to correct the interference at his own expense A 2 2 EN St...

Page 25: ...ment is used in a domestic environment radio interference may occur in which case the user may be required to take corrective actions A 2 5 KCC Notice Republic of Korea Only The KCC label may be located separately from the other regulatory markings applied to your prod uct Class A devices are for business purposes Class A Device KCC Class A Regulatory Label If the regulatory label includes the fol...

Page 26: ...P Ethernet QSFP InfiniBand PCI Express IBTA v1 2 1 Auto Negotiation 20Gb s 5Gt s or 10Gb s 2 5Gt s IEEE Std 802 3ae 10 Gigabit Ethernet IEEE Std 802 3ad Link Aggrega tion and Failover IEEE Std 802 3x Pause IEEE Std 802 1Q VLAN tags IEEE Std 802 1p Priorities Multicast Jumbo frame support 10KB 128 MAC VLAN addresses per port 8 Virtual Lanes for InfiniBand 8 Priority Queues for Ethernet Yes All Port...

Page 27: ...SelL Module Select 9 ResetL Module Reset 10 Vcc Rx 3 3 V Power supply receiver 11 SCL 2 wire serial interface clock 12 SDA 2 wire serial interface data 13 GND Ground 14 Rx3p Receiver Non Inverted Data Output 15 Rx3n Receiver Inverted Data Output 16 GND Ground 17 Rx1p Receiver Non Inverted Data Output 18 Rx1n Receiver Inverted Data Output 19 GND Ground 20 GND Ground 21 Rx2n Receiver Inverted Data O...

Page 28: ... 7 8 3 3 3 3 3 3 3 3 RX4p GND GND GND RX4n RX2p RX2n TX1n GND TX1p GND TX3n TX3p GND IntL ModPrsL VccTx Vcc1 LPMode 18 35 8 50 Top ResetL SDA SCL ModSelL RX3p TX2n GND VccRx 1 2 3 4 5 6 7 8 9 10 1 2 3 4 5 6 7 8 9 TX2p GND TX4n TX4p GND 1 1 1 1 1 1 1 1 1 1 20 GND GND GND RX3n RX1p RX1n 30 RX4p GND GND GND RX4n RX2p RX2n TX1n GND TX1p GND TX3n TX3p GND IntL ModPrsL VccTx Vcc1 LPMode 1 2 3 4 5 6 7 8 ...

Page 29: ... dans une zone avec une température ambi ante dépassant le maximum recommandé de 55 C 131 F Un flux d air de 200LFM à cette température ambiante maximale est nécessaire En outre pour garantir un bon écoulement de l air laissez au moins 8 cm 3 pouces d espace libre autour des ouvertures de ventilation Pendant un orage il ne faut pas utiliser le matériel Ce matériel ne doit être installé remplacé ou...

Page 30: ...bungstemperatur über der maximal empfohlenen Temperatur von 55 C 131 F betrieben werden Außerdem sollten mindestens 8 cm 3 in Freiraum um die Belüf tungsöffnungen sein um einen einwandfreien Luftstrom zu gewährleisten Arbeiten Sie während eines Gewitters und Blitzschlag nicht am Gerät Diese Gerät sollte nur von geschultem und qualifiziertem Personal installiert ausgetauscht oder gewartet werden Di...

Reviews: