Mellanox Technologies ConnectX-3 MCX313A-BCBT User Manual Download

Page: 1 / 65

www.mellanox.com

ConnectX

-3 Ethernet Single and Dual QSFP+

Port Adapter Card User Manual

P/N:

MCX313A-BCBT, MCX314A-BCBT

Rev 2.3

Summary of Contents for ConnectX-3 MCX313A-BCBT

Page 1: ...www mellanox com ConnectX 3 Ethernet Single and Dual QSFP Port Adapter Card User Manual P N MCX313A BCBT MCX314A BCBT Rev 2 3...

Page 2: ...POSE OF AIDING THE CUSTOMER IN TESTING APPLICATIONS THAT USE THE PRODUCTS IN DESIGNATED SOLUTIONS THE CUSTOMER S MANUFACTURING TEST ENVIRONMENT HAS NOT MET THE STANDARDS SET BY MELLANOX TECHNOLOGIES T...

Page 3: ...et Interface 14 2 2 PCI Express Interface 14 2 3 I2C compatible Interface 15 2 4 LED Interface 15 Chapter 3 Hardware Installation 16 3 1 System Requirements 16 3 1 1 Hardware 16 3 1 2 Operating System...

Page 4: ...are Driver 39 4 4 1 Installing and Running the VBI Driver on ESXi 5 x 39 4 4 2 Installing and Running the offline_bundle Driver on ESXi 5 x 39 4 4 3 Removing the VIB offline_bundle Driver 40 4 5 FlexB...

Page 5: ...CI Device 21 Figure 7 Support Download Assistant 42 Figure 8 Mechanical Drawing of the Single port MCX313A BCBT Adapter Card 48 Figure 9 Mechanical Drawing of the Dual port MCX314A BCBT Adapter Card 4...

Page 6: ...3 Single and Dual port 40 56 Gigabit Ethernet Adapter Cards Table 4 Features 12 Table 5 Software and Hardware Requirements 23 Table 6 Software and Hardware Requirements 25 Table 7 MCX313A BCBT Specif...

Page 7: ...oduct Label on page 56 Added GUID of ConnectX 3 Ethernet adapter cards to Section 6 1 General on page 43 Added Appendix B 1 Retrieving Adapter Card GUID on page 56 June 2013 2 0 Updated User Manual st...

Page 8: ...ecifications Table on page 47 January 2012 1 2 Minor edits Updated LED functions in Section 2 3 I2C compatible Inter face on page 15 Formatted specification tables in Appendix 7 Specifications on page...

Page 9: ...nox com Products Software Firm ware Tools MLNX_EN for Linux README Driver Kit for Mellanox Adapter Cards with 10 40GigE Support Document no 2950 This document provides information on the MLNX_EN Linux...

Page 10: ...act for details regarding Technical Support Customers who purchased Mellanox products through a Mellanox approved reseller should first seek assistance through their reseller Firmware and Software Upd...

Page 11: ...t Overview on page 11 Section 1 2 Features and Benefits on page 12 Section 1 3 Operating Systems Distributions on page 12 Section 1 4 Connectivity on page 13 1 1 Product Overview The following tables...

Page 12: ...ice memory eliminating unnecessary system memory copies and CPU over head resulting in significant performance improvements Sockets Acceleration Applications utilizing TCP UDP IP transport can achieve...

Page 13: ...Server 2008 2012 OpenFabrics Enterprise Distribution OFED OpenFabrics Windows Distribution WinOF Ubuntu 12 04 VMware ESXi 4 x and 5 x 1 4 Connectivity Interoperable with InfiniBand or 10 40 Gb Etherne...

Page 14: ...ts of the ConnectX 3 adapter cards are compliant with the IEEE 802 3 Ether net standards listed in Table 4 Features on page 12 Ethernet traffic is transmitted through the cards QSFP connectors 2 2 PCI...

Page 15: ...ible Interface A three pin header on the adapter cards is provided as the I2C compatible interface See Figure 9 Mechanical Drawing of the Dual port MCX314A BCBT Adapter Card on page 49 for the locatio...

Page 16: ...ove 2 Shut down your system if active 3 After shutting down the system turn off power and unplug the cord 4 Remove the card from its package Please note that the card must be placed on an antistatic s...

Page 17: ...Note The following instructions relate to the installation of the gasket for adapter cards that are not shipped with a gasket already installed Mellanox Technologies now provides all ConnectX 3 adapt...

Page 18: ...he Bracket 1 Place the bracket onto the card until the screw holes line up See Figure 5 2 Screw on the bracket using the screws and washers saved from the bracket removal proce dure above Do not force...

Page 19: ...e follow proper electrical grounding procedures 2 Open the system case 3 Place the adapter in an available PCI Express slot 4 Applying even pressure at both corners of the card insert the adapter card...

Page 20: ...ning port See Section 7 3 Adapter LED Operation on page 47 4 After plugging in a cable lock the connector using the latching mechanism particular to the cable vendor When a logical connection is made...

Page 21: ...nd select Device Instance Id Windows 2003 or 5 Hardware Ids Windows 2008 R2 from the Properties pull down menu Figure 6 PCI Device 6 In the Value display box check the fields VEN and DEV fields are se...

Page 22: ...echnologies 22 3 7 2 On Linux Get the device location on the PCI bus by running lspci and locating lines with the string Mella nox Technologies lspci grep i Mellanox 27 00 0 Network controller Mellano...

Page 23: ...ackage consists of several source RPMs The install script rebuilds the source RPMs and then installs the created binary RPMs The created kernel module binaries are placed under lib modules kernel ver...

Page 24: ...erformance tuning scripts are installed Note If the driver was installed without kmp support the sources would be located under usr srs mlnx_en 1 5 10 4 1 3 Loading the Driver Step 1 Make sure no prev...

Page 25: ...The name of the exe is in the following format MLNX_VPI_WinOF version _All_ OS _ arch exe 4 2 3 Extracting Files Without Running Installation To extract the files without running installation perform...

Page 26: ...Driver Installation Rev 2 3 Mellanox Technologies 26 Step 3 Click Next to create a server image Step 4 Click Change and specify the location in which the files are extracted to...

Page 27: ...tract this folder or click Change to install to a different folder Step 6 To complete the extraction click Finish 4 2 4 Installing MLNX_WinOF This section provides instructions for two types of instal...

Page 28: ...MLNX_WinOF To configure your setup to contain the logs option please run the following command after opening a CMD console If you do not want to upgrade your firmware version run the following command...

Page 29: ...nox Technologies 29 Step 3 Read then accept the license agreement and click Next Step 4 Select the target folder for the installation Step 5 The firmware upgrade screen will be displayed in the follow...

Page 30: ...rmware version is older than the one specified in WinOF Installation Guide 4 40 the firmware will be updated accordingly However if the user has both OEM card and Mellanox card only Mellanox card will...

Page 31: ...automatically Performances tools install the performance tools that are used to measure the InfiniBand performance in user environment Analyze tools install the tools that can be used either to diagn...

Page 32: ...Driver Installation Rev 2 3 Mellanox Technologies 32 b Click Install to start the installation...

Page 33: ...he installation If the firmware upgrade fails the following message will be displayed 4 2 4 2 Unattended Installation The following is an example of a MLNX_WinOF_win8 x64 unattended installation sessi...

Page 34: ...X_WinOF driver upgrade in Windows 2012 driver do not completely uninstall the previous version In Windows 2012 MLNX_WinOF Rev 4 2 and above the network configuration is saved upon driver upgrade In Wi...

Page 35: ...to a managed network there is no need to run OpenSM Only one OpenSM should run per subnet In Ethernet interfaces running OpenSM is not required OpenSM does not run as a service during installation as...

Page 36: ...ded mode perform the following Step 1 Open a CMD console Step 2 Uninstall the driver Run 4 2 9 Assigning Port IP After Installation By default your machine is configured to obtain an automatic IP addr...

Page 37: ...SFP Port Adapter Card User Manual Rev 2 3 Mellanox Technologies 37 Step 2 Right click a Mellanox Local Area Connection and left click Properties Step 3 Select Internet Protocol Version 4 TCP IPv4 from...

Page 38: ...ipconfig from a CMD console 4 3 Performance Tuning For guidelines on improving network adapter performance please refer to the performance tun ing guidelines for a Linux Windows environment in the do...

Page 39: ...rify that the driver is loaded run To query network uplinks installed on your machine run The number of uplinks claimed by MLX4_EN driver should be displayed 4 4 2 Installing and Running the offline_b...

Page 40: ...xecution Environment PXE standard specification and FlexBoot software is based on the open source iPXE project see www ipxe org For more information go to http www mellanox com Products Software Ether...

Page 41: ...ckage is available at http www mellanox com Products Software Firmware Tools Make sure to download the package corresponding to your computer s operating system b Enter mst start c Get the Mellanox ms...

Page 42: ...as follows a Download the firmware image zip file from the Support Downloader see Step 2a above b Unzip the firmware image c Burn the firmware image Enter a Reboot the computer b Enter mst start c Ver...

Page 43: ...no longer works Reseat the adapter in its slot or a different slot if necessary Try using another cable Reinstall the drivers for the network driver files may be damaged or deleted Reboot the server...

Page 44: ...grep i Mellanox Mellanox Firmware Tool MFT Download and install MFT http www mellanox com content pages php pg management_tools menu_section 34 Refer to the User Manual for installation instructions...

Page 45: ...ages php pg management_tools menu_section 34 Refer to the User Manual for installation instructions Once installed open a CMD window and run cd C Program Files Mellanox WinMFT mst start mst status fli...

Page 46: ...age 12V 3 3V Typ Power Passive Cables 6 54W Max Power Passive Cables 8 19W Max power available through QSFP port 1 5W Temperature Operational 0 C to 55 C Non operational 0 C to 70 C Humidity 90 relati...

Page 47: ...8 0GT s 8 lanes 2 0 and 1 1 compatible Power and Environmental Voltage 12V 3 3V Typ Power Passive Cables 7 69W Max Power Passive Cables 9 35W Max power available through QSFP port 1 5W Temperature Op...

Page 48: ...nt on indicates a good physical link If neither LED is lit then the physical link has not been established Yellow logical data activity link A blinking yellow indicates activity data transfer Stays of...

Page 49: ...ConnectX 3 Ethernet Single and Dual QSFP Port Adapter Card User Manual Rev 2 3 Mellanox Technologies 49 Figure 9 Mechanical Drawing of the Dual port MCX314A BCBT Adapter Card...

Page 50: ...Specifications Rev 2 3 Mellanox Technologies 50 7 5 Bracket Mechanical Drawing Figure 10 Dual port Tall Bracket Figure 11 Single port Tall Bracket...

Page 51: ...tX 3 Ethernet Single and Dual QSFP Port Adapter Card User Manual Rev 2 3 Mellanox Technologies 51 Figure 12 Dual port Short Bracket Figure 13 Single port Short Bracket Port 1 LEDS Port 2 LEDs Port 1 G...

Page 52: ...ns Rev 2 3 Mellanox Technologies 52 7 6 Regulatory Statements For regulatory statements for all ConnectX 3 cards please refer to http www mellanox com related docs user_manuals Regulatory_and_Complian...

Page 53: ...ectors Pinout A 1 QSFP Connector Pinout Figure 14 Connector and Cage Views Table 10 Connector Pin Number and Name to Signal Name Map Connector Pin Number Connector Pin Name Port A Signal Name 1 GND GN...

Page 54: ...14 RXP_3 Rx3p 15 RXN_3 Rx3n 16 GND GND 17 RXP_1 Rx1p 18 RXN_1 Rx1n 19 GND GND 20 GND GND 21 RXN_2 Rx2n 22 RXP_2 Rx2p 23 GND GND 24 RXN_4 Rx4n 25 RXP_4 Rx4p 26 GND GND 27 ModPrsl_Port0 Mod PrsL 28 IntL...

Page 55: ...ort Adapter Card User Manual Rev 2 3 Mellanox Technologies 55 Figure 15 PCIe Connector Pinout A 3 I2C compatible Connector Pinout Figure 16 Compatible Connector Plug and Pinout Connector Pin Number Si...

Page 56: ...bel B 1 Retrieving Adapter Card GUID On ConnectX 3 Ethernet adapter cards there is a mismatch between the GUID value returned by firmware management tools and that returned by fabric driver utilities...

Page 57: ...10 Base lid 0 LMC 0 SM lid 0 Capability mask 0x00010000 Port GUID 0x0202c9fffe305350 Link layer Ethernet Port 2 State Down Physical state Disabled Rate 10 Base lid 0 LMC 0 SM lid 0 Capability mask 0x0...

Page 58: ...hes of clearance around the ven tilation openings During periods of lightning activity do not work on the equipment or connect or dis connect cables Some copper cables are heavy and not flexible as su...

Page 59: ...ingle and Dual QSFP Port Adapter Card User Manual Rev 2 3 Mellanox Technologies 59 CLASS 1 LASER PRODUCT and reference to the most recent laser standards IEC 60 825 1 1993 A1 1997 A2 2001 and EN 60825...

Page 60: ...maximale est n cessaire En outre pour garantir un bon coulement de l air laissez au moins 8 cm 3 pouces d espace libre autour des ouver tures de ventilation Pendant un orage il ne faut pas utiliser l...

Page 61: ...rave Mise en garde l utilisation de commandes ou de r glages ou l ex cution de proc dures autres que ce qui est sp cifi dans les pr sentes peut engendrer une exposition au rayonnement grave PRODUIT LA...

Page 62: ...ndestens 8 cm 3 in Freiraum um die Bel ftungs ffnungen sein um einen einwandfreien Luftstrom zu gew hrleisten Arbeiten Sie w hrend eines Gewitters und Blitzschlag nicht am Ger t schlie en Sie keine Ka...

Page 63: ...lenkontak Achtung Nutzung von Steuerungen oder Einstellungen oder Ausf hrung von Prozeduren die hier nicht spezifiziert sind kann zu gef hrlichem Strahlenkon takt f hren Klasse 1 Laserprodukt und Refe...

Page 64: ...espacio de 8 cm 3 pulgadas alrededor de las aberturas de ventilaci n No utilizar el equipo ni conectar o desconectar cables durante per odos de actividad de rayos Dado que los cables de cobre son pes...

Page 65: ...3 Ethernet Single and Dual QSFP Port Adapter Card User Manual Rev 2 3 Mellanox Technologies 65 PRODUCTO L SER DE CLASE 1 y referencia a las normas de l ser m s recientes IEC 60825 1 2007 03 y EN 6082...

Search results

Summary of Contents for ConnectX-3 MCX313A-BCBT

Reviews:

Related manuals for ConnectX-3 MCX313A-BCBT

Brands by name

Popular brands

Mellanox Technologies ConnectX-3 MCX313A-BCBT, User Manual

Search results

Summary of Contents for ConnectX-3 MCX313A-BCBT

Reviews:

Related manuals for ConnectX-3 MCX313A-BCBT

Brands by name

Popular brands