Mellanox Technologies MCX312B-XCCT ConnectX-3 Pro Скачать руководство пользователя страница 3

Страница: 3 / 61

ConnectX®-3 Pro Ethernet Dual SFP+ Port Adapter Card User Manual

Rev 1.0

Mellanox Technologies

Table of Contents

Table of Contents . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3

List of Tables . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5

List of Figures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6

Revision History . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7

About this Manual . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8

Intended Audience  . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .   8
Related Documentation. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .   8
Document Conventions. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .   8
Technical Support . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .   9
Firmware and Software Updates. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .   9

Chapter 1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10

1.1 Product Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10

1.2 Features and Benefits . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11

1.3 Operating Systems/Distributions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12

1.4 Connectivity . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12

Chapter 2 Interfaces . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13

2.1 Ethernet SFP+ Interface . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13

2.2 PCI Express Interface . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13

2.3 I2C-compatible Interface . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14

2.4 LED Interface . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14

Chapter 3 Hardware Installation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15

3.1 System Requirements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15

3.1.1 Hardware . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15

3.1.2 Operating Systems/Distributions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15

3.1.3 Software Stacks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15

3.2 Safety Precautions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15

3.3 Pre-installation Checklist . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15

3.4 Bracket Installation Instructions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15

3.4.1 Removing the Existing Bracket . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16

3.4.2 Installing the New Bracket . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16

3.5 Card Installation Instructions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17

3.6 Cables and Modules . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18

3.6.1 Inserting the Optical Transceiver Module. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18

3.6.2 Cable Installation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18

3.7 Identify the Card in Your System . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19

3.7.1 On Windows . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19

3.7.2 On Linux . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20

Chapter 4 Driver Installation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21

4.1 Linux Driver . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21

4.1.1 Hardware and Software Requirements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21

4.1.2 Installing the Driver . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21

Mellanox Technologies Confidential

Содержание MCX312B-XCCT ConnectX-3 Pro

Страница 1: ...www mellanox com ConnectX 3 Pro Ethernet Dual SFP Port Adapter Card User Manual P N MCX312B XCCT Rev 1 0 Mellanox Technologies Confidential...

Страница 2: ...IN TESTING APPLICATIONS THAT USE THE PRODUCTS IN DESIGNATED SOLUTIONS THE CUSTOMER S MANUFACTURING TEST ENVIRONMENT HAS NOT MET THE STANDARDS SET BY MELLANOX TECHNOLOGIES TO FULLY QUALIFY THE PRODUCTO...

Страница 3: ...2C compatible Interface 14 2 4 LED Interface 14 Chapter 3 Hardware Installation 15 3 1 System Requirements 15 3 1 1 Hardware 15 3 1 2 Operating Systems Distributions 15 3 1 3 Software Stacks 15 3 2 Sa...

Страница 4: ...and Running the offline_bundle Driver on ESXi 5 x 39 4 3 3 Removing the VIB offline_bundle Driver 39 4 4 FlexBoot 39 Chapter 5 Updating Adapter Card Firmware 40 Chapter 6 Troubleshooting 42 6 1 Gener...

Страница 5: ...e 2 Documents List 8 Table 3 Dual port 10 Gigabit Ethernet Adapter Cards 10 Table 4 Features 11 Table 5 Software and Hardware Requirements 21 Table 6 Software and Hardware Requirements 23 Table 7 MCX3...

Страница 6: ...Mechanism Closed 18 Figure 6 Module With Locking Mechanism Open 18 Figure 7 PCI Device 20 Figure 8 Support Download Assistant 41 Figure 9 Mechanical Drawing of the Dual port MCX312B XCCT 47 Figure 10...

Страница 7: ...Adapter Card User Manual Rev 1 0 Mellanox Technologies 7 Revision History This document was printed on July 10 2013 Table 1 Revision History Table Date Rev Comments Changes July 2013 1 0 First Releas...

Страница 8: ...See http www mellanox com Products Software Firm ware Tools MLNX_EN for Linux README Driver Kit for Mellanox Adapter Cards with 10GigE Support Document no 2950 User Manual providing information on th...

Страница 9: ...ee your contract for details regarding Technical Support Customers who purchased Mellanox products through a Mellanox approved reseller should first seek assistance through their reseller Firmware and...

Страница 10: ...Section 1 2 Features and Benefits on page 11 Section 1 3 Operating Systems Distributions on page 12 Section 1 4 Connectivity on page 12 1 1 Product Overview The following section provides the orderin...

Страница 11: ...2 Ethernet CPU offload Adapter functionality enabling reduced CPU overhead allowing more available CPU GPUDirect RDMA Using GPUDirect RDMA adapters can directly read and write CUDA host and device me...

Страница 12: ...ndows Server 2008 2012 FreeBSD OpenFabrics Enterprise Distribution OFED OpenFabrics Windows Distribution WinOF VMware ESXi 4 x and 5 x 1 4 Connectivity Interoperable with 10GbE switches Passive copper...

Страница 13: ...ork ports of the ConnectX 3 Pro adapter cards are compliant with the IEEE 802 3 Ethernet standards listed in Table 4 Features on page 11 The SFP port has one Tx Rx pair of SerDes Ethernet traffic is t...

Страница 14: ...n header on the adapter cards is provided as the I2 C compatible interface See Figure 9 Mechanical Drawing of the Dual port MCX312B XCCT on page 47 for the location on the board Figure 2 I2 C compatib...

Страница 15: ...down your system if active 3 After shutting down the system turn off power and unplug the cord 4 Remove the card from its package Please note that the card must be placed on an antistatic surface 5 C...

Страница 16: ...o screws and the two fiber washers 3 4 2 Installing the New Bracket 1 Place the bracket onto the card until the screw holes line up See Figure 3 2 Screw on the bracket using the screws and washers sav...

Страница 17: ...tem case 3 Place the adapter in an available PCI Express slot 4 Applying even pressure at both corners of the card insert the adapter card into the slot until it is firmly seated When the adapter is p...

Страница 18: ...he module will align with the female connectors inside of the cage Also check that there is no dirt or foreign matter in the module or in the cage Figure 5 Module With Locking Mechanism Closed Figure...

Страница 19: ...s which allow for routing horizontally around to the side of the chassis before bending upward or downward in the rack 6 To remove a cable disengage the locks and slowly pull the connector away from t...

Страница 20: ...s a valid Mellanox Technologies PCI Device ID 3 7 2 On Linux Get the device location on the PCI bus by running lspci and locating lines with the string Mella nox Technologies If the PCI device does no...

Страница 21: ...hernet Driver Linux Driver Download Step 2 Install Driver The below sections are examples using ConnectX 3 device and will be updated to include ConnectX 3 Pro in future releases Table 5 Software and...

Страница 22: ...rnel This mode is used for vanilla kernels Note If the Vanilla kernel is installed as rpm please use the disable kmp flag when installing the driver The kernel module sources are placed under usr src...

Страница 23: ...e download page Hardware and Software Requirements 4 2 1 Downloading MLNX_WinOF Follow these steps to download the exe according to your Operating System Step 1 Verify the machine architecture 1 Open...

Страница 24: ...s without running installation perform the following steps Step 1 Open a CMD console Click Start Run and enter CMD Step 2 Enter the following command Step 3 Click Next to create a server image Install...

Страница 25: ...ser Manual Rev 1 0 Mellanox Technologies 25 Step 4 Click Change and specify the location in which the files are extracted to Step 5 Click Install to extract this folder or click Change to install to a...

Страница 26: ...ng is an example of a MLNX_WinOF_win8 x64 installation session Step 1 Double click the exe and follow the GUI instructions to install MLNX_WinOF To configure your setup to contain the logs option plea...

Страница 27: ...ro Ethernet Dual SFP Port Adapter Card User Manual Rev 1 0 Mellanox Technologies 27 Click Next in the Welcome screen Step 2 Read then accept the license agreement and click Next Mellanox Technologies...

Страница 28: ...ases If the user has an OEM card in this case the firmware will not be updated If the user has a standard Mellanox card and the firmware version is older than the one specified in WinOF Installation G...

Страница 29: ...gies 29 Step 5 Configure your system for maximum performance by checking the maximum performance box Step 6 Select a Complete or Custom installation follow Step a and on on page 30 This step requires...

Страница 30: ...erformance tools that are used to measure the InfiniBand performance in user environment Analyze tools install the tools that can be used either to diagnosed or analyzed the Infini Band environment SD...

Страница 31: ...Pro Ethernet Dual SFP Port Adapter Card User Manual Rev 1 0 Mellanox Technologies 31 Click Install to start the installation Step 7 Click Finish to complete the installation Mellanox Technologies Con...

Страница 32: ...her help please run 4 2 4 Upgrading MLNX_WinOF The MLNX_WinOF driver upgrades automatically MLNX_WinOF Windows 2008R2 driver by uninstalling the previous version and installs the new driver However ML...

Страница 33: ...e activated in one of the machines running on the subnet otherwise the interface link will not come up If the cards are connected to a managed network there is no need to run OpenSM Only one OpenSM sh...

Страница 34: ...install MLNX_WinOF in unattended mode perform the following Step 1 Open a CMD console Step 2 Uninstall the driver Run 4 2 8 Assigning Port IP After Installation By default your machine is configured t...

Страница 35: ...User Manual Rev 1 0 Mellanox Technologies 35 Step 2 Right click a Mellanox Local Area Connection and left click Properties Step 3 Select Internet Protocol Version 4 TCP IPv4 from the scroll list and c...

Страница 36: ...from a CMD console 4 2 9 Port Type Management on Windows After installing Mellanox WinOF VPI for Windows on your machine you can change a port s pro tocol configuration The following steps describe ho...

Страница 37: ...t click on the Mellanox ConnectX VPI network adapter and left click Properties Select the Port Protocol tab from the Properties sheet Note The Port Protocol tab is displayed only if the NIC is a VPI I...

Страница 38: ...server machine as root 2 You can either a Remove any earlier version of the driver from your VMware ESXi server machine prior to installing the new version Run b Install the mlx4_en driver VIB package...

Страница 39: ...e from the ESXi server machine run 4 4 FlexBoot FlexBoot supports remote Boot over Ethernet This technology is based on the Preboot Execution Environment PXE standard specification and FlexBoot softwa...

Страница 40: ...a Install the MFT package The package is available at http www mellanox com Products Software Firmware Tools Make sure to download the package corresponding to your computer s operating system b Ente...

Страница 41: ...llows a Download the firmware image zip file from the Support Downloader see Step 2a above b Unzip the firmware image c Burn the firmware image Enter a Reboot the computer b Enter mst start c Verify t...

Страница 42: ...network driver files may be damaged or deleted Reboot the server Adapters stopped working after installing another adapter Try removing and re installing all adapters Check that cables are connected...

Страница 43: ...lspci grep i Mellanox Mellanox Firmware Tool MFT Download and install MFT http www mellanox com con tent pages php pg management_tools menu_section 34 Refer to the User Manual for installation instruc...

Страница 44: ...Refer to the User Manual for installation instructions Once installed open a CMD window and run cd C Program Files Mellanox WinMFT mst start mst status flint d mst_device q Ports Information vstat Fi...

Страница 45: ...es 5 92W Max Power Passive Cables 6 42W Temperature Operational 0 C to 55 C Non operational 0 C to 70 C Humidity 90 relative humiditya a For both operational and non operational states Air Flow 200LFM...

Страница 46: ...cation LED Function Green physical link Constant on indicates a good physical link If neither LED is lit then the physical link has not been established Yellow logical data activity link A blinking ye...

Страница 47: ...v 1 0 Mellanox Technologies 47 7 3 Board Mechanical Drawing and Dimensions Figure 9 Mechanical Drawing of the Dual port MCX312B XCCT All dimensions are in millimeters All the mechanical tolerances are...

Страница 48: ...echanical Drawing Figure 10 Dual port Bracket 7 5 Regulatory Statements For regulatory statements for all ConnectX 3 Pro cards please refer to http www mellanox com related docs user_manuals Regulator...

Страница 49: ...t Dual SFP Port Adapter Card User Manual Rev 1 0 Mellanox Technologies 49 Appendix A Interface Connectors Pinout A 1 SFP Connector Pinout Figure 11 Rear View of Module With Pin Placement Mellanox Tech...

Страница 50: ...t board to a voltage between 2 0V and 3 6V MOD_ABS pulls line low to indicate module is plugged in 5 SCL 2 wire Serial Interface Clock Line d 6 MOD_ABS Module Absent Grounded within the module d 7 RS0...

Страница 51: ...onnector Pinout The adapter cards use a standard PCI Express x8 edge connector and the PCI Express x8 standard pinout according to the PCI Express 3 0 specification Figure 12 PCIe Connector Pinout A 3...

Страница 52: ...Rev 1 0 Mellanox Technologies 52 Connector Pin Number Signal Name 1 SPSDA 2 SPSCL 3 GND 4 NC 5 NC Mellanox Technologies Confidential...

Страница 53: ...Technologies 53 Appendix B Finding the MAC and Serial Number on the Adapter Card Each Mellanox adapter card has a different identifier printed on the label serial number and the card MAC for the Ethe...

Страница 54: ...around the ven tilation openings During periods of lightning activity do not work on the equipment or connect or dis connect cables Some copper cables are heavy and not flexible as such they should be...

Страница 55: ...rt Adapter Card User Manual Rev 1 0 Mellanox Technologies 55 CLASS 1 LASER PRODUCT and reference to the most recent laser standards IEC 60 825 1 1993 A1 1997 A2 2001 and EN 60825 1 1994 A1 1996 A2 20...

Страница 56: ...ssaire En outre pour garantir un bon coulement de l air laissez au moins 8 cm 3 pouces d espace libre autour des ouver tures de ventilation Pendant un orage il ne faut pas utiliser le mat riel et il n...

Страница 57: ...tilisation de commandes ou de r glages ou l ex cution de proc dures autres que ce qui est sp cifi dans les pr sentes peut engendrer une exposition au rayonnement grave PRODUIT LASER DE CLASSE 1 et r f...

Страница 58: ...Freiraum um die Bel ftungs ffnungen sein um einen einwandfreien Luftstrom zu gew hrleisten Arbeiten Sie w hrend eines Gewitters und Blitzschlag nicht am Ger t schlie en Sie keine Kabel an oder ab Kup...

Страница 59: ...ung von Steuerungen oder Einstellungen oder Ausf hrung von Prozeduren die hier nicht spezifiziert sind kann zu gef hrlichem Strahlenkon takt f hren Klasse 1 Laserprodukt und Referenzen zu den aktuells...

Страница 60: ...3 pulgadas alrededor de las aberturas de ventilaci n No utilizar el equipo ni conectar o desconectar cables durante per odos de actividad de rayos Dado que los cables de cobre son pesados y no son fle...

Страница 61: ...t Dual SFP Port Adapter Card User Manual Rev 1 0 Mellanox Technologies 61 PRODUCTO L SER DE CLASE 1 y referencia a las normas de l ser m s recientes IEC 60825 1 2007 03 y EN 60825 1 2007 Mellanox Tech...

Результаты поиска

Содержание MCX312B-XCCT ConnectX-3 Pro

Отзывы:

Похожие инструкции для MCX312B-XCCT ConnectX-3 Pro

Бренды по названию

Популярные бренды

Mellanox Technologies MCX312B-XCCT ConnectX-3 Pro, Руководство пользователя

Результаты поиска

Содержание MCX312B-XCCT ConnectX-3 Pro

Отзывы:

Похожие инструкции для MCX312B-XCCT ConnectX-3 Pro

Бренды по названию

Популярные бренды