Mellanox Technologies MCX312B-XCCT ConnectX-3 Pro User Manual Download Page 12

Page: 12 / 61

Introduction

Rev 1.0

Mellanox Technologies

1.3

Operating Systems/Distributions

•

Citrix XenServer 6.1

•

RHEL/CentOS 5.X and 6.X, Novell SLES10 SP4;

•

SLES11 SP1, SLES 11 SP2, OEL, Fedora 14,15,17, Ubuntu 12.04

•

Windows Server 2008/2012

•

FreeBSD

•

OpenFabrics Enterprise Distribution (OFED)

•

OpenFabrics Windows Distribution (WinOF)

•

VMware ESXi 4.x and 5.x

1.4

Connectivity

•

Interoperable with 10GbE switches

•

Passive copper cable with ESD protection

•

Powered connectors for optical and active cable support

•

QSFP to SFP+ connectivity through QSA module

•

Passive copper cable with ESD protection

Mellanox Technologies Confidential

Summary of Contents for MCX312B-XCCT ConnectX-3 Pro

Page 1: ...www mellanox com ConnectX 3 Pro Ethernet Dual SFP Port Adapter Card User Manual P N MCX312B XCCT Rev 1 0 Mellanox Technologies Confidential...

Page 2: ...IN TESTING APPLICATIONS THAT USE THE PRODUCTS IN DESIGNATED SOLUTIONS THE CUSTOMER S MANUFACTURING TEST ENVIRONMENT HAS NOT MET THE STANDARDS SET BY MELLANOX TECHNOLOGIES TO FULLY QUALIFY THE PRODUCTO...

Page 3: ...2C compatible Interface 14 2 4 LED Interface 14 Chapter 3 Hardware Installation 15 3 1 System Requirements 15 3 1 1 Hardware 15 3 1 2 Operating Systems Distributions 15 3 1 3 Software Stacks 15 3 2 Sa...

Page 4: ...and Running the offline_bundle Driver on ESXi 5 x 39 4 3 3 Removing the VIB offline_bundle Driver 39 4 4 FlexBoot 39 Chapter 5 Updating Adapter Card Firmware 40 Chapter 6 Troubleshooting 42 6 1 Gener...

Page 5: ...e 2 Documents List 8 Table 3 Dual port 10 Gigabit Ethernet Adapter Cards 10 Table 4 Features 11 Table 5 Software and Hardware Requirements 21 Table 6 Software and Hardware Requirements 23 Table 7 MCX3...

Page 6: ...Mechanism Closed 18 Figure 6 Module With Locking Mechanism Open 18 Figure 7 PCI Device 20 Figure 8 Support Download Assistant 41 Figure 9 Mechanical Drawing of the Dual port MCX312B XCCT 47 Figure 10...

Page 7: ...Adapter Card User Manual Rev 1 0 Mellanox Technologies 7 Revision History This document was printed on July 10 2013 Table 1 Revision History Table Date Rev Comments Changes July 2013 1 0 First Releas...

Page 8: ...See http www mellanox com Products Software Firm ware Tools MLNX_EN for Linux README Driver Kit for Mellanox Adapter Cards with 10GigE Support Document no 2950 User Manual providing information on th...

Page 9: ...ee your contract for details regarding Technical Support Customers who purchased Mellanox products through a Mellanox approved reseller should first seek assistance through their reseller Firmware and...

Page 10: ...Section 1 2 Features and Benefits on page 11 Section 1 3 Operating Systems Distributions on page 12 Section 1 4 Connectivity on page 12 1 1 Product Overview The following section provides the orderin...

Page 11: ...2 Ethernet CPU offload Adapter functionality enabling reduced CPU overhead allowing more available CPU GPUDirect RDMA Using GPUDirect RDMA adapters can directly read and write CUDA host and device me...

Page 12: ...ndows Server 2008 2012 FreeBSD OpenFabrics Enterprise Distribution OFED OpenFabrics Windows Distribution WinOF VMware ESXi 4 x and 5 x 1 4 Connectivity Interoperable with 10GbE switches Passive copper...

Page 13: ...ork ports of the ConnectX 3 Pro adapter cards are compliant with the IEEE 802 3 Ethernet standards listed in Table 4 Features on page 11 The SFP port has one Tx Rx pair of SerDes Ethernet traffic is t...

Page 14: ...n header on the adapter cards is provided as the I2 C compatible interface See Figure 9 Mechanical Drawing of the Dual port MCX312B XCCT on page 47 for the location on the board Figure 2 I2 C compatib...

Page 15: ...down your system if active 3 After shutting down the system turn off power and unplug the cord 4 Remove the card from its package Please note that the card must be placed on an antistatic surface 5 C...

Page 16: ...o screws and the two fiber washers 3 4 2 Installing the New Bracket 1 Place the bracket onto the card until the screw holes line up See Figure 3 2 Screw on the bracket using the screws and washers sav...

Page 17: ...tem case 3 Place the adapter in an available PCI Express slot 4 Applying even pressure at both corners of the card insert the adapter card into the slot until it is firmly seated When the adapter is p...

Page 18: ...he module will align with the female connectors inside of the cage Also check that there is no dirt or foreign matter in the module or in the cage Figure 5 Module With Locking Mechanism Closed Figure...

Page 19: ...s which allow for routing horizontally around to the side of the chassis before bending upward or downward in the rack 6 To remove a cable disengage the locks and slowly pull the connector away from t...

Page 20: ...s a valid Mellanox Technologies PCI Device ID 3 7 2 On Linux Get the device location on the PCI bus by running lspci and locating lines with the string Mella nox Technologies If the PCI device does no...

Page 21: ...hernet Driver Linux Driver Download Step 2 Install Driver The below sections are examples using ConnectX 3 device and will be updated to include ConnectX 3 Pro in future releases Table 5 Software and...

Page 22: ...rnel This mode is used for vanilla kernels Note If the Vanilla kernel is installed as rpm please use the disable kmp flag when installing the driver The kernel module sources are placed under usr src...

Page 23: ...e download page Hardware and Software Requirements 4 2 1 Downloading MLNX_WinOF Follow these steps to download the exe according to your Operating System Step 1 Verify the machine architecture 1 Open...

Page 24: ...s without running installation perform the following steps Step 1 Open a CMD console Click Start Run and enter CMD Step 2 Enter the following command Step 3 Click Next to create a server image Install...

Page 25: ...ser Manual Rev 1 0 Mellanox Technologies 25 Step 4 Click Change and specify the location in which the files are extracted to Step 5 Click Install to extract this folder or click Change to install to a...

Page 26: ...ng is an example of a MLNX_WinOF_win8 x64 installation session Step 1 Double click the exe and follow the GUI instructions to install MLNX_WinOF To configure your setup to contain the logs option plea...

Page 27: ...ro Ethernet Dual SFP Port Adapter Card User Manual Rev 1 0 Mellanox Technologies 27 Click Next in the Welcome screen Step 2 Read then accept the license agreement and click Next Mellanox Technologies...

Page 28: ...ases If the user has an OEM card in this case the firmware will not be updated If the user has a standard Mellanox card and the firmware version is older than the one specified in WinOF Installation G...

Page 29: ...gies 29 Step 5 Configure your system for maximum performance by checking the maximum performance box Step 6 Select a Complete or Custom installation follow Step a and on on page 30 This step requires...

Page 30: ...erformance tools that are used to measure the InfiniBand performance in user environment Analyze tools install the tools that can be used either to diagnosed or analyzed the Infini Band environment SD...

Page 31: ...Pro Ethernet Dual SFP Port Adapter Card User Manual Rev 1 0 Mellanox Technologies 31 Click Install to start the installation Step 7 Click Finish to complete the installation Mellanox Technologies Con...

Page 32: ...her help please run 4 2 4 Upgrading MLNX_WinOF The MLNX_WinOF driver upgrades automatically MLNX_WinOF Windows 2008R2 driver by uninstalling the previous version and installs the new driver However ML...

Page 33: ...e activated in one of the machines running on the subnet otherwise the interface link will not come up If the cards are connected to a managed network there is no need to run OpenSM Only one OpenSM sh...

Page 34: ...install MLNX_WinOF in unattended mode perform the following Step 1 Open a CMD console Step 2 Uninstall the driver Run 4 2 8 Assigning Port IP After Installation By default your machine is configured t...

Page 35: ...User Manual Rev 1 0 Mellanox Technologies 35 Step 2 Right click a Mellanox Local Area Connection and left click Properties Step 3 Select Internet Protocol Version 4 TCP IPv4 from the scroll list and c...

Page 36: ...from a CMD console 4 2 9 Port Type Management on Windows After installing Mellanox WinOF VPI for Windows on your machine you can change a port s pro tocol configuration The following steps describe ho...

Page 37: ...t click on the Mellanox ConnectX VPI network adapter and left click Properties Select the Port Protocol tab from the Properties sheet Note The Port Protocol tab is displayed only if the NIC is a VPI I...

Page 38: ...server machine as root 2 You can either a Remove any earlier version of the driver from your VMware ESXi server machine prior to installing the new version Run b Install the mlx4_en driver VIB package...

Page 39: ...e from the ESXi server machine run 4 4 FlexBoot FlexBoot supports remote Boot over Ethernet This technology is based on the Preboot Execution Environment PXE standard specification and FlexBoot softwa...

Page 40: ...a Install the MFT package The package is available at http www mellanox com Products Software Firmware Tools Make sure to download the package corresponding to your computer s operating system b Ente...

Page 41: ...llows a Download the firmware image zip file from the Support Downloader see Step 2a above b Unzip the firmware image c Burn the firmware image Enter a Reboot the computer b Enter mst start c Verify t...

Page 42: ...network driver files may be damaged or deleted Reboot the server Adapters stopped working after installing another adapter Try removing and re installing all adapters Check that cables are connected...

Page 43: ...lspci grep i Mellanox Mellanox Firmware Tool MFT Download and install MFT http www mellanox com con tent pages php pg management_tools menu_section 34 Refer to the User Manual for installation instruc...

Page 44: ...Refer to the User Manual for installation instructions Once installed open a CMD window and run cd C Program Files Mellanox WinMFT mst start mst status flint d mst_device q Ports Information vstat Fi...

Page 45: ...es 5 92W Max Power Passive Cables 6 42W Temperature Operational 0 C to 55 C Non operational 0 C to 70 C Humidity 90 relative humiditya a For both operational and non operational states Air Flow 200LFM...

Page 46: ...cation LED Function Green physical link Constant on indicates a good physical link If neither LED is lit then the physical link has not been established Yellow logical data activity link A blinking ye...

Page 47: ...v 1 0 Mellanox Technologies 47 7 3 Board Mechanical Drawing and Dimensions Figure 9 Mechanical Drawing of the Dual port MCX312B XCCT All dimensions are in millimeters All the mechanical tolerances are...

Page 48: ...echanical Drawing Figure 10 Dual port Bracket 7 5 Regulatory Statements For regulatory statements for all ConnectX 3 Pro cards please refer to http www mellanox com related docs user_manuals Regulator...

Page 49: ...t Dual SFP Port Adapter Card User Manual Rev 1 0 Mellanox Technologies 49 Appendix A Interface Connectors Pinout A 1 SFP Connector Pinout Figure 11 Rear View of Module With Pin Placement Mellanox Tech...

Page 50: ...t board to a voltage between 2 0V and 3 6V MOD_ABS pulls line low to indicate module is plugged in 5 SCL 2 wire Serial Interface Clock Line d 6 MOD_ABS Module Absent Grounded within the module d 7 RS0...

Page 51: ...onnector Pinout The adapter cards use a standard PCI Express x8 edge connector and the PCI Express x8 standard pinout according to the PCI Express 3 0 specification Figure 12 PCIe Connector Pinout A 3...

Page 52: ...Rev 1 0 Mellanox Technologies 52 Connector Pin Number Signal Name 1 SPSDA 2 SPSCL 3 GND 4 NC 5 NC Mellanox Technologies Confidential...

Page 53: ...Technologies 53 Appendix B Finding the MAC and Serial Number on the Adapter Card Each Mellanox adapter card has a different identifier printed on the label serial number and the card MAC for the Ethe...

Page 54: ...around the ven tilation openings During periods of lightning activity do not work on the equipment or connect or dis connect cables Some copper cables are heavy and not flexible as such they should be...

Page 55: ...rt Adapter Card User Manual Rev 1 0 Mellanox Technologies 55 CLASS 1 LASER PRODUCT and reference to the most recent laser standards IEC 60 825 1 1993 A1 1997 A2 2001 and EN 60825 1 1994 A1 1996 A2 20...

Page 56: ...ssaire En outre pour garantir un bon coulement de l air laissez au moins 8 cm 3 pouces d espace libre autour des ouver tures de ventilation Pendant un orage il ne faut pas utiliser le mat riel et il n...

Page 57: ...tilisation de commandes ou de r glages ou l ex cution de proc dures autres que ce qui est sp cifi dans les pr sentes peut engendrer une exposition au rayonnement grave PRODUIT LASER DE CLASSE 1 et r f...

Page 58: ...Freiraum um die Bel ftungs ffnungen sein um einen einwandfreien Luftstrom zu gew hrleisten Arbeiten Sie w hrend eines Gewitters und Blitzschlag nicht am Ger t schlie en Sie keine Kabel an oder ab Kup...

Page 59: ...ung von Steuerungen oder Einstellungen oder Ausf hrung von Prozeduren die hier nicht spezifiziert sind kann zu gef hrlichem Strahlenkon takt f hren Klasse 1 Laserprodukt und Referenzen zu den aktuells...

Page 60: ...3 pulgadas alrededor de las aberturas de ventilaci n No utilizar el equipo ni conectar o desconectar cables durante per odos de actividad de rayos Dado que los cables de cobre son pesados y no son fle...

Page 61: ...t Dual SFP Port Adapter Card User Manual Rev 1 0 Mellanox Technologies 61 PRODUCTO L SER DE CLASE 1 y referencia a las normas de l ser m s recientes IEC 60825 1 2007 03 y EN 60825 1 2007 Mellanox Tech...

Search results

Summary of Contents for MCX312B-XCCT ConnectX-3 Pro

Reviews:

Related manuals for MCX312B-XCCT ConnectX-3 Pro

Brands by name

Popular brands

Mellanox Technologies MCX312B-XCCT ConnectX-3 Pro, User Manual

Search results

Summary of Contents for MCX312B-XCCT ConnectX-3 Pro

Reviews:

Related manuals for MCX312B-XCCT ConnectX-3 Pro

Brands by name

Popular brands