background image

www.mellanox.com

ConnectX

®

-3 Pro 10Gb/s Ethernet Quad Port 

Network Interface Card User Manual

P/N:

MCX349A-XCCN

Rev 1.1 

Summary of Contents for ConnectX-3 Pro MCX349A-XCCN

Page 1: ...www mellanox com ConnectX 3 Pro 10Gb s Ethernet Quad Port Network Interface Card User Manual P N MCX349A XCCN Rev 1 1 ...

Page 2: ...ellanox com page trademarks NOTE THIS HARDWARE SOFTWARE OR TEST SUITE PRODUCT PRODUCT S AND ITS RELATED DOCUMENTATION ARE PROVIDED BY MELLANOX TECHNOLOGIES AS IS ﺴ WITH ALL FAULTS OF ANY KIND AND SOLELY FOR THE PURPOSE OF AIDING THE CUSTOMER IN TESTING APPLICATIONS THAT USE THE PRODUCTS IN DESIGNATED SOLUTIONS THE CUSTOMER S MANUFACTURING TEST ENVIRONMENT HAS NOT MET THE STANDARDS SET BY MELLANOX ...

Page 3: ...onChecklist 6 3 4 Card Installation Instructions 6 3 5 Cables and Modules 6 3 6 Identify the Card in Your System 6 3 6 1 On Linux 6 Chapter 4 Driver Installation 7 4 1 LinuxDriver 7 4 1 1 Hardware and Software Requirements 7 4 1 2 Installing the Driver 7 Chapter 5 Burning Card Firmware 9 Chapter 6 Troubleshooting 11 6 1 General 11 6 2 Linux 12 Chapter 7 Specifications 13 7 1 MCX349A XCCNSpecificat...

Page 4: ... s Ethernet Quad Port Network Interface Card User Manual Rev 1 1 Mellanox Technologies 9 Appendix E Sicherheitshinweise Warnings in German 23 Appendix F Advertencias de seguridad para la instalación Warnings in Spanish 25 ...

Page 5: ...irements 16 Table 6 MCX349A XCCN Specifications Table 22 Table 7 Physical and Logical Link Indication 23 Table 8 I2C compatible Connector Pinout 27 3 5 14 16 17 Figure 7 MCX349A XCCT Card Photo Figure 8 PCI Express Connector Figure 9 Mechanical Drawing of the MCX349A XCCN Mezzanine Card Figure 10 MCX349A XCCN Board Label Example only see Note Figure 11 PCIe Connector Pinout Figure 12 Compatible Co...

Page 6: ... Figures 3 5 14 16 17 Figure 1 MCX349A XCCT Card Photo Figure 2 PCI Express Connector Figure 3 Mechanical Drawing of the MCX349A XCCN Mezzanine Card Figure 4 MCX349A XCCN Board Label Example only see Note Figure 5 PCIe Connector Pinout Figure 6 Compatible Connector Plug and Pinout 18 ...

Page 7: ...v 1 1 Mellanox Technologies 11 Revision History This document was printed on June 20 2017 Table 1 Revision History Table Date Rev Comments Changes June 2017 1 1 Updated Chapter 1 Introduction on page 1 Updated Chapter 3 1 System Requirements on page 5 March 2015 1 0 First Release ...

Page 8: ...s The use of Mb or Mbits small b indicates size in mega bits Mellanox Firmware Tools MFT User Manual Document no 2204UG User Manual describing the set of MFT firmware management tools for a single node See http www mellanox com Products Software Firm ware Tools MLNX_EN for Linux README Driver Kit for Mellanox Adapter Cards with 10GigE Support Document no 2950 This document provides information on ...

Page 9: ...Support Services please see your contract for details regarding Technical Support Customers who purchased Mellanox products through a Mellanox approved reseller should first seek assistance through their reseller Firmware and Software Updates The Mellanox support downloader contains software firmware and knowledge database informa tion for Mellanox products Access the data base from the Mellanox S...

Page 10: ...ystem Requirements on page 5 This chapter covers the following topics Section 1 1 Product Overview on page 1 Section 1 2 Features and Benefits on page 2 Section 1 3 Operating Systems Distributions on page 2 Section 1 4 Connectivity on page 2 1 1 Product Overview The following tables provide the ordering part number port speed number of ports and PCI Express speed Table 1 Quad port 10 Gigabit Ether...

Page 11: ... Uses PCIe Gen 3 0 1 1 and 2 0 compatible through an x8 connector up to 8GT s 10 Gigabit Ethernet Mellanox cards comply with the following IEEE 802 3 standards IEEE Std 802 3 2008 Ethernet IEEE Std 802 3ae 10 Gigabit Ethernet IEEE Std 802 3ad Link Aggregation and Failover Memory PCI Express stores and accesses Ethernet fabric connection information and packet data 3x SPI Flash includes three 32Mb ...

Page 12: ...are compliant with the IEEE 802 3 Ethernet standards listed in Table 2 Features on page 2 2 2 PCI Express Interface The ConnectX 3 Pro network interface cards support PCI Express 3 0 1 1 and 2 0 compatible through an x8 connector The device can be either a master initiating the PCI Express bus opera tions or a slave responding to PCI bus operations The following lists the PCIe interface features P...

Page 13: ...pport for MSI MSI X mechanisms 2 3 I2 C compatible Interface The board include 2 three pin header per chip on the network interface cards provided as the I2C compatible interface 2 4 LED Interface There are two I O LEDs per port For LED specifications please refer to Section 7 3 Adapter LED Operation on page 14 ...

Page 14: ...ower G9T75 BP012 1U OpenPOWER Platform for HPC Server Virtualization TN71 BP012 Habanero OpenPOWER first commercialized hardware system 3 1 1 Hardware This card requires a proprietary PCI Express connector See Figure 2 Figure 2 PCI Express Connector 3 1 2 Operating Systems Distributions Please refer to Section 1 3 Operating Systems Distributions on page 2 3 1 3 Software Stacks Mellanox OpenFabric ...

Page 15: ...rd must be placed on an antistatic surface 5 Check the card for visible signs of damage Do not attempt to install the card if damaged 3 4 Card Installation Instructions To be updated in future release 3 5 Cables and Modules Currently we support industry standard cables only 3 6 Identify the Card in Your System 3 6 1 On Linux Get the device location on the PCI bus by running lspci and locating line...

Page 16: ...Ethernet Driver Linux Driver Download Step b Install Driver Run the following commands to install the driver Table 3 Software and Hardware Requirements Requirements Description Platforms CPU architectures power pc Device ID For the latest list of device IDs please visit http pci ids ucw cz read PC 15b3 Operating System Linux Operating Systems RedHat EL5 8 RedHat EL5 9 RedHat EL6 2 RedHat EL6 3 OEL...

Page 17: ...ackaging KMP mode where the source rpm is rebuilt for each installed flavor of the kernel This mode is used for RedHat and SUSE distributions 2 Non KMP installation mode where the sources are rebuilt with the running kernel This mode is used for vanilla kernels Note If the Vanilla kernel is installed as rpm please use the disable kmp flag when install ing the driver The kernel module sources are p...

Page 18: ...r com puter s operating system mlxburn d dev mst mt4103_pciconf1 img_dir dir force I Using auto detected image file dir fw ConnectX3Pro rel 2_33_5100 MCX349A XCC_0_Ax bin Current FW version on flash 2 33 5100 New FW version 2 33 5100 Note The new FW version is not newer than the current FW version on flash Do you want to continue y n n y Burning FS2 FW image without signatures OK Restoring signatu...

Page 19: ... OK I Image burn completed successfully root qa ibm240 root qa ibm240 mst status MST modules MST PCI module loaded MST PCI configuration module loaded MST devices dev mst mt4103_pciconf0 PCI configuration cycles access domain bus dev fn 0000 01 00 0 addr reg 88 data reg 92 Chip revision is 00 dev mst mt4103_pciconf1 PCI configuration cycles access domain bus dev fn 0000 03 00 0 addr reg 88 data re...

Page 20: ...the drivers for the network driver files may be damaged or deleted Reboot the server Adapters stopped working after installing another adapter Try removing and re installing all adapters Check that cables are connected properly Make sure your motherboard has the latest BIOS Link indicator light is off Ensure that adapter driver s is loaded Try another port on the switch Make sure the cable is secu...

Page 21: ...dev2netdev Card Detection lspci grep i Mellanox Mellanox Firmware Tool MFT Download and install MFT http www mellanox com content pages php pg management_tools menu_section 34 Refer to the User Manual for installation instructions Once installed run mst start mst status flint d mst_device q Ports Information ibstat lbv_devinfo Firmware Version Upgrade To download the latest firmware version refer ...

Page 22: ...l Voltage 12V 5VAUX 3 3VAUX Typ Power Passive Cables 31W Max Power Passive Cables 35 46W Temperature Operational 0 C to 56 C Non operational 0 C to 70 C Humidity 90 relative humidity2 2 For both operational and non operational states Air Flow 10cFM3 3 Air flow is measured 1 from the Mezz from the cooling air inlet side Regulatory EMC Refer to the following link www mellanox com related docs user_m...

Page 23: ... two I O LEDs per port See Table 5 for different LED functions All dimensions are in millimeters All the mechanical tolerances are 0 1mm Table 5 Physical and Logical Link Indication LED2 Speed LED1 No link Link OFF OFF Active Linked at 100MHZ Link OFF Solid Green Active Blinking Green Linked at 1 GHZ Link Solid Yellow Solid Green Active Blinking Green 123 0 88 5 7 2 Board Mechanical Drawing and Di...

Page 24: ...ellanox Technologies 15 Linked at 1 GHZ Link Solid Green Solid Green Active Blinking Green The short bracket has the same port and LED footprints as the tall bracket Table 5 Physical and Logical Link Indication LED2 Speed LED1 ...

Page 25: ... on the print side that shows the card serial number and the card MAC for Ethernet protocol Note The revision indicated on the labels in the following figures do not necessarily represent the latest revision of the card Card revision changes are communicated via Product Change Notification PCN documents that are available via card suppliers Figure 4 MCX349A XCCN Board Label Example only see Note ...

Page 26: ... 17 Appendix B Interface Connectors Pinout B 1 PCI Express x8 Connector Pinout The cards use a proprietary PCI Express x8 connector with 2 x4 buses feeding both Mellanox devices See pinout in Figure 5 Figure 5 PCIe Connector Pinout ...

Page 27: ... Mellanox Technologies 18 B 2 I2 C compatible Connector Pinout Two three hole footprints for I2C Harness is provided as the I2C compatible interface Figure 6 Compatible Connector Plug and Pinout Table 6 I2C compatible Connector Pinout Connector Pin Number Signal Name 1 GND 2 SCL 3 SDA ...

Page 28: ...e Read all installation instructions before connecting the equipment to the power source This equipment should not be operated in an area with an ambient temperature exceed ing the maximum recommended 55 C 131 F To guarantee proper air flow allow at least 8cm 3 inches of clearance around the ven tilation openings During periods of lightning activity do not work on the equipment or connect or dis c...

Page 29: ...hernet Quad Port Network Interface Card User Manual Rev 1 1 Mellanox Technologies 20 CLASS 1 LASER PRODUCT and reference to the most recent laser standards IEC 60 825 1 1993 A1 1997 A2 2001 and EN 60825 1 1994 A1 1996 A2 2001 ...

Page 30: ...dépassant le maximum recommandé de 55 C 131 F Un flux d air de 200LFM à cette température ambiante maximale est nécessaire En outre pour garantir un bon écoulement de l air laissez au moins 8 cm 3 pouces d espace libre autour des ouver tures de ventilation Pendant un orage il ne faut pas utiliser le matériel et il ne faut pas brancher ou débrancher les câbles Ce matériel ne doit être installé remp...

Page 31: ...t grave Mise en garde l utilisation de commandes ou de réglages ou l exécution de procédures autres que ce qui est spécifié dans les présentes peut engendrer une exposition au rayonnement grave PRODUIT LASER DE CLASSE 1 et références aux normes laser les plus récentes CEI 60 825 1 1993 A1 1997 A2 2001 et NE 60825 1 1994 A1 1996 A2 2001 ...

Page 32: ...55 C 131 F betrieben werden Es ist ein Luft strom von 200 LFM bei maximaler Umgebungstemperatur erforderlich Außerdem sollten mindestens 8 cm 3 in Freiraum um die Belüftungsöffnungen sein um einen einwandfreien Luftstrom zu gewährleisten Arbeiten Sie während eines Gewitters und Blitzschlag nicht am Gerät schließen Sie keine Kabel an oder ab Diese Gerät sollte nur von geschultem und qualifiziertem ...

Page 33: ...rahlenkontak Achtung Nutzung von Steuerungen oder Einstellungen oder Ausführung von Prozeduren die hier nicht spezifiziert sind kann zu gefährlichem Strahlenkon takt führen Klasse 1 Laserprodukt und Referenzen zu den aktuellsten Lasterstandards ICE 60 825 1 1993 A1 1997 A2 2001 und EN 60825 1 1994 A1 1996 A2 2001 ...

Page 34: ...con una temperatura ambiente superior a la máxima recomendada 55 C 131 F Además para garantizar una circulación de aire adecuada se debe dejar como mínimo un espacio de 8 cm 3 pulgadas alrededor de las aberturas de ventilación No utilizar el equipo ni conectar o desconectar cables durante períodos de actividad de rayos La instalación el reemplazo y el mantenimiento de este equipo estarán a cargo ú...

Page 35: ...a niveles de radiación peligrosos Precaución el uso de controles o ajustes o la realización de procedimientos distintos de los que aquí se especifican podrían causar exposición a niveles de radiación peligrosos PRODUCTO LÁSER DE CLASE 1 y referencia a las normas de láser más recientes IEC 60825 1 2007 03 y EN 60825 1 2007 ...

Reviews: