Mellanox Technologies MCX4131A-BCAT User Manual Download Page 5

Page: 5 / 72

Rev 1.9

Mellanox Technologies

4.3.5 Firmware Programming . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 51

Chapter 5 Updating Adapter Card Firmware. . . . . . . . . . . . . . . . . . . . . . . . . . 52

5.1 Firmware Update (Example) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 52

Chapter 6 Troubleshooting. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 53

6.1  General  . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .   53
6.2  Linux. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .   54
6.3  Windows . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .   55

Chapter 7 Specifications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 56

Appendix A Interface Connectors Pinouts . . . . . . . . . . . . . . . . . . . . . . . . . . . 61

A.1 QSFP28 Connector Pinouts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 61
A.2 PCI Express x8 Connector Pinout . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 63

Appendix B Finding the MAC and Serial Number on the Adapter Card . . . . 64
Appendix C Safety Warnings . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 65
Appendix D Avertissements de sécurité d’installation (Warnings in French) 67
Appendix E Sicherheitshinweise (Warnings in German) . . . . . . . . . . . . . . . . 69
Appendix F Advertencias de seguridad para la instalación (Warnings in Spanish) 71

Summary of Contents for MCX4131A-BCAT

Page 1: ...Mellanox Technologies www mellanox com ConnectX 4 Lx Single 40 50 Gb s Ethernet QSFP28 Port Adapter Card User Manual P N MCX4131A BCAT MCX4131A GCAT Rev 1 9...

Page 2: ...http www mellanox com page trademarks NOTE THIS HARDWARE SOFTWARE OR TEST SUITE PRODUCT PRODUCT S AND ITS RELATED DOCUMENTATION ARE PROVIDED BY MELLANOX TECHNOLOGIES AS IS WITH ALL FAULTS OF ANY KIND...

Page 3: ...1 System Requirements 16 3 1 1 Hardware 16 3 1 2 Operating Systems Distributions 16 3 1 3 Software Stacks 16 3 2 Safety Precautions 16 3 3 Pre installation Checklist 16 3 4 Bracket Installation Instru...

Page 4: ...e After Installation 34 4 1 7 1 Updating the Device Online 34 4 1 7 2 Updating the Device Manually 34 4 1 7 3 Updating the Device Firmware Automatically upon System Boot 35 4 1 8 UEFI Secure Boot 35 4...

Page 5: ...58 7 4 Adapter LEDs Operations 59 7 5 Board Mechanical Drawing and Dimensions 59 7 6 Bracket Mechanical Drawing 60 Appendix A Interface Connectors Pinouts 61 A 1 QSFP28 Connector Pinouts 61 A 2 PCI E...

Page 6: ...13 Table 5 Hardware and Software Requirements 23 Table 6 mlnxofedinstall Return Codes 29 Table 7 Hardware and Software Requirements 38 Table 8 Hardware and Software Requirements 49 Table 9 MCX4131A B...

Page 7: ...on Results Example 45 Figure 3 Mechanical Drawing of the MCX4131A BCAT MCX4131A GCAT Adapter Card 59 Figure 4 Single port Bracket 60 Figure 5 Connector and Cage Views 61 Figure 6 PCIe x8 Connector Pin...

Page 8: ...er Card Un installation InstructionsSafety Precautions on page 20 Updated the following tables MCX4131A BCAT Specifications on page 56 MCX4131A GCAT Specifications on page 57 August 2016 1 5 Updated C...

Page 9: ...s mlxup Firmware Utility Mellanox OFED for Linux User Manual Document no 2877 User Manual describing OFED features performance tools con tent and configuration See http www mellanox com Products Softw...

Page 10: ...ectX 4 NATIVE ESXi stack See http www mellanox com Products Software Ether net Drivers VMware Driver User Manual v4 15 2 0 Mellanox VMware for Ethernet Release Notes Release notes for Mellanox Connect...

Page 11: ...Product Overview The following section provides the ordering part number port speed number of ports and PCI Express speed Each adapter comes with two bracket heights short and tall Table 3 Single port...

Page 12: ...tion Rev 1 9 12 Mellanox Technologies 1 3 Connectivity Interoperable with 1 10 25 40 50 Gb s Ethernet switches Passive copper cable with ESD protection Powered connectors for optical and active cable...

Page 13: ...in encapsulated formats such as NVGRE and VXLAN While this solves network scalability issues it hides the TCP packet from the hardware offloading engines placing higher loads on the host CPU ConnectX...

Page 14: ...consolidated compute and storage network achieves significant cost perfor mance advantages over multi fabric networks Standard block and file access protocols can leverage RDMA for high performance s...

Page 15: ...age 13 Ethernet traffic is transmitted through the cards QSFP28 connectors 2 2 PCI Express Interface The ConnectX 4 Lx adapter cards support PCI Express 3 0 1 1 and 2 0 compatible through an x8connect...

Page 16: ...ation Checklist 1 Verify that your system meets the hardware and software requirements stated above 2 Shut down your system if active 3 After shutting down the system turn off power and unplug the cor...

Page 17: ...he removal of the bracket 3 4 1 Removing the Existing Bracket 1 Remove the two screws holding the bracket in place The bracket comes loose from the card 3 4 2 Installing the New Bracket 1 Place the br...

Page 18: ...se 3 Locate an available PCI Express slot for the adapter card 4 Applying even pressure at both corners of the card insert the adapter card into the PCI Express slot until firmly seated Please note th...

Page 19: ...ables and Modules To obtain the list of supported cables for your adapter please refer to http www mellanox com products interconnect cables configurator php 3 6 1 Cable Installation 1 All cables can...

Page 20: ...on 7 4 Adapter LEDs Operations on page 59 4 Care should be taken as not to impede the air exhaust flow through the ventilation holes Use cable lengths which allow for routing horizontally around to th...

Page 21: ...arallel to the motherboard 3 8 Identify the Card in Your System 3 8 1 On Windows 1 Open Device Manager on the server Click start Run and then enter devmgmt msc 2 Expand System Devices and locate your...

Page 22: ...EV is equal to 1003 this is a valid Mellanox Technologies PCI Device ID 3 8 2 On Linux Get the device location on the PCI bus by running lspci and locating lines with the string Mella nox Technologies...

Page 23: ...er OS label CPU arch iso You can download it from http www mellanox com Products Soft ware Ethernet Drivers Requirements Description Platforms A server platform with an adapter card based on one of th...

Page 24: ...prompted to acknowledge the deletion of the old packages If you need to install Mellanox OFED on an entire homogeneous cluster a common strategy is to mount the ISO image on one of the cluster nodes a...

Page 25: ...Linux has already installed the OpenSM Subnet Manager on your machine 4 1 3 1 Installation Procedure Step 1 Login to the installation machine as root Step 2 Mount the ISO image on your machine On Ubun...

Page 26: ...irmware update will occur and the installation script will print at the end of installation a message similar to the follow ing Device 1 Device Type ConnectX4 Lx Part Number MCX4131A BCAT Description...

Page 27: ...ca_self_test ofed see the file hca_self_test readme under docs After the installer completes information about the Mellanox OFED installation such as prefix kernel version and installation parameters...

Page 28: ...n SLES and Fedora Distributions lib modules uname r extra mlnx ofa_kernel on RHEL and other RedHat like Distributions lib modules uname r updates dkms on Ubuntu Firmware The firmware of existing netwo...

Page 29: ...pplicable to RedHat OEL Fedora XenServer Operating Systems 4 1 5 1 Setting up MLNX_OFED YUM Repository Step 1 Log into the installation machine as root Step 2 Mount the ISO image on your machine and c...

Page 30: ...30 247 MB s RPM GPG KEY Mellanox saved 1354 1354 sudo rpm import RPM GPG KEY Mellanox warning rpmts_HdrFromFdno Header V3 DSA SHA1 Signature key ID 6224c050 NOKEY Retrieving key from file repos MLNX_O...

Page 31: ...red for running Mellanox cards mlnx ofed guest Installs packages required by guest OS mlnx ofed hpc Installs packages required for HPC mlnx ofed hypervisor Installs packages required by hypervisor OS...

Page 32: ...lable on Mellanox Technologies Web site as described in Section 4 1 7 Updating Firmware After Installation on page 34 4 1 5 3 Uninstalling Mellanox OFED using the YUM Tool Use the script usr sbin ofed...

Page 33: ...lanox sudo apt key add apt key list pub 1024D A9E4B643 2013 08 11 uid Mellanox Technologies support mellanox com sub 1024g 09FCC269 2013 08 11 sudo apt get update apt cache search mlnx ofed mlnx ofed...

Page 34: ...below The following steps are also appropriate in case you wish to burn newer firmware that you have downloaded from Mellanox Technologies Web site http www mellanox com Support Firmware Download Ins...

Page 35: ...e automatic firmware update procedure To do so edit the configurations file opt mellanox mlnx fw updater mlnx fw updater conf and provide a comma separated list of PCI devices to exclude from the firm...

Page 36: ...emoving the signature To remove the signature from the MLNX_OFED kernel modules Step 1 Remove the signature After the signature has been removed a massage as the below will no longer be presented upon...

Page 37: ...e Tuning Depending on the application of the user s system it may be necessary to modify the default con figuration of network adapters based on the ConnectX adapters In case tuning is required please...

Page 38: ...Task Manager File Run new task and enter CMD 3 Enter the following command On an x64 64 bit machine the output will be AMD64 Step 2 Go to the Mellanox WinOF 2 web page at http www mellanox com Produc...

Page 39: ...2 3 1 Attended Installation The following is an example of an installation session Step 1 Double click the exe and follow the GUI instructions to install MLNX_WinOF2 Step 2 Optional Manually configure...

Page 40: ...Driver Installation Rev 1 9 40 Mellanox Technologies Step 5 Read then accept the license agreement and click Next Step 6 Select the target folder for the installation...

Page 41: ...s an OEM card In this case the firmware will not be displayed If the user has a standard Mellanox card with an older firmware version the firmware will be updated accordingly However if the user has b...

Page 42: ...install Performance tools install the performance tools that are used to measure performance in user environment Documentation contains the User Manual and Release Notes Management tools installation...

Page 43: ...stallation Rev 1 9 43 Mellanox Technologies Step 9 In case firmware upgrade option was checked in Step 7 you will be notified if a firmware upgrade is required Step 10 Click Finish to complete the ins...

Page 44: ...Manager Upon installation completion the inf files can be located at ProgramFiles Mellanox MLNX_WinOF2 Drivers OS To see the Mellanox network adapters display the Device Manager and pull down the Net...

Page 45: ...ning Installation To extract the files without running installation perform the following steps Step 1 Open a CMD console Click Start Task Manager File Run new task and enter CMD Step 2 Extract the dr...

Page 46: ...Driver Installation Rev 1 9 46 Mellanox Technologies Step 3 Click Next to create a server image Step 4 Click Change and specify the location in which the files are extracted to...

Page 47: ...Driver Installation Rev 1 9 47 Mellanox Technologies Step 5 Click Install to extract this folder or click Change to install to a different folder Step 6 To complete the extraction click Finish...

Page 48: ...the driver Run 4 2 7 Firmware Upgrade If the machine has a standard Mellanox card with an older firmware version the firmware will be automatically updated as part of the WinOF 2 package installation...

Page 49: ...ble 8 Hardware and Software Requirements Requirements Description Platforms A server platform with an adapter card based on one of the following Mellanox Technologies HCA devices MT27630 ConnectX 4 LX...

Page 50: ...o unload the driver To load the driver To restart the driver Please unload the driver before removing it esxcli software vib remove n nmlx5 core To remove the modules the command must be run in the sa...

Page 51: ...File mft 4 3 0 25 10EM 550 0 0 1391871 x86_64 vib MD5SUM 62f953b77f4ea49c420ff4e1ce8b925b ESX 6 0 File mft 4 3 0 25 10EM 600 0 0 2768847 x86_64 vib MD5SUM 6a3bd63882f2ca3f696c1a96d62112df 2 Install th...

Page 52: ...com Products Software Firmware Tools 5 1 Firmware Update Example server1 mlxup Querying Mellanox devices firmware Device Type ConnectX4 Lx Part Number MCX4131A BCAT Description ConnectX 4 Lx EN netwo...

Page 53: ...deleted Reboot the server Adapters stopped working after installing another adapter Try removing and re installing all adapters Check that cables are connected properly Make sure your motherboard has...

Page 54: ...rep i Mellanox Mellanox Firmware Tool MFT Download and install MFT http www mellanox com content pages php pg management_tools menu_section 34 Refer to the User Manual for installation instructions On...

Page 55: ...menu_section 34 Refer to the User Manual for installation instructions Once installed open a CMD window and run cd C Program Files Mellanox WinMFT mst start mst status flint d mst_device q Ports Info...

Page 56: ...R 10GBASE ER 10GBASE CX4 10GBASE KX4 1000BASE KX SGMII 1000BASE X Data Rate 1 10 25 40 Gb s Ethernet PCI Express Gen3 SERDES 8 0GT s 8 lanes 2 0 and 1 1 compatible Power and Environmental Voltage 12V...

Page 57: ...LR 10GBASE ER 10GBASE CX4 10GBASE KX4 1000BASE KX SGMII 1000BASE X Data Rate 1 10 25 40 50 Gb s Ethernet PCI Express Gen3 SERDES 8 0GT s 8 lanes 2 0 and 1 1 compatible Power and Environmental Voltage...

Page 58: ...3 Airflow Specifications Air Flow LFM a a Cells marked with are not applicable Air Flow Direction Heat Sink to Port Port to Heat Sink Cable Type Passive Active 1 5W Active 3 5W Passive Active 1 5W MCX...

Page 59: ...ical Drawing of the MCX4131A BCAT MCX4131A GCAT Adapter Card LED Color and State Description Off A link has not been established Blinking Ambera a 1 Hz Blinking Yellow occurs due to running a beacon c...

Page 60: ...Specifications Rev 1 9 60 Mellanox Technologies 7 6 Bracket Mechanical Drawing Figure 4 Single port Bracket...

Page 61: ...Pin Number and Name to Signal Name Map Pin Symbol Name Description 1 GND Ground 2 Tx2n Transmitter Inverted Data Input 3 Tx2p Transmitter Non Inverted Data Input 4 GND Ground 5 Tx4n Transmitter Inver...

Page 62: ...Non Inverted Data Output 21 Rx1n Receiver Inverted Data Output 22 Rx1p Ground 23 GND Ground 24 Rx2n Receiver Inverted Data Output 25 Rx2p Receiver Non Inverted Data Output 26 GND Ground 27 Mod PrsL Mo...

Page 63: ...logies A 2 PCI Express x8 Connector Pinout The adapter cards use a standard PCI Express x8 edge connector and the PCI Express x8 standard pinout according to the PCI Express 3 0 specification Figure 6...

Page 64: ...card has a different identifier printed on the label serial number and the card MAC for the Ethernet protocol Figure 7 MCX4131A BCAT Board Label Example Figure 8 MCX4131A GCAT Board Label Example The...

Page 65: ...1 F To guarantee proper air flow allow at least 8cm 3 inches of clearance around the ven tilation openings During periods of lightning activity do not work on the equipment or connect or dis connect c...

Page 66: ...se of controls or adjustment or performance of procedures other than those specified herein may result in hazardous radiation exposure CLASS 1 LASER PRODUCT and reference to the most recent laser stan...

Page 67: ...maximale est n cessaire En outre pour garantir un bon coulement de l air laissez au moins 8 cm 3 pouces d espace libre autour des ouver tures de ventilation Pendant un orage il ne faut pas utiliser l...

Page 68: ...e en garde l utilisation de commandes ou de r glages ou l ex cution de proc dures autres que ce qui est sp cifi dans les pr sentes peut engendrer une exposition au rayonnement grave PRODUIT LASER DE C...

Page 69: ...gstemperatur erforderlich Au erdem sollten mindestens 8 cm 3 in Freiraum um die Bel ftungs ffnungen sein um einen einwandfreien Luftstrom zu gew hrleisten Arbeiten Sie w hrend eines Gewitters und Blit...

Page 70: ...ak Achtung Nutzung von Steuerungen oder Einstellungen oder Ausf hrung von Prozeduren die hier nicht spezifiziert sind kann zu gef hrlichem Strahlenkon takt f hren Klasse 1 Laserprodukt und Referenzen...

Page 71: ...ar una circulaci n de aire adecuada se debe dejar como m nimo un espacio de 8 cm 3 pulgadas alrededor de las aberturas de ventilaci n No utilizar el equipo ni conectar o desconectar cables durante per...

Page 72: ...ligrosos Precauci n el uso de controles o ajustes o la realizaci n de procedimientos distintos de los que aqu se especifican podr an causar exposici n a niveles de radiaci n peligrosos PRODUCTO L SER...

Search results

Summary of Contents for MCX4131A-BCAT

Reviews:

Related manuals for MCX4131A-BCAT

Brands by name

Popular brands

Mellanox Technologies MCX4131A-BCAT, User Manual

Search results

Summary of Contents for MCX4131A-BCAT

Reviews:

Related manuals for MCX4131A-BCAT

Brands by name

Popular brands