background image

Hardware Installation

Rev 1.9

17

Mellanox Technologies

3.4

Bracket Installation Instructions

The card is usually shipped with a tall bracket installed. If this form factor is suitable for your 
requirements, you can skip  the remainder of this section  and  move to 

Section 3.5, “Adapter 

Card Installation Instructions,” on page 18

If you need to replace it with the short bracket 

that is included in the shipping box, please follow the instructions in this section.

To replace the bracket you will need the following parts:
• The new bracket of the proper height

• The 2 screws saved from the removal of the bracket

3.4.1 Removing the Existing Bracket 

1. Remove the two screws holding the bracket in place. The bracket comes loose from the card. 

3.4.2 Installing the New Bracket 

1. Place the bracket onto the card until the screw holes line up. 

2. Screw on the bracket using the screws and washers saved from the bracket removal procedure 

above. 

3. Make sure that the LEDs are aligned onto the bracket holes. 
4. Use a torque driver to apply up to 2.9 lbf-in torque on the screws.

Due to risk of damaging the EMI gasket, it is not recommended to replace the bracket 
more than three times.

Be careful not to put stress on the LED.

Do not force the bracket onto the card. You may have to gently push the LEDs using a 
small screwdriver to align the LEDs with the holes in the bracket.

Содержание MCX4131A-BCAT

Страница 1: ...Mellanox Technologies www mellanox com ConnectX 4 Lx Single 40 50 Gb s Ethernet QSFP28 Port Adapter Card User Manual P N MCX4131A BCAT MCX4131A GCAT Rev 1 9...

Страница 2: ...http www mellanox com page trademarks NOTE THIS HARDWARE SOFTWARE OR TEST SUITE PRODUCT PRODUCT S AND ITS RELATED DOCUMENTATION ARE PROVIDED BY MELLANOX TECHNOLOGIES AS IS WITH ALL FAULTS OF ANY KIND...

Страница 3: ...1 System Requirements 16 3 1 1 Hardware 16 3 1 2 Operating Systems Distributions 16 3 1 3 Software Stacks 16 3 2 Safety Precautions 16 3 3 Pre installation Checklist 16 3 4 Bracket Installation Instru...

Страница 4: ...e After Installation 34 4 1 7 1 Updating the Device Online 34 4 1 7 2 Updating the Device Manually 34 4 1 7 3 Updating the Device Firmware Automatically upon System Boot 35 4 1 8 UEFI Secure Boot 35 4...

Страница 5: ...58 7 4 Adapter LEDs Operations 59 7 5 Board Mechanical Drawing and Dimensions 59 7 6 Bracket Mechanical Drawing 60 Appendix A Interface Connectors Pinouts 61 A 1 QSFP28 Connector Pinouts 61 A 2 PCI E...

Страница 6: ...13 Table 5 Hardware and Software Requirements 23 Table 6 mlnxofedinstall Return Codes 29 Table 7 Hardware and Software Requirements 38 Table 8 Hardware and Software Requirements 49 Table 9 MCX4131A B...

Страница 7: ...on Results Example 45 Figure 3 Mechanical Drawing of the MCX4131A BCAT MCX4131A GCAT Adapter Card 59 Figure 4 Single port Bracket 60 Figure 5 Connector and Cage Views 61 Figure 6 PCIe x8 Connector Pin...

Страница 8: ...er Card Un installation InstructionsSafety Precautions on page 20 Updated the following tables MCX4131A BCAT Specifications on page 56 MCX4131A GCAT Specifications on page 57 August 2016 1 5 Updated C...

Страница 9: ...s mlxup Firmware Utility Mellanox OFED for Linux User Manual Document no 2877 User Manual describing OFED features performance tools con tent and configuration See http www mellanox com Products Softw...

Страница 10: ...ectX 4 NATIVE ESXi stack See http www mellanox com Products Software Ether net Drivers VMware Driver User Manual v4 15 2 0 Mellanox VMware for Ethernet Release Notes Release notes for Mellanox Connect...

Страница 11: ...Product Overview The following section provides the ordering part number port speed number of ports and PCI Express speed Each adapter comes with two bracket heights short and tall Table 3 Single port...

Страница 12: ...tion Rev 1 9 12 Mellanox Technologies 1 3 Connectivity Interoperable with 1 10 25 40 50 Gb s Ethernet switches Passive copper cable with ESD protection Powered connectors for optical and active cable...

Страница 13: ...in encapsulated formats such as NVGRE and VXLAN While this solves network scalability issues it hides the TCP packet from the hardware offloading engines placing higher loads on the host CPU ConnectX...

Страница 14: ...consolidated compute and storage network achieves significant cost perfor mance advantages over multi fabric networks Standard block and file access protocols can leverage RDMA for high performance s...

Страница 15: ...age 13 Ethernet traffic is transmitted through the cards QSFP28 connectors 2 2 PCI Express Interface The ConnectX 4 Lx adapter cards support PCI Express 3 0 1 1 and 2 0 compatible through an x8connect...

Страница 16: ...ation Checklist 1 Verify that your system meets the hardware and software requirements stated above 2 Shut down your system if active 3 After shutting down the system turn off power and unplug the cor...

Страница 17: ...he removal of the bracket 3 4 1 Removing the Existing Bracket 1 Remove the two screws holding the bracket in place The bracket comes loose from the card 3 4 2 Installing the New Bracket 1 Place the br...

Страница 18: ...se 3 Locate an available PCI Express slot for the adapter card 4 Applying even pressure at both corners of the card insert the adapter card into the PCI Express slot until firmly seated Please note th...

Страница 19: ...ables and Modules To obtain the list of supported cables for your adapter please refer to http www mellanox com products interconnect cables configurator php 3 6 1 Cable Installation 1 All cables can...

Страница 20: ...on 7 4 Adapter LEDs Operations on page 59 4 Care should be taken as not to impede the air exhaust flow through the ventilation holes Use cable lengths which allow for routing horizontally around to th...

Страница 21: ...arallel to the motherboard 3 8 Identify the Card in Your System 3 8 1 On Windows 1 Open Device Manager on the server Click start Run and then enter devmgmt msc 2 Expand System Devices and locate your...

Страница 22: ...EV is equal to 1003 this is a valid Mellanox Technologies PCI Device ID 3 8 2 On Linux Get the device location on the PCI bus by running lspci and locating lines with the string Mella nox Technologies...

Страница 23: ...er OS label CPU arch iso You can download it from http www mellanox com Products Soft ware Ethernet Drivers Requirements Description Platforms A server platform with an adapter card based on one of th...

Страница 24: ...prompted to acknowledge the deletion of the old packages If you need to install Mellanox OFED on an entire homogeneous cluster a common strategy is to mount the ISO image on one of the cluster nodes a...

Страница 25: ...Linux has already installed the OpenSM Subnet Manager on your machine 4 1 3 1 Installation Procedure Step 1 Login to the installation machine as root Step 2 Mount the ISO image on your machine On Ubun...

Страница 26: ...irmware update will occur and the installation script will print at the end of installation a message similar to the follow ing Device 1 Device Type ConnectX4 Lx Part Number MCX4131A BCAT Description...

Страница 27: ...ca_self_test ofed see the file hca_self_test readme under docs After the installer completes information about the Mellanox OFED installation such as prefix kernel version and installation parameters...

Страница 28: ...n SLES and Fedora Distributions lib modules uname r extra mlnx ofa_kernel on RHEL and other RedHat like Distributions lib modules uname r updates dkms on Ubuntu Firmware The firmware of existing netwo...

Страница 29: ...pplicable to RedHat OEL Fedora XenServer Operating Systems 4 1 5 1 Setting up MLNX_OFED YUM Repository Step 1 Log into the installation machine as root Step 2 Mount the ISO image on your machine and c...

Страница 30: ...30 247 MB s RPM GPG KEY Mellanox saved 1354 1354 sudo rpm import RPM GPG KEY Mellanox warning rpmts_HdrFromFdno Header V3 DSA SHA1 Signature key ID 6224c050 NOKEY Retrieving key from file repos MLNX_O...

Страница 31: ...red for running Mellanox cards mlnx ofed guest Installs packages required by guest OS mlnx ofed hpc Installs packages required for HPC mlnx ofed hypervisor Installs packages required by hypervisor OS...

Страница 32: ...lable on Mellanox Technologies Web site as described in Section 4 1 7 Updating Firmware After Installation on page 34 4 1 5 3 Uninstalling Mellanox OFED using the YUM Tool Use the script usr sbin ofed...

Страница 33: ...lanox sudo apt key add apt key list pub 1024D A9E4B643 2013 08 11 uid Mellanox Technologies support mellanox com sub 1024g 09FCC269 2013 08 11 sudo apt get update apt cache search mlnx ofed mlnx ofed...

Страница 34: ...below The following steps are also appropriate in case you wish to burn newer firmware that you have downloaded from Mellanox Technologies Web site http www mellanox com Support Firmware Download Ins...

Страница 35: ...e automatic firmware update procedure To do so edit the configurations file opt mellanox mlnx fw updater mlnx fw updater conf and provide a comma separated list of PCI devices to exclude from the firm...

Страница 36: ...emoving the signature To remove the signature from the MLNX_OFED kernel modules Step 1 Remove the signature After the signature has been removed a massage as the below will no longer be presented upon...

Страница 37: ...e Tuning Depending on the application of the user s system it may be necessary to modify the default con figuration of network adapters based on the ConnectX adapters In case tuning is required please...

Страница 38: ...Task Manager File Run new task and enter CMD 3 Enter the following command On an x64 64 bit machine the output will be AMD64 Step 2 Go to the Mellanox WinOF 2 web page at http www mellanox com Produc...

Страница 39: ...2 3 1 Attended Installation The following is an example of an installation session Step 1 Double click the exe and follow the GUI instructions to install MLNX_WinOF2 Step 2 Optional Manually configure...

Страница 40: ...Driver Installation Rev 1 9 40 Mellanox Technologies Step 5 Read then accept the license agreement and click Next Step 6 Select the target folder for the installation...

Страница 41: ...s an OEM card In this case the firmware will not be displayed If the user has a standard Mellanox card with an older firmware version the firmware will be updated accordingly However if the user has b...

Страница 42: ...install Performance tools install the performance tools that are used to measure performance in user environment Documentation contains the User Manual and Release Notes Management tools installation...

Страница 43: ...stallation Rev 1 9 43 Mellanox Technologies Step 9 In case firmware upgrade option was checked in Step 7 you will be notified if a firmware upgrade is required Step 10 Click Finish to complete the ins...

Страница 44: ...Manager Upon installation completion the inf files can be located at ProgramFiles Mellanox MLNX_WinOF2 Drivers OS To see the Mellanox network adapters display the Device Manager and pull down the Net...

Страница 45: ...ning Installation To extract the files without running installation perform the following steps Step 1 Open a CMD console Click Start Task Manager File Run new task and enter CMD Step 2 Extract the dr...

Страница 46: ...Driver Installation Rev 1 9 46 Mellanox Technologies Step 3 Click Next to create a server image Step 4 Click Change and specify the location in which the files are extracted to...

Страница 47: ...Driver Installation Rev 1 9 47 Mellanox Technologies Step 5 Click Install to extract this folder or click Change to install to a different folder Step 6 To complete the extraction click Finish...

Страница 48: ...the driver Run 4 2 7 Firmware Upgrade If the machine has a standard Mellanox card with an older firmware version the firmware will be automatically updated as part of the WinOF 2 package installation...

Страница 49: ...ble 8 Hardware and Software Requirements Requirements Description Platforms A server platform with an adapter card based on one of the following Mellanox Technologies HCA devices MT27630 ConnectX 4 LX...

Страница 50: ...o unload the driver To load the driver To restart the driver Please unload the driver before removing it esxcli software vib remove n nmlx5 core To remove the modules the command must be run in the sa...

Страница 51: ...File mft 4 3 0 25 10EM 550 0 0 1391871 x86_64 vib MD5SUM 62f953b77f4ea49c420ff4e1ce8b925b ESX 6 0 File mft 4 3 0 25 10EM 600 0 0 2768847 x86_64 vib MD5SUM 6a3bd63882f2ca3f696c1a96d62112df 2 Install th...

Страница 52: ...com Products Software Firmware Tools 5 1 Firmware Update Example server1 mlxup Querying Mellanox devices firmware Device Type ConnectX4 Lx Part Number MCX4131A BCAT Description ConnectX 4 Lx EN netwo...

Страница 53: ...deleted Reboot the server Adapters stopped working after installing another adapter Try removing and re installing all adapters Check that cables are connected properly Make sure your motherboard has...

Страница 54: ...rep i Mellanox Mellanox Firmware Tool MFT Download and install MFT http www mellanox com content pages php pg management_tools menu_section 34 Refer to the User Manual for installation instructions On...

Страница 55: ...menu_section 34 Refer to the User Manual for installation instructions Once installed open a CMD window and run cd C Program Files Mellanox WinMFT mst start mst status flint d mst_device q Ports Info...

Страница 56: ...R 10GBASE ER 10GBASE CX4 10GBASE KX4 1000BASE KX SGMII 1000BASE X Data Rate 1 10 25 40 Gb s Ethernet PCI Express Gen3 SERDES 8 0GT s 8 lanes 2 0 and 1 1 compatible Power and Environmental Voltage 12V...

Страница 57: ...LR 10GBASE ER 10GBASE CX4 10GBASE KX4 1000BASE KX SGMII 1000BASE X Data Rate 1 10 25 40 50 Gb s Ethernet PCI Express Gen3 SERDES 8 0GT s 8 lanes 2 0 and 1 1 compatible Power and Environmental Voltage...

Страница 58: ...3 Airflow Specifications Air Flow LFM a a Cells marked with are not applicable Air Flow Direction Heat Sink to Port Port to Heat Sink Cable Type Passive Active 1 5W Active 3 5W Passive Active 1 5W MCX...

Страница 59: ...ical Drawing of the MCX4131A BCAT MCX4131A GCAT Adapter Card LED Color and State Description Off A link has not been established Blinking Ambera a 1 Hz Blinking Yellow occurs due to running a beacon c...

Страница 60: ...Specifications Rev 1 9 60 Mellanox Technologies 7 6 Bracket Mechanical Drawing Figure 4 Single port Bracket...

Страница 61: ...Pin Number and Name to Signal Name Map Pin Symbol Name Description 1 GND Ground 2 Tx2n Transmitter Inverted Data Input 3 Tx2p Transmitter Non Inverted Data Input 4 GND Ground 5 Tx4n Transmitter Inver...

Страница 62: ...Non Inverted Data Output 21 Rx1n Receiver Inverted Data Output 22 Rx1p Ground 23 GND Ground 24 Rx2n Receiver Inverted Data Output 25 Rx2p Receiver Non Inverted Data Output 26 GND Ground 27 Mod PrsL Mo...

Страница 63: ...logies A 2 PCI Express x8 Connector Pinout The adapter cards use a standard PCI Express x8 edge connector and the PCI Express x8 standard pinout according to the PCI Express 3 0 specification Figure 6...

Страница 64: ...card has a different identifier printed on the label serial number and the card MAC for the Ethernet protocol Figure 7 MCX4131A BCAT Board Label Example Figure 8 MCX4131A GCAT Board Label Example The...

Страница 65: ...1 F To guarantee proper air flow allow at least 8cm 3 inches of clearance around the ven tilation openings During periods of lightning activity do not work on the equipment or connect or dis connect c...

Страница 66: ...se of controls or adjustment or performance of procedures other than those specified herein may result in hazardous radiation exposure CLASS 1 LASER PRODUCT and reference to the most recent laser stan...

Страница 67: ...maximale est n cessaire En outre pour garantir un bon coulement de l air laissez au moins 8 cm 3 pouces d espace libre autour des ouver tures de ventilation Pendant un orage il ne faut pas utiliser l...

Страница 68: ...e en garde l utilisation de commandes ou de r glages ou l ex cution de proc dures autres que ce qui est sp cifi dans les pr sentes peut engendrer une exposition au rayonnement grave PRODUIT LASER DE C...

Страница 69: ...gstemperatur erforderlich Au erdem sollten mindestens 8 cm 3 in Freiraum um die Bel ftungs ffnungen sein um einen einwandfreien Luftstrom zu gew hrleisten Arbeiten Sie w hrend eines Gewitters und Blit...

Страница 70: ...ak Achtung Nutzung von Steuerungen oder Einstellungen oder Ausf hrung von Prozeduren die hier nicht spezifiziert sind kann zu gef hrlichem Strahlenkon takt f hren Klasse 1 Laserprodukt und Referenzen...

Страница 71: ...ar una circulaci n de aire adecuada se debe dejar como m nimo un espacio de 8 cm 3 pulgadas alrededor de las aberturas de ventilaci n No utilizar el equipo ni conectar o desconectar cables durante per...

Страница 72: ...ligrosos Precauci n el uso de controles o ajustes o la realizaci n de procedimientos distintos de los que aqu se especifican podr an causar exposici n a niveles de radiaci n peligrosos PRODUCTO L SER...

Отзывы: