background image

NE0154601-00  A

7-1

7

Linux Configuration for 
Bonding Mode and Virtual 

LAN (VLAN)

Linux Bonding Mode

Ensure that the steps required for installing the RPM source, creating the binary, 
and installing the binary have been performed as described in 

“QLogic Adapter 

Driver Installation (RPM Format)” on page 6-5

 before setting up Linux bonding 

mode. 

Type the following command to verify that the QLogic adapter driver has been 
installed:

% lsmod | grep nx_nic

Type the following command to install the driver (if it has not yet been installed):

% modprobe -v nx_nic

The steps for setting the Linux bonding mode are as follows. Note that these are 
example commands. The actual commands may be different depending on the 
system configuration.

1.

% modprobe bonding mode=1 miimon=100 updelay=50000 
primary=eth16

 

2.

% ifconfig bond0 25.145.1.199 netmask 255.255.255.0 
broadcast 25.145.1.255 up

 

3.

% ifenslave bond0 eth15 eth16

 

Type the following command to bring down the bond: 

% ifconfig bond0 down

NOTE:

These commands and steps have been tested under RHEL5. Other Linux 
distributions and versions may enable and utilize bonding differently. 

Содержание 3000 Series

Страница 1: ...NE0154601 00 A QLogic 3000 and 3100 Series Intelligent Ethernet Adapters Users Guide...

Страница 2: ...ns at any time without notice Applications described in this document for any of these products are for illustrative purposes only QLogic Corporation makes no representation nor warranty that such app...

Страница 3: ...Adapters 1 2 Application Notes 1 2 2 System Requirements Hardware Requirements 2 1 Cable Specifications 2 1 SFP Optical Module Requirements 2 2 System and Software Requirements 2 2 Supported QLogic Ad...

Страница 4: ...r 2003 and 2008 Driver Installation and Configuration Windows Server Driver Checklist 5 1 Windows Server Service Pack Requirements 5 1 Firmware ROM Image Location 5 1 Windows Server Driver Installatio...

Страница 5: ...MSI X Support 6 3 Check for Receive Side Scaling RSS Support 6 4 Inbox Kernel GPL Driver and Blacklisting 6 4 Preparing for QLogic Adapter Driver Installation 6 5 QLogic Adapter Driver Installation RP...

Страница 6: ...talled 9 1 Unable to Send Receive Network Traffic Using the QLogic Adapter 9 1 Troubleshooting Tools 9 2 Windows Server Tools 9 2 Linux Tools 9 3 Check for System Errors 9 3 Linux 9 3 Windows Server 9...

Страница 7: ...2 Driver Location Information 5 3 5 3 Select Driver Location 5 4 5 4 Browse for Folder 5 5 5 5 Software Installation Progress 5 5 5 6 Software Installation Complete 5 6 5 7 Driver Installation Verifi...

Страница 8: ...1 2 2 1 Cable Specifications Optical 2 1 2 2 Cable Specifications Copper 2 2 4 1 Mapping of Port Number PCI Function and Ethernet Interface 4 2 4 2 QLE3044 LED Definitions 4 2 5 1 Advanced Properties...

Страница 9: ...the following documentation conventions NOTE provides additional information Text in blue font indicates a hyperlink jump to a figure table or section in this guide and links to Web sites are shown in...

Страница 10: ...with UPPERCASE Press CTRL P Press the UP ARROW key Text in italics indicates terms emphasis variables or document titles For example For a complete listing of license agreements refer to the QLogic So...

Страница 11: ...ts Upon demonstrating knowledge using live equipment QLogic awards a certificate identifying the student as a Certified Professional The training professionals at QLogic may be reached by e mail at tr...

Страница 12: ...Preface Technical Support xii NE0154601 00 A Notes...

Страница 13: ...ftware Release Information Refer to the Release Notes for more information on the software release package contents The Release Notes document contains Software release package contents Current driver...

Страница 14: ...formation about Linux PXE and iSCSI boot see the following applications notes Setting up Linux PXE on Server and Client Systems part number FE0051401 00 iSCSI Boot Setup part number IS0051404 00 Table...

Страница 15: ...page 2 2 Supported QLogic Adapters on page 2 2 Hardware Requirements Cable Specifications Make sure the cables you are using meet the specifications listed in Tables 2 1 and 2 2 Table 2 1 Cable Specif...

Страница 16: ...on the particular system and software requirements for the current software release The drivers and Release Notes are on the QLogic Web site at to driverdownloads qlogic com QLogicDriverDownloads_UI d...

Страница 17: ...er For more detailed instructions see Hardware Installation on page 4 1 Pre installation Checklist Before installing the QLogic adapter 1 Verify that the system meets the requirements specified in Sys...

Страница 18: ...Before installing the driver download the driver package and the Release Notes from the QLogic Web site www qlogic com See Windows Server Driver Checklist on page 5 1 for more information Windows Ser...

Страница 19: ...menu 2 Highlight My Computer then right click the mouse button On the shortcut menu select Manage The Computer Management window opens 3 Select Device Manager under Computer Management 4 From the Dev...

Страница 20: ...er and tools package 1 Type rpm qa grep nx_ 2 Type ifconfig eth n down 3 Type rmmod nx_nic ko 4 Type rpm e nx_nic version 5 Type rpm e nx_tools version Install the Driver RPM Red Hat To install the dr...

Страница 21: ...spec 3 Type the following command to install the binary RPM rpm ivh usr src packages RPMS arch 2 nx_nic version arch rpm The arch variable designates the system architecture Some arch variables are i...

Страница 22: ...3 Installation Instructions Linux Driver Installation 3 6 NE0154601 00 A Notes...

Страница 23: ...or higher PCIe slot 4 Insert the QLE3044 into the PCIe slot Apply uniform pressure on top of the QLE3044 until it is firmly seated in the PCIe bus connector 5 Secure the bracket to the chassis and re...

Страница 24: ...speed of the connection as shown in Table 4 2 Table 4 1 Mapping of Port Number PCI Function and Ethernet Interface Port Number PCI Function Ethernet Interface 1 0 Ethernet interface numbers are dynami...

Страница 25: ...bracket covers the top of the RJ45 Ethernet jacks Slide the bracket upward towards the top of the QLE3044 until it clears all of the Ethernet jacks 3 To replace with a different bracket reverse the p...

Страница 26: ...e QLE3142 into the x8 PCIe slot Apply uniform pressure on top of the QLE3142 until it is firmly seated in the bus connector 6 Connect the SFP module or copper direct attach twinax cable Listen for an...

Страница 27: ...t QLogic provides both of these brackets with the product To remove and replace the bracket 1 Remove the SFP optical modules from their housing see Figure 4 7 2 Remove the two screws at the top and bo...

Страница 28: ...in place with the two screws Figure 4 7 QLE3142 Bracket Removal Figure 4 8 QLE3142 Bracket Replacement QLE3142 Housing Housing Mounting Bracket 1 Remove the two mounting screws 2 Gently pull the brac...

Страница 29: ...iliar before installing the QLogic adapter driver on a Windows Server OS Windows Server Service Pack SP requirements Location of auto load firmware files System requirements see the Release Notes Each...

Страница 30: ...cedure is for a new driver installation 1 Copy the QLogic adapter release package to a directory on the host 2 After the server system is powered up Windows detects the QLogic adapter and the Found Ne...

Страница 31: ...llowing Windows Server 2003 select Install from a list or specific location Advanced and then click the Next button Figure 5 2 Windows Server 2008 select Browse my computer for driver software Figure...

Страница 32: ...this location in the search Figure 5 3 Windows Server 2008 in the Update Driver Software dialog box select Browse for driver software on your computer Type the appropriate path to the QLogic adapter d...

Страница 33: ...ains the 32 bit driver The x64 directory contains the 64 bit driver Figure 5 4 Browse for Folder 5 Do one of the following Windows Server 2003 click Next in the Hardware Update Wizard dialog box to in...

Страница 34: ...are Installation Complete To verify that the driver was properly installed 1 On the Start menu right click My Computer and then select Device Manager A list of devices appears in right side of the win...

Страница 35: ...vice Manager To access the Device Manager 1 On the Start menu right click My Computer and then select Device Manager A list of devices appears in right side of the window 2 Under Network Adapters righ...

Страница 36: ...llation and Configuration Windows Server Driver Configuration 5 8 NE0154601 00 A Advanced Tab Click the Advanced tab to display the driver properties Figure 5 9 Figure 5 9 Adapter Properties Advanced...

Страница 37: ...wControl Default 3 Transmit and receive flow control enabled Values 0 1 2 3 Health Monitoring This parameter maintains the health of the device Disabling this parameter should performed under adviseme...

Страница 38: ...d enable disable options Registry Key LsoV2IPv4 Default Enabled Values Enabled Disabled Size of LSO 64K maximum Large Send Offload V2 IPv6 a This parameter specifies the large send offload enable disa...

Страница 39: ...mbo frame Reg Key RxJumboRingSize Default 2 4096 buffers Values 0 1024 1 2048 2 4096 3 8192 Max Offload Connections This parameter specifies the maximum number of offload connections Reg Key MaxOffloa...

Страница 40: ...rding Registry Key Optimization Default Disabled Values Disabled Enabled Priority and VLAN Tag This parameter controls support for 802 1p q priority tagging Enable this parameter to set the VLAN ID Th...

Страница 41: ...egistry Key TCPChecksumOffloadv4 Default 3 Transmit and receive checksum enabled Values 0 1 2 3 TCP Checksum Offload IPv6 a This parameter enables disables the TCP checksum offload for IPv6 There are...

Страница 42: ...options 0 off 1 transmit 2 receive and 3 transmit receive Registry Key UDPChecksumOffloadv6 Default 3 Transmit and receive checksum enabled Values 0 1 2 3 VLAN ID This parameter sets the VLAN ID for...

Страница 43: ...iver Configuration NE0154601 00 A 5 15 Information Tab Click the Information tab for information about the firmware version BIOS version driver version and other QLogic adapter properties Figure 5 10...

Страница 44: ...ration Windows Server Driver Configuration 5 16 NE0154601 00 A Diagnostics Tab Click the Diagnostics tab to test the QLogic adapter s Flash LED and other functions Figure 5 11 Figure 5 11 Adapter Prop...

Страница 45: ...Configuration Windows Server Driver Configuration NE0154601 00 A 5 17 Statistics Tab Click the Statistics tab to view information about the QLogic adapter Figure 5 12 Figure 5 12 Adapter Properties S...

Страница 46: ...r Driver Configuration 5 18 NE0154601 00 A Flash Update Tab Click the Flash update tab to view the current firmware version on the QLogic adapter and update the firmware if required Figure 5 13 Figure...

Страница 47: ...rver Driver Configuration NE0154601 00 A 5 19 Driver Tab Click the Driver tab to view driver information and update uninstall or restore a previous version of the QLogic adapter driver Figure 5 14 Fig...

Страница 48: ...onfiguration Windows Server Driver Configuration 5 20 NE0154601 00 A Resources Tab Click the Resources tab to view the resource settings for the QLogic adapter Figure 5 15 Figure 5 15 Adapter Properti...

Страница 49: ...he QLogic adapter entry says Limited or no connectivity If there is a red X next to QLogic adapter icon the link is down In this case do the following Verify that the card is seated properly in the PC...

Страница 50: ...Adapter in Windows Server 5 22 NE0154601 00 A 2 Assign an IP address manually by selecting the Internet Protocol TCP IP entry and then clicking the Properties button Figure 5 17 Figure 5 17 Local Area...

Страница 51: ...rotocol TCP IP Properties Dialog Box 4 Verify connectivity with another card or switch using the ping utility Uninstall the QLogic Adapter Driver in Windows Server To uninstall the QLogic adapter driv...

Страница 52: ...08 a Double click Computer navigate to the local disk C and then to the Windows directory b Search for nx and remove all of the following files from each of the folder locations found in the search nx...

Страница 53: ...Adapter Properties Diagnostics Tab Windows Server Performance This section describes Windows performance tuning NOTE The tunable performance parameters are system and application specific Understandi...

Страница 54: ...ter or creating a new parameter see Tcp1323Opts Parameter on page 5 29 2 Set the TcpWindowSize parameter In the TcpWindowSize parameter window set the value in the Value Data box to either 200000 hexa...

Страница 55: ...LE3142 and in particular with fewer threads on Windows Server performance is limited by the receive window and by the outstanding I O a value regardless of hardware limitations For the receive side th...

Страница 56: ...umber of buffers 20K p port base 5001 a outstanding I O 2 x packet array size 1 rb receive buffer size 64K sb send buffer size 0 i Infinite loop f file name output txt u UDP send receive w d Verify fl...

Страница 57: ...is the amount of data the sending host can send at one time on a connection When the value for window size is added to the registry and its size is larger than the default value Windows attempts to u...

Страница 58: ...dialog box opens 2 Type regedit in Open box Figure 5 22 and then click the OK button Figure 5 22 Run Window The Registry Editor window opens 3 Click the HKEY_LOCAL_MACHINE directory Figure 5 23 Figur...

Страница 59: ...Run dialog box opens 2 Type regedit in the Open box and then click the OK button Figure 5 22 The Registry Editor window opens 3 Click the HKEY_LOCAL_MACHINE directory Figure 5 23 4 Navigate to the fol...

Страница 60: ...e 5 26 Figure 5 26 Creating Tcp1323Opts 7 Right click TCp1323Opts and then select Modify In the Value data box type 1 the default value is 0 and then click the OK button Figure 5 27 Figure 5 27 Edit D...

Страница 61: ...d create a new key with a DWORD value Figure 5 25 6 Rename New Value 1 to TCpWindowSize 7 Right click TcpWindowSize and then select Modify Figure 5 28 Figure 5 28 Modifying the TcpWindowSize Parameter...

Страница 62: ...5 Windows Server 2003 and 2008 Driver Installation and Configuration Windows Server Performance 5 34 NE0154601 00 A Notes...

Страница 63: ...d Module Information on page 6 2 Locate the QLogic Tools on page 6 2 Build the Linux Driver Source Code on page 6 2 Enable the Inbox Kernel GPL and Commercial Drivers on page 6 2 Check for MSI X Suppo...

Страница 64: ...ion and module information where n is the port number modinfo nx_nic ethtool i eth n Locate the QLogic Tools Type the following command to go to the directory where the tools are located cd opt netxen...

Страница 65: ...led 3 To disable the inbox kernel GPL driver netxen_nic ko a Type the following command to remove the driver from the OS memory rmmod netxen_nic b Remove or rename the netxen_nic ko file from the lib...

Страница 66: ...0 PCI MSI X eth3 2 146 0 0 PCI MSI X eth3 3 Check for Receive Side Scaling RSS Support To support RSS each port has four MSI X interrupts to send interrupts to any CPU Inbox Kernel GPL Driver and Blac...

Страница 67: ...continuing with the following steps in this section rmmod netxen_nic The following sections describe how to install a new driver Preparing for QLogic Adapter Driver Installation Check for prior versio...

Страница 68: ...ands the arch variable designates the system architecture Some arch variables include i386 i586 i686 x86_64 depending on the system The installed QLogic driver binary will be located in one of the fol...

Страница 69: ...of two jumbo_desc Sets the size of the receive ring for jumbo frames 10GbE ports 1024 64 1024 must be power of two rdesc_1g Sets the size of the receive ring for normal packets 1GbE ports For firmware...

Страница 70: ...Verify that the network services are running and then type service network restart Ping a different IP address to verify connectivity Uninstall the Commercial GPL Driver and Tools Package Type the fol...

Страница 71: ...cy 0 net ipv4 tcp_window_scaling 1 net ipv4 tcp_moderate_rcvbuf 1 net ipv4 route flush 1 Using the iperf Tool The iperf tool measures network performance The following paragraphs show how to use iperf...

Страница 72: ...ple of iperf from the client side iperf c ipAddr of Server w 1M P12 l 16k P number of threads Optimization Note the following PCIe x8 provides optimal performance for 10GbE MSI and MSI X interrupts pe...

Страница 73: ...e following command to install the driver if it has not yet been installed modprobe v nx_nic The steps for setting the Linux bonding mode are as follows Note that these are example commands The actual...

Страница 74: ...imary device is indicated one slave device is configured as the active slave The dmesg command displays the primary port Here is an example output of the dmesg command bonding bond0 making interface e...

Страница 75: ...states are set to BOND_LINK_UP Type the following command to check the status of the bonding process cat proc net bonding bond0 The output for this command is Ethernet Channel Bonding Driver v3 0 1 B...

Страница 76: ...at load time They may be given as command line arguments to the modprobe command but are usually specified in the etc modules conf or etc modprobe conf configuration file or in a distribution specific...

Страница 77: ...ple IP addresses must be separated by a comma At least one IP address must be given for ARP monitoring to function The maximum number of targets that can be specified is 16 The default value is no IP...

Страница 78: ...XOR dest MAC modulo slave count The same slave is selected for each destination MAC This mode pro vides load balancing and fault tolerance 3 broadcast This mode transmits everything on all slave inter...

Страница 79: ...fig add command creates a VLAN device on eth0 and will in turn create an eth0 5 interface Type the following command for eth0 to add VLAN ID 5 vconfig add eth0 5 3 Type the ifconfig command to assign...

Страница 80: ...7 Linux Configuration for Bonding Mode and Virtual LAN VLAN Configuring Virtual LAN VLAN Under Linux 7 8 NE0154601 00 A Notes...

Страница 81: ...Local Area Connection n refers to the port being flashed nxflash exe i Local Area Connection n info the quotation marks are required Check for the following entry Active Firmware version 4 0 305 To d...

Страница 82: ...8 Firmware Management Linux Dynamic Firmware Download 8 2 NE0154601 00 A Check for the following entry Active Firmware version 4 0 305...

Страница 83: ...system 4 Note any error messages that appear during the operating system OS boot sequence 5 Check for system error messages Windows event viewer dmesg display system messages on Linux Unable to Send R...

Страница 84: ...d response If none of the previous steps resolve the problem run the QLogic user diagnostics Troubleshooting Tools The following sections explain how to use the tools under Windows and Linux to help s...

Страница 85: ...and events The QLogic adapter s device drivers indicate status by logging events in the system event log Table 9 2 Troubleshooting Tools in Linux Tool What is Provides nxdebug1 Linux script does not r...

Страница 86: ...e OS then use MSI or legacy mode in the OS Type the following command on the Linux host to check that PCI MSI X or PCI MSI is enabled for the Ethernet interface cat proc interrupts Determine if the in...

Страница 87: ...idth in the output reflects the actual supported width In an system with a QLE3044 for example type the following command to determine if these two widths are the same lspci xxx vvv d 4040 0100 In the...

Страница 88: ...ectrically they are different widths Check the motherboard specification for the supported width of each of the PCIe slots Windows Server 2003 RSS and SNP Support If you have problems with server appl...

Страница 89: ...ion 2 etc a all This command performs all tests regardless of the default D default This command performs only the default test R CRegs This command tests all control registers default F FLASH This co...

Страница 90: ...nH noHw This command disables hardware testing use with D or a nS noLinkSt This command disables link status testing use with D or a nl noLED This command disables LED status testing use with D or a E...

Страница 91: ...using the tar xfp command 3 Remove any previous driver version a Type one of the following commands For a 64 bit operating system OS type pkgchk l p kernel drv amd64 ntxn For a 32 bit OS type pkgchk l...

Страница 92: ...using the gunzip command 2 Untar the firmware package using the tar xfp command 3 Unzip the tools package using the gunzip command 4 Untar the tools package using the tar xfp command 5 Type the follow...

Страница 93: ...over if required The Flash tool will not start the Flash update process if the QLogic adapter driver is not loaded The Flash tool auto identifies the appropriate Flash image for the QLogic adapter Fla...

Страница 94: ...mage onto a CD writable media make sure your system has a CD burner 3 Insert the NX Live CD into the system that contains the QLogic adapter 4 Change any BIOS settings to permit the CD to boot before...

Страница 95: ...ecute the bootinst bat file Press the ENTER key twice to complete the process of making the USB flash drive bootable 9 Insert the NX Live USB flash drive into the server with the QLogic adapter 10 Cha...

Страница 96: ...sh Utility Commands Windows Server Command Definition Description i interface Interface This command specifies the interface type Local Area Connection 1 Local Area Con nection 2 etc info Information...

Страница 97: ...the nxflash utility and ROM image files must be in the same directory from where the nxflash command is executed 4 Type the following command where n is the number of the port being flashed nxflash ex...

Страница 98: ...E 00 7F 25 MAC Address 2 00 0E 1E 00 7F 26 MAC Address 3 00 0E 1E 00 7F 27 Serial Number QG88BK0130 NIC binary romimage found in C netxen 4 0 223 utils Rom Image C netxen 4 0 223 utils lp_qg_cut_thru_...

Страница 99: ...0 0E 1E 00 79 DC MAC Addr 1 00 0E 1E 00 79 DD MAC Addr 2 00 0E 1E 00 79 DE MAC Addr 3 00 0E 1E 00 79 DF Subsystem ID 0x01244040 PHY Type UNKNOWN PHY PXE Status Disabled Updating the Flash on Multiple...

Страница 100: ...shipped with a default Flash version Using the Flash Utility When invoking the nxflash utility use the following syntax nxflash i n command In this command the n indicates the QLogic adapter device n...

Страница 101: ...ckup Flash version to the QLogic adapter Here is an example backup file name flashbackup_ serial num ber _ version _ date time pxe on PXE This command enables PXE pxe off PXE This command disables PXE...

Страница 102: ...the QLogic devices nxflash list Note the function number for the QLogic adapter c Type the following command to start the Flash update use the function number from the previous step in the i option nx...

Страница 103: ...PCIE Function Number is 0 Verifying flash Done Board Type 0x26 NetXen NX3031 Dual Port SFP 10GbE Server Adapter Board Chip Rev B1 Serial Id SF8DBK0145 Efuse ID 0x0000000000000000 Firmware version on...

Страница 104: ...C Flash Update QLogic Adapter Flash Update Linux C 12 NE0154601 00 A Notes...

Страница 105: ...ating an interrupt through special messages that allow emulation of a pin assertion or deassertion MSI X defined in PCI 3 0 allows a device to allocate any number of interrupts between 1 and 2048 and...

Страница 106: ...smaller than a gigabit interface converter that plugs into the Ethernet port VLAN Virtual logical area network LAN A group of hosts with a common set of requirements that communicate as if they were...

Страница 107: ...options 7 4 driver parameters 7 4 mode Linux 7 1 7 5 Bracket removal and replacement 4 3 4 5 C C A 2 Cable specifications 2 1 Cmdif A 2 Commercial GPL driver 6 4 enable 6 2 uninstall 6 8 Conventions i...

Страница 108: ...ows Server C 5 updating on multiple standalone QLogic adapters C 7 utility commands Linux C 8 utility commands Windows Server C 4 G General tab adapter properties 5 7 H H A 1 h A 2 C 5 C 9 Hardware in...

Страница 109: ...c not being sent received using the QLogic adapter 9 1 netxen_nic ko 6 4 Glossary 1 nF A 2 nH A 2 nI A 2 nL A 2 nl A 2 noCRegs A 2 noFlash A 2 noHw A 2 noIntLB A 2 noIRQS A 2 noLED A 2 noLinkST A 2 nR...

Страница 110: ...e 2 1 Resources tab adapter properties 5 20 restore backup file C 4 C 9 romimage Glossary 2 Round robin mode 7 3 RPM Glossary 2 RPM installing the Linux driver in RPM format 6 5 RSS Glossary 2 RSS sup...

Страница 111: ...uring the QLogic adapter in 5 21 diagnostics 5 24 driver configuration 5 7 driver installation 3 2 5 2 driver installation verification 5 6 driver uninstall 5 23 event log 9 3 flash update C 5 perform...

Страница 112: ...QLogic 3000 and 3100 Series Intelligent Ethernet Adapters Users Guide Version 4 6 Index 6 NE0154601 00 A...

Страница 113: ......

Страница 114: ...PCIe are registered trademarks of PCI SIG SUSE is a registered trademark of Novell Inc All other brand and product names are trademarks or registered trademarks of their respective owners Information...

Отзывы: