Qlogic 3000 Series User Manual Download Page 1

Page: 1 / 114

NE0154601-00 A

QLogic 3000 and 3100 Series Intelligent

Ethernet Adapters

Users Guide

Summary of Contents for 3000 Series

Page 1: ...NE0154601 00 A QLogic 3000 and 3100 Series Intelligent Ethernet Adapters Users Guide...

Page 2: ...ns at any time without notice Applications described in this document for any of these products are for illustrative purposes only QLogic Corporation makes no representation nor warranty that such app...

Page 3: ...Adapters 1 2 Application Notes 1 2 2 System Requirements Hardware Requirements 2 1 Cable Specifications 2 1 SFP Optical Module Requirements 2 2 System and Software Requirements 2 2 Supported QLogic Ad...

Page 4: ...r 2003 and 2008 Driver Installation and Configuration Windows Server Driver Checklist 5 1 Windows Server Service Pack Requirements 5 1 Firmware ROM Image Location 5 1 Windows Server Driver Installatio...

Page 5: ...MSI X Support 6 3 Check for Receive Side Scaling RSS Support 6 4 Inbox Kernel GPL Driver and Blacklisting 6 4 Preparing for QLogic Adapter Driver Installation 6 5 QLogic Adapter Driver Installation RP...

Page 6: ...talled 9 1 Unable to Send Receive Network Traffic Using the QLogic Adapter 9 1 Troubleshooting Tools 9 2 Windows Server Tools 9 2 Linux Tools 9 3 Check for System Errors 9 3 Linux 9 3 Windows Server 9...

Page 7: ...2 Driver Location Information 5 3 5 3 Select Driver Location 5 4 5 4 Browse for Folder 5 5 5 5 Software Installation Progress 5 5 5 6 Software Installation Complete 5 6 5 7 Driver Installation Verifi...

Page 8: ...1 2 2 1 Cable Specifications Optical 2 1 2 2 Cable Specifications Copper 2 2 4 1 Mapping of Port Number PCI Function and Ethernet Interface 4 2 4 2 QLE3044 LED Definitions 4 2 5 1 Advanced Properties...

Page 9: ...the following documentation conventions NOTE provides additional information Text in blue font indicates a hyperlink jump to a figure table or section in this guide and links to Web sites are shown in...

Page 10: ...with UPPERCASE Press CTRL P Press the UP ARROW key Text in italics indicates terms emphasis variables or document titles For example For a complete listing of license agreements refer to the QLogic So...

Page 11: ...ts Upon demonstrating knowledge using live equipment QLogic awards a certificate identifying the student as a Certified Professional The training professionals at QLogic may be reached by e mail at tr...

Page 12: ...Preface Technical Support xii NE0154601 00 A Notes...

Page 13: ...ftware Release Information Refer to the Release Notes for more information on the software release package contents The Release Notes document contains Software release package contents Current driver...

Page 14: ...formation about Linux PXE and iSCSI boot see the following applications notes Setting up Linux PXE on Server and Client Systems part number FE0051401 00 iSCSI Boot Setup part number IS0051404 00 Table...

Page 15: ...page 2 2 Supported QLogic Adapters on page 2 2 Hardware Requirements Cable Specifications Make sure the cables you are using meet the specifications listed in Tables 2 1 and 2 2 Table 2 1 Cable Specif...

Page 16: ...on the particular system and software requirements for the current software release The drivers and Release Notes are on the QLogic Web site at to driverdownloads qlogic com QLogicDriverDownloads_UI d...

Page 17: ...er For more detailed instructions see Hardware Installation on page 4 1 Pre installation Checklist Before installing the QLogic adapter 1 Verify that the system meets the requirements specified in Sys...

Page 18: ...Before installing the driver download the driver package and the Release Notes from the QLogic Web site www qlogic com See Windows Server Driver Checklist on page 5 1 for more information Windows Ser...

Page 19: ...menu 2 Highlight My Computer then right click the mouse button On the shortcut menu select Manage The Computer Management window opens 3 Select Device Manager under Computer Management 4 From the Dev...

Page 20: ...er and tools package 1 Type rpm qa grep nx_ 2 Type ifconfig eth n down 3 Type rmmod nx_nic ko 4 Type rpm e nx_nic version 5 Type rpm e nx_tools version Install the Driver RPM Red Hat To install the dr...

Page 21: ...spec 3 Type the following command to install the binary RPM rpm ivh usr src packages RPMS arch 2 nx_nic version arch rpm The arch variable designates the system architecture Some arch variables are i...

Page 22: ...3 Installation Instructions Linux Driver Installation 3 6 NE0154601 00 A Notes...

Page 23: ...or higher PCIe slot 4 Insert the QLE3044 into the PCIe slot Apply uniform pressure on top of the QLE3044 until it is firmly seated in the PCIe bus connector 5 Secure the bracket to the chassis and re...

Page 24: ...speed of the connection as shown in Table 4 2 Table 4 1 Mapping of Port Number PCI Function and Ethernet Interface Port Number PCI Function Ethernet Interface 1 0 Ethernet interface numbers are dynami...

Page 25: ...bracket covers the top of the RJ45 Ethernet jacks Slide the bracket upward towards the top of the QLE3044 until it clears all of the Ethernet jacks 3 To replace with a different bracket reverse the p...

Page 26: ...e QLE3142 into the x8 PCIe slot Apply uniform pressure on top of the QLE3142 until it is firmly seated in the bus connector 6 Connect the SFP module or copper direct attach twinax cable Listen for an...

Page 27: ...t QLogic provides both of these brackets with the product To remove and replace the bracket 1 Remove the SFP optical modules from their housing see Figure 4 7 2 Remove the two screws at the top and bo...

Page 28: ...in place with the two screws Figure 4 7 QLE3142 Bracket Removal Figure 4 8 QLE3142 Bracket Replacement QLE3142 Housing Housing Mounting Bracket 1 Remove the two mounting screws 2 Gently pull the brac...

Page 29: ...iliar before installing the QLogic adapter driver on a Windows Server OS Windows Server Service Pack SP requirements Location of auto load firmware files System requirements see the Release Notes Each...

Page 30: ...cedure is for a new driver installation 1 Copy the QLogic adapter release package to a directory on the host 2 After the server system is powered up Windows detects the QLogic adapter and the Found Ne...

Page 31: ...llowing Windows Server 2003 select Install from a list or specific location Advanced and then click the Next button Figure 5 2 Windows Server 2008 select Browse my computer for driver software Figure...

Page 32: ...this location in the search Figure 5 3 Windows Server 2008 in the Update Driver Software dialog box select Browse for driver software on your computer Type the appropriate path to the QLogic adapter d...

Page 33: ...ains the 32 bit driver The x64 directory contains the 64 bit driver Figure 5 4 Browse for Folder 5 Do one of the following Windows Server 2003 click Next in the Hardware Update Wizard dialog box to in...

Page 34: ...are Installation Complete To verify that the driver was properly installed 1 On the Start menu right click My Computer and then select Device Manager A list of devices appears in right side of the win...

Page 35: ...vice Manager To access the Device Manager 1 On the Start menu right click My Computer and then select Device Manager A list of devices appears in right side of the window 2 Under Network Adapters righ...

Page 36: ...llation and Configuration Windows Server Driver Configuration 5 8 NE0154601 00 A Advanced Tab Click the Advanced tab to display the driver properties Figure 5 9 Figure 5 9 Adapter Properties Advanced...

Page 37: ...wControl Default 3 Transmit and receive flow control enabled Values 0 1 2 3 Health Monitoring This parameter maintains the health of the device Disabling this parameter should performed under adviseme...

Page 38: ...d enable disable options Registry Key LsoV2IPv4 Default Enabled Values Enabled Disabled Size of LSO 64K maximum Large Send Offload V2 IPv6 a This parameter specifies the large send offload enable disa...

Page 39: ...mbo frame Reg Key RxJumboRingSize Default 2 4096 buffers Values 0 1024 1 2048 2 4096 3 8192 Max Offload Connections This parameter specifies the maximum number of offload connections Reg Key MaxOffloa...

Page 40: ...rding Registry Key Optimization Default Disabled Values Disabled Enabled Priority and VLAN Tag This parameter controls support for 802 1p q priority tagging Enable this parameter to set the VLAN ID Th...

Page 41: ...egistry Key TCPChecksumOffloadv4 Default 3 Transmit and receive checksum enabled Values 0 1 2 3 TCP Checksum Offload IPv6 a This parameter enables disables the TCP checksum offload for IPv6 There are...

Page 42: ...options 0 off 1 transmit 2 receive and 3 transmit receive Registry Key UDPChecksumOffloadv6 Default 3 Transmit and receive checksum enabled Values 0 1 2 3 VLAN ID This parameter sets the VLAN ID for...

Page 43: ...iver Configuration NE0154601 00 A 5 15 Information Tab Click the Information tab for information about the firmware version BIOS version driver version and other QLogic adapter properties Figure 5 10...

Page 44: ...ration Windows Server Driver Configuration 5 16 NE0154601 00 A Diagnostics Tab Click the Diagnostics tab to test the QLogic adapter s Flash LED and other functions Figure 5 11 Figure 5 11 Adapter Prop...

Page 45: ...Configuration Windows Server Driver Configuration NE0154601 00 A 5 17 Statistics Tab Click the Statistics tab to view information about the QLogic adapter Figure 5 12 Figure 5 12 Adapter Properties S...

Page 46: ...r Driver Configuration 5 18 NE0154601 00 A Flash Update Tab Click the Flash update tab to view the current firmware version on the QLogic adapter and update the firmware if required Figure 5 13 Figure...

Page 47: ...rver Driver Configuration NE0154601 00 A 5 19 Driver Tab Click the Driver tab to view driver information and update uninstall or restore a previous version of the QLogic adapter driver Figure 5 14 Fig...

Page 48: ...onfiguration Windows Server Driver Configuration 5 20 NE0154601 00 A Resources Tab Click the Resources tab to view the resource settings for the QLogic adapter Figure 5 15 Figure 5 15 Adapter Properti...

Page 49: ...he QLogic adapter entry says Limited or no connectivity If there is a red X next to QLogic adapter icon the link is down In this case do the following Verify that the card is seated properly in the PC...

Page 50: ...Adapter in Windows Server 5 22 NE0154601 00 A 2 Assign an IP address manually by selecting the Internet Protocol TCP IP entry and then clicking the Properties button Figure 5 17 Figure 5 17 Local Area...

Page 51: ...rotocol TCP IP Properties Dialog Box 4 Verify connectivity with another card or switch using the ping utility Uninstall the QLogic Adapter Driver in Windows Server To uninstall the QLogic adapter driv...

Page 52: ...08 a Double click Computer navigate to the local disk C and then to the Windows directory b Search for nx and remove all of the following files from each of the folder locations found in the search nx...

Page 53: ...Adapter Properties Diagnostics Tab Windows Server Performance This section describes Windows performance tuning NOTE The tunable performance parameters are system and application specific Understandi...

Page 54: ...ter or creating a new parameter see Tcp1323Opts Parameter on page 5 29 2 Set the TcpWindowSize parameter In the TcpWindowSize parameter window set the value in the Value Data box to either 200000 hexa...

Page 55: ...LE3142 and in particular with fewer threads on Windows Server performance is limited by the receive window and by the outstanding I O a value regardless of hardware limitations For the receive side th...

Page 56: ...umber of buffers 20K p port base 5001 a outstanding I O 2 x packet array size 1 rb receive buffer size 64K sb send buffer size 0 i Infinite loop f file name output txt u UDP send receive w d Verify fl...

Page 57: ...is the amount of data the sending host can send at one time on a connection When the value for window size is added to the registry and its size is larger than the default value Windows attempts to u...

Page 58: ...dialog box opens 2 Type regedit in Open box Figure 5 22 and then click the OK button Figure 5 22 Run Window The Registry Editor window opens 3 Click the HKEY_LOCAL_MACHINE directory Figure 5 23 Figur...

Page 59: ...Run dialog box opens 2 Type regedit in the Open box and then click the OK button Figure 5 22 The Registry Editor window opens 3 Click the HKEY_LOCAL_MACHINE directory Figure 5 23 4 Navigate to the fol...

Page 60: ...e 5 26 Figure 5 26 Creating Tcp1323Opts 7 Right click TCp1323Opts and then select Modify In the Value data box type 1 the default value is 0 and then click the OK button Figure 5 27 Figure 5 27 Edit D...

Page 61: ...d create a new key with a DWORD value Figure 5 25 6 Rename New Value 1 to TCpWindowSize 7 Right click TcpWindowSize and then select Modify Figure 5 28 Figure 5 28 Modifying the TcpWindowSize Parameter...

Page 62: ...5 Windows Server 2003 and 2008 Driver Installation and Configuration Windows Server Performance 5 34 NE0154601 00 A Notes...

Page 63: ...d Module Information on page 6 2 Locate the QLogic Tools on page 6 2 Build the Linux Driver Source Code on page 6 2 Enable the Inbox Kernel GPL and Commercial Drivers on page 6 2 Check for MSI X Suppo...

Page 64: ...ion and module information where n is the port number modinfo nx_nic ethtool i eth n Locate the QLogic Tools Type the following command to go to the directory where the tools are located cd opt netxen...

Page 65: ...led 3 To disable the inbox kernel GPL driver netxen_nic ko a Type the following command to remove the driver from the OS memory rmmod netxen_nic b Remove or rename the netxen_nic ko file from the lib...

Page 66: ...0 PCI MSI X eth3 2 146 0 0 PCI MSI X eth3 3 Check for Receive Side Scaling RSS Support To support RSS each port has four MSI X interrupts to send interrupts to any CPU Inbox Kernel GPL Driver and Blac...

Page 67: ...continuing with the following steps in this section rmmod netxen_nic The following sections describe how to install a new driver Preparing for QLogic Adapter Driver Installation Check for prior versio...

Page 68: ...ands the arch variable designates the system architecture Some arch variables include i386 i586 i686 x86_64 depending on the system The installed QLogic driver binary will be located in one of the fol...

Page 69: ...of two jumbo_desc Sets the size of the receive ring for jumbo frames 10GbE ports 1024 64 1024 must be power of two rdesc_1g Sets the size of the receive ring for normal packets 1GbE ports For firmware...

Page 70: ...Verify that the network services are running and then type service network restart Ping a different IP address to verify connectivity Uninstall the Commercial GPL Driver and Tools Package Type the fol...

Page 71: ...cy 0 net ipv4 tcp_window_scaling 1 net ipv4 tcp_moderate_rcvbuf 1 net ipv4 route flush 1 Using the iperf Tool The iperf tool measures network performance The following paragraphs show how to use iperf...

Page 72: ...ple of iperf from the client side iperf c ipAddr of Server w 1M P12 l 16k P number of threads Optimization Note the following PCIe x8 provides optimal performance for 10GbE MSI and MSI X interrupts pe...

Page 73: ...e following command to install the driver if it has not yet been installed modprobe v nx_nic The steps for setting the Linux bonding mode are as follows Note that these are example commands The actual...

Page 74: ...imary device is indicated one slave device is configured as the active slave The dmesg command displays the primary port Here is an example output of the dmesg command bonding bond0 making interface e...

Page 75: ...states are set to BOND_LINK_UP Type the following command to check the status of the bonding process cat proc net bonding bond0 The output for this command is Ethernet Channel Bonding Driver v3 0 1 B...

Page 76: ...at load time They may be given as command line arguments to the modprobe command but are usually specified in the etc modules conf or etc modprobe conf configuration file or in a distribution specific...

Page 77: ...ple IP addresses must be separated by a comma At least one IP address must be given for ARP monitoring to function The maximum number of targets that can be specified is 16 The default value is no IP...

Page 78: ...XOR dest MAC modulo slave count The same slave is selected for each destination MAC This mode pro vides load balancing and fault tolerance 3 broadcast This mode transmits everything on all slave inter...

Page 79: ...fig add command creates a VLAN device on eth0 and will in turn create an eth0 5 interface Type the following command for eth0 to add VLAN ID 5 vconfig add eth0 5 3 Type the ifconfig command to assign...

Page 80: ...7 Linux Configuration for Bonding Mode and Virtual LAN VLAN Configuring Virtual LAN VLAN Under Linux 7 8 NE0154601 00 A Notes...

Page 81: ...Local Area Connection n refers to the port being flashed nxflash exe i Local Area Connection n info the quotation marks are required Check for the following entry Active Firmware version 4 0 305 To d...

Page 82: ...8 Firmware Management Linux Dynamic Firmware Download 8 2 NE0154601 00 A Check for the following entry Active Firmware version 4 0 305...

Page 83: ...system 4 Note any error messages that appear during the operating system OS boot sequence 5 Check for system error messages Windows event viewer dmesg display system messages on Linux Unable to Send R...

Page 84: ...d response If none of the previous steps resolve the problem run the QLogic user diagnostics Troubleshooting Tools The following sections explain how to use the tools under Windows and Linux to help s...

Page 85: ...and events The QLogic adapter s device drivers indicate status by logging events in the system event log Table 9 2 Troubleshooting Tools in Linux Tool What is Provides nxdebug1 Linux script does not r...

Page 86: ...e OS then use MSI or legacy mode in the OS Type the following command on the Linux host to check that PCI MSI X or PCI MSI is enabled for the Ethernet interface cat proc interrupts Determine if the in...

Page 87: ...idth in the output reflects the actual supported width In an system with a QLE3044 for example type the following command to determine if these two widths are the same lspci xxx vvv d 4040 0100 In the...

Page 88: ...ectrically they are different widths Check the motherboard specification for the supported width of each of the PCIe slots Windows Server 2003 RSS and SNP Support If you have problems with server appl...

Page 89: ...ion 2 etc a all This command performs all tests regardless of the default D default This command performs only the default test R CRegs This command tests all control registers default F FLASH This co...

Page 90: ...nH noHw This command disables hardware testing use with D or a nS noLinkSt This command disables link status testing use with D or a nl noLED This command disables LED status testing use with D or a E...

Page 91: ...using the tar xfp command 3 Remove any previous driver version a Type one of the following commands For a 64 bit operating system OS type pkgchk l p kernel drv amd64 ntxn For a 32 bit OS type pkgchk l...

Page 92: ...using the gunzip command 2 Untar the firmware package using the tar xfp command 3 Unzip the tools package using the gunzip command 4 Untar the tools package using the tar xfp command 5 Type the follow...

Page 93: ...over if required The Flash tool will not start the Flash update process if the QLogic adapter driver is not loaded The Flash tool auto identifies the appropriate Flash image for the QLogic adapter Fla...

Page 94: ...mage onto a CD writable media make sure your system has a CD burner 3 Insert the NX Live CD into the system that contains the QLogic adapter 4 Change any BIOS settings to permit the CD to boot before...

Page 95: ...ecute the bootinst bat file Press the ENTER key twice to complete the process of making the USB flash drive bootable 9 Insert the NX Live USB flash drive into the server with the QLogic adapter 10 Cha...

Page 96: ...sh Utility Commands Windows Server Command Definition Description i interface Interface This command specifies the interface type Local Area Connection 1 Local Area Con nection 2 etc info Information...

Page 97: ...the nxflash utility and ROM image files must be in the same directory from where the nxflash command is executed 4 Type the following command where n is the number of the port being flashed nxflash ex...

Page 98: ...E 00 7F 25 MAC Address 2 00 0E 1E 00 7F 26 MAC Address 3 00 0E 1E 00 7F 27 Serial Number QG88BK0130 NIC binary romimage found in C netxen 4 0 223 utils Rom Image C netxen 4 0 223 utils lp_qg_cut_thru_...

Page 99: ...0 0E 1E 00 79 DC MAC Addr 1 00 0E 1E 00 79 DD MAC Addr 2 00 0E 1E 00 79 DE MAC Addr 3 00 0E 1E 00 79 DF Subsystem ID 0x01244040 PHY Type UNKNOWN PHY PXE Status Disabled Updating the Flash on Multiple...

Page 100: ...shipped with a default Flash version Using the Flash Utility When invoking the nxflash utility use the following syntax nxflash i n command In this command the n indicates the QLogic adapter device n...

Page 101: ...ckup Flash version to the QLogic adapter Here is an example backup file name flashbackup_ serial num ber _ version _ date time pxe on PXE This command enables PXE pxe off PXE This command disables PXE...

Page 102: ...the QLogic devices nxflash list Note the function number for the QLogic adapter c Type the following command to start the Flash update use the function number from the previous step in the i option nx...

Page 103: ...PCIE Function Number is 0 Verifying flash Done Board Type 0x26 NetXen NX3031 Dual Port SFP 10GbE Server Adapter Board Chip Rev B1 Serial Id SF8DBK0145 Efuse ID 0x0000000000000000 Firmware version on...

Page 104: ...C Flash Update QLogic Adapter Flash Update Linux C 12 NE0154601 00 A Notes...

Page 105: ...ating an interrupt through special messages that allow emulation of a pin assertion or deassertion MSI X defined in PCI 3 0 allows a device to allocate any number of interrupts between 1 and 2048 and...

Page 106: ...smaller than a gigabit interface converter that plugs into the Ethernet port VLAN Virtual logical area network LAN A group of hosts with a common set of requirements that communicate as if they were...

Page 107: ...options 7 4 driver parameters 7 4 mode Linux 7 1 7 5 Bracket removal and replacement 4 3 4 5 C C A 2 Cable specifications 2 1 Cmdif A 2 Commercial GPL driver 6 4 enable 6 2 uninstall 6 8 Conventions i...

Page 108: ...ows Server C 5 updating on multiple standalone QLogic adapters C 7 utility commands Linux C 8 utility commands Windows Server C 4 G General tab adapter properties 5 7 H H A 1 h A 2 C 5 C 9 Hardware in...

Page 109: ...c not being sent received using the QLogic adapter 9 1 netxen_nic ko 6 4 Glossary 1 nF A 2 nH A 2 nI A 2 nL A 2 nl A 2 noCRegs A 2 noFlash A 2 noHw A 2 noIntLB A 2 noIRQS A 2 noLED A 2 noLinkST A 2 nR...

Page 110: ...e 2 1 Resources tab adapter properties 5 20 restore backup file C 4 C 9 romimage Glossary 2 Round robin mode 7 3 RPM Glossary 2 RPM installing the Linux driver in RPM format 6 5 RSS Glossary 2 RSS sup...

Page 111: ...uring the QLogic adapter in 5 21 diagnostics 5 24 driver configuration 5 7 driver installation 3 2 5 2 driver installation verification 5 6 driver uninstall 5 23 event log 9 3 flash update C 5 perform...

Page 112: ...QLogic 3000 and 3100 Series Intelligent Ethernet Adapters Users Guide Version 4 6 Index 6 NE0154601 00 A...

Page 113: ......

Page 114: ...PCIe are registered trademarks of PCI SIG SUSE is a registered trademark of Novell Inc All other brand and product names are trademarks or registered trademarks of their respective owners Information...

Search results

Summary of Contents for 3000 Series

Reviews:

Related manuals for 3000 Series

Brands by name

Popular brands

Qlogic 3000 Series, User Manual

Search results

Summary of Contents for 3000 Series

Reviews:

Related manuals for 3000 Series

Brands by name

Popular brands