Qlogic FastLinQ 3400 Series User Manual Download

Page: 7 / 287

User’s Guide—Converged Network Adapters and Intelligent Ethernet Adapters

QLogic FastLinQ 3400, 8400 Series

vii

83840-546-00 E

Installing the Source RPM Package . . . . . . . . . . . . . . . . . . . . . . . . . .

Installing the KMP Package. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

Building the Driver from the Source TAR File . . . . . . . . . . . . . . . . . . .

Load and Run Necessary iSCSI Software Components . . . . . . . . . . . . . . .

Unloading/Removing the Linux Driver . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

Unloading/Removing the Driver from an RPM Installation . . . . . . . . .

Removing the Driver from a TAR Installation . . . . . . . . . . . . . . . . . . .

Uninstalling the QCC GUI . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

Patching PCI Files (Optional) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

Network Installations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

Setting Values for Optional Properties . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

bnx2x Driver . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

disable_tpa . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

int_mode . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

dropless_fc . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

disable_iscsi_ooo . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

multi_mode . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

num_queues . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

pri_map. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

qs_per_cos . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

cos_min_rate . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

bnx2i Driver . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

error_mask1 and error_mask2 . . . . . . . . . . . . . . . . . . . . . . . . . .

en_tcp_dack . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

time_stamps . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

sq_size . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

rq_size . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

event_coal_div . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

last_active_tcp_port . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

ooo_enable . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

bnx2fc Driver . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

debug_logging . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

Driver Defaults . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

bnx2 Driver . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

bnx2x Driver . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

Driver Messages . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

Summary of Contents for FastLinQ 3400 Series

Page 1: ...83840 546 00 E User s Guide Converged Network Adapters and Intelligent Ethernet Adapters QLogic FastLinQ 3400 8400 Series...

Page 2: ...loading technologies Functional Description on page 1 Added a QConvergeConsole Plug ins for vSphere to the list of manageability features Features on page 2 Added the Adapter Management section Adapte...

Page 3: ...paragraph at the end of the section describing two traffic classes that can be used by the Windows QoS service Data Center Bridging in Windows Server 2012 on page 172 Removed the table describing the...

Page 4: ...iv 83840 546 00 E User s Guide Converged Network Adapters and Intelligent Ethernet Adapters QLogic FastLinQ 3400 8400 Series...

Page 5: ...y xxvii Laser Safety xxvii FDA Notice xxvii Agency Certification xxvii EMI and EMC Requirements xxvii Product Safety Compliance xxviii 1 Product Overview Functional Description 1 Features 2 iSCSI 4 FC...

Page 6: ...ting Up MBA in a Client Environment 13 Enabling the MBA Driver 13 Configuring the MBA Driver 13 Setting Up the BIOS 15 Setting Up MBA in a Server Environment 15 Red Hat Linux PXE Server 15 MS DOS UNDI...

Page 7: ...on 33 Removing the Driver from a TAR Installation 33 Uninstalling the QCC GUI 34 Patching PCI Files Optional 34 Network Installations 34 Setting Values for Optional Properties 35 bnx2x Driver 35 disab...

Page 8: ...signed to Network Interface Which Is Down 43 SCSI ML Initiated Host Reset Session Recovery 43 CNIC Detects iSCSI Protocol Violation Fatal Errors 44 CNIC Detects iSCSI Protocol Violation Non FATAL Warn...

Page 9: ..._tx_queues 53 pri_map 53 qs_per_cos 53 cos_min_rate 53 dropless_fc 54 RSS 54 max_vfs 54 enable_vxlan_offld 54 Driver Defaults 54 Unloading and Removing Driver 55 Driver Messages 55 Driver Sign On 55 N...

Page 10: ...ring VLANs for iSCSI Boot 93 Other iSCSI Boot Considerations 94 Changing the Speed and Duplex Settings in Windows Environments 94 Virtual LANs 95 The dd Method of Creating an iSCSI Boot Image 95 Troub...

Page 11: ...QLogic Multiple Boot Agent for FCoE Boot 119 UEFI Boot LUN Scanning 123 Provisioning Storage Access in the SAN 125 Pre Provisioning 125 CTRL R Method 125 One Time Disabled 126 Windows Server 2008 R2...

Page 12: ...IOV 159 SR IOV and Storage 161 SR IOV and Jumbo Packets 161 13 Microsoft Virtualization with Hyper V Supported Features 163 Single Network Adapter 164 Windows Server 2008 164 Windows Server 2008 R2 an...

Page 13: ...Selecting a Team Type 187 Teaming Mechanisms 188 Architecture 189 Outbound Traffic Flow 190 Inbound Traffic Flow SLB Only 190 Protocol Support 191 Performance 192 Types of Teams 192 Switch Independen...

Page 14: ...acle 214 Teaming and Network Backup 215 Load Balancing and Failover 216 Fault Tolerance 217 Troubleshooting Teaming Problems 219 Teaming Configuration Tips 219 Troubleshooting Guidelines 220 Frequentl...

Page 15: ...ng Diagnostics 240 Diagnostic Test Descriptions 242 18 Troubleshooting Hardware Diagnostics 248 QCC GUI Diagnostic Tests Failures 248 QCC Network Test Failures 249 Checking Port LEDs 249 Troubleshooti...

Page 16: ...User s Guide Converged Network Adapters and Intelligent Ethernet Adapters QLogic FastLinQ 3400 8400 Series xvi 83840 546 00 E...

Page 17: ...t VLAN 94 8 12 Saving the iSCSI Boot VLAN Configuration 94 8 13 iSCSI Initiator Properties 99 8 14 iSCSI Initiator Node Name Change 100 8 15 iSCSI Initiator Add a Target Portal 100 8 16 Target Portal...

Page 18: ...with Tagging 156 15 1 Process for Selecting a Team Type 187 15 2 Intermediate Driver 189 15 3 Teaming Across Switches Without an Interswitch Link 204 15 4 Teaming Across Switches With Interconnect 20...

Page 19: ...2 8 5 Offload iSCSI OIS Driver Event Log Messages 105 11 1 Example VLAN Network Topology 157 13 1 Configurable Network Adapter Hyper V Features 163 13 2 Configurable Teamed Network Adapter Hyper V Fea...

Page 20: ...xx 83840 546 00 E User s Guide Converged Network Adapters and Intelligent Ethernet Adapters QLogic FastLinQ 3400 8400 Series...

Page 21: ...ows your network computer to boot with the images provided by remote servers across the network Chapter 4 Windows Driver Software describes Windows driver installation and removal QLogic management ap...

Page 22: ...ion SR IOV to virtualize network controllers and how to enable SR IOV Chapter 13 Microsoft Virtualization with Hyper V describes the use of Microsoft Hyper V for Windows Server 2008 and 2012 Chapter 1...

Page 23: ...For example Table 9 2 lists problems related to the user interface and remote agent See Installation Checklist on page 6 For more information visit www qlogic com Text in bold font indicates user int...

Page 24: ...are shortcut keys To enter the date type mm dd yyyy where mm is the month dd is the day and yyyy is the year Topic titles between quotation marks identify related topics either within this manual or i...

Page 25: ...ads and Documentation page driverdownloads qlogic com 2 Type the QLogic model name in the search box 3 In the search results list locate and select the firmware software or documentation for your prod...

Page 26: ...ed service consult your plan for available hours For Support phone numbers see the Contact Support link at support qlogic com Knowledge Database The QLogic knowledge database is an extensive collectio...

Page 27: ...ject to the following two conditions 1 this device may not cause harmful interference and 2 this device must accept any interference received including interference that may cause undesired operation...

Page 28: ...tion and Flicker VCCI VCCI 2012 04 Class A AS NZS CISPR22 AS NZS CISPR 22 2009 A1 2010 Class A KCC KC RRA KN22 KN24 2013 Class A Product Safety Compliance UL cUL product safety UL60950 1 2nd Edition 2...

Page 29: ...boot iSCSI boot Fibre Channel over Ethernet FCoE offload and acceleration for Fibre Channel block storage Enterprise networks that use multiple protocols and multiple network fabrics benefit from the...

Page 30: ...ws operating systems Features The following is a list of the QLogic 8400 3400 Series adapters features Some features may not be available on all adapters iSCSI offload FCoE offload NIC partitioning NP...

Page 31: ...iant multiple power modes Intelligent platform management interface IPMI support Advanced network features Jumbo frames up to 9 600 bytes The OS and the link partner must support jumbo frames Virtual...

Page 32: ...a whole file iSCSI maps the SCSI request response application protocols and its standardized command set over TCP IP networks As iSCSI uses TCP as its sole transport protocol it greatly benefits from...

Page 33: ...ted Adaptive Interrupt Frequency The adapter driver intelligently adjusts host interrupt frequency based on traffic conditions to increase overall application throughput When traffic is light the adap...

Page 34: ...on Windows and Linux platforms to manage QLogic 8400 3400 Series Adapters on both local and remote computer systems For information about installing the QCC GUI see the QConvergeConsole GUI Installati...

Page 35: ...mplemented as low profile PCIe cards The adapters ship with a full height bracket for use in a standard PCIe slot or an optional spare low profile bracket for use in a low profile PCIe slot Low profil...

Page 36: ...rements IA32 or EMT64 based computer that meets operating system requirements One open PCI Express slot Depending on the PCI Express support on your adapter the slot may be of type PCI Express 1 0a x1...

Page 37: ...ter WARNING The adapter is being installed in a system that operates with voltages that can be lethal Before you open the case of your system observe the following precautions to protect yourself and...

Page 38: ...esser width adapter can be seated into a greater width slot x8 in a x16 but a greater width adapter cannot be seated into a lesser width slot x8 in a x4 If you do not know how to identify a PCI Expres...

Page 39: ...42 RJ adapter supports Automatic MDI Crossover MDIX which eliminates the need for crossover cables when connecting machines back to back A straight through Category 5 5e 6 6A 7 cable allows the machin...

Page 40: ...t A network consists of one or more boot servers that provide boot images to multiple computers through the network The QLogic implementation of the MBA module has been tested successfully in the foll...

Page 41: ...s in the removable disk drive and power up your system 2 Type uxdiag mba 0 disable 1 enable c devnum or uediag mba 0 disable 1 enable c devnum where devnum is the specific device s number 0 1 2 to be...

Page 42: ...ased user diagnostics application described in Performing Diagnostics on page 240 For more information about the CCM utility see the Comprehensive Configuration Management User s Guide 1 Restart your...

Page 43: ...nux distribution has PXE Server support It allows users to remotely perform a complete Linux installation over the network The distribution comes with the boot images boot kernel vmlinuz and initial r...

Page 44: ...ect to a network for the MS DOS environment download the Intel PXE PDK from the Intel website This PXE PDK comes with a TFTP ProxyDHCP Boot server The PXE PDK can be downloaded from Intel at http down...

Page 45: ...ment tool across all QLogic adapters The QLogic Control Suite QCS GUI is no longer supported for the 8400 3400 Series Adapters and adapters based on 57xx 57xxx controllers and has been replaced by the...

Page 46: ...DrvInst folder and then double click Setup exe to open the InstallShield Wizard 4 Click Next to continue 5 After you review the license agreement click I accept the terms in the license agreement and...

Page 47: ...soft patch for iSCSI crash dump file generation Microsoft KB939875 from http support microsoft com kb 939875 To determine if you need to install the Microsoft patch see Table 4 1 Using Silent Installa...

Page 48: ...Type the following setup s v qn REINSTALL ALL To perform a silent install to force a downgrade default is NO setup s v qn DOWNGRADE Y Manually Extracting the Device Drivers To manually extract the Wi...

Page 49: ...ck Next 3 In the Custom Setup dialog box review the components to be installed make any necessary changes and then click Next 4 In the Ready to Install the Program dialog box click Install to proceed...

Page 50: ...the device The operating system attempts to shut down every possible device only when the computer attempts to go into hibernation To have the controller stay on at all times do not click the Allow th...

Page 51: ...4 Windows Driver Software Setting Power Management Options 23 83840 546 00 E CAUTION Do not select Allow the computer to turn off the device to save power for any adapter that is a member of a team...

Page 52: ...n Limitations Packaging Installing Linux Driver Software Unloading Removing the Linux Driver Patching PCI Files Optional Network Installations Setting Values for Optional Properties Driver Defaults Dr...

Page 53: ...is driver also receives and processes device interrupts both on behalf of itself for L2 networking and on behalf of the bnx2fc FCoE and cnic drivers cnic The cnic driver provides the interface between...

Page 54: ...distributions bnx2fc Driver The current version of the driver has been tested on 2 6 x kernels starting from 2 6 32 kernel which is included in RHEL 6 1 distribution This driver may not compile on old...

Page 55: ...r gz iSCSI user space management tool binary open fcoe qlgc subvert arch rpm open fcoe userspace management tool binary RPM for SLES11 SP2 and legacy versions fcoe utils qlgc subver arch rpm open fcoe...

Page 56: ...or RHEL cd rpmbuild rpmbuild bb SPECS netxtreme2 spec For SLES cd usr src packages rpmbuild bb SPECS netxtreme2 spec 3 Install the newly compiled RPM rpm ivh RPMS arch netxtreme2 version arch rpm Note...

Page 57: ...ig boot lldpad on chkconfig boot fcoe on 6 Inbox drivers are included with all of the supported operating systems The simplest means to ensure the newly installed drivers are loaded is to reboot 7 For...

Page 58: ...For FCoE offload and iSCSI offload TLV make sure var lib lldpad lldpad conf is created and each ethX block does not specify adminStatus or if specified it is set to 0 adminStatus 0 as below lldp eth5...

Page 59: ...file rmmod bnx2x 2 Load the driver modprobe bnx2x Building the Driver from the Source TAR File 1 Create a directory and extract the TAR files to the directory tar xvzf netxtreme2 version tar gz 2 Bui...

Page 60: ...onents on page 32 for instructions on loading the software components required to use the QLogic iSCSI offload feature To configure the network protocol and address after building the driver refer to...

Page 61: ...g make install from the tar file the bnx2x ko driver file has to be manually deleted from the operating system See Installing the Source RPM Package on page 28 for the location of the installed driver...

Page 62: ...updates usr share hwdata pci ids new Next the old files can be backed up and the new files can be renamed for use cp usr share hwdata pci ids usr share hwdata old pci ids cp usr share hwdata pci ids...

Page 63: ...the TPA feature on all 8400 3400 Series network adapters in the system The parameter can also be set in modprobe conf See the man page for more information insmod bnx2x ko disable_tpa 1 or modprobe bn...

Page 64: ...mode The optional parameter multi_mode is for use on systems that support multi queue networking Multi queue networking on the receive side depends only on MSI X capability of the system multi queue n...

Page 65: ...es divided into 2 CoS 4 queues in each CoS cos_min_rate The optional parameter cos_min_rate is used to determine the weight of each CoS for round robin scheduling in transmission This parameter is eva...

Page 66: ...yed ACK enables disables TCP delayed ACK feature on offloaded iSCSI connections Defaults TCP delayed ACK is ENABLED For example insmod bnx2i ko en_tcp_dack 0 or modprobe bnx2i en_tcp_dack 0 time_stamp...

Page 67: ...ctions RQ size is not required greater than 16 as it is used to place iSCSI ASYNC NOP REJECT messages and SCSI sense data Defaults 16 Range 16 to 32 Note that QLogic validation is limited to a power o...

Page 68: ...x4 ELS debugging 0x8 Misc debugging 0x10 Max debugging 0xff Driver Defaults bnx2 Driver bnx2x Driver bnx2 Driver Speed Autonegotiation with all speeds advertised Flow Control Autonegotiation with RX a...

Page 69: ...TSO Enabled on 2 6 kernels bnx2x Driver Speed Autonegotiation with all speeds advertised Flow control Autonegotiation with RX and TX advertised MTU 1500 range is 46 9600 RX Ring Size 4078 range is 0 4...

Page 70: ...ver Driver Sign On QLogic 8400 3400 Series 10 Gigabit Ethernet Driver bnx2x v1 6 3c July 23 20xx CNIC Driver Sign On bnx2 only QLogic 8400 3400 Series cnic v1 1 19 Sep 25 20xx NIC Detected eth QLogic...

Page 71: ...o allocate iscsi cid bnx2i unable to allocate iSCSI context resources Network Route to Target Node and Transport Name Binding Are Two Different Devices bnx2i conn bind ep 0x ROUTE_HBA does not belong...

Page 72: ...0 U bnx2i iscsi_error invalid resi len bnx2i iscsi_error MRDSL violation bnx2i iscsi_error F bit not set bnx2i iscsi_error invalid TTT bnx2i iscsi_error invalid DataSN bnx2i iscsi_error burst len viol...

Page 73: ...0 0 0 0 0 0 0 0 Open iSCSI Daemon Handing Over Session to Driver bnx2i conn update MBL 0x800 FBL 0x800MRDSL_I 0x800 MRDSL_T 0x2000 bnx2fc Driver BNX2FC Driver Signon QLogic NetXtreme II FCoE Driver bn...

Page 74: ...ERROR destroy timed out bnx2fc Disable request timed out destroy not set to FW bnx2fc Disable failed with completion status status bnx2fc Destroy failed with completion status status Unable to Issue...

Page 75: ...team adapters together using the bonding kernel module and a channel bonding interface For more information see the Channel Bonding information in your operating system documentation Statistics Detai...

Page 76: ...ort FCoE Support Packaging The VMware driver is released in the packaging formats shown in Table 6 1 For information about iSCSI offload in VMware server see iSCSI Offload on VMware Server on page 114...

Page 77: ...400 Series 10 GbE network adapters go to http www vmware com resources compatibility search php deviceCategory io and do the following 1 Type the adapter name in quotes in the Keyword window such as Q...

Page 78: ...k in the results section to show the PCI identifiers Figure 6 3 Figure 6 3 PCI Identifiers 3 Click the model link to show a listing of all of the driver packages Figure 6 4 Click the desired ESXi vers...

Page 79: ...host 6 To install the driver package issue the following command esxcli software vib install d path offline bundle name zip maintenance mode or esxcli software vib install depot path offline bundle na...

Page 80: ...m vmkload_mod bnx2x int_mode 1 Set the int_mode parameter to 2 as shown below to force using MSI mode on all 8400 3400 Series network adapters in the system vmkload_mod bnx2x int_mode 2 disable_tpa Th...

Page 81: ...map priority 0 to 3 to CoS 0 and map priority 4 to 7 to CoS 1 qs_per_cos The optional parameter qs_per_cos is used to specify the number of queues that will share the same CoS This parameter is evalua...

Page 82: ...queues For VMware ESXi 5 1 5 5 6 0 values for RSS can be from 2 to 4 RSS 1 disables RSS queues max_vfs The optional parameter max_vfs can be used to enable a specific number of virtual functions Value...

Page 83: ...360012 MSI X Enabled Successfully bnx2x eth0 using MSI X Link Up and Speed Indication bnx2x eth0 NIC Link is Up 10000 Mbps full duplex receive transmit flow control ON Link Down Indication bnx2x eth0...

Page 84: ...Queues to use with the following command esxcfg module s multi_mode 1 num_queues num of queues bnx2x Otherwise allow the bnx2x driver to select the number of NetQueues to use with the following comman...

Page 85: ...VNPort MAC Priority and VLAN id for the Fabric that is connected to the C NIC The following command can also be used to verify that the interface is working properly esxcfg scsidevs a Output example v...

Page 86: ...es FCoE drivers Supported Distributions The FCoE DCB feature set is supported on VMware ESXi 5 0 and later Table 6 2 QLogic 8400 3400 Series FCoE Drivers Driver Description bnx2x This driver manages a...

Page 87: ...lgcUpg bat QLogic Firmware Upgrade Utility for Windows v2 7 14 0 C Brd MAC Drv Name 0 16A1 000E1E508E20 Yes 0061 QLogic 57840 10 Gigabit Ethernet 61 1 16A1 000E1E508E22 Yes 0062 QLogic 57840 10 Gigabi...

Page 88: ...version SWIM6 7 12 31 Upgrading SWIM7B image to version SWIM7 7 12 31 Upgrading SWIM8B image to version SWIM8 7 12 31 Forced upgrading E3_EC_V2 image from ver N A to ver N A Forced upgrading E3_PCIE_V...

Page 89: ...40 10 Gigabit Ethernet 62 Upgrading L2T Forced upgrading L2T image from ver L2T 7 10 31 to ver L2T 7 10 31 Forced upgrading L2C image from ver L2C 7 10 31 to ver L2C 7 10 31 Forced upgrading L2X image...

Page 90: ...1 p1p2 Forced upgrading MFW1 image from ver MFW1 7 12 27 to ver MFW1 7 12 31 Upgrading MFW2 image to version MFW2 7 12 31 Upgrading SWIM1B image to version SWIM1 7 12 31 Upgrading SWIM2B image to vers...

Page 91: ...m Exit Code 95 Successfully upgraded mf800v7c 31 QLogic Firmware Upgrade Utility for Linux v2 7 13 C Brd MAC Drv Name 0 1639 0026B942B53E Yes PowerEdge R710 BCM5709 Gigabit Ethernet rev 20 em1 1 1639...

Page 92: ...CM5709 Gigabit Ethernet rev 20 em3 3 1639 0026B942B544 Yes PowerEdge R710 BCM5709 Gigabit Ethernet rev 20 em4 4 16A1 000E1E503150 Yes BCM57840 NetXtreme II 10 Gigabit Ethernet rev 11 p1p1 5 16A1 000E1...

Page 93: ...ge R710 BCM5709 Gigabit Ethernet rev 20 em3 3 1639 0026B942B544 Yes PowerEdge R710 BCM5709 Gigabit Ethernet rev 20 em4 4 16A1 000E1E503150 Yes BCM57840 NetXtreme II 10 Gigabit Ethernet rev 11 p1p1 5 1...

Page 94: ...PowerEdge R710 BCM5709 Gigabit Ethernet rev 20 em4 4 16A1 000E1E503150 Yes BCM57840 NetXtreme II 10 Gigabit Ethernet rev 11 p1p1 5 16A1 000E1E503152 Yes BCM57840 NetXtreme II 10 Gigabit Ethernet rev 1...

Page 95: ...3 1639 0026B942B544 Yes PowerEdge R710 BCM5709 Gigabit Ethernet rev 20 em4 4 16A1 000E1E503150 Yes BCM57840 NetXtreme II 10 Gigabit Ethernet rev 11 p1p1 5 16A1 000E1E503152 Yes BCM57840 NetXtreme II 1...

Page 96: ...fload also known as Microsoft Open iSCSI initiator and offload QLogic s offload iSCSI driver or HBA Configuration of the path is set with the HBA Boot Mode option located on the General Parameters scr...

Page 97: ...for targets such as EqualLogic or EMC 2 Create a virtual disk 3 Map the virtual disk to the iSCSI target created in step 1 4 Associate an iSCSI initiator with the iSCSI target 5 Record the iSCSI targe...

Page 98: ...onfiguration Disabled The static information is entered through the iSCSI Initiator Parameters Configuration screen CHAP Authentication Controls whether the iSCSI boot host software uses CHAP authenti...

Page 99: ...Count Controls the number of connection retries the iSCSI Boot ini tiator will attempt if the iSCSI target LUN is busy IP Version This option specific to IPv6 Toggles between the IPv4 or IPv6 protoco...

Page 100: ...In the CCM device list Figure 8 2 use the up or down arrow keys to select a device and then press ENTER Figure 8 2 CCM Device List 4 In the Main menu select MBA Configuration Figure 8 3 and then pres...

Page 101: ...on Dynamic iSCSI Boot Configuration Static iSCSI Boot Configuration In a static configuration you must enter data for the system s IP address the system s initiator IQN and the target parameters obtai...

Page 102: ...ER Figure 8 6 Selecting General Parameters 1 In the General Parameters menu use the up or down arrow keys to select a parameter and then use the right or left arrow keys to set the following values TC...

Page 103: ...be changed when the adapter is in Multi Function mode NOTE For initial OS installation to a blank iSCSI target LUN from a CD DVD ROM or mounted bootable OS installation image set Boot to iSCSI Target...

Page 104: ...er values as you did in Step 5 Otherwise proceed to Step 8 8 Press ESC once to return to the Main menu and a second time to exit and save the configuration 9 Select Exit and Save Configurations to sav...

Page 105: ...scsiboot where the string 11 22 33 44 55 66 corresponds to the controller s MAC address If DHCP option 43 IPv4 only is used then any settings on the Initiator Parameters 1st Target Parameters or 2nd T...

Page 106: ...adapter s running configuration 4 HBA Boot Mode cannot be changed when the adapter is in Multi Function mode NOTE For initial OS installation to a blank iSCSI target LUN from a CD DVD ROM or mounted...

Page 107: ...way CHAP CHAP Secret optional if two way CHAP and must be 12 characters in length or longer 6 Select ESC to return to the Main menu 7 Select ESC and select Exit and Save Configuration Configuring the...

Page 108: ...that of DHCP option 17 while the iSCSI initiator IQN is simply the initiator s IQN Table 8 2 DHCP Option 17 Parameter Definition Parameter Definition iscsi A literal string servername The IP address...

Page 109: ...ic adapters support the following DHCP configurations DHCPv6 Option 16 Vendor Class Option DHCPv6 Option 17 Vendor Specific Information Table 8 3 DHCP Option 43 Suboption Definition Suboption Definiti...

Page 110: ...assign the initiator IQN to the iSCSI boot client along with two iSCSI target IQNs that can be used for booting Table 8 4 list the DHCP option 17 suboptions The content of option 17 should be 2 byte O...

Page 111: ...g Adapter Drivers into Windows Image Files on page 91 Also refer to the Microsoft knowledge base topic KB974072 at support microsoft com Other software required Bindview exe Windows Server 2008 R2 onl...

Page 112: ...Windows window appears the target drive should be visible This is a drive connected through the iSCSI boot protocol located in the remote iSCSI target 12 Select Next to proceed with Windows Server 20...

Page 113: ...ection from the remote device Ensure that the target has sufficient disk space to hold the new O S installation 5 Boot up the remote system When the Preboot Execution Environment PXE banner appears pr...

Page 114: ...ux driver CD 2 Configure the iSCSI Boot Parameters for DVD direct install to target by disabling the Boot from target option on the network adapter 3 Configure to install through the non offload path...

Page 115: ...iSCSI Boot Parameters and continue with installation until it is done At this stage the initial installation phase is complete The rest of the procedure pertains to creating a new customized initrd f...

Page 116: ...spond with your choice in the iSCSI Boot parameters section If HBA Boot Mode was enabled in the iSCSI Boot Parameters section you have to boot the offload image SLES 10 x and SLES 11 do not support of...

Page 117: ...tarts the iSCSI initiator daemon if the root filesystem is on an iSCSI device END INIT INFO ISCSIADM sbin iscsiadm ISCSIUIO sbin iscsiuio CONFIG_FILE etc iscsid conf DAEMON sbin iscsid ARGS c CONFIG_F...

Page 118: ...then ISCSIADM m node p ip T target o update n node conn 0 startup v onboot fi done Reset status of this service rc_reset We only need to start this for root on iSCSI if grep q iscsi_tcp proc modules t...

Page 119: ...the driver package b Type the following command to start the driver installer setup exe a c In the Network location field type the path of the folder to which to extract the driver package For exampl...

Page 120: ...or Linux over the network and operate as if it were a local disk drive 1 Reboot the server 2 Press CTRL S 3 To boot through an offload path set the HBA Boot Mode to Enabled To boot through a non offl...

Page 121: ...a member of that VLAN 1 During a boot of the Initiator system press CTRL S to open the QLogic CCM pre boot utility Figure 8 8 Figure 8 8 Comprehensive Configuration Management 2 In the CCM device list...

Page 122: ...12 Otherwise select Exit and Discard Configuration Press ENTER Figure 8 12 Saving the iSCSI Boot VLAN Configuration 7 After all changes have been made press CTRL ALT DEL to exit CCM and to apply the c...

Page 123: ...package on you Linux system You can get this package from QLogic CD 7 Delete all ifcfg eth files 8 Configure one port of the network adapter to connect to iSCSI Target for instructions see Configurin...

Page 124: ...ess and the target configured using a router configured IPv6 address Solution This is a known Windows TCP IP stack issue Problem The QLogic iSCSI Crash Dump utility will not work properly to capture a...

Page 125: ...the install media Problem In Windows Server 2012 toggling between iSCSI HBA offload mode and iSCSI software initiator boot can leave the machine in a state where the HBA offload miniport bxois will n...

Page 126: ...ed up before the device can be reset iscsid running in user space is generally less predictable as it can run slowly and take a long time to disconnect and reconnect iSCSI sessions during network rese...

Page 127: ...com en us download details aspx displaylang en id 18986 and locate the direct link for your system Configure Microsoft Initiator to Use QLogic s iSCSI Offload Now that the IP address has been configur...

Page 128: ...Server 100 83840 546 00 E 3 Type the initiator IQN name and then click OK Figure 8 14 iSCSI Initiator Node Name Change 4 Select the Discovery tab Figure 8 15 and click Add to add a target portal Figur...

Page 129: ...546 00 E 5 Enter the IP address of the target and click Advanced Figure 8 16 Figure 8 16 Target Portal IP Address 6 From the General tab select QLogic 10 Gigabit Ethernet iSCSI Adapter for the local a...

Page 130: ...8 iSCSI Protocol iSCSI Offload in Windows Server 102 83840 546 00 E 7 Select the adapter IP address for the Initiator IP and then click OK Figure 8 18 Figure 8 18 Selecting the Initiator IP Address...

Page 131: ...8 iSCSI Protocol iSCSI Offload in Windows Server 103 83840 546 00 E 8 In the iSCSI Initiator Properties dialog box Figure 8 19 click OK to add the target portal Figure 8 19 Adding the Target Portal...

Page 132: ...get using the QLogic iSCSI adapter Figure 8 20 Logging on to the iSCSI Target 10 In the Log On to Target dialog box Figure 8 21 click Advanced Figure 8 21 Log On to Target Dialog Box 11 On the General...

Page 133: ...inning with Root Q What IP addresses should be avoided A The IP address should not be the same as the LAN Q Why does the install fail when attempting to complete an iSCSI offload install using Windows...

Page 134: ...in the dump data For details about iSCSI Function code please refer to iSCSI User s Guide 9 Error Target did not respond in time for a SCSI request The CDB is given in the dump data 10 Error Login req...

Page 135: ...data contains the entire iSCSI header 25 Error Data digest error was detected Dump data contains the cal culated checksum followed by the given checksum 26 Error Target trying to send more data than r...

Page 136: ...tor is not configured to perform CHAP 41 Error Target did not send AuthMethod key during security negotia tion phase 42 Error Target sent an invalid status sequence number for a connec tion Dump data...

Page 137: ...ting in I O failure 58 Error Initiator could not allocate a tag for processing a request resulting in I O failure 59 Error Target dropped the connection before the initiator could tran sition to Full...

Page 138: ...for details 68 Error After receiving an async logout from the target attempt to relogin the session failed Error status is given in the dump data 69 Error Attempt to recover an unexpected terminated s...

Page 139: ...h the source package qlgc_iscsiuio v 5 Start brcm_iscsiuio qlgc_iscsiuio Bind iSCSI Target to QLogic iSCSI Transport Name In Linux each iSCSI port is an interface known as iface By default the open is...

Page 140: ...e the iSCSI VLAN add the VLAN ID in the iface file for iSCSI In the following example the VLAN ID is set to 100 Begin Record 6 2 0 873 2 el6 Iface iscsi_ifacefile name Iface ipaddress 0 0 0 0 Iface hw...

Page 141: ...le name should be ifcfg eth0 100 The following are example settings in the configuration file DEVICE ethX 100 BOOTPROTO static ONBOOT yes IPADDR NETMASK USERCTL no NETWORK VLAN yes Restart the network...

Page 142: ...nformation on sq_size and rq_size The driver logs the following message to syslog when the maximum allowed connection offload limit is reached bnx2i unable to allocate iSCSI context resources Linux iS...

Page 143: ...rk may be isolated in a VLAN to segregate it from other traffic When this is the case you must make the iSCSI interface on the adapter a member of that VLAN To configure the VLAN using the vSphere cli...

Page 144: ...8 iSCSI Protocol iSCSI Offload on VMware Server 116 83840 546 00 E 7 Configure the VLAN on VMKernel Figure 8 23 Figure 8 23 Configuring the VLAN on VMKernel...

Page 145: ...classification of FCoE and FIP frames FIP is the FCoE Initialization Protocol used to establish and maintain connections Receiver CRC offload Transmitter CRC offload Dedicated queue set for Fibre Chan...

Page 146: ...e second entry must be the OS installation media It is important that the boot order be set correctly or else the installation will not proceed correctly Either the desired boot LUN will not be discov...

Page 147: ...ent banner to invoke the CCM utility 2 Select the device through which boot is to be configured Figure 9 1 FCoE Boot Variable CCM Device List NOTE When running in NIC Partitioning NPAR mode FCoE boot...

Page 148: ...peer must also be DCBX capable with parameters that allow for full DCBX synchronization Figure 9 2 FCoE Boot Variable Enable DCB DCBX 4 On some platforms you may need to set the boot protocol through...

Page 149: ...er Ethernet FCoE Boot from SAN 121 83840 546 00 E 5 Configure the desired boot target and LUN From the Target Information Menu Figure 9 4 select the first available path Figure 9 4 FCoE Boot Variable...

Page 150: ...the target to be used for boot Figure 9 5 Figure 9 5 FCoE Boot Variable Specify Target WWPN and Boot LUN Figure 9 6 FCoE Boot Target Information 7 Press ESC until prompted to exit and save changes To...

Page 151: ...AN by allowing you to choose from a list of targets and selecting a WWPN instead of typing the WWPN To configure FCoE boot from SAN using UEFI boot LUN scanning 1 In the Main Menu select FCoE Boot Con...

Page 152: ...gure 9 8 FCoE Target Parameters Window The first six target entries 1 6 enable you to select a WWPN from a menu Use the UP and DOWN arrows to select the WWPN field and then press ENTER In the WWPN lis...

Page 153: ...example if the FIP MAC is 00 10 18 11 22 33 then the WWPN will be 20 00 00 10 18 11 22 33 CTRL R Method The CTRL R method allows you to use the boot initiator to bring up the link and login into all...

Page 154: ...ot order must be configured with QLogic boot first and installation media second Furthermore during OS installation it is required to bypass the FCoE boot and pass through to the installation media fo...

Page 155: ...27 83840 546 00 E Wait through all option ROM banners Once FCoE boot is invoked it will connect to the target and provide a four second window to press CTRL D to invoke the bypass Press CTRL D to proc...

Page 156: ...llation Go through the normal procedures for OS installation When no disk devices are found Windows will prompt you to load additional drivers At this point connect a USB flash drive containing the fu...

Page 157: ...ver Ethernet FCoE Boot from SAN 129 83840 546 00 E 2 Then load the bxfcoe OFC driver Figure 9 12 Figure 9 12 Load bxfcoe Driver 3 Select the boot LUN to be installed Figure 9 13 Figure 9 13 Selecting...

Page 158: ...s Server 2012 FCoE Boot from SAN also Microsoft s procedure injects only the eVBD and NDIS drivers QLogic strongly recommends injecting all drivers especially those in bold eVBD VBD BXND OIS FCoE NDIS...

Page 159: ...uild and Boot on page 118 Then use the guidelines in the following sections for FCoE boot installation with the appropriate Linux version SLES11 SP2 Installation RHEL6 Installation SLES11 SP2 Installa...

Page 160: ...AN 132 83840 546 00 E 2 Follow the on screen instructions to choose the Driver Update medium and load drivers Figure 9 15 Figure 9 15 Choosing Driver Update Medium 3 Once the driver update is complete...

Page 161: ...el Over Ethernet FCoE Boot from SAN 133 83840 546 00 E 4 When requested click Configure FCoE Interfaces 5 Ensure FCoE Enable is set to yes on the 10GbE QLogic initiator ports you wish to use as the SA...

Page 162: ...set to yes and DCB required is set to no 7 For each interface to be enabled for FCoE boot click on Create FCoE VLAN Interface The VLAN interface creation dialog will launch Click Yes to confirm This...

Page 163: ...Ethernet FCoE Boot from SAN 135 83840 546 00 E 8 Once complete with configuration of all interface click OK to proceed 9 Click Next to continue installation YaST2 will prompt to activate multipath An...

Page 164: ...ontinue installation as usual 11 Under the Expert tab on the Installation Settings screen select Booting 12 Select the Boot Loader Installation tab and then select Boot Loader Installation Details mak...

Page 165: ...ion splash screen press Tab and add the options dd updates URL_TO_ANACONDA_UPDATE_IMAGE to the boot command line Please refer to the Red Hat Installation Guide Section 28 1 3 http docs redhat com docs...

Page 166: ...0 546 00 E 5 When prompted Do you have a driver disk enter Yes 6 Once drivers are loaded proceed with installation NOTE RHEL does not allow driver update media to be loaded over the network when insta...

Page 167: ...9 Fibre Channel Over Ethernet FCoE Boot from SAN 139 83840 546 00 E 7 Select Specialized Storage Devices when prompted 8 Click Add Advanced Target...

Page 168: ...hernet FCoE Boot from SAN 140 83840 546 00 E 9 Select Add FCoE SAN and select Add drive 10 For each interface intended for FCoE boot select the interface deselect Use DCB select Use auto vlan and then...

Page 169: ...ual Upon completion of installation the system will reboot 15 Once booted ensure all boot path devices are set to start on boot Set onboot yes under each network interface config file in etc sysconfig...

Page 170: ...for the newly added interfaces through ifconfig a 2 Edit boot grub menu lst Add ifname INTERFACE MAC_ADDRESS to the line kernel vmlinuz for each new interface The MAC address must be all lower case an...

Page 171: ...c fcoe cfg INTERFACE file for each new FCoE initiator by duplicating the etc fcoe cfg INTERFACE file that was already configured during initial installation b Bring up the new interfaces ifconfig INTE...

Page 172: ...from SAN requires that the latest QLogic 8400 Series asynchronous drivers be included into the ESXi 5 1 5 5 6 0 install image Refer to Image_builder_doc pdf from VMware on how to slipstream drivers 1...

Page 173: ...9 Fibre Channel Over Ethernet FCoE Boot from SAN 145 83840 546 00 E 3 Press F11 to accept the agreement and continue 4 Select the boot LUN for installation and press ENTER to continue...

Page 174: ...9 Fibre Channel Over Ethernet FCoE Boot from SAN 146 83840 546 00 E 5 Select the desired installation method 6 Select the keyboard layout 7 Enter a password...

Page 175: ...m the install 9 Press ENTER to reboot after installation 10 On 57800 and 57810 boards the management network is not vmnic0 After booting open the GUI console and display the configure management netwo...

Page 176: ...IP address to the management network rather than to the FCoE boot device To create a vSwitch for the FCoE boot devices add the boot device vmnics in vSphere Client under Networking Configuring FCoE B...

Page 177: ...nt failover paths are desired you can configure those paths through CCM and the MBA will automatically failover to secondary paths if the first path is not available Further the redundant boot paths w...

Page 178: ...ntry for the boot from SAN setup uses the correct or updated intrd name in boot grub menu lst 5 To complete your driver upgrade reboot the system and select the modified grub boot entry that contains...

Page 179: ...e drivers and see your SAN disk s detach or disconnect the USB flash drive immediately before selecting the disk for further installation Configuring FCoE By default DCB is enabled on QLogic 8400 Seri...

Page 180: ...of partitions for each port can range from one to four thus a dual port NIC can have up to eight partitions Each partition behaves as if it is an independent NIC port Benefits of a partitioned 10G NI...

Page 181: ...C port The user can disable a selected partition by disabling all protocols Ethernet iSCSI and FcoE on that partition Network MAC Address The MAC address of the port iSCSI MAC Address If an iSCSI adap...

Page 182: ...r value The smallest recommended value for a partition is 10 Maximum Bandwidth The maximum bandwidth setting defines an upper threshold value ensuring that this limit is not exceeded during transmissi...

Page 183: ...hen all six offloads will share the bandwidth equally In this case each offload will be assigned roughly 16 67 of the total bandwidth 2 If Relative Bandwidth Weight is configured as 25 for all four PF...

Page 184: ...p to 64 VLANs 63 tagged and 1 untagged can be defined for each QLogic adapter on your server depending on the amount of memory available in your system VLANs can be added to a team to allow multiple V...

Page 185: ...ne of the switch ports which is con figured for VLANs 1 2 and 3 Both the adapter and the connected switch port have tagging turned on Because of the tag ging VLAN capabilities of both devices the serv...

Page 186: ...m load balancing and failover NOTE VLAN tagging is only required to be enabled on switch ports that create trunk links to other switches or on ports connected to tag capable end stations such as serve...

Page 187: ...to address these performance issues by creating a virtual function VF a lightweight PCIe function that can be directly assigned to a virtual machine VM bypassing the hypervisor layer for the main data...

Page 188: ...figure and enter the appropriate value in the Number of VFs per PF field 2 In Virtual Switch Manager create a virtual NIC Select Allow Management operating system to share the network adapter if the h...

Page 189: ...IOV VF connections This limitation applies only when the adapter is configured in NPAR mode It is not relevant when the adapter is configured in single function mode SR IOV and Jumbo Packets If SR IOV...

Page 190: ...ndows Server 2008 and 2012 This section is intended for those who are familiar with Hyper V and it addresses issues that affect the configuration of 8400 3400 Series network adapters and teamed networ...

Page 191: ...v4 Yes Yes Yes IPv6 Yes Yes Yes IPv4 Large Send Offload LSO parent and child partition Yes Yes Yes IPv4 Checksum Offload CO parent and child partition Yes Yes Yes IPv6 LSO parent and child partition N...

Page 192: ...ffload capability in the QCC GUI however CO and LSO will not work This is a limitation of Hyper V Hyper V does not support CO and LSO in an IPv6 network Windows Server 2008 R2 and 2012 When configurin...

Page 193: ...member SLB team allowed with latest QLogic Advanced Server Program QLASP version Note VM MAC is not pre sented to external switches Link Aggregation IEEE 802 3ad LACP team type Yes Yes Yes Generic Tru...

Page 194: ...for both the host parent partition and the guest child partition with the QLASP teaming software you must configure the team for tagging Unlike VLAN tagging with a single adapter tagging cannot be ma...

Page 195: ...SLB Teaming When Hyper V server is installed on a system configured to use Smart Load Balance and Failover SLB type teaming you can enable Virtual Machine Queueing VMQ to improve overall network perf...

Page 196: ...008 From Windows Server 2008 to Windows Server 2008 R2 From Windows Server 2008 R2 to Windows Server 2012 Prior to performing an OS upgrade when a QLogic 8400 3400 Series adapter is installed on your...

Page 197: ...mpler to deploy upgrade and maintain than in standard Ethernet networks DCB has a standards based bandwidth sharing at its core allowing multiple fabrics to coexist on the same physical fabric The var...

Page 198: ...sponsible to maintain the reliability by way of acknowledgment and retransmission In a network with multiple traffic classes it becomes very difficult to maintain the reliability of traffic in the abs...

Page 199: ...tself as willing and as such will accept all DCB settings as advertised by the switch If PFC is operational PFC settings supersede link level flow control settings If PFC is not operational link level...

Page 200: ...ted settings is relinquished to the operating system that is the QCC GUI can no longer be used for administrative control of the DCB You can use PowerShell to configure and manage the QoS feature Usin...

Page 201: ...e default traffic class that can be used by the Windows QoS service On 8400 Series Adapters disable iSCSI offload or FCoE offload or both to free one or two traffic classes for use by the Windows QoS...

Page 202: ...cutive Summary Glossary Teaming Concepts Software Components Hardware Requirements Teaming Support by Processor Configuring Teaming Supported Features by Team Type Selecting a Team Type This section d...

Page 203: ...sion 6 of the IP Protocol iSCSI Internet Small Computer Systems Interface L2 Layer 2 Used to describe network traffic that is not offloaded and where hardware only performs Layer 2 operations on the t...

Page 204: ...together into a team of physical ports called a virtual adapter PXE Preboot Execution Environment RAID redundant array of inexpensive disks Smart Load Balanc ing and Failover Switch independent failov...

Page 205: ...unicate with other Ethernet devices using the MAC address not the IP address However most applications work with a host name that is translated to an IP address by a Naming Service such as WINS and DN...

Page 206: ...02 3ad LACP SLB Auto Fallback Disable There are three methods for classifying the supported teaming types The first is based on whether the switch port configuration must also match the adapter teamin...

Page 207: ...ddresses when using secondary IP addresses The team MAC address is selected from the list of load balance members When the system receives an ARP request the software networking stack will always send...

Page 208: ...each client as the destination address of the ARP request also known as a directed ARP This is considered client load balancing and not traffic load balancing When the intermediate driver detects a si...

Page 209: ...nd TCP UDP port number Since routers do not alter the source and destination IP address the load balancing algorithm works as intended Configuring routers for Hot Standby Routing Protocol HSRP does no...

Page 210: ...as reliable and robust as an LACP negotiated link LACP automatically determines which member links can be aggregated and then aggregates them It provides for the controlled addition and removal of phy...

Page 211: ...protocol stack to enable the teaming architecture see Figure 15 2 The miniport driver controls the host LAN controller directly to enable functions such as sends receives and interrupt processing The...

Page 212: ...ity of Gigabit Ethernet adapter manufacturers Therefore half duplex mode is not considered here Teaming across hubs is supported for troubleshooting purposes such as connecting a network analyzer for...

Page 213: ...am for your application The teaming software supports up to eight ports in a single team and up to 16 teams in a single system These teams can be any combination of the supported teaming types but eac...

Page 214: ...es b Yes b Load balances non IP No Yes IPX out bound traffic only Yes Yes Same MAC address for all team members No No Yes Yes Same IP address for all team mem bers Yes Yes Yes Yes Load balancing by IP...

Page 215: ...aming offers link aggregation and fault tolerance to meet both of these requirements Preference teaming should be selected in the following order Link Aggregation as the first choice Generic Trunking...

Page 216: ...gic Teaming Services Teaming Mechanisms 188 83840 546 00 E Teaming Mechanisms Architecture Types of Teams Attributes of the Features Associated with Each Type of Team Speeds Supported for Each Type of...

Page 217: ...the team A Layer 3 address must also be configured for the virtual adapter The primary function of QLASP is to balance inbound for SLB and outbound traffic for all teaming modes among the physical ad...

Page 218: ...ode path has been designed to achieve best possible concurrency where multiple concurrent accesses to the Outbound Flow Hash Table are allowed For protocols other than TCP IP the first physical adapte...

Page 219: ...oadcast packets from looping back through the system from other physical adapters Protocol Support ARP and IP TCP UDP flows are load balanced If the packet is an IP protocol only such as ICMP or IGMP...

Page 220: ...single physical adapter that provides a particular hardware feature such as Large Send Offload Types of Teams Switch Independent The QLogic Smart Load Balancing type of team allows two to eight physic...

Page 221: ...supports connecting the teamed ports to hubs and switches if they are on the same broadcast domain It does not support connecting to a router or Layer 3 switches because the ports must be on the same...

Page 222: ...ng MAC Address No Outbound Load Balancing using IP Address Yes Multivendor teaming Supported Must include at least one QLogic Ethernet adapter as a team member Applications Generic trunking works with...

Page 223: ...iverted to other ports in the team Network Communications The following are the key attributes of Dynamic Trunking Failover mechanism Link loss detection Load Balancing Algorithm Outbound traffic is b...

Page 224: ...c through that team member Later if that team member begins to detect a response from a probe target this indicates that the link has been restored and the teaming software automatically resumes passi...

Page 225: ...eConsole GUI Number of teams Maximum 16 Number of adapters per team Maximum 16 Hot replace Yes Hot add Yes Hot remove Yes Link speed support Different speeds b Frame protocol All Incoming packet manag...

Page 226: ...ifferent speeds Frame protocol All Incoming packet management Switch Outgoing packet management QLASP Failover event Loss of link only Failover time 500 ms Fallback time 1 5 s approximate a MAC addres...

Page 227: ...mbers or changing advanced settings of a team member make sure each team member has been configured similarly Settings to check include VLANs and QoS Packet Tagging Jumbo Frames and the various offloa...

Page 228: ...d would not benefit from a software only implementation An adapter that supports Checksum Offload advertises this capability to the operating system so that the checksum does not need to be calculated...

Page 229: ...ns to support Virtual Bridged Local Area Network tagging on Ethernet networks as specified in the IEEE 802 1Q specification The VLAN protocol permits insertion of a tag into an Ethernet frame to ident...

Page 230: ...General Network Considerations Teaming with Microsoft Virtual Server 2005 Teaming Across Switches Spanning Tree Algorithm Layer 3 Routing Switching Teaming with Hubs for troubleshooting purposes only...

Page 231: ...the Interconnect cable in place These scenarios describe the behavior of teaming across the two switches and the importance of the interconnect link The diagrams show the secondary team member sending...

Page 232: ...connectivity Consider a cable disconnect on the Top Switch port 4 In this case Gray would send the ICMP Request to Red 49 C9 but because the Bottom switch has no entry for 49 C9 in its CAM Table the...

Page 233: ...each other without any problems Note the additional entries in the CAM table for both switches The link interconnect is critical for the proper operation of the team As a result it is highly advisable...

Page 234: ...derations 206 83840 546 00 E Figure 15 5 represents a failover event in which the cable is unplugged on the Top Switch port 4 This is a successful failover with all stations pinging each other without...

Page 235: ...that you do not run into a loop situation when you have redundant paths in your network STP detects disables network loops and provides backup links between switches or bridges It allows the device to...

Page 236: ...a port going to forwarding it sends a TCN to the root bridge through its root port The root bridge then advertises a BPDU with a Topology Change to the entire network This causes every bridge to redu...

Page 237: ...or 100Mbps switched network configuration Hub bandwidth is shared among all connected devices as a result when more devices are connected to the hub the bandwidth available to any single device conne...

Page 238: ...without affecting the network Clients could be connected directly to the hub and fault tolerance would still be maintained server performance however would be degraded Figure 15 6 Team Connected to a...

Page 239: ...the private adapter and usually resides on a separate private subnetwork The other adapter is used for client communications and is referred to as the public adapter Multiple adapters may be used for...

Page 240: ...and two public On each node the two public adapters are teamed and the private adapter is not Teaming is supported across the same switch or across two switches Figure 15 8 shows the same 2 node Fibr...

Page 241: ...ement of the nodes in the cluster It can also be used for job scheduling and monitoring In our current HPCC offerings only one of the on board adapters is used If Myrinet or IB is present this adapter...

Page 242: ...00 E Oracle In our Oracle Solution Stacks we support adapter teaming in both the private network interconnect between RAC nodes and public network with clients or the application layer above the data...

Page 243: ...he network link bandwidth thus impacting production data and tape backup performance Network backups usually consist of a dedicated backup server running with tape backup software such as NetBackup Ga...

Page 244: ...tape backup server to reliably use adapter performance and network bandwidth when backing up clients a network infrastructure must implement teaming such as load balancing and fault tolerance Data cen...

Page 245: ...ent Server Blue through an G ARP to update its ARP cache to reflect the backup server Adapter B MAC address When Client Server Blue needs to transmit data it uses either one of its adapter interfaces...

Page 246: ...the data can no longer be sent from Switch 1 to the Adapter A interface on the backup server the data is redirected from Switch 1 through Switch 2 to the Adapter B interface on the backup server This...

Page 247: ...upported it is recommended that all adapters in a team be the same speed either all Gigabit Ethernet or all Fast Ethernet For speeds of 10Gbps it is highly recommended that all adapters in a team be t...

Page 248: ...tion network to a production network it is strongly recommended to test again for failover and fallback 15 Test the performance behavior of the team before placing into a production environment 16 Net...

Page 249: ...network protocols are load balanced when in a team Answer QLogic s teaming software only supports IP TCP UDP traffic All other traffic is forwarded to the primary adapter Question Which protocols are...

Page 250: ...ms that can be configured on the same server Answer Up to 16 teams can be configured on the same server Question Why does my team loose connectivity for the first 30 to 50 seconds after the Primary ad...

Page 251: ...I am currently using Answer In all operating systems the most accurate method for checking the driver revision is to physically locate the driver file and check the properties Question Can SLB detect...

Page 252: ...ntermediate or teaming driver Base Driver Physical Adapter Miniport The base driver is identified by source L2ND Table 15 7 lists the event log messages supported by the base driver explains the cause...

Page 253: ...configured for 10Mb half duplex link The adapter has been manually configured for the selected line speed and duplex settings No action is required 7 Informational Network controller configured for 10...

Page 254: ...ll the interrupt handler Reboot the operating system remove other device drivers that may be sharing the same IRQ 15 Error Unable to map IO space The device driver can not allocate mem ory mapped I O...

Page 255: ...for 10Gb full duplex link The adapter has been manually configured for the selected line speed and duplex settings No action is required 22 Error Network controller failed initialization because it c...

Page 256: ...cannot cre ate a device instance Reboot the operating system 4 Error Unable to create sym bolic link for the man agement interface Another driver has cre ated a conflicting device name Unload the con...

Page 257: ...ported operating system or update the driver 13 Informational Hot standby adapter is selected as the pri mary adapter for a team without a load balancing adapter A standby adapter has been activated R...

Page 258: ...tion with the remote target s for the LiveLink enabled team member has been established or restored No action is required 20 Informational The LiveLink feature in QLASP disconnected the link for the n...

Page 259: ...action is required 5 Informational Network controller configured for 10Mb full duplex link The adapter has been manually configured for the selected line speed and duplex set tings No action is requi...

Page 260: ...amount of physical memory installed and replace the adapter 12 Informational Driver initialized suc cessfully The driver has suc cessfully loaded No action is required 13 Error Driver initialization f...

Page 261: ...cing and Failover with Auto Fallback Enabled SLB Link Aggregation 802 3ad Generic Trunking FEC GEC 802 3ad Draft Static SLB with Auto Fallback Disable For more information on network adapter teaming c...

Page 262: ...pter team member connections due to failure of the adapter cable switch port or switch where the teamed adapters are attached to separate switches the load distribution is reevaluated and reassigned a...

Page 263: ...n team If the link partner is not correctly configured for 802 3ad link configuration errors are detected and noted With this mode all adapters in the team are configured to receive packets for the sa...

Page 264: ...tatically through user configuration software The Generic Trunking FEC GEC 802 3ad Draft Static type of team supports load balancing and failover for both outbound and inbound traffic SLB Auto Fallbac...

Page 265: ...1 Smart Load Balancing Operating System Protocol Failover Fallback All QLogic Failover Fallback Multivendor IP IPX NetBE UI IP IPX NetBE UI Windows Server 2008 Y Y N S Y N N S Windows Server 2008 R2...

Page 266: ...runking type of team requires the Ethernet switch to support some form of port trunking mode for example Cisco s Gigabit EtherChannel or other switch vendor s Link Aggregation mode The Generic Trunkin...

Page 267: ...in your system QLogic 8400 3400 Series User Diagnostics also allows you to update device firmware and to view and change settings for available adapter properties To run QLogic 8400 3400 Series User D...

Page 268: ...device Specifies the adapter device to test Similar to dev for back ward compatibility uediag cof Allows tests to continue after detecting a failure uediag dev device Specifies the adapter device to...

Page 269: ...uediag I iteration Specifies the number of iterations to run on the selected tests uediag idmatch Enables matching of VID DID SVID and SSID from the image file with device IDs Used only with fnvm raw...

Page 270: ...cription Number Name Group A Basic Functional Tests A1 Register Verifies that registers accessible through the PCI PCIe interface implement the expected read only or read write attributes by attemptin...

Page 271: ...uses an MSI message to be DMA d to host memory A negative test is also performed to verify that when an MSI is masked it does not write an MSI message to host memory A6 Memory BIST Invokes the interna...

Page 272: ...ixed data patterns are used to ensure that no memory bit is stuck high or low while the walking zeroed ones and address tests are used to ensure that memory writes do not corrupt adja cent memory loca...

Page 273: ...frame and the checksum CRC offload logic In this test packets are submitted to the chip as if they were received over Ethernet and the TPAT block cracks the frame identifying the TCP IP and UDP heade...

Page 274: ...C11 FIO Events Verifies that the event bits in the CPU s Fast IO FIO interface are triggering correctly when a particular chip events occur such as a VPD request initiated by the host an expansion RO...

Page 275: ...maintained by the chip is correct by enabling MAC loopback mode and sending Layer 2 packets of various sizes The adapter should not be connected to a network D6 RPC Verifies the Receive Path Catch up...

Page 276: ...ernal external diagnostics where packet information is transmitted across the physical link for instructions and information on running tests in an MS DOS environment see Chapter 18 Troubleshooting QC...

Page 277: ...re install the diagnostic software 6 Contact your hardware vendor QCC Network Test Failures Typically the QCC network test failures are the result of a configuration problem on the network or with the...

Page 278: ...s and change them if they are in conflict with another device Verify that your server is using the latest BIOS Try inserting the adapter in another slot If the new position works the original slot in...

Page 279: ...27 3 bnx2fc fcoe libfcoe scsi_transport_fc 55235 3 bnx2fc fcoe libfc bnx2i 53488 11 cnic 86401 6 bnx2fc bnx2i libiscsi 47617 8 be2iscsi bnx2i cxgb4i cxgb3i libcxgbi ib_iser iscsi_tcp libis csi_tcp scs...

Page 280: ...cally removing a NIC that was part of a team and then rebooting the team did not perform as expected Solution To physically remove a teamed NIC from a system you must first delete the NIC from the tea...

Page 281: ...a team member supports underlying management software ASF UMP the link may be maintained on the switch for the adapter despite its driver being disabled This may result in the switch continuing to pa...

Page 282: ...to discard packets inside the on chip receive buffers in the case a particular host queue is depleted the on chip receive buffers will rarely be depleted therefore it may appear that flow control is n...

Page 283: ...I Configuration tab Problem In Windows Server 2008 R2 if the OS is running as an iSCSI boot OS the VolMgr error The system could not successfully load the crash dump driver appears in the event log So...

Page 284: ...Microsoft hotfix see Microsoft knowledge base article KB952942 at http support microsoft com kb 952942 Problem The network adapter has shut down and an error message appears indicating that the fan o...

Page 285: ...ector as described in Table A 2 The QCC GUI also provides information about the status of the network link and activity Table A 1 Network Link and Activity Indicated by the RJ 45 Port LEDs Port LED LE...

Page 286: ......

Page 287: ...Red Hat RHEL and CentOS are service marks or registered trademarks of Red Hat Inc PCIe is a registered trademark of PCI SIG Corporation Alteon is a registered trademark of Nortel Networks Inc Citrix a...

Search results

Summary of Contents for FastLinQ 3400 Series

Reviews:

Related manuals for FastLinQ 3400 Series

Brands by name

Popular brands

Qlogic FastLinQ 3400 Series, User Manual

Search results

Summary of Contents for FastLinQ 3400 Series

Reviews:

Related manuals for FastLinQ 3400 Series

Brands by name

Popular brands