background image

1–Product Overview
Adapter Specifications

1-12

FE0254601-00 A

Adapter Specifications

The QLogic 8100 Series Adapters provide high-performance server connectivity 
to SAN and LAN networks. 

Table 1-5

 lists the adapter physical and electrical 

specifications.

NOTE:

Some features may not be available for all 8100 Series Converged Network 
Adapters. Refer to the data sheet for the a list of adapter models and 
supported features.

Table 1-5. Physical and Electrical Specification

Specification

Description

Ports

Single-port or dual-port 10Gbps Ethernet. Pluggable SFPs 
(SFP+) for enhanced serviceability.

Transceivers

SFP+ pluggable:

QLogic supported active and passive copper cables with 
transceivers

QLogic optical short range (SR)—300 meter maximum 
cable length

Table 1-6

 shows the adapter models and supported 

transceivers.

Form Factor

Low-profile PCIe card. The adapter ships with a full-height 
bracket for use in a standard PCIe slot, or an optional spare 
low-profile bracket for use in a low-profile PCIe slot. 
Low-profile slots are typically found in compact servers.

Power Consumption

Approximately 7-10 Watts (typical) for dual-port QLogic 8100 
Series Adapters

Bus Interface

PCIe interface with eight lanes. The adapter operates in one 
of the following modes

PCIe Gen 1 x8 mode, 250MBps per lane

PCIe Gen 2 x4 mode, 500MBps per lane

QLogic adapters can automatically train a PCIe Gen 2 x8 
slot to use the slot as a PCIe Gen 2 x4 slot, where four lanes 
of the PCIe Gen 2 x8 slot are powered off to save power and 
maximize performance.

Summary of Contents for QConvergeConsole CLI 8100 Series

Page 1: ...FE0254601 00 A User s Guide Converged Network Adapter 8100 Series...

Page 2: ...erves the right to change product specifications at any time without notice Applications described in this document for any of these products are for illustrative purposes only QLogic Corporation make...

Page 3: ...Adapters xxiii EMI and EMC Requirements xxiv CNS 13438 Class A QLE8xxx xxiv MIC Class A QLE81xx xxv Product Safety Compliance xxv Quick Start Installation Instructions xxvii Step 1 Verify the Package...

Page 4: ...s 3 2 Installing Hardware 3 4 Install the Adapter 3 5 Verify the Adapter Installation 3 6 Installing Software 3 7 Creating the Driver Disk or Extracting the Driver File into a Folder 3 8 Identifying U...

Page 5: ...indows Installation 3 46 Passive Windows Installation 3 46 Overwrite Previous Windows Installations 3 47 Starting the QConvergeConsole CLI 3 47 4 Installation in a Linux Environment Overview 4 1 Syste...

Page 6: ...vSphere Client 5 12 Configuring the Driver Parameters 5 15 Configuring a Hard Drive in a Virtual Machine 5 18 Configuring a Network Adapter in a Virtual Machine 5 24 Deploying NPIV for VMware ESX ESXi...

Page 7: ...Dependent Bonding 6 41 Bonding Prerequisites 6 41 Ethernet Channel Bonding Driver 6 42 Bonding Driver Parameters 6 42 Loading the Bonding Driver 6 45 Unloading the Bonding Driver 6 46 Changing Bonding...

Page 8: ...d Network Adapter Requirements 7 16 FCoE Switch Requirements 7 16 Storage Array Requirements 7 16 Boot from SAN Configuration 7 17 Boot from SAN Topologies 7 17 Single Path Configuration 7 18 Multipat...

Page 9: ...s 8 30 Host Server Requirements 8 30 Converged Network Adapter Requirements 8 31 FCoE Switch Requirements 8 31 Storage Array Requirements 8 32 Boot from SAN Configuration Topologies 8 32 Single Path T...

Page 10: ...talling FlasUTIL 9 13 Using FlasUTIL 9 14 Installing the Multi boot Image 9 15 EFIUTIL 9 16 A Adapter Port LEDs B Cisco Nexus 5000 Series Switch Configuration Enable FCoE on the Switch B 2 Create and...

Page 11: ...8100 Series Adapter Device Entries 3 15 3 14 Installing an FCoE Driver 3 15 3 15 Typical QLogic 8100 Series Adapter Port Entry 3 15 3 16 Updating an FCoE Driver 3 16 3 17 Confirming the FCoE Adapter 3...

Page 12: ...allation Status 3 42 3 55 Install the QConvergeConsole Enable SSL Feature 3 42 3 56 Install the QConvergeConsole Install Complete Notification 3 43 3 57 QConvergeConsole Main Window on the Server Wher...

Page 13: ...lecting Browse Datastore 5 5 5 6 Creating a Temporary Folder in Which to Store the Driver ISO Files 5 6 5 7 Opening the Temporary Driver Folder 5 6 5 8 Uploading Drivers 5 6 5 9 Verifying Adapter Driv...

Page 14: ...SS Status Windows 2008 6 11 6 6 Enabling RSS Windows 2008 6 11 6 7 Enabling RSS Windows Advanced Properties 6 12 6 8 Disable RSS Windows 2008 6 13 6 9 Disable RSS Per Port 6 14 6 10 Enabling or Disabl...

Page 15: ...rs 8 12 8 4 Fast UTIL Adapter Settings 8 13 8 5 Fast UTIL Advanced Adapter Settings 8 14 8 6 Locating QLogic 8100 Adapter PCI Devices 8 20 8 7 Identifying the Adapter Port PCI Device ID 8 20 8 8 Ident...

Page 16: ...s for Windows 6 5 6 2 NIC Driver Parameters for Linux 6 29 6 3 Sysfs Locations and Parameters 6 34 6 4 Linux Bonding Driver Parameters 6 42 7 1 Driver Parameters 7 1 7 2 Operation Mode Values 7 5 8 1...

Page 17: ...les 8 53 8 23 Set Device Command Timeout Utility Command Options 8 54 8 24 Set Device Command Timeout Utility Command Examples 8 55 8 25 Set Device Command Timeout Utility Main Menu Options 8 56 8 26...

Page 18: ...xviii FE0254601 00 A User s Guide Converged Network Adapter 8100 Series Adapters...

Page 19: ...Network Adapter including hardware components software components and adapter specifications Section 2 describes the QLogic 8100 Series Converged Network Adapter management tools including the QConver...

Page 20: ...ppendix C describes the use of the Brocade FCoE switch CLI to configure the switch port as a virtual Fibre Channel port Intended Audience This guide is intended for those responsible for deploying QLo...

Page 21: ...mmand line text For example To return to the root directory from anywhere in the file structure Type cd root and press ENTER Enter the following command sh install bin Key names and key strokes are in...

Page 22: ...ining for technical professionals for all iSCSI Converged Network InfiniBand and Fibre Channel products From the main QLogic web page at www qlogic com click the Support tab at the top then click the...

Page 23: ...signed and manufactured according to IEC60825 1 on the safety label of laser product Class 1 Laser Product Caution Class 1 laser radiation when open Appareil laser de classe 1 Do not view directly wit...

Page 24: ...est conform la norme NMB 003 du Canada CE Mark 2004 108 EC EMC Directive compliance EN55022 2006 A1 2007 CISPR22 2006 Class A QLE8xxx EN55024 1998 EN61000 3 2 Harmonic Current Emission EN61000 3 3 Vol...

Page 25: ...2nd Edition 2007 03 3 27 UL CSA C22 2 60950 1 07 2nd Edition Use only with listed ITE or equivalent Complies with 21 CFR 1040 10 and 1040 11 2006 95 EC low voltage directive QLogic 8100 Series Conver...

Page 26: ...Preface Legal Notices xxvi FE0254601 00 A...

Page 27: ...e you need to open the computer and locate the appropriate bus slot If necessary consult your computer system manual for instructions to remove the computer cover Follow these steps to install the ada...

Page 28: ...nsceivers sold by QLogic For copper connectivity see the list of approved copper cables on QLogic s Web site http www qlogic com Resources Documents LineCards Copper_Cabl es_Support_Matrix_Line_Card p...

Page 29: ...d your operating system and then click Go The product download page opens 3 On the download page under Management Tools select QConvergeConsole and download it to your system 4 Follow the instructions...

Page 30: ...Quick Start Additional Resources xxx FE0254601 00 A...

Page 31: ...capabilities of a Fibre Channel adapter and an Ethernet NIC A Converged Network Adapter provides simultaneous Fibre Channel and Ethernet traffic over a shared 10Gb Ethernet link Deploying Converged N...

Page 32: ...L Enhanced transmission selection 802 1Qaz Standard Ethernet with these enhancements is known as enhanced Ethernet EE converged enhanced Ethernet CEE lossless Ethernet or data center Ethernet DCE What...

Page 33: ...pter appears to the operating system as two separate adapters Figure 1 2 Combined SAN and LAN Function on One Converged Network Adapter The 8100 Series Adapter boosts system performance with 10Gbps sp...

Page 34: ...lly as TCP IP and storage networking traffic in this case FCoE to the switch The FCoE switch routes data networking traffic to the existing Ethernet networking cloud of switches and routers The FCoE s...

Page 35: ...because of the translation capability of the switch Figure 1 3 FCoE Deployment Hardware Components A typical 8100 Series Adapter has the following major components1 ASIC reduced instruction set compu...

Page 36: ...at runs the FCoE and NIC protocols The Converged Network Controller also interfaces with the PCIe host bus and controls the I O operations of the adapter Flash 4MB nonvolatile memory or Flash memory I...

Page 37: ...c approved copper cables visit http www qlogic com Resources Pages Resources aspx and select Cable Support LEDs Light emitting diodes indicate the real time status of the adapter Each port has two LED...

Page 38: ...Network Adapters support PXE boot for servers with BIOS and unified extensible firmware interface UEFI capabilities and boot from SAN for servers with BIOS UEFI and FCode capabilities Operating System...

Page 39: ...gement tools and utilities including the following QConvergeConsoleTM Web Management Graphical User Interface GUI which is used to configure and manage QLogic Fibre Channel adapters Intelligent Ethern...

Page 40: ...by the Linux bonding driver NIC management is fully integrated with Linux tools such as ethtool ifconfig and vconfig QConvergeConsole Web Management GUI QConvergeConsole CLI Windows Red Hat RHEL Novel...

Page 41: ...mware EDC PHY firmware 815x series only Utilities FlasUTIL VPD Util EFI Util FlasUTIL is a DOS based utility that updates the Flash image on the adapter This utility is invoked through the update bat...

Page 42: ...er cables with transceivers QLogic optical short range SR 300 meter maximum cable length Table 1 6 shows the adapter models and supported transceivers Form Factor Low profile PCIe card The adapter shi...

Page 43: ...ter port will function however QLogic provides no warranty or technical support for this configuration Unsupported c c The adapter port will not function QLE8140 SR QLE8142 SR Unsupportedb Unsupported...

Page 44: ...with existing Fibre Channel driver stack and legacy applications Features Overlapping protection domains OPD Out of order frame re assembly OoOFR Intelligently interleaved direct memory access iiDMA P...

Page 45: ...EE 1149 1 JTAG IPv4 Specification RFC 791 IPv6 Specification RFC 2460 TCP UDP Specification RFC 793 768 ARP Specification RFC 826 Enhanced Ethernet Priority based flow control 802 1Qbb rev 0 Enhanced...

Page 46: ...support QLogic 8100 Series Adapters qlremote and netqlremote Agent software that allows the remote management of QLogic adapters with the QConvergeConsole web management interface QLogic FC HBA API SN...

Page 47: ...e QConvergeConsole through a browser either locally on the server or remotely from another computer Your browser window becomes the client used to connect to servers that host the QLogic adapters and...

Page 48: ...ariety of file formats E mail notifications QConvergeConsole can automatically send notifications with a copy of the current host configuration to an e mail distribution list thus enabling the informa...

Page 49: ...refer to the QConvergeConsole CLI User s Guide for your adapter model and target operating system version at http driverdownloads qlogic com Offline Utilities The QLogic 8100 Series Converged Network...

Page 50: ...lity provides a UEFI shell into the server manufacturer s boot up menu interface which configures advanced adapter features including boot from SAN EFIUTIL This utility installs the multi boot image i...

Page 51: ...ws Server 2008 Server Core Architecture Support IA 32 x86 Intel64 AMD64 x64 Refer to the Read Me file provided with the QLogic 8100 Series Adapter multi flash image or Windows driver for a complete li...

Page 52: ...c 814x Series Adapters operate only with optical transceivers sold by QLogic QLogic 815x Series Adapters ship with empty SFP cages that support active and passive copper cables for connecting to an FC...

Page 53: ...lumn 5 In the selection list click on the adapter model number in the second column 6 In the third column click the version of the Microsoft Windows operating system that is installed on the server Fo...

Page 54: ...greement and then click Agree 10 When prompted click Save to save the driver file to your workstation Installing Hardware CAUTION To minimize the risk of Electrostatic Discharge ESD damage use a works...

Page 55: ...ots for the SFP transceivers and LEDs e Fasten the half height bracket using the screws provided f Reinstall each SFP transceiver Press the transceiver into the port until it clicks in place 3 Power o...

Page 56: ...and that it can be recognized as a PCIe device by the server 1 While the host server is booting verify that the adapter BIOS banner appears without errors Some servers may require that you press the...

Page 57: ...rmation on configuring boot from SAN refer to Boot from SAN on page 7 15 3 For unified extensible firmware interface UEFI servers boot into the UEFI shell and enter the drivers command to verify that...

Page 58: ...evice ID identifies device types within devices for the same vendor For the QLogic 8100 Series Adapter the device IDs are 8000 NIC function and 8001 FCoE function For Microsoft Windows unless a valid...

Page 59: ...n 1 Right click on the My Computer icon on the desktop or in the Start menu and then select Manage 2 Select Device Manager in the left pane 3 In the right pane under Other Devices right click on any d...

Page 60: ...rface For information about installing the QConvergeConsole Web Management Interface refer to the QConvergeConsole User s Guide For information about determining the currently installed QLogic driver...

Page 61: ...he QLogic adapter NIC function that is listed as Ethernet Controller under this section Figure 3 7 shows typical entries for a dual port QLogic 8100 Series Adapter For information about identifying QL...

Page 62: ...er this section Figure 3 9 shows typical entries for a dual port QLogic 8100 Series Adapter Figure 3 9 Typical QLogic 8100 Series Ethernet Adapter Port Entries b To update the driver right click Ether...

Page 63: ...elect Install from a list or specific location Advanced and then click Next 9 Click Have Disk and then navigate to the folder containing the extracted QLogic NIC driver that you downloaded in Download...

Page 64: ...procedure for each port To install the FCoE driver 1 Install the adapter as described in Installing Hardware on page 3 4 2 After the Microsoft Windows operating system has completed booting up log on...

Page 65: ...o install the driver right click Fibre Channel Controller and then click Update Driver Figure 3 14 Figure 3 14 Installing an FCoE Driver 6 If you are updating QLogic adapter drivers a Click SCSI and R...

Page 66: ...tion Advanced and then click Next 9 Click Have Disk and then navigate to the folder containing the extracted QLogic FCoE driver that you downloaded in Downloading QLogic Drivers on page 3 2 10 Select...

Page 67: ...4 2 After the Microsoft Windows operating system has completed booting up log on to the server as the Administrator 3 Right click on the My Computer icon on the desktop or in the Start menu and then s...

Page 68: ...ers a Click Network Adapters for NIC drivers Find each port of the QLogic adapter NIC function that is listed as QLogic10Gb PCI Ethernet Adapter under this section Figure 3 20 shows typical entries fo...

Page 69: ...Driver Software Wizard 8 In the Update Driver Software Ethernet Controller dialog box click Browse and then navigate to the folder containing the QLogic NIC driver that you downloaded earlier Click Ne...

Page 70: ...ing system has completed booting up log on to the server as the Administrator 3 Right click on the My Computer icon on the desktop or in the Start menu and select Manage 4 In the Server Management win...

Page 71: ...QLogic adapter drivers a Click Storage controllers for FCoE drivers Find each port of the QLogic adapter FCoE function that is listed as QLogic FCoE Adapter under this section Figure 3 26 shows typica...

Page 72: ...re Wizard 8 In the Update Driver Software Ethernet Controller dialog box click Browse and then navigate to the folder containing the QLogic FCoE driver that you downloaded earlier Figure 3 29 Click Ne...

Page 73: ...g and Updating Drivers Using the Windows SuperInstaller The Windows SuperInstaller provides the following tasks and functions Driver pre installation Driver installation Driver updates Multiple instal...

Page 74: ...ick Go 8 Under Drivers click the download link for the Windows SuperInstaller Figure 3 32 On the same page review the Readme file which describes how to install and use the Windows SuperInstaller The...

Page 75: ...r 2003 Installation with the Converged Network Adapter as Boot Device for FCoE Driver Only To install Windows Server 2003 on the boot from SAN disk attached to the QLogic Converged Network Adapter 1 S...

Page 76: ...Insert Driver Disk 6 Windows displays a list of drivers found on the disk Figure 3 35 Select QLogic FCoE Adapter and then press ENTER Figure 3 35 Select QLogic FCoE Adapter NOTE Windows Server 2003 do...

Page 77: ...ue with the standard Windows Server 2003 installation procedure For more information about the other QLogic BIOS configurations required to enable a server to boot from SAN refer to Boot from SAN on p...

Page 78: ...FE0254601 00 A 3 When prompted to indicate the type of installation Figure 3 37 click Custom advanced Figure 3 37 Windows Installation Type 4 When prompted to indicate where to install Windows Figure...

Page 79: ...insert the QLogic driver disk 3 5 inch disk USB memory stick CD DVD ROM click Browse and then select the drive containing the QLogic driver disk Figure 3 39 Insert the Driver Disk 6 Windows Setup pres...

Page 80: ...ormation about the other QLogic BIOS configurations required to enable a server to boot from SAN refer to Boot from SAN on page 7 15 Removing the Driver To remove the driver from the Microsoft Windows...

Page 81: ...cates an unhealthy state Figure 3 42 shows a dual port QLogic 8100 adapter in Device Manager Windows 2008 when the FCoE and NIC drivers are installed and the Network Adapters and Storage Controllers s...

Page 82: ...s Figure 3 43 Figure 3 43 Network Adapters and Storage Controllers d In the Properties dialog box click the Driver tab and find the field Driver Version field Figure 3 44 shows an example of a NIC ada...

Page 83: ...es To update the firmware you must update the boot code on the QLogic 8100 Series Adapters QLogic publishes one boot code for all operating systems and QLogic 8100 Series Adapter models Obtaining the...

Page 84: ...multi boot image to a temporary location on your workstation Determining the Installed Firmware Version Use the QConvergeConsole GUI or QConvergeConsole CLI to determine the firmware version of the Q...

Page 85: ...web management GUI in the left pane expand the host to view the connected adapters 2 Select the port QLogic 8100 Series Adapter for which to determine the installed firmware version The HBA Info tabb...

Page 86: ...tal Product Data VPD list Figure 3 48 Displaying the Multi boot Image Version Upgrading the Firmware Boot Code Using QConvergeConsole GUI or QConvergeConsole CLI Firmware is updated for the adapter an...

Page 87: ...for the adapter the unacceptable Flash data file message displays Re select a valid file and click OK The Security Check dialog box appears 7 In the Enter Password box type the password and then clic...

Page 88: ...are Version on page 3 34 For information about using QLogic offline utilities see Section 9 Installing Management Tools QLogic 8100 Series Adapters can be managed with QLogic tools requiring a separat...

Page 89: ...Logic Web site http driverdownloads qlogic com 2 Click QLogic Products 3 In the selection box Figure 3 50 click Converged Network Adapters in the left column your adapter model number in the middle co...

Page 90: ...remotely from another computer From the main window you can connect to servers that host QLogic adapters and devices you want to manage Perform the following steps to install the QConvergeConsole on y...

Page 91: ...talled a message prompts whether you want to install Tomcat on your system Figure 3 52 Figure 3 52 Install the QConvergeConsole Install Tomcat on Your System 3 Click Yes The Pre Installation Summary d...

Page 92: ...tion status Figure 3 54 Figure 3 54 Install the QConvergeConsole Installation Status A message prompts you to confirm that you want to enable the Secure Socket Layer SSL feature which allows you to ru...

Page 93: ...NIC and FCoE to remotely manage the server in which your adapter is physically installed These agents can be installed using the Windows SuperInstaller found on the download sections for your specific...

Page 94: ...eConsole Resides To open QConvergeConsole from a remote computer Enter the IP address of the QConvergeConsole server followed by the access port and application name in the browser s address bar using...

Page 95: ...Management Tools FE0254601 00 A 3 45 Figure 3 58 Entering QConvergeConsole Web Address Example The initial main menu of the QConvergeConsole opens as shown in Figure 3 59 Figure 3 59 QConvergeConsole...

Page 96: ...ication is Program files QLogic Corporation QCCCLI If you want a different directory type it in the command line For example QCCCLI msi installdir directory The preceding command installs the QConverg...

Page 97: ...rmation Type QCCCLI msi i forceinstall true Starting the QConvergeConsole CLI You can start the QLogic 8100 Series Converged Network Adapter in Windows in the following ways Double click the QCCCLI ic...

Page 98: ...3 Installation in a Windows Environment Installing Management Tools 3 48 FE0254601 00 A...

Page 99: ...c adapter products are certified with products from leading converged networking switch and server vendors For product level interoperability information visit http www qlogic com Interoperability Pag...

Page 100: ...CoE switch QLogic 814x Series Adapters operate only with optical transceivers sold by QLogic QLogic 815x Series Adapters ship with empty SFP cages that support active and passive copper cables for con...

Page 101: ...f height bracket using the screws provided f Reinstall the SFP transceivers back by pressing them in until the transceivers clicks 3 Power off the computer and all attached devices such as monitors pr...

Page 102: ...n in a Linux Environment Installing Hardware 4 4 FE0254601 00 A 11 Connect the other end of the Ethernet cable to a supported switch 12 Plug in the power cables and power up the server Figure 4 1 Adap...

Page 103: ...nfirm that the adapter is seated properly If necessary install the adapter in another available PCIe x8 slot If the BIOS banner still does not appear verify that the adapter is compatible with the ser...

Page 104: ...ver qla2xxx The QLogic 8100 Series Adapter FCoE drivers are included inbox or in kernel with all supported versions of RHEL 5 except RHEL 5 3 QLogic releases asynchronous updates to inbox drivers peri...

Page 105: ...3 Select an Adapter and a Linux Operating System 7 Under Drivers click the download link FC FCoE Adapter Driver for RHEL 5 x Figure 4 4 Figure 4 4 Download the FCoE Adapter Driver 8 Read the QLogic li...

Page 106: ...that contains the required packages In this example the RHEL 5 installation DVD is mounted and available at media RHEL 5 4 x86_64 DVD cd media RHEL 5 4 x86_64 DVD Server 12 Enter the following comman...

Page 107: ...ute the build sh script to compile the driver modules from the source code extras build sh install The build sh script does the following Builds the QLogic FCoE driver ko files Copies the ko files to...

Page 108: ...out a reboot by unloading and loading the driver using the modprobe utility 1 To unload the driver using the modprobe utility type the following command modprobe r qla2xxx The following error message...

Page 109: ...binaries for RHEL 5 3 To download create and install a DD Kit for RHEL 5 3 on the SAN 1 Go to the QLogic Web site http driverdownloads qlogic com 2 Click QLogic Products 3 Click Adapters 4 In the sele...

Page 110: ...to save the DD Kit file to a temporary location on the hard drive The compressed file contains the driver binaries in ISO image format The file name has the following format qla2xxx x xx xx xx xx xx k...

Page 111: ...the optical drive and power up the server The system boots from the CD and stops at the boot prompt Figure 4 9 Figure 4 9 RHEL 5 3 Boot Screen 15 At the boot prompt press the F2 16 In the Installer B...

Page 112: ...5 3 CD DVD into the optical drive Press ENTER continue 22 Follow the instructions to complete the operating system installation process For information about additional configuration that may be requi...

Page 113: ...4 11 Select an Adapter and a Linux Operating System 7 Under Drivers click the download link Converged Network Adapter Networking Driver Figure 4 12 Figure 4 12 Download the Networking Driver 8 Read t...

Page 114: ...he RHEL 5 installation DVD is mounted and available at media RHEL 5 4 x86_64 DVD cd media RHEL 5 4 x86_64 DVD Server 12 Enter the following commands in order to compile each package and preserve depen...

Page 115: ...Builds the QLogic networking driver ko files Copies the ko file to the appropriate lib modules Kernel_version kernel drivers net ql ge directory Figure 4 13 shows the make install command execution l...

Page 116: ...llowing command modprobe r qlge The following error message indicates that the unload operation failed because the server is engaged in I O operations through the QLogic adapter or another module is d...

Page 117: ...xx scsi_transport_fc sd_mod The following example lists the kernel modules for the QLogic networking driver lsmod grep qlgc qlge 129881 0 2 Verify the QLogic adapter driver versions You can use sysfs...

Page 118: ...from SAN configuration the FCoE driver qla2xxx cannot be uninstalled because the server accesses the operating system image over the SAN through the adapter Attempts to remove the FCoE driver could di...

Page 119: ...OS drivers UEFI drivers and offline utilities To update the firmware you must update the boot code on the QLogic 8100 Series Adapters QLogic publishes one boot code for all operating systems and 8100...

Page 120: ...Firmware Version Using the QConvergeConsole Use QConvergeConsole GUI or QConvergeConsole CLI to determine the firmware version of the QLogic adapter installed in the server For information about inst...

Page 121: ...are Version 3 Expand the Port node and select the FCoE port NOTE Ignore the driver firmware version listed under Information it is not related to the installed adapter firmware version QLogic 8100 Ser...

Page 122: ...cat sys class scsi_host hostX fw_version 5 03 02 8d4 To display the MPI firmware version log in as root and type the following command cat sys class scsi_host hostX mpi_version 1 40 00 10400 Upgradin...

Page 123: ...reads the multi boot image to determine the version information of the image file A dialog box presents the current multi boot image version and the boot code version This is not the firmware version...

Page 124: ...Firmware Version on page 4 22 For information about using QLogic offline utilities refer to Section 9 Management Tool Installation QLogic 8100 Series Adapters can be managed with QLogic utilities or...

Page 125: ...Click QLogic Products 3 Click Adapters 4 In the selection list click Converged Network Adapters in the first column 5 In the selection list click on the adapter model number in the second column 6 In...

Page 126: ...ux environment 1 Open the directory containing the installer QConvergeConsole_Installer_ version bin Figure 4 20 Figure 4 20 Install the QConvergeConsole Directory Containing Installer 2 From the Term...

Page 127: ...nstalls QConvergeConsole in the directory opt QConvergeConsole_Installer Figure 4 23 Figure 4 23 Install the QConvergeConsole Installer Extracts FIles The InstallAnywhere window prepares to install th...

Page 128: ...vironment Management Tool Installation 4 30 FE0254601 00 A The Pre Installation Summary dialog box Figure 4 25 opens Figure 4 25 Install the QConvergeConsole Pre Installation Summary 6 Read the inform...

Page 129: ...Linux Environment Management Tool Installation FE0254601 00 A 4 31 During the installation the installer notifies you of the installation status Figure 4 26 Figure 4 26 Install the QConvergeConsole I...

Page 130: ...NIC andFCoE to remotely manage the server in which your adapter is physically installed These agents can be installed using the Linux SuperInstaller found on the download sections for your specific a...

Page 131: ...Console Resides To open QConvergeConsole from a remote computer Enter the IP address of the QConvergeConsole server followed by the access port and application name in the browser s address bar using...

Page 132: ...ol Installation 4 34 FE0254601 00 A Figure 4 29 Entering QConvergeConsole Web Address Example The initial main menu of the QConvergeConsole opens as shown in Figure 4 30 Figure 4 30 QConvergeConsole M...

Page 133: ...xvzf ql hba snapshot x xx tgz tar xvzf ql lun state online x x tgz tar xvzf ql set cmd timeout x x tgz 3 For each utility change to the directory listed in Table 4 2 and enter the corresponding comman...

Page 134: ...on about using the Linux utilities refer to Using the QLogic Linux Utilities on page 8 41 ql hba snapshot x xx ql hba snapshot sh ql lun state online x x ql lun state online sh i ql set cmd timeout x...

Page 135: ...ies Adapter ships with a full height bracket installed and a spare half height low profile bracket To install the half height bracket a Using the bail handle of the SFP transceivers pull out the SFP m...

Page 136: ...em manual for information about how to remove the server cover 5 Pull out the slot cover if any by removing the screw or releasing the lever 6 Grasp the adapter by the top edge and insert it firmly in...

Page 137: ...eries Adapter driver is not included with the VMware ESX ESXi4 0 operating system Therefore you must download the drivers for VMware ESX ESXi 4 0 from the QLogic Web site at http driverdownloads qlogi...

Page 138: ...ating System 6 In the Drivers table click the links that correspond to the following descriptions to download the drivers Networking driver for VMware ESX ESXi 4 0 x and 4 1 FC FCoE driver for VMware...

Page 139: ...tworking Drivers FE0254601 00 A 5 5 8 On the ESX host server in maintenance mode select the Summary tab Figure 5 4 Figure 5 4 Selecting the Summary Tab 9 Right click the storage icon and then select B...

Page 140: ...r ISO files Figure 5 6 Figure 5 6 Creating a Temporary Folder in Which to Store the Driver ISO Files 11 Click the Upload icon to upload the driver ISO files into the temporary folder Figure 5 7 Figure...

Page 141: ...ile zip update 17 Go back to the directory that contains the ISO files by issuing the following command cd vmfs volumes Storage1 esxconsole temp 18 Unmount the first ISO file from the ESX host server...

Page 142: ...he last column Figure 5 9 Verifying Adapter Driver Installation Validating Driver and Firmware Versions Use the console operating system to identify Converged Network Adapters on a VMware ESX ESXi 4 0...

Page 143: ...r FCoE adapter 3 including the current state the firmware version the driver version and the boot code version Figure 5 10 Displaying FCoE Adapter Driver Details 5 List details for the QLogic adapter...

Page 144: ...5 Installation in a VMware Environment Installing the FCoE and Networking Drivers 5 10 FE0254601 00 A Figure 5 11 Displaying Networking Adapter Driver Details...

Page 145: ...le in Figure 5 12 shows networking driver version and firmware version for adapter 3 Figure 5 12 Displaying Networking Driver and Firmware Versions Identifying QLogic Adapters Using vSphere Client You...

Page 146: ...t Network Adapters to display all network adapters as shown in Figure 5 14 Figure 5 14 Displaying Network Adapters Using the vSphere Client Configuring NIC Using the vSphere Client To configure the NI...

Page 147: ...and then click the Configuration tab 4 In the Hardware pane select Networking as shown in Figure 5 15 Figure 5 15 Configuring Networking Adapters 5 Select Add Networking in the upper right portion of...

Page 148: ...here Client 5 14 FE0254601 00 A 7 Click the vmnic associated with the QLogic adapter to be connected to the new virtual switch and then click Next Figure 5 17 Selecting the Virtual Switch 8 Modify the...

Page 149: ...made using the esxcfg module s command are preserved across system reboots To configure driver parameters 1 To list the driver parameters issue the following command esxcfg module g qla2xxx 2 To set t...

Page 150: ...the adapter The default is 0 ql2xextended_error_logging Enables 1 or disables 0 extended error logging The default is 0 ql2xiidmaenable Enables 1 or disables 0 iIDMA settings The default is 1 ql2xint...

Page 151: ...ds ql2xusedefmaxrdreq PCIe maximum read request size Adjust the PCIe maximum read request size 0 use system default 1 The default 0 ql2xusedrivernaming Enables 1 or disables 0 the consistent device na...

Page 152: ...in a virtual machine 1 Open vSphere and exit maintenance mode on the vSphere client Figure 5 19 Figure 5 19 Exiting Maintenance Mode 2 Power off the virtual machine that you are configuring 3 Select t...

Page 153: ...Environment Configuring a Hard Drive in a Virtual Machine FE0254601 00 A 5 19 6 Click Add in the Virtual Machine Properties window to add a device to the virtual machine Figure 5 21 Figure 5 21 Virtua...

Page 154: ...select Hard Drive to add a storage device to the virtual machine and then click Next Figure 5 22 Figure 5 22 Add Hardware Device Type 8 Select the type of disk Click Raw Device Mappings and then click...

Page 155: ...5 21 9 Select a target LUN In this example accept the selected LUN and then click Next Figure 5 24 Figure 5 24 Add Hardware Select Target LUN 10 Select a datastore In this example accept the default S...

Page 156: ...601 00 A 11 Select a compatibility mode In this example accept the default Physical and then click Next Figure 5 26 Figure 5 26 Add Hardware Compatibility Mode 12 Select advanced options In this examp...

Page 157: ...00 A 5 23 13 Review the disk settings and then click Finish to complete the configuration Figure 5 28 Figure 5 28 Add Hardware Ready to Complete 14 Observe the New Hard Disk adding entry in the Virtu...

Page 158: ...dapter in a virtual machine 1 Open vSphere and exit maintenance mode on the vSphere client Figure 5 30 Figure 5 30 Exiting Maintenance Mode 2 Power off the virtual machine that you are configuring 3 S...

Page 159: ...ironment Configuring a Network Adapter in a Virtual Machine FE0254601 00 A 5 25 6 Click Add in the Virtual Machine Properties window to add a device to the virtual machine Figure 5 21 Figure 5 32 Virt...

Page 160: ...ck Next Figure 5 33 Figure 5 33 Add Hardware Select Adapter 8 Select the adapter type and network connection For information about these options refer to the VMware documentation In this example accep...

Page 161: ...01 00 A 5 27 9 Review the adapter settings and then click Finish to complete the adapter configuration Figure 5 35 Figure 5 35 Add Hardware Ready to Complete 10 Observe the New NIC adding entry in the...

Page 162: ...documentation For information about NPIV refer to the following documents Fibre Channel SAN Configuration Guide http www vmware com pdf vsphere4 r40 vsp_40_san_cfg pdf Configuring and Troubleshooting...

Page 163: ...en powered off To create an NPIV ready virtual machine 1 Open the vSphere client and then click Inventory in the navigation bar Expand the inventory as needed 2 Select the managed host to which you wa...

Page 164: ...nfiguration procedure Name and Location Datastore Virtual Machine Version Guest Operating System CPUs Memory Network SCSI Controller as you would for any non NPIV virtual machine 6 Select a disk In th...

Page 165: ...the LUN to attach to the VM and then click Next Figure 5 40 Figure 5 40 Create New Virtual Machine Select Target LUN 8 Select the datastore on which to store the LUN mapping In this example click Sto...

Page 166: ...Virtual and then click Next Figure 5 42 Figure 5 42 Create New Virtual Machine Compatibility Mode 10 Select advanced options In this example accept the default and then click Next 11 Complete the crea...

Page 167: ...Channel NPIV in the left pane click Generate new WWNs and then click Finish Figure 5 44 Figure 5 44 Virtual Machine Properties Generate New WWNs 14 To confirm that the WWNs were generated for the por...

Page 168: ...Assignment field of the Virtual Machines Properties window Figure 5 45 Figure 5 45 Confirm Node and Port WWNs NOTE Do NOT power on the virtual machine prior to configuring zoning and LUN masking For i...

Page 169: ...tion with one of the following methods Microsoft Windows property pages Sets and displays the NIC parameters updates QLogic drivers and enables or disables the NIC function Property pages is available...

Page 170: ...re 6 1 Accessing Device Manager 2 Under Network Adapters right click the QLogic 10Gb PCI Ethernet Adapter and then select Properties to display the Properties dialog box Figure 6 2 The properties wind...

Page 171: ...Download and install the QLogic the QConvergeConsole CLI from http driverdownloads qlogic com by selecting the QLogic adapter model and target operating system 2 Click the shortcut icon on the deskto...

Page 172: ...ter Configuring the NIC in a Windows Environment 6 4 FE0254601 00 A Figure 6 3 Main Interactive Menu NIC Driver Parameters Windows Table 6 1 lists the QLogic 8100 Series Adapter NIC function driver pa...

Page 173: ...roperty Pages for QLogic adapter navigate to Advanced tab HeaderdataSplit Enable or disable Header Data Split HDS HDS splits the header informa tion from an incoming packet so that the CPU does not ha...

Page 174: ...upport Enable or disable Large Send Offload support Enabling offloads the task of segmenting TCP mes sages into valid Ethernet frames onto the adapter thereby reducing CPU use Windows Server 2008 only...

Page 175: ...ndows Property Pages for QLogic adapter navigate to Advanced tab ReceiveSideS caling Receive Side Scaling RSS processes a TCP connection across multiple processors or processor cores Enable Disable En...

Page 176: ...ble Windows Property Pages for QLogic adapter navigate to Advanced tab or QConvergeConsole CLI TCPChecksumO ffloadV2IPv4 Computes Tx or verifies Rx the TCP checksum of packets in IPv4 with enhanced v2...

Page 177: ...prove per formance and reduce CPU use With Offloading enabled the adapter com putes or verifies the check sum for the operating system Rx and Tx Enable Disable Rx Enable Tx Enable Rx and Tx Enable Win...

Page 178: ...OffloadSupport parameter refer to Table 6 1 Receive Side Scaling QLogic 8100 Series Adapters supports receive side scaling RSS in Microsoft Windows environments for nonoffloaded IP TCP traffic When a...

Page 179: ...Enabling RSS in the Microsoft Networking Stack The current state of RSS can be displayed and enabled using the following methods Windows Server 2008 To display the RSS status as shown in Figure 6 5 is...

Page 180: ...sts double click EnableRSS type 1 and then click OK to enable RSS 5 Restart the server on which the EnableRSS value has been modified Enabling RSS Using the Windows Advanced Property Pages To enable R...

Page 181: ...tworking stack enter the following Windows command as the administrator as shown in Figure 6 8 netsh int tcp set global rss disabled Figure 6 8 Disable RSS Windows 2008 Windows Server 2003 To disable...

Page 182: ...46 aspx Header Data Split HDS Header data split HDS is a feature of the networking stack in Microsoft Windows Server 2008 and is fully supported by the QLogic 8100 Series Adapter NIC driver HDS enable...

Page 183: ...the value to Enabled or Disabled 2 Click OK to save the setting and enable or disable HDS Figure 6 10 Enabling or Disabling HDS NIC Teaming Teaming combines two or more interfaces and provides advanta...

Page 184: ...ilover mode allows only one active team member at any time When the active team member is not available due to a link down or a hardware fault the automatic failover mechanism selects another healthy...

Page 185: ...nvergeConsole CLI by clicking on its desktop icon 3 Type 2 and press ENTER to select Host Level Info and Operations from the main Interactive Menu 4 Type 2 and press ENTER in the Host Level Info and O...

Page 186: ...nd then press ENTER to select Configure Teams Menu 9 In the Configure Teams menu type 3 and then press ENTER to select Configure New Team Figure 6 13 a At the prompt Select Team Type type 1 to create...

Page 187: ...creating a team a new logical interface appears in the Microsoft Windows Network Connections window as shown in Figure 6 14 Figure 6 14 Logical Interface QLogic VT IM Miniport Driver NOTE Ports that...

Page 188: ...ng a Team To delete a team 1 Start QConvergeConsole CLI by clicking its desktop icon 2 In the main interactive menu type 3 and then press ENTER to select Configure Team Menu 3 In the Configure Teams M...

Page 189: ...Using this protocol the QLogic 8100 adapter NIC function assigns a VLAN ID to each frame that it transmits The connected switch understands that the tag and packets are switched only within the VLAN...

Page 190: ...nal source for VLAN Teaming driver choose one of the following Figure 6 17 No Installs the VLAN teaming driver bundled with the QConvergeConsole CLI Yes Specifies the path to the zip file containing t...

Page 191: ...team and then press ENTER c At the prompt Enter VLAN ID 1 4095 type the VLAN ID Refer to the documentation for the connecting switch to determine if there are reserved VLAN IDs that should not be use...

Page 192: ...em for all operations while the QLogic VLAN teaming driver manages the physical interfaces and teaming Removing VLAN ID Assignment To remove VLAN ID assignments from a physical interface or team 1 Sta...

Page 193: ...ter multi boot image that allows a networked server to boot with the images provided by remote servers Prerequisites for PXE Boot PXE boot requires the following A client server with a PXE compliant B...

Page 194: ...include the QLogic 8100 Series Adapter drivers 2 A successful PXE boot requires that the Microsoft Windows image that resides on the PXE boot server contains the latest QLogic 8100 Series Adapter driv...

Page 195: ...xtension that identifies the request as one coming from a client that implements the PXE protocol 2 Assuming that a DHCP server or a proxy DHCP server is available that is capable of implementing this...

Page 196: ...s for use by the QLogic adapter during the PXE boot process The DHCP OFFER message also contains the boot server list 4 PXE boot code acknowledges the DHCPOFFER message and waits for an acknowledgemen...

Page 197: ...lost if the server reboots To make persistent configuration changes edit the file etc sysconfig network scripts ifcfg ethX modprobe A utility that loads and unloads a kernel module such as the QLogic...

Page 198: ...egmentation offload gso Enables or disables generic segmenta tion offload Off On off ethtool generic receive offload gro Enables or disables generic receive offload Off On off ethtool qlge_irq_type Ty...

Page 199: ...dule Any driver parameter that is modified using this method requires that the QLogic driver be reloaded for nonpersistent changes or rebooted for persistent changes Therefore this method disrupts I O...

Page 200: ...obe v qlge qlge_irq_type 1 qlge_mpi_coredump 0 3 Verify that the values for these parameters have changed For example cat etc bus pci drivers qlge module parameters qlge qlge_irq_type cat etc bus pci...

Page 201: ...ckup copy of the RAMDISK initrd image For example cp initrd kernel version img initrd kernel version img bak c Generate a new RAMDISK image containing the updated QLogic FCoE driver mkinitrd f initrd...

Page 202: ...fs location where the driver parameter to be modified is represented as a sysfs special file entry For example cd sys module qlge parameters 2 Modify the sysfs entry for the corresponding driver param...

Page 203: ...make persistent changes edit the appropriate etc sysconfig networking scripts ifcfg ethX file and then add ETHTOOL options The following sections describe how to make both persistent and nonpersisten...

Page 204: ...the file ETHTOOL_OPTS any of the ethtool s parameters 3 Save the file etc sysconfig network scripts ifcfg eth0 4 Stop the interface eth0 For example etc sysconfig network scripts ifdown eth0 5 Bring...

Page 205: ...ify that the MTU has been changed ifconfig eth0 Figure 6 26 shows the new MTU value Figure 6 26 Verify the MTU Value Identifying the QLogic 8100 Adapter Network ID To identify the adapter network ID 1...

Page 206: ...and 85 00 1 are listed under the qlge section in sysfs 3 List the contents of the soft link for the device ID In Figure 6 29 find the net ethX entries The X in each entry represents the network inter...

Page 207: ...85 00 0 maps to eth0 QLogic driver parameters can now be displayed and configured through sys class net eth0 You can set network interface options and parameters using commands such as ifconfig and et...

Page 208: ...d using ethtool as described in NIC Driver Parameters Linux on page 6 29 Do not disable checksum offload unless you are debugging a checksum computation problem Enabling TCP checksum offload significa...

Page 209: ...it side of TCP IP traffic between them Switch Dependent Bonding Switch dependent bonding implements the adapter bonding function with the bonding capabilities of the switch There are two switch depend...

Page 210: ...ding module at load time Though these parameters can be used as arguments in the modprobe command it is recommended that they be specified in the etc modprobe conf configuration file If any of these p...

Page 211: ...he downdelay value should be a multiple of the mii mon value if not it will be rounded down to the nearest multiple 0 32767 updelay milliseconds Specifies the time to wait before enabling a slave afte...

Page 212: ...nt slave becomes active if and only if the active slave fails The bond s MAC address is externally visible on only one port network adapter to avoid confusing the switch primary String A string eth0 e...

Page 213: ...1 the bonding driver is already loaded Figure 6 31 Verifying that the Bonding Driver Is Loaded To load the bonding driver enter one of the following commands modprobe v bonding miimon x or modprobe v...

Page 214: ...d the configurable parameters enter the following modinfo bonding Changing Bonding Driver Parameters modprobe is a Linux utility that intelligently adds or removes a module from the Linux kernel modpr...

Page 215: ...reboots edit the file etc modprobe conf add the QLogic FCoE driver parameters and values build a new RAMDISK image and reboot For example 1 Open the file etc modprobe conf with an editor in read writ...

Page 216: ...ecified that define the type of bond to be created For information about loading the bonding driver refer to Loading the Bonding Driver on page 6 45 Nonpersistent Bonding Configuration 1 Create a bond...

Page 217: ...interface a Create or open the file etc sysconfig network scripts ifcfg bond0X with an editor vi etc sysconfig network scripts ifcfg bond0 b Append the following commands to the file to modify the net...

Page 218: ...Save the file and then exit the editor 4 Repeat Step 3 for each physical network interface that is to be part of the bonding interface 5 Restart the network service by issuing the following command se...

Page 219: ...t down and the bonding driver removed the original MAC addresses are restored Figure 6 34 ifconfig Command Output Disabling a Bonding Network Interface To disable a bonding interface issue the followi...

Page 220: ...configure VLANs on Linux systems with network interface bonding VLAN 802 1q kernel module 8021q Linux kernel module that provides the VLAN 802 1q support for network interfaces The Linux 8021q VLAN dr...

Page 221: ...VLAN 802 1q Kernel Module Is Loaded To load the VLAN 802 1q kernel module issue the following command modprobe v 8021q If the command produces no output the VLAN 802 1q Kernel Module is already loaded...

Page 222: ...5 over physical network interface eth0 vconfig add eth0 5 The resulting VLAN interface appears as eth0 5 in Linux network configuration utilities 2 Assign an IP address to the VLAN interface The follo...

Page 223: ...6 shows the resulting file Figure 6 36 Creating a Network Configuration File VLAN Interface c Save the file and then exit the editor 2 Restart the network services by issuing the following command ser...

Page 224: ...e You can configure VLAN devices over a bond interface using the 8021q driver However only packets coming from the 8021q driver and passing through bonding are tagged by default VLAN interfaces can be...

Page 225: ...client that implements the PXE protocol 2 Assuming that a DHCP server or a proxy DHCP server is available that is capable of implementing this extended protocol after several intermediate steps the s...

Page 226: ...s by sending a DHCPOFFER message with an IP address for use by the QLogic adapter during the PXE boot process The DHCP OFFER message also contains the boot server list 4 PXE boot code acknowledges the...

Page 227: ...vironment and the operating system images to the client server It is possible to configure a single physical server as both a DHCP and a boot server For information about setting up a Linux server as...

Page 228: ...6 Configuring NIC Functionality in the Converged Network Adapter Configuring the NIC in a Linux Environment 6 60 FE0254601 00 A...

Page 229: ...he Fast UTIL configuration options described in Fast UTIL on page 9 2 Table 7 1 Driver Parameters Parameter Description Default Range Configuration Method Operation Mode The reduced interrupt opera ti...

Page 230: ...ging of driver detected events that occur in the driver or the Fibre Channel bus 0 0 Disabled 1 Enabled QConvergeConsole GUI or QConverge Console CLI Execution Throttle Maximum number of com mands tha...

Page 231: ...les out of order frames as they are received minimizing network conges tion by eliminating the retransmission of frames and exchanges Disabled Enabled Dis abled QConvergeConsole GUI or QConverge Conso...

Page 232: ...ibes the Operation Mode parameter values in detail Enable Fibre Channel Tape Support Enables or disables FCP 2 recovery Disable this param eter if the Fibre Channel adapter is connected to a storage s...

Page 233: ...ttee T11 within the INCITS standards body by the FC DA Fibre Channel Direct Attach and FC LS Fibre Channel Link Services specifications NPIV virtualizes the Fibre Channel adapter function such that ea...

Page 234: ...rs can create virtual FCoE adapter ports within multiple zones and assign them to VMs for migration without reconfiguring zoning or LUN masking This solution creates a virtual network that is easier t...

Page 235: ...to create virtual adapter ports using the QConvergeConsole GUI For information about creating virtual adapter ports using QConvergeConsole CLI refer to the QConvergeConsole CLI User Guide To create a...

Page 236: ...e following The driver determines the number of vPorts allowed For example a Windows driver that supports 16 ports can allow up to 15 virtual ports To generate a different set of randomly selected WWN...

Page 237: ...isted in the left pane of the QConvergeConsole window beneath the FCoE port selected when creating the virtual ports as shown in the following example Figure 7 3 Verifying Additional Virtual Ports NOT...

Page 238: ...nsole GUI For information about deleting virtual adapter ports using QConvergeConsole CLI refer to the QConvergeConsole CLI User s Guide To delete one or more virtual ports connect the QConvergeConsol...

Page 239: ...iew 7 Click OK to refresh the host immediately or click Cancel if you want to refresh the view at a later time Verifying Deletion of Virtual Ports Use QConvergeConsole GUI to verify that the virtual a...

Page 240: ...ameter restore default Flash update from file Flash save to file Adapter parameter update from file Adapter parameter save to file Adapter parameter update from templates Target link speed intelligent...

Page 241: ...s for various levels of latency requirements across virtual ports The bandwidth method assigns a bandwidth percentage 0 100 or a bandwidth rate 0 10Gb to applications or VMs that are using a virtual p...

Page 242: ...contend for port bandwidth Consider how bandwidth is required to maximize application or virtual machine performance and set the QoS level to 105 percent of that value For example if a mission critic...

Page 243: ...find the boot disk on the SAN Because the boot device resides on the SAN it simplifies server management Separating the boot image from each server allows administrators to leverage the advanced capa...

Page 244: ...s the correct zoning configuration according to the following rules Locate the FCoE switch on the SAN that contains the boot LUN so that the FCoE switch is visible to the server through the QLogic ada...

Page 245: ...hard drives 2 Configure a single path to the storage array when installing Microsoft Windows For multiple adapter port configurations for redundancy connect only one adapter port to the SAN during in...

Page 246: ...ritical servers However single path configuration does offer some degree of fault tolerance because the QLogic 8100 Series Adapter can configure alternate boot LUNs As shown in Figure 7 6 if the prima...

Page 247: ...primary and alternate boot LUNs through two independent paths A single point of failure is unlikely to with this configuration You can enhance this configuration further by adding more adapter ports...

Page 248: ...about configuring an UEFI server proceed to Step 5 a Configure the switch with a zone that includes the adapter port and one storage array port using either soft zoning WWPN based or hard zoning port...

Page 249: ...Name Lun option Type the LUN number and then press ENTER The adapter scans the available devices l Specify the alternate boot LUNs Move the cursor to the Boot Port Name Lun fields select the device fr...

Page 250: ...e driver handle number d Display the list of adapters that are managed by this driver by issuing the following command drvcfg driverhandle Locate and note the controller handle number inside the brack...

Page 251: ...the WWPN and LUN number Press ENTER to return to the Main Menu k Select Edit Database under NVRAM Parameters from the Configuration Main Menu l Enter the WWPN and LUN number of the primary and altern...

Page 252: ...dia in the optical drive on the server the windows installation process starts automatically The adapter drivers must be installed on the server during the installation of the operating system For inf...

Page 253: ...switch zoning to ensure that the second adapter port has access to both storage array controllers d Install Microsoft MPIO or the storage array vendor s multipath solution onto the Microsoft Windows o...

Page 254: ...7 Configuring FCoE in a Windows Environment Boot from SAN 7 26 FE0254601 00 A...

Page 255: ...guration options described in Fast UTIL on page 9 2 Table 8 1 FCoE Driver Parameters for Linux Parameter Description Default Range Configuration Method ql2xlogintimeout Login timeout value in seconds...

Page 256: ...ing Enables or disables driver tracking of queue full status returns and dynamically adjusts a SCSI device s queue depth 1 0 Disable 1 Enable modprobe sysfs ql2xqfullrampup Time to wait before increas...

Page 257: ...onsole GUI or QConverge Console CLI Spin up delay Time that the adapter port waits before scanning the channel for devices 0 0 2 seconds Fast UTIL Frame Size Maximum frame length of a Fibre Channel fr...

Page 258: ...nverge Console GUI or QConverge Console CLI Link Down Timeout Time to wait for a link to come up 30 0 240 sec onds Fast UTIL QConverge Console GUI or QConverge Console CLI LUNs per Target Number of LU...

Page 259: ...ID is 0 Set this ID to a unique value from 0 through 125 if more than one adapter is connected to a FC AL loop and the host bus adapter hard loop ID is enabled 0 0 125 QConverge Console GUI or QConve...

Page 260: ...ot preserved across server reboots To make nonpersistent changes to adapter driver parameters using modprobe 1 Unload the QLogic FCoE driver module For example modprobe r qla2xxx Enable Fibre Channel...

Page 261: ...module parameters ql2xenablemsix cat etc bus pci drivers qla2xxx module parameters ql2xextended_error_logging Making Persistent Changes Using modprobe Persistent changes are preserved across server re...

Page 262: ...server to activate the new RAMDISK image by issuing the following command shutdown r now 5 After a successful reboot verify the changes by issuing the following commands cat etc bus pci drivers qla2x...

Page 263: ...ges The following example should report 64 if the previous command was successful cat sys module qla2xxx parameters ql2xmaxqdepth Configuring FCoE Parameters Using QLogic Utilities Table 8 3 describes...

Page 264: ...onverge Console CLI Yes Online requires a func tioning operating system to run Download from http driver downloads qlogic com For information about installing QLogic utilities refer to Man agement Too...

Page 265: ...01 00 A 8 11 To configure a parameter from the list of HBA parameters 1 Expand the port number in the system tree left pane of the QConvergeConsole browser window 2 Click the FCoE port node 3 Click th...

Page 266: ...he Advanced HBA Parameters subtab as shown in Figure 8 3 Figure 8 3 QConvergeConsole Advanced HBA Parameters Configuring FCoE Driver Parameters Using Fast UTIL You can configure most of the adapter FC...

Page 267: ...ced adapters settings using Fast UTIL 1 Select the Select Host Adapter option 2 Select Configuration Settings 3 Select Advanced Adapter Settings as shown in Figure 8 4 Table 8 5 Fast UTIL FCoE Driver...

Page 268: ...t UTIL Advanced Adapter Settings Displaying FCoE Driver Parameters Using sysfs Table 8 6 lists the FCoE driver parameters and sysfs locations by which you can display parameter values using sysfs For...

Page 269: ...ql2xmaxqdepth w ql2xplogiabsentdevice w ql2xqfullrampup w ql2xqfulltracking w qlport_down_retry w Refer to FCoE Driver Parameters for Linux on page 8 1 sys class fc_host h ostX device Link to the phy...

Page 270: ...frames with errors fcp_control_requests Number of FCP control requests fcp_input_megabytes Total FCP traffic received MB fcp_input_requests Total number of FCP frames received fcp_output_megabytes To...

Page 271: ...rrors encountered by the LR LRR NOS OLS LIP LPB and LPE prim itive sequences reset_statistics w Resets the adapter statistics rx_frames Total number of frames received since the last reset_statistics...

Page 272: ...rsion MPI NIC firmware version npiv_vports_inuse Number of NPIV ports currently in use optrom_bios_version BIOS version on the Converged Network Adapter optrom_efi_version Converged Network Adapter EF...

Page 273: ...t w Update event unique_id Unique ID vlan_id VLAN ID used for FCoE frames vn_port_mac_address Virtual node port MAC address vport_create w Create a virtual NPIV port Refer to Cre ating Virtual Ports o...

Page 274: ...e driver is managing the PCI bus device ID as 85 00 2 and 85 00 3 For example ls l sys bus pci drivers qla2xxx The search list in Figure 8 7 shows that the PCI device IDs 85 00 2 and 85 00 3 are liste...

Page 275: ...le to display the adapter firmware version issue the following command cat sys class scsi_host host6 fw_version To modify sysfs entries use the Linux Echo command For example to enable the beacon on t...

Page 276: ...on Mode and Interrupt Delay Timer values in a test environment before applying the changes to a production environment Interrupt Delay Timer zio_timer This parameter is valid if the Operation Mode par...

Page 277: ...lows multiple N_Port IDs to share a single physical N_Port N_Port sharing allows multiple Fibre Channel initiators to use a single physical port easing hardware requirements in SAN design especially w...

Page 278: ...ultiple zones and assign them to VMs for migration without reconfiguring zoning or LUN masking This solution creates a virtualized network that is easier to manage and maintain In addition support for...

Page 279: ...refer to Identifying the SCSI Host ID on page 8 19 2 Confirm that the link is up between the adapter port and the FCoE switch by issuing the following command cat sys class scsi_host hostX state Link...

Page 280: ..._host hostX for a new entry Issue the following command where X is the virtual port SCSI host ID for the virtual port ls l sys class scsi_host hostX The new virtual port is the first available numeral...

Page 281: ...he virtual port WWPN and WWNN by issuing the following commands where X is the port SCSI host ID cat sys class scsi_host hostX port_name cat sys class scsi_host hostX node_name 2 Delete the virtual po...

Page 282: ...documentation Differentiating Virtual Ports from Physical Ports in sysfs Virtual ports and physical ports have different sets of sysfs parameters You can distinguish a virtual port from a physical po...

Page 283: ...w centralized management of operating system images for rapid deployment scenarios and disaster recovery options While many modern servers provide high availability local disk configurations through s...

Page 284: ...The following summarizes the configuration process 1 Set the boot order to disable boot from local disk or disconnect the internal hard drives 2 Configure a single path to the storage array when insta...

Page 285: ...OS is disabled by default Disregard this requirement if a UEFI enabled server is used If failover capabilities are required during boot from SAN multiple QLogic 8100 Series Adapters are required to cr...

Page 286: ...fault tolerance and high availability required for boot from SAN installations The following sections describe two boot from SAN topologies single path configuration least fault tolerant and multipat...

Page 287: ...components and their connections The server has access to the primary and alternate boot LUNs through two independent paths A single point of failure is unlikely with this configuration You can enhanc...

Page 288: ...A Figure 8 13 Multipath Topology Converged Networking Switch 1 Storage Array Server Controller A CNA Port 1 LUN 1 Primary Boot Device LUN 3 Alternate Boot Device LUN 2 Alternate Boot Device LUN 4 Alt...

Page 289: ...an UEFI server proceed to Step 5 a Configure the switch with a zone that includes the adapter port and one storage array port using either soft zoning WWPN based or hard zoning port number based and e...

Page 290: ...ame Lun option and then press ENTER The adapter scans the available devices k Specify the alternate boot LUNs Move the cursor to the Boot Port Name Lun fields l Select the device from which to boot in...

Page 291: ...play the list of adapters that are managed by this driver issue the following command Locate and note the controller handle number inside the brackets labeled Ctrl drvcfg driverhandle e Configure the...

Page 292: ...WWPN and LUN number Press ENTER to return to the Main menu k Select Edit Database under NVRAM Parameters from the Configuration Main menu l Type the WWPN and LUN numbers of the primary and alternate b...

Page 293: ...allation process starts automatically if the server boots from the optical drive For information about installing RHEL 5 to boot from SAN refer to Installing Software on page 3 7 7 Some versions of RH...

Page 294: ...rvice or install a storage array vendor multipath solution on the RHEL 5 operating system e Repeat Steps 4 or 5 to configure the a second adapter port to provide failover for the boot from SAN device...

Page 295: ...k OK 4 Continue installing RHEL 5 Using the QLogic Linux Utilities This subsection describes how to obtain install and launch the QLogic Linux utilities The QLogic Linux utilities listed in Table 8 9...

Page 296: ...TGT LUN Discovery utility package FC HBA Change LUN State utility Change the state of LUNs connected to a QLogic Fibre Channel adapter from offline to online running Set Device Command Timeout utility...

Page 297: ...LUNs If the utility does recognize that a LIP is needed this option is ignored current luns cl Display current LUNs on the system extended scan e Rescan the LUNs to identify attribute changes in exist...

Page 298: ...refresh Rescan all adapters with a Run a proc based scan ql dynamic tgt lun disc sh scan proc Rescan all adapters and set the maximum number of LUNs to be scanned ql dynamic tgt lun disc sh scan max...

Page 299: ...CAN Current X Change the maximum number of LUNs to be scanned X By default the utility scans a maxi mum of 256 LUNs Decreasing the number of LUNs reduces the scan time DISPLAY CURRENT LUNS Show the cu...

Page 300: ...ation in proc scsi scsi information in etc qla2xxx conf and relevant information about QLogic FCoE driver configurations RHEL 5 version information System configuration information including a list of...

Page 301: ...execution sequence Figure 8 20 HBA Collect Utility Execution Example Table 8 15 HBA Collect Utility Package Files File Description COPYING GNU general public license that describes rights to copy dis...

Page 302: ...Snapshot utility package Using the Utility To display QLogic adapter information issue the following command ql hba snapshot sh Host number a all options If you omit options the utility displays info...

Page 303: ...lp text hostlist hl Displays the list of QLogic hosts adapters connected to this RHEL 5 server parameters p Displays the command line parameters that can be passed to the QLogic adapter driver statist...

Page 304: ...ched to it Enables all offline LUNs with single command Selects targets for every host menu interface only Package Contents Table 8 19 describes the files in the FC HBA LUN State utility package Using...

Page 305: ...mands that perform them Table 8 20 FC HBA Change LUN State Utility Command Line Options Option Abbreviation Description Host number Scan for all offline LUNs on the specified HOSTS QLogic adapter port...

Page 306: ...f a LUN and the press ENTER 2 Type the option number for OFFLINE to ONLINE RUNNING and then press ENTER To change the state of all LUNS from offline to online type the option for MAKE ALL ONLINE and t...

Page 307: ...owing command ql set cmd timeout sh HOST To display the timeout values for devices connected to a specified target and host ID issue the following command ql set cmd timeout sh HOST TARGET To set the...

Page 308: ...ns Option Abbreviation Description HOST QLogic adapter port SCSI host ID hostX as identified in sys class scsi_host hostX TARGET Target ID connected to the adapter port TIMEOUT Timeout value in second...

Page 309: ...nd Examples Task Command Example Display the timeout value for all devices connected to QLogic adapters ql set cmd timeout sh Display the timeout value for all devices connected to host 4 ql set cmd t...

Page 310: ...imeout Utility Main Menu Options Option Description HOSTX Select a QLogic adapter port for which to display or set the tim eout value Selecting this option opens the SELECT TARGET for HOSTX sub menu F...

Page 311: ...8 23 Select Target for HostX Menu Table 8 26 describes the Select Target for HostX menu options Figure 8 24 shows the Modify Display Timeout menu Figure 8 24 Modify Display Timeout Menu Table 8 26 Sel...

Page 312: ...Timeout menu options Table 8 27 Modify Display Timeout Menu Options Option Description MODIFY TIMEOUT Specify the timeout value in seconds for the selected tar get s DISPLAY TIMEOUT Display the curren...

Page 313: ...to update the multi boot image including firmware on QLogic 8100 Series Adapters These utilities can also display BIOS UEFI version information perform advanced debugging and collect support informati...

Page 314: ...nd advanced adapter settings selects boot devices restores default adapter settings and displays raw NVRAM data Displays information about Fibre Channel devices connected to the adapter Verifies disk...

Page 315: ...t UTIL initialization is in progress If more than one adapter is installed on the server Fast UTIL prompts you to select an adapter to configure Figure 9 2 Figure 9 2 Selecting an Adapter After an ada...

Page 316: ...server to put those changes into effect Configuration Settings The Configuration Settings option enables you to display and configure adapter parameters select boot devices restore default settings a...

Page 317: ...he adapter SFP cage This is not the CEE MAC address that is used for LLDP communications between the adapter and the FCoE switch Interrupt Level Interrupt that is used by the adapter The interrupt lev...

Page 318: ...1 For information about configuring a server to boot from SAN refer to Boot from SAN on page 7 15 Figure 9 5 Selectable Boot Setting Window Table 9 2 describes the selectable boot setting parameters...

Page 319: ...e Boot is disabled BIOS configures the first disk drive LUN it finds as the boot device If Selectable Boot is enabled and the Boot Port Name Lun parameter is unspecified BIOS configures the first LUN...

Page 320: ...Support to use Advanced Adapter Settings The Advanced Adapter Settings option opens the Advanced Adapter Settings window Figure 9 7 from which you can view and modify advanced adapter parameters Modif...

Page 321: ...e default is 30 seconds When the QLogic adapter is connected to a stor age enclosure with a large number of drives this parameter can be increased For recommended values consult the stor age array pro...

Page 322: ...Controller Order Enables or disables loading the adapter BIOS if the Con verged Network Adapter is selected as the first controller in the system BIOS boot controller order If this parameter is dis a...

Page 323: ...ions Loopback Data Test The Loopback Data Test option verifies the adapter transmit and receive functions This test is not the same as the internal loopback test that is available in QConvergeConsole...

Page 324: ...Write selection on the Main Menu Prior to using this selection changes to the local copy may be abandoned by using the Abandon or Quit selections on the Main Menu To start the Configuration protocol...

Page 325: ...image Write the multi boot image Verify the multi boot image Verify the NVRAM Installing FlasUTIL To install the FlasUTIL utility 1 Create a DOS bootable disk or USB removable drive 2 Download the QL...

Page 326: ...face for the adapter at address xxxx L xxxx Write NVRAM to the adapter at address xxxx If you omit the address the command writes the NVRAM to all adapters F xxxx Write BIOS code to the adapter at add...

Page 327: ...e vital product data Q Quiet mode suppresses all messages on the display S xxxx Display the serial number of the adapter at address xxxx If you omit the address the command displays the serial numbers...

Page 328: ...runs from the EFI shell It consists of the program efiutil efi and an auxiliary driver efiaux drv The auxiliary driver is used if efiutil efi is unable to detect a QLogic EFI driver capable of support...

Page 329: ...line parameters used to start efiutil If no parameters are used EFIUTIL starts in CLI mode as follows To start the EFIUTIL CLI on an IA64 system type the following command efiutil To start the EFIUTIL...

Page 330: ...9 Offline Utilities EFIUTIL 9 18 FE0254601 00 A...

Page 331: ...LEDs The Storage Traffic LED indicates the state of data traffic exchanged with the SAN The Link Ethernet Traffic LED indicates the state of data traffic exchanged with the LAN Observe the LED states...

Page 332: ...w flashing unison Power on no link On On Power on link established no activity Flashing On Power on link established Ethernet activity only On Flashing Power on link established storage activity only...

Page 333: ...interface switch port 4 Create and configure a virtual Fibre Channel port 5 Verify that the Converged Network Adapter is logged into the switch The steps and commands presented in this appendix may va...

Page 334: ...c binding 1 disabled port_track 1 disabled npiv 1 enabled lacp 1 disabled npv 1 disabled interface vlan 1 disabled private vlan 1 disabled udld 1 disabled vpc 1 disabled cimserver 1 disabled fcoe 1 di...

Page 335: ...and configure the VLAN 1 Enter the switch configuration mode by issuing the following command configure terminal 2 Create the VLAN interface 1002 by issuing the following commands config vlan 1002 nex...

Page 336: ...le the Ethernet interface by issuing the following command config if no shutdown 7 Exit the interface configuration mode by issuing the following command config if exit Create and Configure a Virtual...

Page 337: ...20 c2 08 57 95 10 00 00 20 c2 08 57 95 fc2 3 1 0xc60004 20 02 00 20 c2 08 57 95 10 00 00 20 c2 08 57 95 fc2 4 1 0xc60002 20 01 00 20 c2 08 57 95 10 00 00 20 c2 08 57 95 fc3 1 1 0xc60006 20 04 00 20 c...

Page 338: ...B Cisco Nexus 5000 Series Switch Configuration Verify that the Adapter Is Logged into the Switch B 6 FE0254601 00 A...

Page 339: ...ort 6 Verify that the Converged Network Adapter is logged into the switch The steps and commands presented in this appendix may vary depending on your switch model and the firmware version installed o...

Page 340: ...te and Configure FCoE VLAN on page C 3 2 If the Ethernet switch service is disabled the status of the FCoE 10 24 blade will be Faulty Issue the following command to confirm the status of the FCoE 10 2...

Page 341: ...the VLAN interface 1002 by issuing the following command config interface vlan 1002 For QLogic Converged Network Adapters use only VLAN 1002 to enable FCF forwarding 3 Enable the forwarding of FCoE tr...

Page 342: ...nel traffic In the following example CoS 3 is set to table entry 1 which means that the adapter port can use 40 percent of the switch port bandwidth for FCoE traffic and 60 percent of the switch port...

Page 343: ...Disabled 15 7 PFC Disabled Priority Table CoS 0 1 2 3 4 5 6 7 PGID 2 2 2 1 2 2 2 2 FCoE CoS None Enabled on the following interfaces For information about associating the CEE MAP with interfaces refe...

Page 344: ...dapter is connected 1 Enter the interface configuration mode for the CEE switch port that connects to the QLogic adapter by issuing the following command In the example the QLogic adapter port is conn...

Page 345: ...e fc 00 01 1b 01 2 List the name server database information by issuing the following command conf if te 0 19 do fos nsshow t Type Pid COS PortName NodeName TTL sec N 011b01 3 10 00 00 00 c9 9c c2 ef...

Page 346: ...C Brocade CEE FCoE Switch Blade Configuration Verify that the Adapter is Logged into the Switch C 8 FE0254601 00 A...

Page 347: ......

Page 348: ...at is a registered trademark of Red Hat Inc Linux is a registered trademark of Linus Torvalds Cisco and Nexus are trademarks or registered trademarks of Cisco Systems Inc Java is a trademark of Sun Mi...

Reviews: