Dell Brocade 825 Installation And Reference Manual Download Page 266

Page: 266 / 272

238

Brocade Adapters Installation and Reference Guide

53-1002144-01

Canadian requirements

1741 adapters

200

stand-up adapters

194

CE statement

1741 adapters

200

stand-up adapters

194

checksum offloads

CIM Provider

CIM Provider installation package

CNA

boot image

DCB features

driver packages

environmental and power requirements

178

Ethernet features

fabric OS support

xiv

FCoE features

firmware

hardware specifications

180

host compatibility

host support

illustration

installing driver package with software installer

LED operation

184

low-profile bracket

MAC addressing

xxiii

management

BCU

BOFM support

HCM

PCI system values

180

PCIe interface

179

PCIe support

physical characteristics

179

product overview

PWWN

xxii

serial number

xxii

software

downloading from website

installation options

installation packages

installer

overview

storage support

xiv

supported models

xiii

switch compatibility

switch support

xiv

throughput per port

transfer rate

CNA (stand-up)

environmental and power requirements

185

CNA mode

CNA software installer

CNAs

hardware and software compatibility

SFPs

command line utility

communications port firewall issue

compliance

Fibre Channel standards

192

laser

195

regulatory

199

1741 adapters

199

mezzanine adapters

199

stand-up adapters

192

configuring adapters

203

connecting adapters to switch or storage

DCB management

BCU

HCM

DCBCXP

document conventions

xviii

document feedback

xxvii

downgrade software

driver packages

components

confirming in Linux

105

106

downgrading

install with RPM commands

installing HCM

installing to boot LUN

162

installing with scripts and commands

installing with software installer

intermediate

network

removal with scripts and commands

removing with software uninstaller

removing with software uninstaller commands

selectively install

storage

upgrading

driver update disk (dud)

driver update for booting over SAN

170

Summary of Contents for Brocade 825

Page 1: ...53 1002144 01 5 August 2011 Brocade Adapters Installation and Reference Manual Supporting CNA models 1741 1020 1010 1007 Supporting HBA models 825 815 804 425 415 Supporting Fabric Adapter model 1860 ...

Page 2: ... Communications Systems Incorporated Document History Corporate and Latin American Headquarters Brocade Communications Systems Inc 130 Holger Way San Jose CA 95134 Tel 1 408 333 8000 Fax 1 408 333 8101 E mail info brocade com Asia Pacific Headquarters Brocade Communications Systems China HK Ltd No 1 Guanghua Road Chao Yang District Units 2718 and 2818 Beijing 100020 China Tel 8610 6588 8888 Fax 86...

Page 3: ... 1001926 02 Updates to support Brocade 1741 adapter November 2010 Brocade Adapters Installation and Reference Manual 53 1002144 01 Updates to support Adapter release 3 0 and Brocade 1860 adapter August 2011 Title Publication number Summary of changes Date ...

Page 4: ......

Page 5: ...ii Host operating system support for HCM xvii What s new in this document xviii Document conventions xviii Text formatting xviii Command syntax conventions xix Command examples xix Notes cautions and warnings xix Key terms xx Notice to the reader xx Additional information xx Brocade resources xx Other industry resources xxi Providing details for support xxii Support Save overview xxiv Initiating S...

Page 6: ...27 Adapter management features 31 General adapter management 32 Fabric Adapter management 33 CNA management 33 NIC Management 35 HBA management 36 Fabric Adapter management 36 Adapter software 37 Driver packages 37 Management utilities 38 Host Connectivity Manager 42 Boot code 42 CIM Provider 43 Adapter event messages 43 Software installation and driver packages 43 Software installation options 48...

Page 7: ...ler 88 Installer log 89 Using software installation scripts and system commands 89 Software installation and removal notes 89 Driver installation and removal on Windows systems 91 Driver installation and removal on Linux systems 95 Driver installation and removal on Solaris systems 97 Driver installation and removal on VMware systems 99 Confirming driver package installation 103 Confirming driver ...

Page 8: ...FI support for boot over SAN 129 Host system requirements for boot over SAN 130 Storage system requirements for boot over SAN 130 Disabling N_Port trunking 131 Configuring boot over SAN 131 Operating system and driver installation on boot LUNs 148 Installing the full driver package on boot LUNs 162 Fabric based boot LUN discovery 163 Configuring fabric based boot LUN discovery Brocade fabrics 164 ...

Page 9: ...ents 192 Fibre Channel standards compliance 192 Regulatory compliance 192 Stand up adapters 192 Mezzanine adapters 199 Appendix A Adapter Configuration In this appendix 203 Introduction 203 Storage instance specific persistent parameters 203 Managing instance specific persistent parameters 205 Storage driver level parameters 206 Linux and VMware driver configuration parameters 206 Windows driver c...

Page 10: ...x Brocade Adapters Installation and Reference Manual 53 1002144 01 ...

Page 11: ...Hardware Installation provides procedures to install adapter hardware and connect to the fabric or switch Also included are procedures to verify hardware and software installation Chapter 3 Software Installation provides procedures to install software such as the Brocade Host Connectivity Manager HCM and driver packages Also included are instructions to verify software and hardware installation Us...

Page 12: ...rs FIGURE 1 Installing adapters using this document Install adapter drivers utilities and other software in host system Verify software and hardware installation Configure HCM agent operation as necessary Configure network addressing CNA only Chapter 3 Appendix A Configure boot over SAN on BIOS or UEFI based systems Install operating system adapter drivers utilities and other software on boot devi...

Page 13: ...bles Refer to Hardware compatibility on page 4 for more information CNAs The following Fibre Channel over Ethernet FCoE CNAs are supported Brocade 1007 Dual port mezzanine CNA with a per port maximum of 10 Gbps This is an IBM compact form factor horizontal CFFh mezzanine type adapter that installs on supported server blades Brocade 1010 Single port stand up CNA with a per port maximum of 10 Gbps B...

Page 14: ...ured Ports on Fabric Adapters configured in CNA mode can connect to Fibre Channel SANs and Ethernet data networks through a compatible FCoE switch These ports can also connect to standard Ethernet LAN switch For a current list of compatible switches refer to the latest interoperability matrices on the adapters website at www brocade com adapters Ports configured in HBA mode support Fabric OS and c...

Page 15: ...figured in NIC mode CNAs Refer to the following subsections FCoE support on page xvi Ethernet support on page xvi HBAs Refer to Fibre Channel support on page xv NOTE Specific operating system release levels service pack levels and other patch requirements are detailed in the current adapter release notes NOTE Also refer to the latest Brocade interoperability matrices on the Brocade website at www ...

Page 16: ... Windows 7 x86 and x64 Windows Server Core for Windows 2008 x86 and x64 Microsoft WinPE 3 0 for Windows 2008 x86 and x64 Linux RHEL 4 9 5 5 5 6 6 0 6 1 x86 and x64 Linux SLES 10 and 11 x86 and x64 Solaris 10 x86 x64 and SPARC NOTE Solaris is not supported on Brocade 804 or 1007 adapters VMware ESX Server 4 0 4 1 5 0 x64 NOTE Drivers and BCU are supported on the VMware ESX platforms HCM is supporte...

Page 17: ...x64 Hypervisor support The following lists operating systems that support hypervisor operation for Brocade adapters Windows Server 2008 Hyper V x64 Linux RHEVH 6 x x64 Linux XEN x86 and x64 Linux KVM x64 VMware ESX 4 0 4 1 and 5 0 x64 Oracle VM 3 0 x64 Citrix XenServer 6 0 x64 Host operating system support for HCM The following operating systems support HCM management for adapters Windows Server 2...

Page 18: ...n this document and documentation updates refer to the release notes for your adapter software version Document conventions This section describes text formatting conventions and important notice formats used in this document Text formatting The narrative text formatting conventions that are used are as follows bold text Identifies command names Identifies the names of user manipulated GUI element...

Page 19: ...tant information or provides a reference to related information ATTENTION An Attention statement indicates potential damage to hardware or data CAUTION A Caution statement alerts you to situations that can be potentially hazardous to you or cause damage to hardware firmware software or data DANGER A Danger statement indicates conditions or situations that can be potentially lethal or extremely haz...

Page 20: ...ese references are made for informational purposes only Additional information This section lists additional Brocade and industry specific documentation that you might find helpful Brocade resources To get up to the minute information go to http my brocade com to register at no cost for a user ID and password A variety of resources for Brocade products is available Corporation Referenced Trademark...

Page 21: ...system enclosure components The Brocade mezzanine card adapters are compatible with blade servers switch modules interconnect modules I O modules and other components that install in supported blade system enclosures For compatibility information visit the compatible blade server and blade system enclosure manufacturer s website Also refer to Hardware compatibility on page 10 SAN information White...

Page 22: ...hooting steps already performed and the results 2 Adapter serial number The adapter serial number and corresponding bar code are provided on the serial number label illustrated below This label is located on the adapter card You can also display the serial number through the following HCM dialog boxes and BCU commands Adapter Properties tab in HCM Select an adapter in the device tree then click th...

Page 23: ...AC address during FCoE Initialization Protocol FIP operations This MAC is assigned for the current FCoE communication only To find this MAC address perform one of the following tasks Select an FCoE port in the HCM device tree then click the Properties tab in the right pane to display the port Properties panel Look for the FCoE MAC field Enter the port query port_id BCU command Look for the FCoE MA...

Page 24: ...the ESX system Through your internet browser Internet Explorer 6 or later or Firefox 2 0 or later you can collect Support Save output if you do not have root access do not have access to file transfer methods such as File Transfer Protocol FTP and Secure Copy SCP or do not have access to the Host Connectivity Manager HCM A Support Save collection can also occur automatically for a port crash event...

Page 25: ...ng commands For Linux use the following commands then reboot the system To disable auto recovery for the network BNA driver insmod bna o bnad_ioc_auto_recover 0 To disable auto recovery for the storage BFA driver insmod bfa o ioc_auto_recover 0 For VMware use the following commands To unload and load the network BNA driver with IOC auto recovery disabled use the following commands esxcfg module u ...

Page 26: ...e current directory for Windows systems bfa_supportsave dir Creates and saves the supportsave output under a directory name that you provide bfa_supportsave dir ss_file_name Creates and saves the supportsave output under a directory and file name that you provide If the directory already exists it will be overwritten NOTE If specifying a directory make sure that the directory does not already exis...

Page 27: ...e Completed Port crash events have a CRITICAL severity and you can view the details in the Master Log and Application Log tables in HCM Support Save differences Following are differences in data collection for the HCM BCU and browser applications of bfa_supportsave BCU Collects driver related logs HCM Agent information and configuration files Browser Collects driver related and HCM Agent logs and ...

Page 28: ...xxviii Brocade Adapters Installation and Reference Manual 53 1002144 01 ...

Page 29: ...2 illustrates major components of the dual port Brocade 1860 Fabric Adapter Brocade 1860 single or dual port adapter models can ship with the following configurations of small form factor pluggable SFP transceivers Single port model 16 Gbps Fibre Channel SFP 10GbE SFP or without optics Dual port model Two 16 Gbps Fibre Channel SFP two 10GbE SFP or without optics Although adapters may ship with spe...

Page 30: ...e installed for the port The port provides Host Bus Adapter HBA functions on a single port so that you can connect your host system to devices on the Fibre Channel SAN Ports with 8 Gbps SFPs configured in HBA mode can operate at 2 4 or 8 Gbps Ports with 16 Gbps SFPs configured in HBA mode can operate at 4 8 or 16 Gbps Fabric Adapter ports set in HBA mode appear as FC ports when discovered in HCM T...

Page 31: ...ns run simultaneously Fabric Adapter ports set CNA mode appear as FCoE ports when discovered in HCM These ports appear as 10 GbE NIC to the operating system Changing the port mode You can change the mode of individual ports on an adapter using the following BCU commands The bcu port mode command allows you can change the mode of individual ports on the adapter The bcu adapter mode command allows y...

Page 32: ... Distance depends on cable type Refer to Cabling on page 176 Any switch compatible with the adapter 10 Gbps LR long range SFP 10 km 1310 NM Optical long range SFP for fiber optic cable 10 km 6 2 mi Any switch compatible with the adapter 1 meter direct attached SFP copper cable SFP for 1 meter 3 2 feet maximum twinaxial copper cable Any switch compatible with the cable 3 meter direct attached SFP c...

Page 33: ...pology or directly to a storage array in a point to point topology Using Fabric Adapter ports configured in CNA mode you can connect a server host system to a Fibre Channel SAN through connection with a compatible FCoE switch Refer to the latest Brocade interoperability matrices for a list of supported server models on Brocade s website at www brocade com adapters Converged network adapters Table ...

Page 34: ...ata Center Bridging DCB networks FCoE and 10 Gbps DCB operations run simultaneously The combined high performance and proven reliability of a single ASIC design makes these CNAs ideal for connecting host systems on Ethernet networks to SAN fabrics based on Brocade Fabric or M Enterprise operating systems Stand up adapters Stand up type CNAs such as the 1010 and 1020 are low profile MD2 form factor...

Page 35: ...de branded SFP laser transceivers supplied with stand up CNAs 1 LEDs for port 1 SFP 2 Cable connectors for port 1 and port 0 SFPs Fiber optic SFP illustrated 3 LEDs for port 0 SFP 4 Low profile mounting bracket Note The CNA ships with the low profile mounting bracket installed 5 PCIe x8 connector 6 ASIC 2 3 1 4 Note This photo illustrates parts location only The CNA may not look exactly like your ...

Page 36: ...0 Gbps Please note that the following illustration is representative and may have minor physical differences from the card that you purchased FIGURE 4 Brocade 1007 CNA NOTE Labels showing the part number PWWNs port MAC addresses model number and serial number for the Brocade 1007 CNA are on the reverse top side of the card 1 ASIC with heat sink 2 x8 PCIe interface connector 3 Release lever Pull to...

Page 37: ... additional information related to the supported blade server blade system enclosure and other devices installed in the enclosure such as I O modules and switch modules refer to the installation instructions provided with these products 1741 The Brocade BR1741M k 2P Mezz Card also known as the Brocade 1741 mezzanine card is small form factor SFF mezzanine card containing two ports operating at 10 ...

Page 38: ...rocade branded small form factor pluggable SFP transceivers described in Table 4 in Brocade stand up CNAs The table provides the type description and switch compatibility information for supported SFPs Host systems and switches stand up adapters For a current list of switches servers and applications compatible with Brocade stand up adapters refer to the latest interoperability matrixes on Brocade...

Page 39: ...vided for the blade server and blade system enclosure The Brocade mezzanine adapter is compatible with the following types of modules that install in the supported blade system enclosure Pass through modules I O modules Switch modules NOTE For detailed information about these modules see the installation and user guides and interoperability guides provided for these modules and the blade system en...

Page 40: ...ble 5 provides the model number port speed number of ports and adapter type for the current Brocade Fibre Channel PCIe HBAs These adapters provide reliable high performance host connectivity for mission critical SAN environments Two types of HBAs are available Stand up adapters These are low profile MD2 form factor PCI Express PCIe cards measuring 6 6 in by 2 714 in 16 765 cm by 6 89 cm that insta...

Page 41: ... Brocade 410 and 420 Fibre Channel HBAs also known as the Brocade 400 Fibre Channel HBAs Stand up models Figure 6 on page 13 illustrates major components of the Brocade 825 stand up model HBA Please note that the following illustration is representative and may have minor physical differences from the HBA that you purchased FIGURE 6 825 HBA with low profile mounting bracket head sink removed 1 LED...

Page 42: ...ates major components of the Brocade 804 mezzanine HBA This mezzanine card installs in supported blade servers that install in Hewlett Packard BladeSystem c Class enclosures Please note that the following illustration is representative and may have minor physical differences from the HBA that you purchased FIGURE 7 804 mezzanine HBA 1 Mounting screws 2 ASIC 3 OEM serial and part number 4 PWWNs for...

Page 43: ...ules interconnect modules and other components that install in supported blade system enclosures For details on blade servers and system enclosures that are compatible with this adapter refer to the following The interoperability matrices on Brocade s website at www brocade com adapters Manufacturer websites for these products Your blade server or blade system enclosure marketing representative or...

Page 44: ... ports configured in HBA mode CNAs Refer to the following subsections General features on page 16 FCoE features on page 20 Data Center Bridging and Ethernet features on page 22 HBAs Refer to the following subsections General features on page 16 HBA features on page 27 General features Brocade adapters support the following general features for enhanced performance and connectivity in the SAN and E...

Page 45: ...re supported on Brocade CNAs and on Fabric Adapter 10 GbE ports configured in CNA or NIC mode You cannot create or delete vNICs for Brocade CNA models such as the 1010 and 1020 Multiple vNICs are only supported on Fabric Adapter ports vNIC create and delete functions are supported For Fabric Adapter ports you can create up to four Ethernet PFs per port using the BCU vnic create command Therefore f...

Page 46: ...mands vnic create port_id b bandwidth Creates a new vNIC instance for a given adapter port You can specify the maximum bandwidth allowable for this vNIC vnic delete pcifn Removes the specified vNIC instance vnic query pcifn Queries information about the virtual NIC vnic enable pcifn Enables a vNIC on a specified adapter port for a specified PCI function vnic disable pcifn Disables a vNIC on a spec...

Page 47: ...s for enhanced serviceability stand up adapters only Storage Management Initiative Specification SMI S Specification supporting the Common Information Model CIM Provider which allows any standard Common Information Model CIM and SMI S based management software to manage installed Brocade adapters NOTE Although SMI S Provider and CIM Provider may be used interchangeably CIM is the more generic term...

Page 48: ... direct attached device is also supported Fabric based boot LUN discovery a feature that allows the host to obtain boot LUN information from the fabric zone database NOTE This feature is not available for direct attached targets Persistent binding This enables you to permanently assign a system SCSI target ID to a specific Fibre Channel device Fibre Channel Security Protocol FC SP providing device...

Page 49: ... on an adapter physical port through the HCM Basic Port Configuration dialog box and the BCU fcpim lunmaskadd command to identify the logical port initiator and remote WWN target for the LUN number Refer to the Brocade Adapter Administrator s Guide for more information on configuration This feature has following limitations Only 16 LUN masking entries are allowed per physical port Multiple BCU ins...

Page 50: ...guration only Internally hardware will always be configured to support FCoE frames that require mini Jumbo size frames NOTE The jumbo frame size set for the network driver cannot be greater than the setting on the attached FCoE switch or the switch cannot accept jumbo frames Simple Network Management Protocol SNMP SNMP is an industry standard method of monitoring and managing network devices Broca...

Page 51: ...ets The adapter firmware obtains the iSCSI configuration from the switch through the DCB Exchange Protocol DCBX and applies the configuration to the network driver to classify the iSCSI traffic The adapter will use this as a priority for all network traffic Note the following for the different adapter models On CNA adapters and Fabric Adapter port configured in CNA mode ETS support will only be su...

Page 52: ... priorities in the ASIC This feature enables Brocade CNAs and Fabric Adapter ports configured in CNA mode to pass link layer traffic using multiple transmit priorities without interfering with the assigned priority for the FCoE or iSCSI traffic on the same port This also allows handling of FCoE or iSCSI priority changes propagated from the DCB switch Multiple traffic priorities are used to ensure ...

Page 53: ...ve chores like setting up the MAC address and retrieving statistics through the adapter UNDI drivers are embedded in the CNA firmware Network Priority The CNA and Fabric Adapter port configured in CNA mode support this feature which provides a mechanism to enable DCB flow control 802 1Qbb Priority based Flow Control Pause 802 1p on network traffic In addition it guarantees mutual exclusion of FCoE...

Page 54: ...tation can be done by the Transmission Control Protocol TCP is called TCP segmentation VLAN 802 1Q A Virtual LAN VLAN is a way to provide segmentation of an Ethernet network A VLAN is a group of hosts with a common set of requirements that communicate as if they were attached to the same LAN segment regardless of their physical location A VLAN has the same attributes as a physical LAN but it allow...

Page 55: ...X systems that use high speed I O devices such as 10 Gbps Ethernet vNICs or virtual network interface cards NICs Virtual Network Interface Cards vNICs are virtual partitions that appear as a virtual or logical NICs to the host operating system vNICs are supported on Brocade CNAs and on Fabric Adapter 10 GbE ports configured in CNA or NIC mode Multiple vNICs are only supported on Fabric Adapter por...

Page 56: ...s exclusive access to the boot LUN Refer to the Brocade Administrator s Guide for more information Quality of Service QoS feature working in conjunction with the QoS feature on Brocade switches to assign high medium default or low traffic priority to a given source or destination traffic flow The following licenses need to be installed on the edge switch connected to each HBA port or Fabric Adapte...

Page 57: ...ongestion and alleviates I O slowdowns at faster targets Target rate limiting is enforced on all targets that are operating at a speed lower than that of the target with the highest speed If the driver is unable to determine a remote port s speed 1 Gbps is assumed You can change default speed using BCU commands Target Rate Limiting protects only FCP write traffic N_Port ID Virtualization NPIV Allo...

Page 58: ...m a boot device located somewhere on the SAN instead of the host s local disk or direct attached Fibre Channel storage Specifically this boot device is a logical unit number LUN located on a storage device Booting from direct attached Fibre Channel storage is also supported Fabric based boot LUN discovery a feature that allows the host to obtain boot LUN information from the fabric zone database N...

Page 59: ...gical HBAs to the host operating system Multiple vHBAs are not supported therefore you cannot create or delete them from an adapter For more information refer to I O virtualization on page 16 Adapter management features The Host Connectivity Manager HCM and Brocade Command Line Utility BCU are the primary management tools for HBAs CNAs and Fabric Adapters You can load HCM as an optional applicatio...

Page 60: ...36 for ports configured in HBA mode NIC Management on page 35 for ports configured in NIC mode Fabric Adapter management on page 36 CNAs Refer to the following subsections General adapter management on page 32 CNA management on page 33 HBAs Refer to the following subsections General adapter management on page 32 HBA management on page 36 General adapter management Use BCU commands and HCM for inst...

Page 61: ...MP and BladeCenter Open Fabric Manager Brocade 1007 adapter only FCoE management HCM and BCU provide the provides the following functions for CNAs and for Fabric Adapter ports configured in CNA mode CNA port statistics display FCoE ports configuration Fibre Channel Security Protocol FC SP configuration Enabling target rate limiting vHBA statistics monitoring Port target and Fibre Channel Protocol ...

Page 62: ...down Be sure to configure valid non zero values for PWWN NWWN when using BOFM Simple Network Management Protocol Simple Network Management Protocol SNMP is supported by CNAs and by Fabric Adapter for ports configured in CNA or NIC mode SNMP is an industry standard method of monitoring and managing network devices This protocol promotes interoperability because SNMP capable systems must adhere to a...

Page 63: ...ils on MIB groups and objects supported by Brocade adapters refer to Appendix B MIB Reference NIC Management Ports on Fabric Adapters only can be set to operate in NIC mode These ports appear as 10 GbE NICs to the host operating system BCU commands and HCM provide features for configuring troubleshooting and monitoring NIC connections to the Ethernet LAN For an overview refer to Ethernet managemen...

Page 64: ...or adapter conditions and problems Monitor and analyze traffic between N_Port pairs through a mirrored port on the switch HBA Analyzer Virtual FC ports creation vHBA statistics display FCP IM Module statistics display Fabric statistics display Port configuration LUN masking configuration Historical statistics HCM and BCU commands provide the following features only for Brocade Fabric Adapter ports...

Page 65: ... systems Three types of adapter drivers are provided in installation packages Storage driver all adapters This driver provides Fibre Channel frame transport for Brocade HBAs and Fabric Adapter ports configured in HBA mode as well as FCoE transport for Brocade CNAs The installer logic detects either a FCoE or Fibre Channel network and the appropriate driver support is provided automatically NOTE Th...

Page 66: ...rts configured in CNA mode it manages the physical Ethernet link to present an Ethernet interface to the network driver and a virtual FCoE link to the storage driver once DCB compliance is established for the link For Fabric Adapters with ports configured in NIC mode it manages the physical Ethernet link to present an Ethernet interface to the network driver ATTENTION The LLDP DCBCXP engine is imp...

Page 67: ...software HCM agent The agent provides an interface for managing adapters installed on the host through the HCM application CIM Provider CIM Provider packages installed on your host system allow any standard Common Information Model CIM and SMI S based management software to manage installed Brocade adapters The appropriate CIM Provider rpm or msi package loads to your host system when you install ...

Page 68: ...BLE 7 Operating system support for network and storage drivers Operating System x86 x64 IA 64 SPARC Windows1 Windows Server 20032 Both drivers supported 32b Both drivers supported 64b Both drivers not supported N A Windows Server 20083 Both drivers supported 32b Both drivers supported 64b Both drivers not supported N A Windows Server 20083 R2 SP14 Both drivers not supported 32b Both drivers suppor...

Page 69: ...igured in HBA mode and HBAs Hot fix KB932755 or later is the minimum requirement and KB943545 is recommended 3 For Windows 2008 hot fix KB968675 and KB2490742 are recommended Hot fix KB958015 is recommended for CNAs and Fabric Adapter ports configured in CNA mode For Windows 2008 R2 KB977977 is recommended for CNAs and Fabric Adapter ports configured in CNA mode 4 Supported by Windows 2008 drivers...

Page 70: ...an also manage the current version as well as all previous versions of the HCM agent Boot code The adapter boot code contains the following PCI BIOS 2 1 or later PCI firmware 3 0 Boot code for PCI system BIOS Boot code for x86 and x64 platforms Unified Extensible Firmware Interface UEFI Boot code for UEFI systems NOTE UEFI is not supported on the Brocade 804 adapter Adapter firmware The adapter bo...

Page 71: ...d where adapter event message HTML files are loaded to your host system refer to the Tools for Collecting Data chapter in the Brocade Adapters Troubleshooting Guide In addition you can view all event messages in the Message Reference appendix of the same guide Software installation and driver packages Table 9 on page 44 describes the software installation packages that you can download for each su...

Page 72: ...tem and Platform Brocade Adapter Software Installer Driver Package Windows Server 2003 x86 brocade_adapter_software_installer_ windows_ version exe Installs HCM and appropriate driver package brocade_driver_win2003_x86_ version exe Storport miniport storage and network drivers with HCM Agent for Standard Enterprise Server on x86 platforms This package also contains installer script brocade_install...

Page 73: ...er_linux_rhel5_ version tar gz4 LinuxRHEL 6 0 6 1 x86 brocade_adapter_software_installer_ linux_ version bin Installs HCM and appropriate driver package 5 brocade_driver_linux_ version tar gz3 brocade_driver_linux_rhel6_ version tar gz4 LinuxRHEL 6 0 6 1 x86_x64 brocade_adapter_software_installer_ linux_ version bin Installs HCM and appropriate driver package 5 brocade_driver_linux_ version tar gz...

Page 74: ...ckage for operating system and platform brocade_driver_solaris10_ version tar6 Leadville based storage driver with user applications such as HCM Agent Brocade Adapter Software Installer and BCU for x86 platforms Solaris 10 0 SPARC x86_64 brocade_adapter_software_installer_ solaris10_sparc_ version bin Installs HCM and appropriate driver package brocade_driver_solaris10_ version tar6 Leadville base...

Page 75: ... The driver module is compiled on the system during the RPM installation An installer program is available for use when you untar this package To install this package the appropriate distribution kernel development packages must be installed for the currently running kernel which include the gcc compiler and the kernel sources Although this package installs SLES drivers the error message bfa or bn...

Page 76: ...A or Fabric Adapter installed in a host system Refer to Software installation and driver packages on page 43 for a complete list of driver and software installer packages that you can download from the Brocade adapter website at www brocade com adapters On the adapters website navigate to the Downloads page Items shipped with your adapter This section describes items shipped with your adapter Stan...

Page 77: ...ux Solaris and VMware systems A Zip file is available for Windows 2003 and VMware ESX 5 0 systems NOTE When installing the operating system to the remote boot LUN you must use the driver update disk DUD appropriate for the host operating system and platform or installation will fail Also note that two separate DUDs are available for each operating system to provide appropriate storage and network ...

Page 78: ...nload ISO Image to download brocade_adapter_software_ISO_ date iso Adapter boot code image This contains BIOS and UEFI boot code and firmware used by the boot code to boot from the adapter Load this code to option ROM on the adapter using the BCU boot update command Download this image from the Brocade adapters website using the following steps a Go to the adapters website at www brocade com adapt...

Page 79: ..._rhel54_i386_dud_ version iso6 brocade_fc_adapter_rhel55_i386_dud_ version iso5 brocade_nw__adapter_rhel55_i386_dud_ version iso6 brocade_fc_adapter_rhel56_i386_dud_ version iso5 brocade_nw__adapter_rhel56_i386_dud_ version iso6 brocade_fc_adapter_rhel60_i386_dud_ version iso5 brocade_nw__adapter_rhel60_i386_dud_ version iso6 brocade_fc_adapter_rhel61_i386_dud_version iso5 brocade_nw_adapter_rhel6...

Page 80: ...ut only on HBAs and Fabric Adapter HBA ports After installing the boot package be sure to upgrade to the latest driver 2 2008 DUDs support Fabric Adapters and HBAs Zip file contains files for floppy disk Windows 3 Network drivers for CNAs and for Fabric Adapter ports configured in CNA or NIC mode Zip file contains files for floppy disk For network boot the network driver is injected as part of the...

Page 81: ...he following tasks Run the Support Save feature Reinstall drivers Run adapter utilities NOTE Launching BCU on Windows systems through methods other than through the desktop shortcut is not recommended and may result in display of inconsistent information To list all the commands and subcommands type the following command bcu help To check the CLI and Driver version number type the following comman...

Page 82: ...54 Brocade Adapters Installation and Reference Manual 53 1002144 01 Using BCU commands 1 ...

Page 83: ... ports configured in CNA or NIC mode and CNAs on a VMware systems it is advisable to install the driver before the adapter so that the NICs will be properly numbered in the system Perform appropriate steps under Chapter 3 Software Installation then return to this chapter To troubleshoot problems after installation refer to the Brocade Adapters Troubleshooting Guide For details in items shipped wit...

Page 84: ...or gold connector contacts 1 Check that you have received all items needed for installation Refer to Items shipped with your adapter on page 48 2 Remove the adapter from its packaging and check for damage If it appears to be damaged or if any component is missing contact Brocade or your reseller support representative 3 Make a backup of your system data 4 Power down the host Unplug all power cords...

Page 85: ...and installing SFP transceivers on page 59 for procedures b Remove the two screws attaching the bracket to the adapter and pull off the bracket Refer to Figure 8 FIGURE 8 Removing or installing adapter mounting bracket c Carefully guide the new mounting bracket onto the adapter making sure the bracket mounting tabs align with the holes in the adapter d Replace and tighten the two screws e Store th...

Page 86: ...cedures 12 Replace the system s case or cover and tighten all screws Connecting an adapter to a switch or direct attached storage Use multimode fiber optic cable or twinaxial copper cable Fabric Adapters with ports configured in CNA mode and CNAs only with appropriate connectors when connecting the adapter to the switch Use multimode fiber optic cable when connecting an HBA or Fabric Adapter port ...

Page 87: ...for installing into the server cabinet use the following steps 1 Pull out the protective rubber plug from the SFP connector 2 Remove the SFP For SFPs with optical transceivers use your thumb and forefinger to unlatch the bail from the side of the cable connector Using the bail or pull tab as a handle pull the SFP straight out of the receiver Refer to the left illustration in Figure 10 NOTE For 16 ...

Page 88: ...f you are replacing an adapter perform the following steps 1 Make a backup of your system data 2 Power down the host Unplug all power cords and network cables 3 Remove all covers necessary from the system to access the PCIe slot where you want to install the adapter Refer to documentation provided with your system to locate PCIe slots and cover removal procedures 4 Unlatch the mounting bracket for...

Page 89: ...ne adapter determines where you install the interconnect modules Instructions for accessing the server blade through a console or workstation to install adapter drivers and software For details on other devices that install in the blade system enclosure refer to the Installation and User Guide that came with the device For details on compatibility with blade servers switch modules I O modules and ...

Page 90: ...tion Have the following available for installing the adapter Adapter shipping carton which includes the adapter and necessary documentation Fully operational blade server Access to blade server through local or remote console connection Blade server or storage expansion unit Installation and User s Guide Blade system enclosure Installation and User s Guides I O module installation guide for the bl...

Page 91: ...is section to update this firmware if required Determining firmware version To query the PHY module and determine attributes such as the PHY module status and installed firmware version use the bcu phy query command bcu phy query port_id where port_id ID of port for which you want to determine the firmware version This could be the PWWN port hardware path or user specified port name This could als...

Page 92: ...64 Brocade Adapters Installation and Reference Manual 53 1002144 01 Mezzanine adapters 2 ...

Page 93: ...sing the Brocade Adapter Software Uninstaller refer to Software removal using Adapter Software Uninstaller on page 83 and upgrading software using the Brocade Adapter Software Installer refer to Software upgrade using Adapter Software Installer on page 87 Procedures are also provided for configuring HCM agent operations and setting the IP address and subnet mask on CNAs and Fabric Adapter ports co...

Page 94: ..._installer_Solaris10_ platform _ version bin NOTE The platform variable in the installer commands is the host system architecture such as SPARC x86 or x64 The Brocade Adapter Software Installer is not supported on the VMware ESX platforms for installing drivers HCM or utilities However you can use an appropriate Brocade Adapter Software Installer to install HCM on a guest system For VMware drivers...

Page 95: ...ar gz or when using the Brocade Adapter Software Installer and the kernel has been upgraded to a version without pre compiled binaries perform the following tasks to make sure the drivers will load on system reboot For Linux SLES 10 systems make sure that the LOAD_ UNSUPPORTED_MODULES_AUTOMATICALLY variable on your system is set to yes This variable is in the following configuration file etc sysco...

Page 96: ...ost in maintenance mode since a system reboot is required after installation Using the Brocade Adapter Software Installer Use information in this section to install the Host Connectivity Manager HCM and driver packages for your host platform using the Brocade Adapter Software Installer BASI application Instructions for using the GUI based installer and command line installer are provided The Broca...

Page 97: ... libXau el6 i686 rpm libXext el6 i686 rpm libXi el6 i686 rpm libXtst el6 i686 rpm libxcb el6 i686 rpm nss softokn freebl el6 i686 rpm glibc el6 i686 rpm Using the GUI based installer The Brocade Adapter Software Installer BASI GUI based application or commands are the preferred methods to install the following components on your host system Storage and network drivers Management Utilities These in...

Page 98: ...oftware Installers Drivers or Documents list then download the appropriate Brocade Adapter Software Installer or driver package for your system Find the installer program for your system s operating system and platform under Software installation and driver packages on page 43 Select Download ISO Image to download an ISO 9660 iso optical disk image containing the Brocade Adapter Software Installer...

Page 99: ...ation data on page 114 for more information If this message does not display go on to step 6 6 If a screen such as the one in Figure 12 on page 72 displays listing software components already installed on your system select one of the following options click Continue then skip to step 10 Install with existing configuration The installer compares each configured property and keeps the original valu...

Page 100: ...ys prompting you to close all HCM applications close all applications if they are still running then click OK The Choose Install Set screen displays Figure 13 or Figure 14 NOTE This following screen displays for all adapter models except the Brocade 804 adapter FIGURE 13 Choose Install Set screen models except the 804 adapter NOTE The following screen displays for the Brocade 804 adapter only ...

Page 101: ...elect Yes to update the image and continue installation Select No to not update the image and continue installation 9 If the Choose Install Folder screen displays prompting you to choose a destination folder for the software select either of the following options If this screen does not display go on to step 10 Enter a location for installing the software where the default installation folder disp...

Page 102: ...on progress for the various software components NOTE For Windows systems a Force Driver Installation message box displays if a better driver is already installed for the adapter If message displays select OK to overwrite the existing driver or Cancel to quit installation After software installs the Install Complete screen displays listing installed drivers and other components Figure 16 on page 75...

Page 103: ...apter boot code are synchronized be sure to update your adapter with the latest boot image from the Brocade website at www brocade com adapters whenever you install or update adapter driver packages From the adapters website navigate to the drivers Downloads page Access the appropriate download page by selecting your host s operating system from the Download Individual Software Installers Drivers ...

Page 104: ...ler command without parameters as outlined in Using the GUI based installer on page 69 may generate errors and the installer program will fail Using the installer command with parameters outlined in this section will allow you to install all or individual adapter software components NOTE Brocade 804 and 1007 adapters are not supported on Solaris systems Following are the commands you can use for s...

Page 105: ...OARCH_DRIVER NO YES i silent Install drivers HCM GUI both or management utilities Overwrites the backed up initrd file sh brocade_adapter_software_installer_linux_ version bin DCHOSEN_INSTALL_SET DRIVER GUI BOTH UTIL DFORCE_INITRD_BACKUP NO YES i silent Solaris systems x_86 platforms Install drivers HCM GUI both or management utilities Overwrites the existing driver installed on system sh brocade_...

Page 106: ...t this is recommended for silent mode sh brocade_adapter_software_installer_solaris10_sparc_ version bin i silent f HCMDefaultInstall properties Command options Following are the options that you can modify and in command strings You can also edit these fields in the properties file to change the default install set INSTALLER_UI silent Specifies that the installation mode should be silent CHOSEN_I...

Page 107: ...sion exe Linux systems sh brocade_adapter_software_installer_linux_ version bin Solaris systems sh brocade_adapter_software_installer_solaris10_ x86_ version bin sh brocade_adapter_software_installer_solaris10_ x64_ version bin sh brocade_adapter_software_installer_solaris10_sparc_ version bin Complete details on editing and executing the properties file are available under the Guidelines for sile...

Page 108: ...ou to overwrite the file not overwrite the file or quit To make sure that the drivers and adapter boot code are synchronized be sure to update your adapter with the latest boot image from after you install or update adapter driver packages using the following steps a Go to the adapters website at www brocade com adapters b Navigate to the Downloads page c Select your operating system from the Down...

Page 109: ...version bin DCHOSEN_INSTALL_SET DRIVER i silent To install the driver packages HCM and management utilities in silent mode Windows systems brocade_adapter_software_installer_windows_ platform _ version exe DCHOSEN_INSTALL_SET BOTH UTIL i silent Linux systems sh brocade_adapter_software_installer_linux_ version bin DCHOSEN_INSTALL_SET BOTH UTIL i silent Solaris systems sh brocade_adapter_software_i...

Page 110: ...e after the software installer command HCM the storage driver and the network driver are installed by default in silent mode The HCM Agent starts automatically after installation This is the recommended method for silent installation NOTE Brocade 804 and 1007 adapters are not supported on Solaris systems so Solaris options in this section do not apply Use the following steps 1 At the command line ...

Page 111: ...tion data Refer to HCM configuration data on page 114 for more information Using the Brocade Software Uninstaller Use the following steps to remove software that was installed with the GUI based Brocade Adapter Software Installer native system scripts and system commands Instructions are provided for Windows Linux and Solaris systems NOTE Also use these procedures if HCM is installed on VMware and...

Page 112: ...isplays about the uninstall click Next 3 If a message displays prompting you to close HCM close the application if it is running then click OK on the message box 4 When the Uninstall Options screen displays with uninstall options select an option Select Complete Uninstall to remove the driver packages and all other installed Brocade adapter software components Select Uninstall Specific Features to...

Page 113: ...following steps to remove it 1 Go to the Programs and Features list typically Control Panel Programs Programs and Features 2 Right click Brocade Adapter Software 3 Select Uninstall Change Using Software Uninstaller commands The following steps explain how to use the Adapter Software Uninstaller commands to remove the network and storage driver packages and HCM from Windows Linux and Solaris system...

Page 114: ... cd install directory UninstallBrocade Adapter Software The default install directory is C Program Files BROCADE Adapter Linux and Solaris systems cd install directory UninstallBrocade Adapter Software The default install directory is opt brocade adapter To launch the uninstaller in silent mode you must use and provide values for both the following parameters DCHOSEN_INSTALL_SET i silent Uninstall...

Page 115: ...r Software Installer commands for installation and an existing driver is installed on the system you must use the following parameter to overwrite with the new driver DFORCE_WIN_DRIVER_INSTALLATION 1 For example to overwrite the existing driver packages with the new driver packages and start the HCM Agent automatically use the following command brocade_adapter_software_installer_windows_ platform ...

Page 116: ...e not supported the following procedures are recommended for downgrading between versions 3 0 2 3 2 2 2 1 2 0 and 1 1 NOTE Downgrading the driver is not supported when downgrading from 3 0 to earlier versions However it is possible to restore the 3 0 configuration for version 2 3 if you explicitly save the configuration before removing 3 0 and installing version 2 3 Downgrading HCM and driver or H...

Page 117: ... utilities to Windows Linux and VMware systems using Brocade provided installation scripts Installing driver packages on Solaris systems using native system installer commands Software installation and removal notes The following steps assume that the host s operating system is functioning normally and that all adapters have been installed in the system When upgrading Windows drivers install the n...

Page 118: ... driver package or other adapter software first exit the HCM application and stop the HCM Agent Stop the agent using instructions under HCM Agent operations on page 112 Removing driver packages with system commands is not recommended since this only removes the driver from the operating system stack and does not clean up the driver and utility directories Use the Brocade Adapter Software Uninstall...

Page 119: ...bric Adapter ports configured in CNA mode Windows 2008 R2 KB977977 is recommended for CNAs and Fabric Adapter ports configured in CNA mode Although you can install the driver using the Windows Device Manager use the driver installer script brocade_installer bat or use the Brocade GUI or command based Adapter Software Installer brocade_adapter_software_installer_windows_ platform _ version exe inst...

Page 120: ...se to the driver directory where you want to install the extracted files when prompted for example C Adapter Drivers Note that you can specify a directory other than the default directory 5 Go to the command prompt and change directories cd to the path where you extracted files in step 4 6 Enter the following command using appropriate parameters to install or uninstall the driver package brocade_i...

Page 121: ...ation uninstallation or preinstallation operations W2K3_HOTFIX W2K8_HOTFIX If INSTALL_OP INSTALL use this option to override the installed hot fix with a new hot fix or to avoid checking for a hot fix To specify a new hot fix for override use the format KBnnnnnn Required Optional Description For example W2K8_HOTFIX KB9987654 Required newer_hotfix To avoid checking for hot fix use the value For exa...

Page 122: ...nder Other Devices scan the Device Manager for hardware changes To scan right click on any device in the list and select Scan for hardware changes After you scan for changes the adapter should display in the Device Manager as described under step 9 11 If necessary start the HCM Agent using steps under HCM Agent operations on page 112 NOTE Manually installing the driver package does not automatical...

Page 123: ...ux driver package and standard host configuration you can use these RPMs Refer to Software installation and driver packages on page 43 for a description of packages and kernel versions that they support 1 Boot the host and log on with Administrator privileges 2 Create an installation directory such as opt CNA or opt HBA depending on your adapter 3 Download the appropriate tar gz file for your Linu...

Page 124: ...ing SNMP files were installed this installs the SNMP subagent drivers and other utilities snmp only If management utilities containing SNMP files were installed this installs the SNMP subagent only Examples To install all RPMs network storage and utilities enter one of the following commands brocade_install_rhel sh brocade_install_sles sh To install all RPMs and add storage bfa driver to initrd en...

Page 125: ... the HCM Agent by using steps under HCM Agent operations on page 112 NOTE Manually installing the driver package with installation scripts does not automatically start the HCM Agent 8 When the driver is installed and the system is connected to the fabric verify adapter operation Verify LED operation for stand up adapters by referring to Adapter LED operation stand up adapters on page 184 Upgrading...

Page 126: ...nd change to the directory where you copied the driver file 4 Perform the following steps a Enter the following command and press Enter to untar the file tar xvf brocade_driver_ operating system _ version tar This extracts the driver packages utilities packages and installation script Storage drivers bfa_driver_ operating system _ version pkg Network drivers bna_driver_ operating system _ version ...

Page 127: ...any directory enter the following commands to remove installed packages pkgrm bfa pkgrm bna bkgrm brcd util 5 Respond to prompts Do you want to remove this package by entering y 6 Respond to prompts Do you want to continue with the removal of this package by entering y After a series of messages the following confirms removal Removal of bfa was successful Removal of bna was successful Removal of b...

Page 128: ...tware installation and driver packages on page 43 for a description of host systems that this VMware driver package supports 1 Download then copy the VMware driver package to your system s tmp directory 2 From the temporary directory extract the file using the following commands tar zxvf brocade_driver_ esxversion _ driverversion tar gz 3 Enter one of the following command to run the installer For...

Page 129: ... 184 Adapter LED operation stand up adapters on page 191 Installation on ESXi 4 0 and 4 1 systems Drivers are provided as ISO images packaged in a tarball Use the install script to selectively install storage and network driver packages with utilities to VMware systems Refer to Software installation and driver packages on page 43 for a description of host systems that this VMware driver package su...

Page 130: ...ss where ESXi address ESXi server s IP entered at step 9 12 Mount the adapter driver iso file on a temporary directory such as ISO Create ISO if does not exist mkdir p ISO mount o loop Brocade Driver ISO file ISO As an example mount o loop bfa_esx40_2 3 0 0 iso ISO 13 Scan the ESXi 4 host against the driver CD bulletin IDs using the following command vihostupdate s bundle path of driver zip in mou...

Page 131: ...t Confirming driver package installation Adapter driver packages from Brocade contain the current driver firmware and HCM agent for specific operating systems Make sure the correct package is installed for your operating system Current driver packages are listed under Software installation and driver packages on page 43 An out of date driver may cause the following problems Storage devices and tar...

Page 132: ...ed Unloaded The driver is not currently loaded but it was loaded at least once since you restarted the system Never Loaded The driver was never loaded This status can indicate that the driver s image file is corrupted or that you specified a driver name that is missing from the system Device Manager Verify if the driver is installed and Windows is recognizing the adapter using the following steps ...

Page 133: ...tions Systems Inc displays for an HBA or Fabric Adapter port configured in HBA mode Fibre Channel Brocade Communications Systems Inc and Ethernet Controller display for a CNA or Fabric Adapter port configured in CNA or NIC mode if driver packages have correctly loaded lsmod This command displays information about all loaded modules If bfa appears in the list the storage driver is loaded to the sys...

Page 134: ... Driver should display These commands check for and lists the installed driver package files pkgchk nv bfa pkgchk nv bna This command displays all available information about software packages or sets that are installed on the system pkginfo l For example if the storage driver package is installed bfa_pkg should display with a complete install status in the list of installed packages PKGINST bfa N...

Page 135: ...e version For the storage driver verify that an entry for bfa exists For the network driver verify that an entry for bna exists These commands display the latest versions of installed drivers for ESX 5 0 systems esxcli software vib list grep bfa esxcli software vib list grep bna This command prints the names of the Brocade adapter storage driver package bfa if installed rpm qa grep i bfa This comm...

Page 136: ... chapters in this manual Product Overview on page 1 This includes hardware and software compatibility information This chapter also describes software installation packages supported by host operating system and platforms Hardware Installation on page 55 This chapter provides hardware installation instructions Software Installation This chapter provides software installation instructions Specifica...

Page 137: ...ing for mezzanine adapters only The blade server or server blade is turned on The adapter is installed in the appropriate connector On some blade servers or server blades connectors may only support a specific adapter type Refer to your blade sever documentation for help Whether the blade server or server blade on which the adapter is installed is correctly configured and installed in the blade sy...

Page 138: ...vices typically Start Control Panel Administrative Tools Services b Right click SNMP and select Start Linux systems 1 Go to the following directory where the subagent files are installed opt brocade adapter 2 For RHEL systems enter one of the following commands Enter brocade_install_rhel sh snmp to install the SNMP subagent drivers and other utilities Enter brocade_install_rhel sh snmp only to ins...

Page 139: ...river in the Driver File text box OR Click the Browse button and navigate to the location of the driver file to update 5 Select Start Update The selected file downloads If an error occurs during the downloading process an error message displays 6 Review the installation progress details that display in the dialog box to determine if the files install successfully NOTE During the installation a war...

Page 140: ... HCM GUI will launch 3 Log in to HCM when prompted To launch HCM in the future use the HCM shortcut icon On Windows the shortcut is located under Start menu Brocade Host Connectivity Manager For Solaris launch HCM from the command prompt using the following command sh opt brocade fchba client Host_Connectivity_Manager HCM Agent operations This section outlines the commands used to perform the foll...

Page 141: ... Agent on Solaris systems Use the following commands NOTE The Brocade 804 and 1007 adapters are not supported on Solaris systems so Solaris options do not apply Determining agent operation svcs hcmagentservice Starting the agent agent will not restart if system reboots or agent stops unexpectedly svcadm enable t hcmagentservice Starting the agent agent restarts if system reboots svcadm enable hcma...

Page 142: ...ng the agent a Run the services msc command to display the Services window b Right click Brocade HCM Agent Service and select Stop Stopping the agent from restart after system reboots a Run the services msc command to display the Services window b Right click Brocade HCM Agent Service and select Stop c Right click Brocade HCM Agent Service and select Properties d Select the Manual option in Startu...

Page 143: ... earlier you can only restore data that you backed up during software removal when you are prompted to restore data during software installation For HCM 2 0 and later you can restore data when prompted to do so during software installation or by using the HCM Restore Data dialog box Setting IP address and subnet mask on CNAs After installing a CNA or Fabric Adapter with ports configured in CNA or ...

Page 144: ...xample for using the ifconfig command to set the IP address and subnet mask Note that a CNA and a Fabric Adapter with ports configured in CNA or NIC mode are typically named eth0 ifconfig eth0 193 164 1 10 netmask 255 255 255 0 up VMware Please refer to ESX ESXi Configuration Guide on network configuration for VMware ESX ESXi 4 x and 5 0 ...

Page 145: ...on from the Brocade adapters website using the following steps a Go to the adapters website at www brocade com adapters b Navigate to the adapters Downloads page c Select your operating system from the Downloads list to display appropriate download files d Download the release notes from the Documentation section The following system BIOS and platforms support Brocade adapters Peripheral Component...

Page 146: ...ing system from the Downloads list to display appropriate download files 4 Download the boot code image from the Boot Code area Update the boot code image file to the adapter installed on your host system using the Host Connectivity Manager HCM and BCU commands Although BCU updates the file from the host s local drive you can use HCM to update from a remote system NOTE All Brocade adapters install...

Page 147: ...s website using the following steps a Go to the adapters website at www brocade com adapters b Navigate to the adapters Downloads page c Select your operating system from the Downloads list to display appropriate download files d Download the boot code image from the Boot Firmware area 2 Extract the boot code image file 3 Launch HCM 4 Select a host on the device tree and then select Adapter Softwa...

Page 148: ...ocated somewhere on the Ethernet LAN instead of the host s local disk or over the SAN Booting from a remote LAN location provides the obvious advantage of recovering quickly from a host or adapter malfunction With PXE BIOS enabled on the adapter for a specific port ID or a VLAN ID for a specified port replacing an old host with a new one involves installing the adapter from the old host into the n...

Page 149: ...e over the SAN or from the host s local disk UNDI universal network device interface is an application program interface API used by the PXE protocol to enable basic control of I O It performs other administrative chores like setting up the MAC address and retrieving statistics through the adapter UNDI drivers are embedded in the adapter firmware When PXE boot or PXE BIOS is enabled the following ...

Page 150: ... VLAN ID to be used during network boot for the specific port NOTE Enabling VLAN during network boot requires support from the operating system and has not been fully validated due to operating system limitations Host system requirements for network boot Consider these requirements for your host system when configuring network boot You may need to disconnect internal IDE hard drives to disable the...

Page 151: ...e Configuration Utility Use the following procedures to configure network boot using the PXE PXE BIOS Configuration Menu 1 Power on the host system 2 Watch the screen as the system boots When Brocade PXE 2 1 BIOS 2010 11 All rights reserved displays press Alt B or Ctrl B The Brocade PXE BIOS Configuration Menu displays a list of installed adapter ports similar to the following Under the Ad No colu...

Page 152: ...uration Utility screen For example use the following keys to select and change information Up and Down keys Scroll to a different field Enter Select a field and configure values Left and Right arrow keys Change a value Alt S Save configuration values to adapter flash memory Alt Q Exit the utility Esc Go back a screen Page Up or Page Down Go to preceding or next screen NOTE To restore factory defau...

Page 153: ...the device tree CNA CNA port Fabric Adapter port configured in CNA or NIC mode 2 Select Configure Basic Port Configuration to display the Basic Port Configuration dialog box 3 Select the PXE Boot tab to display network boot parameters 4 Perform any or all of the following actions as appropriate for your needs Click the PXE Boot enable check box to enable or disable BIOS You must enable BIOS to sup...

Page 154: ...e or port hardware path Disable BIOS for PXE boot bcu ethboot disable port_id where port_id Specifies the ID of the port for which you want to set network boot attributes This could be the adapter_id port_id port PWWN port name or port hardware path Enter a VLAN ID for a specific port for use when booting over the network bcu ethboot vlan port_id vlan_id where port_id Specifies the ID of the port ...

Page 155: ... situation Even though you install a similar host the new host may require unique System BIOS options and other settings or internal IDE drives may need to be disconnected or disabled to boot over SAN If replacing the Brocade adapter in a host with a similar Brocade adapter you will need to reconfigure the adapter and storage to boot from the appropriate remote boot device You must also update acc...

Page 156: ...t adapters For more information and configuration procedures for booting over SAN refer to Configuring boot over SAN on page 131 NOTE You can enable or disable BIOS for boot over SAN set port speed HBAs and Fabric Adapter port configured in HBA mode only and display adapter BIOS settings using BCU commands By default BIOS is enabled on all adapter ports The Brocade BIOS Configuration Utility embed...

Page 157: ... are also referred to as virtual drives and boot devices LUNs targeted as boot devices must contain the boot image for the host which consists of the adapter driver host operating system and other files that allow the host to boot from the LUN The process for booting from a boot LUN is referred to as booting over SAN For more information and configuration procedures for booting over SAN refer to C...

Page 158: ...e systems may allow these drives to be enabled in the system BIOS if they correctly support the bootstrap protocol Typically the boot order must be CD ROM diskette then Fibre Channel drive After the operating system installs you can change this order if desired Boot over SAN is not supported on Windows 2003 systems for CNA models and for Fabric Adapter ports configured in CNA or NIC modes Due to t...

Page 159: ...Port 0 when configuring Fabric Zones and LUN Masking for storage For Microsoft Windows and Linux environments the SAN must be connected to the host system in a switched fabric or point to point topology Fibre Channel Arbitrated Loop FC AL connections are not supported Disabling N_Port trunking The Fibre Channel N_Port Trunking feature works in conjunction with the trunking feature on Brocade switc...

Page 160: ...ce Manual 53 1002144 01 Boot over SAN 4 Overview Figure 17 on page 133 provides a flow chart for the Procedures on page 134 and information elsewhere in this chapter to configure your adapter host system and remote boot device for booting over SAN ...

Page 161: ...ver SAN Step 6 8 Configure LUN for booting from host system Step 12 Optional Install full driver package on boot LUN Step 14 Boot host system from storage boot device Step 15 Install adapter drivers host operating system and necessary files on boot LUN Step 13 Create target zone in fabric containing adapter port PWWN and LUN storage port Step 9 Install latest boot code and adapter driver if needed...

Page 162: ...erating system support for drivers refer to Software installation and driver packages on page 43 and Operating system support on page 40 4 Install the latest adapter boot code and driver using the following steps a Download the latest boot code and driver package from the Brocade adapters website using the following steps 1 Go to the adapters website at www brocade com adapters 2 Navigate to the a...

Page 163: ... storage device are attached The zone should contain only the PWWN of the storage system port where the boot LUN is located and the PWWN of the adapter port Refer to the Brocade Fabric OS Administrator s Guide for zoning procedures 10 For BIOS systems use one of the following sections to enable or disable BIOS to boot over SAN set adapter port speed HBAs and Fabric Adapter ports configured in HBA ...

Page 164: ... attached Fibre Channel targets select the Flash Values or First LUN options Fabric Discovered Host boots from LUN information provided by the fabric NOTE Fabric based boot LUN discovery Fabric Discovered is not supported for booting from direct attached targets Flash Values Host boots from LUN information stored in flash memory First LUN Host boots from the first visible LUN Set port speed for th...

Page 165: ...6 ports are supported by the BIOS Configuration Utility Select Page Up to go to a previous screen or Page Down to go to the next screen NOTE To bypass functions and stop loading BIOS you must to press X for each port Press X within 5 seconds to bypass execution of functions displayed on screens If you press X after 5 seconds the next function instead of current function will be bypassed 3 Select a...

Page 166: ...ter to begin adapter configuration A screen similar to the following displays showing the port s current BIOS version NWWN PWPN and MAC CNAs and Fabric Adapter ports configured in CNA mode only Table 11 on page 138 explains options available for BIOS Port Speed and Boot LUN settings TABLE 11 Brocade BIOS Configuration Utility field descriptions Field Description BIOS The value of BIOS must be Enab...

Page 167: ...the list Boot LUN Fabric Discovered When enabled LUN information such as the location of the boot LUN is provided by the fabric refer to Fabric based boot LUN discovery on page 163 Flash Values Boot LUN information will be obtained from flash memory Note that values are saved to flash when you configure and save them through the BIOS Configuration Utility and BCU First LUN The host boots from the ...

Page 168: ...n then enter the PWWN and LUN values for the boot device Press M to exit Select a device and press Enter This displays additional screens that allow you to select discovered LUNs as boot devices If you select a device under Boot Device Settings and press Enter a screen similar to the following displays listing all discovered boot targets 9 Select a target on which you want to designate a boot LUN ...

Page 169: ...s management or configuration utility refer to step 8 under Procedures on page 134 NOTE You only need to select the bootable LUN once After the first boot the same LUN will be used until changed through the BIOS Configuration Utility 11 Press Enter The selected device will be added to the list of boot devices for the adapter 12 Save or exit the configuration utility To save the configuration press...

Page 170: ...heck box to enable boot over SAN You must enable BIOS to support boot over SAN for an adapter port If disabled the host system cannot boot from Fibre Channel disk drives The default setting for the adapter boot BIOS is enabled NOTE For mezzanine adapters only if BIOS was enabled through a blade system management application the Pre boot BIOS Enable option will be selected and cannot be changed The...

Page 171: ...port it must be bound to the LUN using the appropriate management or configuration utility for the storage system In addition a zone set must be created on the attached switch containing PWWN of the storage system port where the boot LUN is located and the PWWN of the adapter port Click the up and down arrows to the right of the table to reorder boot devices in the table Click the delete symbol X ...

Page 172: ...Configuration Utility HCM and BCU firstlun The host boots from the first LUN visible to the adapter that is discovered in the fabric p pos Specifies the start position in the flash array of boot LUNs The range is 0 3 The default value of 0 means the existing PWWN LUN information in flash would be erased b pwwn lun The host boots from the LUN information defined by the target PWWN and LUN value lun...

Page 173: ...eference Manual 145 53 1002144 01 Boot over SAN 4 NOTE For details on using BCU commands refer to instructions for enabling boot over SAN using BCU commands in the Host Configuration chapter of the Brocade Adapters Administrator s Guide ...

Page 174: ...ntation and help system for specific details On systems with EFI shell commands you can use such commands as drvcfg dh and drivers to configure adapter values an example procedure for these systems follows On some systems you can access drvcfg and other commands from a menu system to configure adapter values Refer to instructions or online help provided for your system On other systems you will ne...

Page 175: ...ions currently set on the adapter are valid b When you are prompted to enable the adapter port press the Y or N key to enable or disable the port c When prompted enter a port speed HBAs and Fabric Adapter ports configured in HBA mode only d To terminate and not save values that you have selected press Esc and go to the next step Following is example output from the drvcfg command using driver hand...

Page 176: ...you that you configured as a bootable device when setting up the adapter BIOS or UEFI on the host system Instructions are provided for the following Installing Windows Server 2003 and the driver Installing Windows Server 2008 and the driver Installing Linux RHEL 4 x or 5 x and the driver Installing Linux SLES 10 and later and the driver Installing Solaris and the driver Installing VMware and the d...

Page 177: ...on is complete 2 Download the appropriate Windows 2003 adapter driver update disk dud zip file for your host platform from the Brocade adapters website at www brocade com adapters using the following steps a On the adapters website navigate to the drivers Downloads page b On the downloads page select your host s operating system from the Download Individual Software Installers Drivers or Documents...

Page 178: ... for booting over SAN already has an operating system installed be sure to use options for reformatting the LUN during Windows Server 2008 installation Refer to your operating system documentation for details NOTE For HBAs and Fabric Adapter ports configured in HBA mode you will need the fc dud file brocade_adapter_fc_ operating system _ platform _dud_ version zip For CNAs and Fabric Adapter ports...

Page 179: ...driver update disk 10 Click OK NOTE If Hide drivers that are not compatible with hardware on this computer is selected only drivers for installed adapter models will display on the Select the drive to be installed screen If not selected drivers for all adapter models display 11 Select the driver for the adapter that you are configuring for boot over SAN and click Next After the driver loads remote...

Page 180: ...r adapter drivers NOTE For RHEL 5 x86 and x86_64 systems install the fc DUD files for CNAs and Fabric Adapter ports configured in CNA mode and for HBAs and Fabric Adapter ports configured in HBA mode The fc dud file format is brocade_fc_adapter_ operating system _ platform _dud_ version iso 2 Download the appropriate RHEL adapter driver update disk dud iso file for your host platform from the Broc...

Page 181: ...n instructions and refer to your system documentation as necessary to format and complete installation on the target boot LUN Installing Linux SLES 10 and later and the driver Use the following steps to install SLES 10 and later and the adapter driver on an unformatted Fibre Channel disk configured as a bootable device For HBAs installed on SLES 11 on UEFI supported systems refer to UEFI mode inst...

Page 182: ...ter For SLES 11 systems press F6 When the system prompts to select Yes No or File select Yes and press Enter 6 When the Please choose the driver update medium prompt displays install the CD or USB drive containing the driver update disk that you created in step 3 NOTE You must load the Brocade adapter driver at this stage so that the system can access the boot LUN for Linux installation If you are...

Page 183: ...ilities refer to Installing the full driver package on boot LUNs on page 162 after completing the following steps 1 Refer to Boot installation packages on page 49 for a list of driver update disk files and the operating systems that support these files Also refer to Operating system support on page 40 for information on operating system support for adapter drivers NOTE Install the fc dud for an HB...

Page 184: ...oot option using the following steps a Log in as root b Right click the screen and select Open Terminal from the menu c Edit the boot grub menu lst file and change default 0 to default 1 Also comment out the hiddenmenu line hiddenmenu d Change the timeout to 15 seconds instead of the default 5 recommended e Save the file and reboot 15 The RHEL compatible kernel should now boot by default Installin...

Page 185: ... driver update iso file appropriate for your system from the Brocade adapters website using the following steps a Go to the adapters website at www brocade com adapters b Navigate to the adapters Downloads page c Select your operating system from the Downloads list to display the appropriate download files d Download the file from the Driver Update Disks DUDs area 3 Create an install time update C...

Page 186: ...system documentation as necessary to format and complete installation on the target boot LUN Installing VMware and the driver Use the following steps to install VMware and the adapter driver on an unformatted Fibre Channel disk that you that you configured as a bootable device when setting up the adapter BIOS or UEFI on the host system If the LUN you have targeted for booting over SAN already has ...

Page 187: ...e appropriate VMware drivers for the system 4 Insert the ESX OS disk into the host system 5 When prompted for an upgrade or installation method select the graphical mode Installation messages display followed by a welcome screen 6 Follow on screen prompts to continue and accept license agreement 7 If prompted for Installation Options select Complete Server install formatting installation hard disk...

Page 188: ...ntries in the boot options menu 2 Insert the SLES 11 product CD in your host system and follow your system procedures to boot from the CD 3 Proceed with the SLES 11 installation making certain to set up the UEFI boot efi partition and to select the elilo boot loader During the installation the boot loader installation process will display an error dialog box Retrying the boot loader installation w...

Page 189: ...that support these files Also refer to Operating system support on page 40 for information on operating system support for adapter drivers 2 Download the Brocade adapter driver update iso file appropriate for your system from the Brocade adapters website using the following steps a Go to the adapters website at www brocade com adapters b Navigate to the adapters Downloads page c Select your operat...

Page 190: ... support on page 40 1 Compare the version of the full driver package that you wish to install with the version of the driver already installed on the boot LUN There are a variety of methods to determine the driver version installed on your operating system Refer to Confirming driver package installation on page 103 for more information If the versions do not match you will perform additional steps...

Page 191: ...discovery is enabled the host s boot LUN information is stored in a SAN fabric zone This zone contains zone members that include the PWWN of the adapter port and PWWN and LUN WWN of the storage target The adapter boot code will query the zone member list for the zone name that matches the adapter PWWN to determine the boot target and LUN NOTE Fabric Based Boot LUN Discovery auto discovery from fab...

Page 192: ...name matching the HBA PWWN to determine the boot target and LUN For details on this command and additional parameters refer to the Fabric OS Command Reference Guide Using BCU boot blunZone command Use the Fabric OS zoneCreate command to create a zone on the switch where the adapter is connected zonecreate zonename member member The zonename operand will be BFA_ adapter port WWN _BLUN For example i...

Page 193: ...ds zonecreate zonename member member For example if the output from boot blunZone is the following you simply enter this for the zoneCreate command operands on the switch BFA_100000051E419ACB_BLUN 00 00 00 00 50 00 00 05 00 00 00 01 1e 41 9a ca 00 00 00 02 DD EE FF 00 00 00 00 03 09 AA BB CC 4 Enter the FOS OS cfgSave command on the switch to save the zone configuration NOTE The zone created is on...

Page 194: ...name and member for the switch commands bcu boot blunZone c cfg p port_wwn r rport_wwn l lun_id lun where c cfg Specifies boot LUN use c BLUN p port_WWN The hexadecimal WWN of the adapter port connecting to the boot LUN For example 10 00 00 05 1e 41 9a cb r rport_WWN The hexadecimal WWN of the remote storage target s port For example 50 00 00 05 1e 41 9a ca l lun_id lun The hexadecimal LUN identif...

Page 195: ... only an entity to store boot LUN data There is no zone enforcement by the fabric You must create a separate zone containing the adapter port and storage target port to ensure that the adapter port is able to see the target NOTE For additional details on configuring zones and zone sets refer the configuration guide for your Cisco switch Boot systems over SAN without operating system or local drive...

Page 196: ...riate download files d Download the file from the Boot Code area NOTE For UEFI based systems create a WinPE image for your system using steps under Creating a WinPE image on page 169 2 Create a bootable CD or USB drive using the ISO image Refer to the documentation for your CD or USB drive burning software for details As an example of open source USB burning software for bootable Live USB drives r...

Page 197: ... a bootable CD or USB drive from this image using appropriate burning software and install WAIK on your local system where you will create the WinPE image 3 Determine the appropriate adapter driver package for your operating system and host platform using information in Software installation and driver packages on page 43 The WinPE image creation is based on the Vista kernel Therefore use the driv...

Page 198: ...ew adapter driver without removing the existing driver This is the recommended procedure to update drivers If you remove the adapter driver which requires a system reboot because the adapter was modified then reinstall the driver installation will fail because the operating system cannot update the driver while a system reboot is pending However if you reboot the system after removing the driver t...

Page 199: ...height standard bracket installed and a low profile bracket included for mounting in your host system Table 18 lists the two bracket types and dimensions PCI Express interface Install Brocade stand up adapters in PCI Express PCIe computer systems with an Industry Standard Architecture Extended Industry Standard Architecture ISA EISA bracket type Following are some of the features of the PCIe inter...

Page 200: ... the Properties dialog box for the adapter by right clicking the adapter and selecting Properties from the shortcut menu 3 Select the Details and Driver tabs to locate specific values Hardware specifications The adapter supports features outlined in Table 19 on page 180 TABLE 13 Fabric Adapter hardware specifications Feature Description Port speeds 10 312 Gbps for installed 10GbE SFPs 16 8 or 4 Gb...

Page 201: ...t 8 Gbps 800 MB at 4 Gbps 400 MB at 2 Gbps Ethernet performance 10 312 Gbps throughput per port Line rate performance for 700 byte packets Low latency receive 1 5us transmit 2us Topology Ethernet 10 Gbps DCB Fibre Channel Point to Point N_Port Data protection Cyclic redundancy check CRC on PCIE and line side links ECC within the ASIC memory blocks 2 bit detection and 1 bit correction Error correct...

Page 202: ...oad IPv4 Specification RFC 791 IPv6 Specification RFC 2460 TCP UDP Specification RFC 793 768 ARP Specification RFC 826 Data Center Bridging DCB Capability DCB Exchange Protocol DCBXP 1 0 and 1 1 RSS with support for IPV4TCP IPV4 IPV6TCP IPV6 hash types Syslog SRIOV Jumbo frames Interrupt coalescing Interrupt moderation Multiple transmit priority queues Network Priority Large and small receive buff...

Page 203: ...r FC IPoFC Target rate limiting Boot Over SAN including direct attached Fabric Based Boot LUN Discovery Persistent binding I O interrupt coalescing and moderation Class 3 Class 2 control frames Fibre Channel Protocols and features SCSI over FC FCP FCP2 FCP3 FC SP Authentication NPIV Quality of Service QoS Target Rate Limiting Boot Over SAN Fabric Based Boot LUN Discovery I O Interrupt Coalescing T...

Page 204: ... m 1804 ft Ethernet 10 Gbps LR long reach SFP 10 km 1310 nm Single mode media 9 microns NA 10 km 6 2 mi 1m direct attached SFP copper cable Copper twinaxial cable 1m 3 2 ft 1m 3 2 ft 3m direct attached SFP copper cable Copper twinaxial cable 3m 9 8 ft 3m 9 8 ft 5m direct attached SFP copper cable Copper twinaxial cable 5m 16 4 ft 5m 16 4 ft TABLE 15 Fibre Channel transceiver cable specifications T...

Page 205: ... port are visible through the mounting brackets FIGURE 18 LED locations for Brocade dual port A and single port B 1860 Fabric Adapters Table 21 describes operation for the following LEDs visible on the CNA TABLE 16 LED operation State Slow flashing green1 Slow flashing green Slow flashing green Beaconing Slow flashing green Slow flashing green Off Invalid optic Slow flashing green Off Off Power on...

Page 206: ...f Power on Ethernet link established No activity Off On Fast flashing green Power on Link established Receive and Transmit FCoE activity Off Fast flashing green Off Power on Link established Receive and Transmit Ethernet activity only Off Fast flashing green Fast flashing green Power on Link established Receive and Transmit Ethernet and FCoE activity 1 1 second on 1 second off 2 50 msec on 50 msec...

Page 207: ... connect to switch and I O modules installed in the blade system enclosure through high speed links in the internal enclosure backplane PCI Express interface Install Brocade stand up CNAs in PCI Express PCIe computer systems with an Industry Standard Architecture Extended Industry Standard Architecture ISA EISA bracket type Install the Brocade mezzanine CNAs in supported server blades that install...

Page 208: ...or the CNA by right clicking the CNA and selecting Properties from the shortcut menu 3 Select the Details and Driver tabs to locate specific values Hardware specifications The CNA supports features outlined in Table 19 TABLE 19 CNA hardware specifications Feature Description Port speeds 10 312 Gbps SFP transceivers stand up adapters Multimode fiber optic small form factor pluggable plus SFP Copper...

Page 209: ...ification RFC 791 IPv6 Specification RFC 2460 TCP UDP Specification RFC 793 768 ARP Specification RFC 826 Data Center Bridging DCB Capability DCB Exchange Protocol DCBXP 1 0 and 1 1 Dell iSCSI Flexible MAC addressing RSS with support for IPV4TCP IPV4 IPV6TCP IPV6 hash types Syslog Jumbo frames Interrupt coalescing Interrupt moderation Multiple transmit queues for Windows and Linux Multiple transmi...

Page 210: ...FIP discovery protocol for dynamic FCF discovery and FCoE link management FPMA and SPMA type FIP fabric login FCoE protocols FCP 3 initiator mode only FC SP FC LS FC GS FC FS2 FC FDMI FC CT FCP FCP 2 FCP 3 FC BB 5 FCoE checksum offload SCSI SBC 3 NPIV IP over FC IPoFC Target rate limiting Boot Over SAN Fabric Based Boot LUN Discovery Persistent binding I O interrupt coalescing and moderation Class...

Page 211: ...m Length Ethernet 10 Gbps SR short range SFP 1490 nm OM1 6 25 125 multimode OM2 50 125 multimode OM3 50 125 multimode OM4 50 125 multimode NA 33m 104 98 ft 82m 269 ft 300m 984 25 ft 550 m 1804 ft Ethernet 10 Gbps LR long reach SFP 10 km 1310 nm Single mode media 9 microns NA 10 km 6 2 mi 1m direct attached SFP copper cable Copper twinaxial cable 1m 3 2 ft 1m 3 2 ft 3m SFP direct attached copper ca...

Page 212: ...t Storage or network activity traffic is occurring over the Ethernet link Storage icons FCoE activity is occurring over link TABLE 21 LED operation Lnk Act Storage State Off Off Off Adapter not operational It may not be powered up or not initialized Slow flashing green1 Off Off Adapter is operational but the physical link is down Steady green Off Off Link is up No Ethernet or storage traffic Stead...

Page 213: ... port on connected switch beacon Flashing amber5 Off Off Unsupported SFP 1 1 second on 1 second off 2 50 msec on 50 msec off 3 1 sec on 250 msec off 4 1 sec on 250 msec off 5 640 msec on 640 msec off TABLE 22 Environmental and power requirements Property Requirement Airflow 45 LFM Altitude Operating 3 048 meters 10 000 ft at 40 C 104 F Nonoperating 12 192 meters 40 000 ft at 25 C 77 F Operating Te...

Page 214: ...uirement Airflow Provided by blade system enclosure Altitude Operating 3 048 meters 10 000 ft Nonoperating 12 193 meters 40 000 ft Operating Temperature 0 to 50 C 32 to 122 F Nonoperating Temperature Maximum 73 C 163 F Minimum 40 C 40 F Operating Humidity 50 C 122 F at 10 to 93 Nonoperating Humidity 60 C 140 F at 10 to 93 Power Dissipation 9 5 W maximum 8 5 W nominal Operating Voltage Per PCIe 2 0...

Page 215: ...in by 4 5 in 10 16 cm by 11 43 cm Mezzanine adapters mount on server blades that install in supported blade system enclosures Refer to Hardware compatibility on page 15 for references to HBA compatibility information Note that mezzanine adapters do not have external port connectors with optics such as stand up HBAs but internal ports that connect to the switch and interconnect modules installed in...

Page 216: ...steps 1 Access the Device Manager 2 Open the Properties dialog box for the HBA by right clicking the HBA and selecting Properties from the shortcut menu 3 Select the Details and Driver tabs to locate specific values Hardware specifications The Fibre Channel interface supports features outlined in Table 26 TABLE 26 Supported Fibre Channel features Feature Description Port Speeds Brocade 804 Interna...

Page 217: ...acity Data Rate Per Port Full Duplex 1600 MB at 8 Gbps 800 MB at 4 Gbps 400 MB at 2 Gbps Performance Per Port 500 000 IOPs maximum Distance Support stand up adapters 50 m at 8 Gbps with 62 5 125 micron multimode fiber Topology Point to Point N_Port Protocols SCSI over FC FCP FCP3 initiator mode only FC SP Authentication NPIV Other Features ASIC Flip flops Parity Protected ECC Memory Parity Protect...

Page 218: ...nel transceiver and cable specifications Transceiver type Speed OM1 M6 62 5 125 micron OM2 M5 50 125 micron OM3 M5E 50 125 micron OM4 M5F 50 125 micron Single Mode Media 9 microns SWL 2 Gbps 150 m 492 ft 300 m 984 ft 500 m 1640 ft N A N A SWL 4 Gbps 70 m 229 ft 150 m 492 ft 380 m 1 264 ft 400 m 1 312 ft N A SWL 8 Gbps 21 m 68 ft 50 m 164 ft 150 m 492 ft 190 m 623 ft N A LWL 2 Gbps N A N A N A N A ...

Page 219: ...ovides the meanings for LED operation on a specific port TABLE 28 LED operation LED Operation Meaning LED is steady green Depending on the LED illuminated link is active at 1 2 4 or 8 Gbps Port is online connected to an external device but has no traffic Note that only one of these LEDs will be steady green to indicate speed LED flickering green Activity such as data transfers is occurring on the ...

Page 220: ...ocade adapters meet or exceed the Fibre Channel standards for compliance performance and feature capabilities as defined in the Brocade standards compliance list This information is available through links under the Solutions and Technology heading on the Brocade website at www brocade com Regulatory compliance This section provides international regulatory compliance notices for the Brocade adapt...

Page 221: ...diate radio frequency energy and if not installed and used in accordance with the instructions may cause harmful interference to radio communications However there is no guarantee that interference will not occur in a particular installation If this equipment does cause harmful interference to radio or television reception which can be determined by turning the equipment off and on the user is enc...

Page 222: ... cause radio interference and the user might be required to take corrective measures The standards compliance label on the adapter contains the CE mark which indicates that this system conforms to the provisions of the following European Council directives laws and standards Electromagnetic Compatibility EMC Directive 89 336 EEC and the Complementary Directives 92 31 EEC 93 68 EEC and 2004 108 EEC...

Page 223: ...R22 or AS NZS CISPR22 C Tick Mark Canada Bi Nat UL CSA 60950 1 2nd Ed or latest cCSAus ICES 003 Class B European Union Austria Belgium Cyprus Czech Republic Denmark Estonia Finland France Germany Greece Hungary Ireland Italy Latvia Lithuania Luxembourg Malta Poland Portugal Slovakia Slovenia Spain Sweden The Netherlands and United Kingdom EN 60950 1 or latest TUV CE EN55022 2006 Class B EN 55024 I...

Page 224: ...he product will be used under normal conditions in accordance with the operating manual of the product China RoHS The contents included in this section are per the requirements of the People s Republic of China Management Methods for Controlling Pollution by Electronic Information products Names and Contents of the Toxic and Hazardous Substances or Elements In accordance with China s Management Me...

Page 225: ...Brocade Adapters Installation and Reference Manual 197 53 1002144 01 Regulatory compliance 5 TABLE 31 Hazardous Substances Toxic Substances HS TS concentration chart ...

Page 226: ...ty Because these boards are installed in a PCIe bus slot all voltages are below the SELV 42 4 V limit The adapters are recognized per Bi Nat UL CSA 60950 1 1st Ed or later for use in the US and Canada They also comply with IEC 60950 1 and EN60950 1 A CB Scheme certificate is available upon request ...

Page 227: ...warning US only This equipment has been tested and complies with the limits for a Class A computing device pursuant to Part 15 of the FCC Rules These limits are designed to provide reasonable protection against harmful interference when the equipment is operated in a commercial environment This equipment generates uses and can radiate radio frequency energy and if not installed and used in accorda...

Page 228: ...be required to take corrective actions CE statement ATTENTION This is a Class A product In a domestic environment this product might cause radio interference and the user might be required to take corrective measures The standards compliance label on the adapter contains the CE mark which indicates that this system conforms to the provisions of European Council directives laws and standards listed...

Page 229: ... Hungary Ireland Italy Latvia Lithuania Luxembourg Malta Poland Portugal Slovakia Slovenia Spain Sweden The Netherlands and United Kingdom EN60950 1 2006 A11 TUV CE EN55022 2006 Class A Emissions EN55024 Immunity EN61000 3 2 2000 A14 Harmonics EN61000 3 3 A1 2001 Voltage Fluctuations EN55022 Emissions EN55024 Immunity International IEC 61000 4 2 Electrostatic Discharge IEC 61000 4 3 Radiated Field...

Page 230: ...202 Brocade Adapters Installation and Reference Manual 53 1002144 01 Regulatory compliance 5 ...

Page 231: ... or Fabric Adapter CNA port operation Storage instance specific persistent parameters Instance specific persistent configuration parameters for storage drivers with valid value ranges are listed in Table 33 You can change these values using the BCU commands provided in the table These parameters are stored in the following locations on your system Linux and VMware etc bfa conf Solaris kernel drv b...

Page 232: ...upt coalesce bfa coalesce 1 0 Off 1 On vhba intr vHBA interrupt delay bfa delay HBAs 1125 804 HBA 25 CNAs 25 min 0 max 1125 vhba intr vHBA interrupt latency bfa latency HBAs 225 804 HBA 5 CNAs 5 0 microseconds 225 microseconds vhba intr log level bfa log level 3 1 Critical 2 Error 3 Warning 4 Info log level path time out value TOV bfa pathtov 30 min 1 max 60 fcpim pathtov Supported in release 2 0 ...

Page 233: ...cy value of 0 disables latency monitor timeout interrupt d delay Sets the delay timeout interrupt value A delay can be between 0 to 1125 microseconds A delay value of 0 disables the delay timeout interrupt NOTE You can also modify vHBA Interrupt Coalescing parameters through HCM Refer to the Brocade Adapters Administrator s Guide for details port speed bfa port speed 0 0 auto select 1 1 Gbps HBAs ...

Page 234: ...by the SCSI transport layer This parameter is passed to the SCSI layer during SCSI transport attach bfa_io_max_sge 128 Maximum Scatter gather elements supported per I O request This parameter is passed to the SCSI layer during SCSI transport attach bfa_lun_queue_depth 32 Maximum SCSI requests per LUN This parameter is passed to the SCSI layer during SCSI transport attach fdmi_enable 1 enabled Enab...

Page 235: ...o_recover 0 Add the following entry in etc modprobe conf then load the driver bfa options ioc_auto_recover 0 Following are examples for disabling FDMI Load driver with the parameter value modprobe bfa__fdmi_enable 0 Add the following entry in etc modprobe conf then load the driver bfa options fdmi_enable 0 Managing VMware driver configuration To set a configuration parameter use the following step...

Page 236: ... Edit tool regedt32 or the BCU drvconf key command For details on using these commands refer to the Brocade Adapters Administrator s Guide Important notes We recommend using the applicable BCU command to dynamically update the value where available rather than reloading the driver Disabling the devices will disrupt adapter connectivity To find out if the driver has unloaded successfully after disa...

Page 237: ...fcoe Parameters Device 2 Click rport_del_timeout 3 Click Edit Modify 4 For Value data enter 60 5 Click OK 6 Use the following steps to reload the driver and reinitialize the driver parameters from the modified registry a Quiesce all application access to disks that are connected through the adapter b Stop the Brocade HCM Agent Service refer to HCM Agent operations on page 112 for instructions c Op...

Page 238: ...or example to set the number of FCP IO requests use the following num ios 600 2 When you have set all desired parameters reboot the system TABLE 36 Solaris driver configuration parameters Parameter Default Value Notes ioc auto recover 1 Auto recover IOC IO controller on heartbeat failure msix disable 1 Disable MSIx interrupt and use INTx num fcxps 64 Maximum number of unassisted Fibre Channel exch...

Page 239: ...rk driver configuration parameters Function Default Value Possible Values Method to Configure Notes Autorecovery Disable Enable Disable Device Manager Supported on Windows Server 2003 and 2008 FlowControl Transmit Tx and Receive Rx Enable Enable Disable Device Manager Enables 802 3x flow control for Windows 2008 only Interrupt Moderation Enable Enable Disable Device Manager IPv4 Checksum Offload E...

Page 240: ...ce Manager HCM1 BCU commands 1 Creates team of adapter ports of following types Failover and failback 802 3ad based link aggregation VLAN ID Disabled 0 Can enable VLAN IDs with values from 0 4094 Device Manager HCM1 BCU commands1 Create a single port VLAN with Device Manager Creates multiple VLANs using BCU commands or HCM Disable VLANs in Device Manager Supported by Windows Server 2003 and 2008 V...

Page 241: ...stered Network Address Priority and VLAN support Receive Side Scaling RSS TCP UDP IPv4 Checksum Offload TCP UDP IPv6 Checksum Offload Following is an example for using the Device Manager on Windows 2008 Server To configure these parameters use the following steps 1 Run devmgmt msc to open the Device Manager window 2 Expand Network Adapters An instance of the adapter model should display for each i...

Page 242: ... 2 through 5 for each port that you want to configure NIC Teaming When adapter ports are configured as members of NIC teams an instance of the team name Team Team_Name appears in the Device Manager Right clicking this instance displays a Properties dialog box similar to the example shown in Figure 22 on page 215 Note that the team name Failover displays in the dialog box title Configure team relat...

Page 243: ... Ethernet Adapter Right clicking this instance displays a Properties dialog box labeled Team Failover Brocade 10G Ethernet Adapter The Advanced tab contains the same parameters as shown in Figure 21 on page 214 for the physical port Note that you cannot configure the parameters in this dialog box that are configured for a team without removing the port as a member of the team However you can confi...

Page 244: ...rameter Enable Enable Disable ethtool K command offload K ethX Enable or disable transmit and receive checksum offload TCP Segmentation Offload TSO instance specific parameter Enable Enable Disable ethtool K command ethtool K ethX MSI X Message Signaled Interrupts Extended 1 1 Enable 0 Disable Module parameter bnad_msix Parameter is only supported on 2 6 kernels that support MSI Locally Administer...

Page 245: ...found in the system eth1 is the second eth2 is the third and so on tso TCP Segmentation Offload Display current offload settings enter the following command ethtool k ethX where ethx Adapter position in server For example eth0 is the first Ethernet interface found in the system eth1 is the second eth2 is the third and so on Interrupt Moderation ethtool C vmnicX adaptive rx on off where ethx Adapte...

Page 246: ...es or disables MSI X Add the entry in etc modprobe conf then load the driver options bna bnad_msix 0 1 NOTE MSI X is enabled in the network driver by default and must remain enabled for NetQueue to function Enabling NetQueue in VMware system also enables MSI X in the system If enabling NetQueue make sure that bnad_msix 0 is not listed in VMware module parameters because that would disable NetQueue...

Page 247: ...mand Assign a VLAN ID to a port group on a specific vswitch MSI X Message Signaled Interrupts Extended Enable 0 Disable 1 Enable 0 cfg module parameter bnad_msix_disable Advanced user configuration This parameter is used to disable MSI X The parameter is enabled by default in the network driver However the NetQueue feature of VMware must be enabled in the VMware system to enable MSI X in the syste...

Page 248: ...llowing command esxcfg module g bna Following is an example of using the esxcfg command to set the Jumbo Packet MTU size First set the MTU size on a virtual switch using the following command esxcfg vswitch m MTU size vSwitch ID where MTU size MTU size 1500 9000 kb vSwitch ID Virtual switch identification such as vSwitch0 Display a list of virtual switches on the host system and their configuratio...

Page 249: ...he first Ethernet interface found in the system eth1 is the second eth2 is the third and so on autoneg Autonegotiate on or off rx Receive on or off tx Transmit on or off Managing VMware driver configuration with ethtool To enable or disable interrupt moderation use the following command ethtool C ethX adaptive rx on off where ethx Adapter position in server For example eth0 is the first Ethernet i...

Page 250: ... Disable NetQueue in VMkernel using the VI Client as follows 1 Log in to the VI Client 2 Click the Configuration tab for the Server host 3 Click Advanced Settings 4 Click VMkernel 5 Select the checkbox for VMkernel Boot netNetqueueDisabled then click OK 6 Reboot the server NOTE For more information on using this command refer to your VMware system documentation on enabling NetQueue in VMware 4 0 M...

Page 251: ...figuration tab for the Server host 3 Click Advanced Settings 4 Click VMkernel 5 Find the corresponding value field for VMkernel Boot netPktHeapMaxSize and enter 128 6 Find the corresponding value field for VMkernel Boot netPktHeapMinSize and enter 32 7 Click OK to save the changes 8 Reboot the system TABLE 40 NetQueues and filters per NetQueue for CNAs CPUs NetQueues no default NetQueues jumbo Rec...

Page 252: ...or these frames up to 9000 Use the following steps 1 Add the following line to the bna conf file This file is located in kernel drv bna conf bfa x _port mtu mtu_value where x BNA Brocade Network Adapter driver instance number mtu_value 1500 to 9000 NOTE Size must not be greater than size set on the FCoE switch 2 Reload the driver 3 Enter the following command ifconfig bna instance number mtu MTU s...

Page 253: ...rmware version produtIDBuildNumber Build version productIDURL URL of WEB based application to manage this product productIDDeviceNetworkName Operating system specific computer name Product Status Group productStatusGlobalStatus Current status of the product productStatusLastGlobalStatus Other Unknown OK Non Critical Critical Non recoverable productStatusTimestamp The status before the current stat...

Page 254: ...for IPv6 ethIPv4ChecksumOffload Enabled or disabled state of IPv4 checksum offload ethIPv6ChecksumOffload Enabled or disabled state of IPv6 checksum offload ethMode Loopback promiscuous or normal mode ethMTU Maximum transmission unit configured Statistics Group Port Statistics portStatsAdapterIndex Adapter index of the port portStatsPortIndex Port Index portRxPackets Number of packets received por...

Page 255: ...butes vLANId VLAN index vLanAdapterIndex VLAN adapter Index vLanPortIndex VLAN port index vLANName Name of the device as it appears in device manager for example Brocade 10G advanced virtual miniport 1 vLANInterfaceName Name of the interface as it appears in network connections list for example local area connection X vLANEnabled VLAN state enabled 1 disabled 0 vLANStatus Connected or disconnected...

Page 256: ...mberMACAddress MAC address of the member Traps and Events Group vLANAdded VLAN added vLANRemoved VLAN removed teamMemberAdded Team member added teamMemberRemoved Team member removed teamFailover Team failover teamFailback Team failback teamAdded Team added teamRemoved Team removed LinkUp supported by native SNMP service Port link up event LinkDown supported by native SNMP service Port link down ev...

Page 257: ...BASI Brocade Adapter Software Installer BCU Brocade Command Line Utility BFA Brocade Fabric Adapter BFAD Brocade Fabric Adapter Driver BFAL Brocade Fabric Adapter Driver Library BNA Brocade Network Advisor BNI Brocade Network Intermediate driver BIOS Basic Input Output System BNA Brocade Network Adapter BNAD Brocade Network Adapter Driver BOFM BladeCenter Open Fabric Manager CEE Converged Enhanced...

Page 258: ...ion CNA Converged Network Adapter DCBCXP Data Center Bridging Capability Exchange Protocol DHCP Dynamic Host Configuration Protocol DHCP DCB Data Center Bridging DCBX Data Center Bridging Exchange DMA Direct Memory Access EMC Electromagnetic Compatibility EPUP Environmental Protection Use Period ESD Electrostatic Discharge ETS Enhanced Transmission Selection FAA Fabric Assigned Address FCF Fibre C...

Page 259: ...CoE Initialization Protocol FTP File Transfer Program GUI Graphical User Interface GZME Get Zone Member List HBA Host Bus Adapter HCM Host Connectivity Manager HS TS Hazardous Substances Toxic Substances initrd Initial RAM disk IRQ Interrupt Request ISA EISA Industry Standard Architecture Extended Industry Standard Architecture KVM Keyboard Video or Visual Display Unit Mouse LKA Link Keep Alive LL...

Page 260: ...LACP Link Aggregation Control Protocol LSO Large Send Offload LVD Low Voltage Directive MAC Media Access Control MSI Message Signaled Interrupts MSI X Message Signaled Interrupts Extended MTU Maximum Transmission Unit NBP Network Bootstrap Program NDIS Network Driver interface Specification NETIOC Network I O Control NIC Network Interface Card NPIV N_Port ID Virtualization NWWN Node World Wide Nam...

Page 261: ... Flow Control PCI Peripheral Component Interconnect PCIe Peripheral Component Interconnect Express POM Pluggable Optical Module PWWN Port World Wide Name PXE Preboot eXecution Environment QoS Quality of Service RHEL Red Hat Enterprise Linux RPSC Remote Port Speed Capability SAN Storage Area Network SCP Secure Copy SFCB Small Footprint CIM Broker SFP Small Form Factor Pluggable ...

Page 262: ...bsystem ID SVID Subsystem Vendor Identification SRIOV Single Root I O Virtualization SRIOV TCP Transmission Control Protocol TFTP Trivial File Transfer TLV type length values TSO TCP Segmentation Offload TRL Target Rate Limiting UAC User Account Control UDP User Datagram Protocol UEFI Unified Extensible Firmware Interface UEFI boot support UNDI Universal Network Device Interface VC Virtual Channel...

Page 263: ... VID Vendor ID vHBA Virtual Host Bus Adapter VM Virtual Machine vNIC Virtual Network Interface Card VLAN Virtual Local Area Network VMQ Virtual Machine Queue WFAS Windows Firewall and Advanced Service WHQL Windows Hardware Quality Lab WinPE Windows Preinstallation Environment WMI Windows Management Initiative WoL Wake on LAN WWN World Wide Name WWPN World Wide Port Name ...

Page 264: ...236 Brocade Adapters Installation and Reference Manual 53 1002144 01 List of Acronyms C ...

Page 265: ... boot code 117 118 boot image 50 boot installation packages 51 boot LUN discovery 20 30 boot LUNs installing for IBM 3xxx M2 and Dell 11G systems 160 installing full driver package 162 installing image on boot LUNs 162 installing Linux RHEL 4 x and 5 x 152 installing Linux SLES 10 and 11 153 installing Linux 6 x 155 installing OEL 6 x 155 installing operating system and driver 148 installing Solar...

Page 266: ... xiv 12 supported models xiii switch compatibility 5 10 12 switch support xiv throughput per port 20 22 transfer rate 20 CNA stand up environmental and power requirements 185 CNA mode 3 22 CNA software installer 43 CNAs hardware and software compatibility 10 SFPs 10 command line utility 31 32 35 38 communications port firewall issue 90 compliance Fibre Channel standards 192 laser 195 regulatory 19...

Page 267: ...ardware specifications 172 LED operation 177 management BCU 33 HCM 33 PCI system values 172 PCIe interface 171 PCIe support 5 physical characteristics 171 SFPs 4 storage support 5 fabric based boot LUN discovery 163 configuring Brocade fabrics 164 configuring Cisco fabrics 165 FC trunking 29 FCC warning 1741 adapters 199 stand up adapters 193 FCoE features of CNAs 20 FCP IM I O profiling 28 FC SP ...

Page 268: ...are and software compatibility 15 SFPs 15 HCM configuration data 114 data backup 114 removal 83 RHEL 6 0 x64 systems 69 HCM agent 39 modifying operation 112 starting 112 starting and stopping 112 stopping 112 verifying operation 112 HCM agent communications port changing 112 firewall issue 67 90 Host Connectivity Manager HCM agent 39 installing 66 removing with software uninstaller commands 87 hos...

Page 269: ...nting bracket CNA 179 CNA low profile 7 Fabric Adapter standard 171 HBA low profile 8 9 13 14 install or remove 57 replacing 57 MSI X 25 30 multiple transmit priority queues 24 N N_Port trunking 29 requirements 30 NetQueues 27 NetQueues and filters CNAs 222 Fabric Adapters 223 NetQueues configuring 221 network boot 25 configuring BIOS with BCU commands 126 configuring BIOS with HCM 125 configuring...

Page 270: ...C statement 199 safety and EMC regulatory compliance table 201 VCCI statement 200 804 adapters 199 stand up adapters 192 BSMI warning 194 Canadian requirements 194 CE statement 194 FCC warning 193 KCC statement 193 laser compliance 195 safety and EMC regulatory compliance table 195 VCCI statement 194 removing driver and HCM 86 removing driver with software installer 83 removing driver with softwar...

Page 271: ...ll script 97 installing on boot LUN 156 manually removing driver 99 modifying agent operation 113 storage driver configuration parameters 210 upgrading driver 99 stand up adapters installation 56 stand up adapters replacing 60 safety information 198 storage driver 37 configuration parameters 206 instance specific persistent parameters 203 storage driver configuration parameters Linux and VMware 20...

Page 272: ... configuration parameters 219 removing driver with script 100 storage driver configuration parameters 206 upgrading driver 103 W Windows installing HCM on Windows Vista 66 installing HCM on Windows XP 66 Windows 7 driver support 19 Windows Server Core 19 30 Windows systems firewall issue 67 90 installing driver with script 91 installing Windows 2003 on boot LUN 149 installing Windows 2008 on boot ...

Search results

Summary of Contents for Brocade 825

Reviews:

Brands by name

Popular brands

Dell Brocade 825, Installation And Reference Manual

Search results

Summary of Contents for Brocade 825

Reviews:

Brands by name

Popular brands