manualshive.com logo in svg

Dell Broadcom NetXtreme Family of Adapters, User Manual

The Dell Broadcom NetXtreme Family of Adapters is a high-performance network adapter series that ensures fast and reliable connectivity for your Dell computers. To enhance your user experience, a comprehensive User Manual is available for free download from our website, manualshive.com. Get all the information you need to maximize the features of your adapter effortlessly.

Share
Download
background image

Configuring Teaming: Broadcom NetXtreme II Network Adapter User Guide

file:///T|/htdocs/NETWORK/BroadCom/71921/NetXtremeII/en/teaming.htm[9/26/2012 3:28:31 PM]

Smart Load Balancing™ and Failover

Smart Load Balancing™ and Failover is the Broadcom implementation of load balancing based on IP flow. This feature

supports balancing IP traffic across multiple adapters (team members) in a bidirectional manner. In this type of team, all

adapters in the team have separate MAC addresses. This type of team provides automatic fault detection and dynamic failover

to other team member or to a hot standby member. This is done independently of Layer 3 protocol (IP, IPX, NetBEUI);

rather, it works with existing Layer 2 and 3 switches. No switch configuration (such as trunk, link aggregation) is necessary

for this type of team to work.

 NOTES:

If you do not enable LiveLink™ when configuring SLB teams, disabling Spanning Tree Protocol (STP) or enabling

Port Fast at the switch or port is recommended. This minimizes the downtime due to spanning tree loop

determination when failing over. LiveLink mitigates such issues.
TCP/IP is fully balanced and IPX balances only on the transmit side of the team; other protocols are limited to

the primary adapter.
If a team member is linked at a higher speed than another, most of the traffic is handled by the adapter with the

higher speed rate.

Link Aggregation (802.3ad)

This mode supports link aggregation and conforms to the IEEE 802.3ad (LACP) specification. Configuration software allows

you to dynamically configure which adapters you want to participate in a given team. If the link partner is not correctly

configured for 802.3ad link configuration, errors are detected and noted. With this mode, all adapters in the team are

configured to receive packets for the same MAC address. The outbound load-balancing scheme is determined by our BASP

driver. The team link partner determines the load-balancing scheme for inbound packets. In this mode, at least one of the

link partners must be in active mode.

 NOTE: Link Aggregation team type is not supported for TOE teaming.

Generic Trunking (FEC/GEC)/802.3ad-Draft Static

The Generic Trunking (FEC/GEC)/802.3ad-Draft Static type of team is very similar to the Link Aggregation (802.3ad) type of

team in that all adapters in the team are configured to receive packets for the same MAC address. The Generic Trunking

(FEC/GEC)/802.3ad-Draft Static) type of team, however, does not provide LACP or marker protocol support. This type of team

supports a variety of environments in which the adapter link partners are statically configured to support a proprietary

trunking mechanism. For instance, this type of team could be used to support Lucent's OpenTrunk or Cisco's Fast

EtherChannel (FEC). Basically, this type of team is a light version of the Link Aggregation (802.3ad) type of team. This

approach is much simpler, in that there is not a formalized link aggregation control protocol (LACP). As with the other types of

teams, the creation of teams and the allocation of physical adapters to various teams is done statically through user

configuration software.

The Generic Trunking (FEC/GEC/802.3ad-Draft Static) type of team supports load balancing and failover for both outbound

and inbound traffic.

 NOTE: Generic Trunking (FEC/GEC/802.3ad-Draft Static) team type is not supported for TOE teaming.

SLB (Auto-Fallback Disable)

The SLB (Auto-Fallback Disable) type of team is identical to the Smart Load Balancing and Failover type of team, with the

following exception—when the standby member is active, if a primary member comes back on line, the team continues using

the standby member, rather than switching back to the primary member.

All primary interfaces in a team participate in load-balancing operations by sending and receiving a portion of the total traffic.

Standby interfaces take over in the event that all primary interfaces have lost their links.

Failover teaming provides redundant adapter operation (fault tolerance) in the event that a network connection fails. If the

primary adapter in a team is disconnected because of failure of the adapter, cable, or switch port, the secondary team

member becomes active, redirecting both inbound and outbound traffic originally assigned to the primary adapter. Sessions

will be maintained, causing no impact to the user.

Limitations of Smart Load Balancing and Failover/SLB (Auto-Fallback Disable) Types

Summary of Contents for Broadcom NetXtreme Family of Adapters

Page 1: ...hts reserved Trademarks used in this text Broadcom NetXtreme II Ethernet Wirespeed LiveLink and Smart Load Balancing are among the trademarks of Broadcom Corporation and or its affiliates in the United States certain other countries and or the EU Dell and the DELL logo are trademarks of Dell Inc Microsoft and Windows are trademarks of Microsoft Corporation Linux is a trademark of Linus Torvalds Ne...

Page 2: ...o be subject to the customs and export laws and regulations of the country in which the Products are manufactured and or received Customer agrees to abide by those laws and regulations Further under U S law the Products may not be sold leased or otherwise transferred to restricted end users or to restricted countries In addition the Products may not be sold leased or otherwise transferred to or ut...

Page 3: ... alleviating I O bottlenecks The Broadcom NetXtreme II adapter includes a 10 100 1000 Mbps or 10 Gbps Ethernet MAC with both half duplex and full duplex capability and a 10 100 1000 Mbps or 10 Gbps PHY The transceiver is fully compatible with the IEEE 802 3 standard for auto negotiation of speed Using the Broadcom teaming software you can split your network into virtual LANs VLANs as well as group...

Page 4: ...multiple power modes IPMI support Advanced network features Jumbo frames up to 9 KB The OS and the link partner must support jumbo frames Virtual LANs IEEE Std 802 3ad Teaming Smart Load Balancing Teaming Smart Load Balancing TOE Teaming with the correct configuration Flow Control IEEE Std 802 3x LiveLink supported in both the 32 bit and 64 bit Windows operating systems Logical Link Control IEEE S...

Page 5: ...CPU utilization even further The Broadcom NetXtreme II adapter targets best system performance maintains system flexibility to changes and supports current and future OS convergence and integration Therefore the adapter s iSCSI offload architecture is unique as evident by the split between hardware and host processing NOTES The iSCSI offload feature is not available for all Broadcom network adapte...

Page 6: ...ests diagnostics and analyses on each adapter as well as to modify property values and view traffic statistics for each adapter Supported Operating Environments The Broadcom NetXtreme II adapter has software support for the following operating systems Microsoft Windows 32 bit and 64 bit extended Linux 32 bit and 64 bit extended MS DOS ESX Server VMware NetWare Oracle Solaris SCO UnixWare SCO OpenS...

Page 7: ...Functionality and Features Broadcom NetXtreme II Network Adapter User Guide file T htdocs NETWORK BroadCom 71921 NetXtremeII en features htm 9 26 2012 3 28 28 PM Back to Contents Page ...

Page 8: ...edundant adapter operation in the event that a network connection fails When multiple Gigabit Ethernet network adapters are installed in the same system they can be grouped into teams creating a virtual adapter A team can consist of two to eight network interfaces and each interface can be designated as a primary interface or a standby interface standby interfaces can be used only in a Smart Load ...

Page 9: ...nking FEC GEC 802 3ad Draft Static The Generic Trunking FEC GEC 802 3ad Draft Static type of team is very similar to the Link Aggregation 802 3ad type of team in that all adapters in the team are configured to receive packets for the same MAC address The Generic Trunking FEC GEC 802 3ad Draft Static type of team however does not provide LACP or marker protocol support This type of team supports a ...

Page 10: ...anced in both inbound and outbound directions IPX traffic is load balanced in the outbound direction only Other protocol packets are sent and received through one primary interface only Failover for non IP traffic is supported only for Broadcom network adapters The Generic Trunking type of team requires the Ethernet switch to support some form of port trunking mode for example Cisco s Gigabit Ethe...

Page 11: ...ort or per team basis allowing very flexible network configurations Figure 1 Example of Servers Supporting Multiple VLANs with Tagging Figure 1 shows an example network that uses VLANs In this example network the physical LAN consists of a switch two servers and five clients The LAN is logically organized into three different VLANs each representing a different IP subnet The features of this netwo...

Page 12: ...ch port 10 Both the adapter and the switch port are configured for VLANs 1 and 2 and have tagging enabled NOTE VLAN tagging is only required to be enabled on switch ports that create trunk links to other switches or on ports connected to tag capable end stations such as servers or workstations with Broadcom adapters Adding VLANs to Teams Each team supports up to 64 VLANs 63 tagged and 1 untagged N...

Page 13: ...application to register the events from the client application using queries as examples shown below in order to receive events properly SELECT FROM __InstanceModificationEvent where TargetInstance ISA BRCM_NetworkAdapter SELECT FROM __InstanceModificationEvent where TargetInstance ISA BRCM_ExtraCapacityGroup SELECT FROM __InstanceCreationEvent where TargetInstance ISA BRCM_NetworkAdapter SELECT F...

Page 14: ...xtensible Agent The Broadcom NetXtreme II Gigabit Ethernet Controller Extended Information SNMP extensible agent bcmif dll is designed for Windows Server 2008 SNMP service The extensible agent allows the SNMP manager software to actively monitor the configurations of the Broadcom NetXtreme II adapter It is intended to supplement the information already provided by the standard SNMP Management Netw...

Page 15: ...computer that meets operating system requirements One open slot PCI Express 1 0a x4 or PCI Express Gen2 x8 128 MB RAM minimum Operating System Requirements General PCI Express v1 0a x4 or greater Host Interface Microsoft Windows One of the following versions of Microsoft Windows Windows Server 2008 family Windows Server 2008 R2 family Novell NetWare Novell NetWare 6 5 with the latest support pack ...

Page 16: ...connector Never attempt to install a damaged adapter Installation of the Add In NIC The following instructions apply to installing the Broadcom NetXtreme II adapter add in NIC in most systems Refer to the manuals that were supplied with your system for details about performing these tasks on your particular system Installing the Add In NIC 1 Review Safety Precautions and Preinstallation Checklist ...

Page 17: ...er cable requirements for connecting to 10 100 1000BASE T and 10GBASE T ports Table 1 10 100 1000BASE T and 10GBASE T Cable Specifications Port Type Connector Media Maximum Distance 10BASE T RJ 45 Category 3 4 or 5 unshielded twisted pairs UTP 100m 328 ft 100 1000BASE T1 RJ 45 Category 52 UTP 100m 328 ft 10GBASE T RJ 45 Category 63 UTP Category 6A3 UTP 50m 164 ft 100m 328 ft 1 1000BASE T signaling...

Page 18: ...l Network Driver Interface UNDI and provides a network interface in the Linux remotely booted client environment Intel APITEST The Broadcom PXE driver passes all API compliance test suites MS DOS UNDI The MS DOS Universal Network Driver Interface UNDI seamlessly binds with the Broadcom UNDI to provide a network adapter driver interface specification NDIS2 interface to the upper layer protocol stac...

Page 19: ...rt LEDs on the adapter to start blinking 4 Use the UP ARROW DOWN ARROW LEFT ARROW and RIGHT ARROW keys to move to and change the values for other menu items as desired 5 Press F4 to save your settings 6 Press ESC when you are finished Setting Up the BIOS To boot from the network with the MBA make the MBA enabled adapter the first bootable device under the BIOS This procedure depends on the system ...

Page 20: ...gent Driver Software Broadcom NetXtreme II Network Adapter User Guide file T htdocs NETWORK BroadCom 71921 NetXtremeII en pxe htm 9 26 2012 3 28 39 PM Please read all Restrictions and Disclaimers Back to Contents Page ...

Page 21: ...Platforms The NDIS2 driver software can be run from an MS DOS startup disk using Microsoft Network Client 3 0 or from the hard disk using Microsoft LAN Manager 2 2 Creating a Startup Disk to Run Microsoft Network Client To perform this installation you must have the following items Windows NT Server 4 0 CD ROM A blank MS DOS system disk 3 5 high density floppy disk Access to the Broadcom NDIS2 dri...

Page 22: ...sableDHCP 0 DriverName TCPIP BINDINGS MS NE2CLONE LANABASE 0 Example Protocol ini file for IPX network setup version 0x3110 netcard ms ne2clone 1 MS NE2CLONE 1 transport ms ndishlp MS NDISHLP transport ms nwlink MS NWLINK lana0 ms ne2clone 1 ms nwlink lana1 ms ne2clone 1 ms ndishlp MS NE2CLONE DriverName BXND20X protman DriverName PROTMAN PRIORITY MS NDISHLP MS NDISHLP DriverName ndishlp BINDINGS ...

Page 23: ... NET nwlink A NET NET START BASIC net use z SERVERNAME SHARENAME For NetBEUI SET PATH A NET A NET NET START BASIC net use z SERVERNAME SHARENAME 5 Create a Config sys file on the startup disk in drive A as shown below files 30 device a net ifshlp sys lastdrive z Installing the DOS NDIS2 Driver Software on the Hard Disk To install the DOS NDIS2 Driver Software on the hard disk 1 Verify that the sys...

Page 24: ...ertain order These keywords are used concurrently and are included for manufacturing purposes Do not use them unless you are familiar with how to configure PCI devices A PCI device scan utility is needed to find this information LineSpeed Specifies the speed of the network connection in Mbit s Requires the decimal number 10 100 or 1000 Technically a line speed of 1000 Mbit s cannot be forced and i...

Page 25: ...e must be installed on a system having an MS DOS operating system MS DOS 6 22 is recommended Preinstallation Requirements 1 Copy the Broadcom ODI driver files to a floppy disk Copy the BX2 LAN and BX2 LDI files for the Client32 driver 2 Go to the Novell web site http www novell com coolsolutions tools 13555 html and download the NetWare DOS Client files to the hard disk download the dw271e zip fil...

Page 26: ...o not use these keywords unless you know how to configure PCI devices The BusNum keyword value which represents the PCI bus number in which the adapter is located is a hexadecimal number ranging from 0 to FF The FuncNum keyword value which represents the function port number of a multiport adapter is a hexadecimal number with 0 representing the first port and 1 representing the second port The Dev...

Page 27: ...rnet adapter in the DOS environment NOTE To successfully install the adapter driver for DOS the adapter must be installed in the computer before you install the driver 2 Install the DOS 6 22 files on your computer hard disk or have them available on a removable storage device Installing the DOS ODI Driver on DOS 6 22 1 Copy the DOS ODI driver file to the root directory of the hard disk 2 Copy Lsl ...

Page 28: ... values can be used in the Net cfg file If a PCI scan utility displays card 1 at bus 4 and device 11 hexadecimal and card 3 at bus 3 and device 13 hexadecimal the following load instructions are written to the Net cfg file load card 3 first and optionally load card 1 second LINK DRIVER BX2 BUSNUM 3 DEVNUM 13 13 hex 19 decimal LINK DRIVER BX2 BUSNUM 4 DEVNUM 11 11 hex 17 decimal The FUNNUM keyword ...

Page 29: ...rking driver and the cnic driver supports additional features required by the bnx2i iSCSI offload driver bnx2x Linux driver for the BCM57710 BCM57711 BCM57712 10 Gbps network adapters bnx2i Linux driver to enable iSCSI offload on the BCM5708 BCM5709 BCM57710 BCM57711 BCM57712 10 100 1000 2500 10000 Mbps network adapters Limitations bnx2 Driver bnx2x Driver bnx2i Driver bnx2 Driver The current vers...

Page 30: ...river Packaging Format Drivers Source RPM netxtreme2 version src rpm Compressed tar netxtreme2 version tar gz Source DKMS RPM netxtreme2 version dkms src rpm Binary DKMS RPM netxtreme2 version dkms noarch rpm Supplemental tar netxtreme2_sup version tar gz Source KMP RPM broadcom netxtreme2 version src rpm KMP RPM broadcom netxtreme2 kmp default version x86_64 rpm KMP trace RPM broadcom netxtreme2 ...

Page 31: ...eady contain an older version of the driver The driver is installed to the following path 2 6 x kernels lib modules kernel_version kernel drivers net bnx2 ko 2 6 16 kernels and newer bnx2 driver lib modules kernel_version kernel drivers net bnx2 ko lib modules kernel_version kernel drivers net cnic ko 2 6 16 kernels and newer bnx2i driver lib modules kernel_version kernel drivers scsi bnx2i bnx2i ...

Page 32: ...e Broadcom iSCSI offload feature To configure the network protocol and address after building the driver refer to the manuals supplied with your operating system Installing the Binary DKMS RPM Driver Package Dynamic Kernel Module Support DKMS is designed to simplify the rebuilding of modules whenever you upgrade the kernel This is accomplished by creating a framework where a kernel dependent modul...

Page 33: ...alled using make install from the tar file the bnx2 ko driver file has to be manually deleted from the operating system See Installing the Source RPM Package for the location of the installed driver Patching PCI Files Optional NOTE The examples used in this procedure refer to the bnx2 driver but also apply to the bnx2x and bnx2i drivers For hardware detection utilities such as Red Hat kudzu to pro...

Page 34: ...mbinations This property is used to disable Message Signal Interrupts MSI and the property is valid only on 2 6 kernels that support MSI By default the driver enables MSI if it is supported by the kernel It runs an interrupt test during initialization to determine if MSI is working If the test passes the driver enables MSI Otherwise it uses legacy INTx mode insmod bnx2 ko disable_msi 1 or modprobe...

Page 35: ... queues will be limited by number of queues supported by hardware The multi_mode optional parameter can also be used to enable SAFC Service Aware Flow Control by differentiating the traffic to up to 3 CoS Class of Service in the hardware according to the VLAN PRI value or according to the IP DSCP value least 3 bits num_queues The optional parameter num_queues may be used to set the number of queue...

Page 36: ...ns will be treated as errors CAUTION Do not use error_mask if you are not sure about the consequences These values are to be discussed with Broadcom development team on a case by case basis This is just a mechanism to work around iSCSI implementation issues on the target side and without proper knowledge of iSCSI protocol details users are advised not to experiment with these parameters en_tcp_dac...

Page 37: ...ction Defaults N A Valid values N A Note This is a read only parameter ooo_enable Enable TCP out of order feature enables disables TCP out of order rx handling feature on offloaded iSCSI connections Defaults TCP out of order feature is ENABLED For example insmod bnx2i ko ooo_enable 1 or modprobe bnx2i ooo_enable 1 Driver Defaults bnx2 Driver bnx2x Driver bnx2 Driver Speed Autonegotiation with all ...

Page 38: ...ce RX Microseconds 25 range is 0 3000 Coalesce TX Microseconds 50 range is 0 12288 Coalesce Statistics Microseconds 999936 approximately 1 second range is 0 16776960 in increments of 256 MSI X Enabled if supported by the 2 6 kernel and the interrupt test passes TSO Enabled WoL Disabled Driver Messages The following are the most common sample messages that may be logged in the var log messages file...

Page 39: ...i cid bnx2i unable to allocate iSCSI context resources Network route to target node and transport name binding are two different devices bnx2i conn bind ep 0x ROUTE_HBA does not belong to hba USER_CHOSEN_HBA where ROUTE_HBA net device on which connection was offloaded based on route information USER_CHOSEN_HBA HBA to which target node is bound using iscsi transport name Target cannot be reached on...

Page 40: ...rtain violation to treat as warning and not as a critical error Driver puts a session through recovery conn_err hostno 3 conn 03fbcd00 iscsi_cid 2 cid a1800 Reject iSCSI PDU received from the target bnx2i printing rejected PDU contents 0 1 ffffffa1 0 0 0 0 20 0 8 0 7 0 0 0 0 0 0 10 0 0 40 24 0 0 ffffff80 0 18 0 0 3 ffffff88 0 0 3 4b 20 2a 0 0 2 ffffffc8 14 0 0 28 40 0 0 0 0 0 0 0 Open iSCSI daemon...

Page 41: ...scsi packages RHEL5 rpm e iscsi initiator utils 2 Install the source RPM package rpm ivh open iscsi package name src rpm 3 CD to the RPM path and build the binary driver for your kernel cd usr src redhat OpenLinux turbo packages rpm or rpmbuild bb SPECS open iscsi package name spec for RPM version 4 x x Note that the RPM path is different for different Linux distributions 4 Install the newly built...

Page 42: ...rgetname portal ipaddr port login List all drives active in the system fdisk l Maximize Offload iSCSI Connections With default driver parameters set which includes 128 outstanding commands bnx2i can offload the following number of connections BCM5708 28 BCM5709 43 BCM5771x 128 This is not a hard limit but just a simple on chip resource allocation math bnx2i will be able to offload 28 connections o...

Page 43: ...Linux Driver Software Broadcom NetXtreme II Network Adapter User Guide file T htdocs NETWORK BroadCom 71921 NetXtremeII en linux htm 9 26 2012 3 28 46 PM Back to Contents Page ...

Page 44: ...the latest Novell NetWare support pack files The NetWare support pack or patch file s needed for the operating system running on your server are indicated below Table 1 NetWare Support Files NetWare Version Support Pack Files to be Installed NetWare 6 5 Latest support pack The latest support pack can be found at http support novell com tools csp index html Installing NetWare Server 6 5 Driver Soft...

Page 45: ...he load statements are described below Configuration Properties for BX2 LAN Driver TxDescriptors Initializes Descriptor resources on the adapter for transmits Min 100 Max 512 Default 120 RxBuffers This is to pre allocate receive ECBs Receive adapter resources This setting may be affected by the NetWare Server maximum minimum packet receive buffer settings Min 32 Max 1000 Default 200 Speed This key...

Page 46: ...er a specific amount of packets is transmitted Min 0 Disabled Max 100 The default value is 20 RxPacketsPer Enables allowing an interrupt to occur after a specific amount of packets is received Min 0 Disabled Max 100 The default value is 75 CheckSum Enables or disables the transmit and receive checksum offload feature Checksum offload support is only for TCP IP packets therefore the default setting...

Page 47: ...etting is no jumbo packets NOTES Jumbo frames are supported only on NetWare 6 0 and later Also the first frame loaded must be ETHERNET_II Jumbo frame support must have the following text in the Startup ncf file Set maximum physical receive packet size 18000 P3 This keyword is used when running Perform3 exe tests and may be used to increase performance on networks running with many IPX clients Set ...

Page 48: ...off The default value is 0 No wake up capability Fiber The driver has support for the 1000FD fiber adapter The fiber auto negotiates link with a fiber switch even though it only supports 1000FD In some cases the user may want to force the adapter to 1000FD AUTO default FORCE NOTE If you modify any of the adapter properties you must reboot the system before the changes take effect If you make chang...

Page 49: ...h the Broadcom driver and remark them out by inserting the symbol at the beginning of each command line or by deleting the statement Example LOAD BX2 SLOT 2 FRAME Ethernet_802 2 NAME BX2_1_E82 BIND IPX BX2_1_E82 NET FAFD3D25 LOAD BX2 SLOT 2 FRAME Ethernet_802 3 NAME BX2_1_E83 BIND IPX BX2_1_E83 NET 5A2D8D6D LOAD BX2 SLOT 2 FRAME Ethernet_SNAP NAME BX2_1_ESP BIND IPX BX2_1_ESP NET 477A35BD LOAD BX2...

Page 50: ...t at this time because of driver size limitations Solaris DU diskettes can be used to install the driver into the system both during system installation and or after the system has been installed and booted This driver only works with the GLDv3 Streams interface as it appears in Solaris 10 Update 4 and later Installing the Driver 1 Change directory to where BRCMbnxe version pkg resides 2 pkgadd d ...

Page 51: ...item X For boolean values 1 TRUE and 0 FALSE Memory Usage The number of RX TX buffer descriptors specified in the configuration file can have a detrimental affect on memory usage If the counts are too high DMA allocations can fail thereby affecting other drivers loaded on the system If DMA allocations fail during system initialization and or boot then there is a chance the system will not boot Thi...

Page 52: ...ty level of 6 so changing an interface s priority level to 5 is common 1 First read the driver conf man page for a background primer 2 Find out the driver instance paths assigned on your system grep bnxe etc path_to_inst pci 0 0 pci8086 2779 1 pci14e4 1650 0 0 bnxe pci 0 0 pci8086 2779 1 pci14e4 1650 0 1 1 bnxe 3 Normally the name of the driver is the last portion of the path but you should use th...

Page 53: ...ll fail indicating the driver is busy This is true when you have two or more instances of bnxef loaded in which case you should first delete all FCoE ports and then unload the driver Unloading will occur only when all the instances are deleted Supported FC FCoE Devices The bnxef Broadcom 10 Gb FCoE driver works with all the major FCoE fabric devices It is also compatible with all known FC disk dev...

Page 54: ... command These parameters can also be set via the esxcfg module command See the man page for more information int_mode The optional parameter int_mode is used to force using an interrupt mode other than MSI X By default the driver will try to enable MSI X if it is supported by the kernel If MSI X is not attainable then the driver will try to enable MSI if it is supported by the kernel If MSI is no...

Page 55: ...s is used to specify the number of queues that will share the same CoS This parameter is evaluated by the driver up to 3 values of 8 bits each Each byte sets the desired number of queues for that CoS The total number of queues is limited by the hardware limit For example set the qs_per_cos parameter to 0x10101 to create a total of three queues one per CoS In another example set the qs_per_cos para...

Page 56: ...0000 IRQ 16 node addr 001018360012 MSI X Enabled Successfully bnx2x eth0 using MSI X Link Up and Speed Indication bnx2x eth0 NIC Link is Up 10000 Mbps full duplex receive transmit flow control ON Link Down Indication bnx2x eth0 NIC Link is Down Memory Limitation If you see messages in the log file that look like the following then the ESX host is severely strained To relieve this disable NetQueue ...

Page 57: ...lso receives and processes device interrupts both on behalf of itself for L2 networking and on behalf of the bnx2fc FCoE protocol and cnic drivers bnx2fc The Broadcom VMware FCoE driver is a kernel mode driver used to provide a translation layer between the VMware SCSI stack and the Broadcom FCoE firmware hardware In addition the driver interfaces with the networking layer to transmit and receive ...

Page 58: ... state connection based hardware offload solution designed to significantly reduce the CPU burden encumbered by a non offload software initiator Installation Check To verify the correct installation of the driver and to ensure that the host port is seen by the switch follow the procedure below To verify the correct installation of the driver 1 Verify the host port shows up in the switch FLOGI data...

Page 59: ...er and a command line silent mode for unattended installation see Using Silent Installation are available NOTES Before installing the driver software verify that the Windows operating system has been upgraded to the latest version with the latest service pack applied A network device driver must be physically installed before the Broadcom NetXtreme II Controller can be used with your Windows opera...

Page 60: ...will use the Broadcom iSCSI Crash Dump utility it is important to follow the installation sequence Run the installer Install the Microsoft iSCSI Software Initiator along with the patch MS KB939875 NOTE If performing an upgrade of the device drivers from the installer re enable iSCSI Crash Dump from the Advanced section of the BACS Configuration tab Perform this procedure after running the installe...

Page 61: ...forms setup s v qn ADDSOURCE Driversi32 AMD64 platforms setup s v qn ADDSOURCE Driversa64 NOTE The Broadcom device drivers are a required feature and are always installed even if you do not specify ADDSOURCE To perform a silent install from within a batch file To perform a silent install from within a batch file and to wait for the install to complete before continuing with the next command line t...

Page 62: ...utomated Deployment Services ADS Therefore a separate driver was created to accommodate these Microsoft deficiencies This driver is known as the NetXtreme II monolithic driver but it is sometimes referred to as the RIS driver The NetXtreme II monolithic driver was developed to work only for the text mode portion of a WDS legacy installation and to establish connectivity with a deployment agent for...

Page 63: ...ommand prompt run the copype cmd script The script requires two arguments hardware architecture and destination location copype cmd arch destination For example copype x86 c VistaPEx86 NOTE The directory structure c VistaPEx86 is used throughout this procedure 3 Mount the base image to a local directory so that you can add or remove packages by typing imagex mountrw c VistaPEx86 winpe wim 1 c Vist...

Page 64: ...file with a text editor like Microsoft Notepad or WordPad 2 Perform a search on the file for Registry parameters to locate the section that will allow you to configure the adapter speed duplex 3 Once located notice the following information shown params_utp hkr req_medium 2 0 params_fiber hkr req_medium 2 65283 These make up two separate sections that can be configured one for standard RJ 45 coppe...

Page 65: ...omputer attempts to go into hibernation To have the controller stay on at all times do not click the Allow the computer to turn off the device to save power check box NOTE Power management options are not available on blade servers NOTES The Power Management tab is available only for servers that support power management To enable Wake on LAN WOL when the computer is on standby click Allow the dev...

Page 66: ...ating Systems for iSCSI Boot The Broadcom NetXtreme II Gigabit Ethernet adapters support iSCSI boot on the following operating systems Windows Server 2008 32 bit and 64 bit supports offload and non offload paths Windows Server 2008 R2 64 bit supports offload and non offload paths Linux RHEL 5 5 and later SLES 11 1 and later supports offload and non offload paths SLES 10 x and SLES 11 only supports...

Page 67: ...abled the iSCSI boot host software immediately attempts to boot form the iSCSI target If set to disabled the iSCSI boot host software does not attempt to boot from the iSCSI target and control returns to the system BIOS so that the next boot device may be used The One Time Disabled option is used when you want to do a remote install of the OS to an iSCSI target As the option is named it is set to ...

Page 68: ...set the following TCP IP parameters via DHCP Disabled For IPv4 IP Autoconfiguration Disabled For IPv6 non offload iSCSI parameters via DHCP Disabled CHAP Authentication Disabled Boot to iSCSI target Disabled DHCP Vendor ID BRCM ISAN Link Up Delay Time 0 Use TCP Timestamp Enabled for some targets such as the Dell EMC AX100i it is necessary to enable Use TCP Timestamp Target as First HDD Disabled LU...

Page 69: ...nd the DHCP server provides no DNS server information When the DHCP server provides no DNS server information both the primary and secondary DNS server values are set to 0 0 0 0 When the Windows OS takes over the Microsoft iSCSI initiator retrieves the iSCSI Initiator parameters and configures the appropriate registries statically It will overwrite whatever is configured Since the DHCP daemon runs...

Page 70: ...dapter parameters NOTE The IP addresses for the primary and secondary adapters must be in two different subnets 5 Select ESC and select Exit and Save Configuration 6 Select F4 to save your MBA configuration Enabling CHAP Authentication Ensure that CHAP authentication is enabled on the target To enable CHAP authentication 1 From the General Parameters screen set CHAP Authentication to Enabled 2 Fro...

Page 71: ...i target DHCP Option 43 Vendor Specific Information DHCP option 43 vendor specific information provides more configuration options to the iSCSI client than DHCP option 17 In this configuration three additional suboptions are provided that assign the initiator IQN to the iSCSI boot client along with two iSCSI target IQNs that can be used for booting The format for the iSCSI target IQN is the same a...

Page 72: ...ns are listed below Table 4 DHCP Option 17 Suboption Definition Suboption Definition 201 First iSCSI target information in the standard root path format iscsi servername protocol port LUN targetname 203 iSCSI initiator IQN NOTE In Table 4 the brackets are required for the IPv6 addresses The content of option 17 should be 2 byte Option Number 201 202 203 2 byte length data Configuring the DHCP Serv...

Page 73: ... Next to proceed W2K8R2 installation 16 A few minutes after the W2K8R2 DVD installation process starts there will be a system restart follows 17 After a reboot W2K8R2 installation routine should start and continue on Completing installation 18 Then there will be another system restart follows check and verify the SUT is able to boot to the desktop 19 After W2K8R2 is booted up load all drivers and ...

Page 74: ...ection If HBA Boot Mode was enabled in the iSCSI Boot Parameters section you have to boot the offload image SuSE 10 x and SLES 11 do not support offload Remote DVD installation Installation using the remote DVD method can only be performed through the non offload path After completing the installation the system can be setup to boot from either the non offload or offload paths as described in the ...

Page 75: ...offload image SLES 10 x and SLES 11 do not support offload SUSE 11 1 Remote DVD installation workaround 1 Create a new file called boot open iscsi with the content shown below 2 Copy the file you just created to etc init d folder and overwrite the existing one Content of the new boot open iscsi file bin bash etc init d iscsi BEGIN INIT INFO Provides iscsiboot Required Start Should Start boot multi...

Page 76: ...arget option to Enabled 4 To boot through an offload path set the HBA Boot Mode to Enabled To boot through a non offload path set the HBA Boot Mode to Disabled If CHAP authentication is needed enable CHAP authentication after determining that booting is successful see Enabling CHAP Authentication Other iSCSI Boot Considerations There are several other factors that should be considered when configu...

Page 77: ...he resolution below First install the Windows Automated Installation Kit AIK from Microsoft on the test machine where you are going to modify the OS media Then delete the old network drivers in the boot wim of the OS media by following the procedure below 1 Create a temporary folder such as D temp 2 Create the following two subfolders in the temporary folder Win2008R2Copy Win2008R2Mod 3 Copy all t...

Page 78: ...be freed up before the device can be reset iscsid running in userspace is generally less predictable as it can run slowly and take a long time to disconnect and reconnect iSCSI sessions during network reset especially when the number of connections is large Broadcom cannot guarantee that iSCSI sessions will always recover in every conceivable scenario when the networking device is repeatedly being...

Page 79: ...Configuring Resource Reservations 3 Select the Configuration tab 4 DHCP is the default for IP address assignment but this can be changed to static IP address assignment if this is the preferred method of IP address assignment NOTE The IP address assignment method cannot be changed if the adapter was used for boot 5 Select Apply and close BACS Configure Microsoft Initiator to Use Broadcom s iSCSI O...

Page 80: ...e II Network Adapter User Guide file T htdocs NETWORK BroadCom 71921 NetXtremeII en iscsi htm 9 26 2012 3 29 03 PM 4 Select the Discovery tab and click Add to add a target portal 5 Enter the IP address of the target and click Advanced ...

Page 81: ...Adapter User Guide file T htdocs NETWORK BroadCom 71921 NetXtremeII en iscsi htm 9 26 2012 3 29 03 PM 6 From the General tab select Broadcom NetXtreme II C NIC iSCSI Adapter from Local adapter 7 Select the IP address for the adapter from Source IP ...

Page 82: ...tocol Broadcom NetXtreme II Network Adapter User Guide file T htdocs NETWORK BroadCom 71921 NetXtremeII en iscsi htm 9 26 2012 3 29 03 PM 8 Click OK to close Advanced setting and then OK to add the target portal ...

Page 83: ... II Network Adapter User Guide file T htdocs NETWORK BroadCom 71921 NetXtremeII en iscsi htm 9 26 2012 3 29 03 PM 9 From the Targets tab select the target and click Log On to log into your iSCSI target using the Broadcom iSCSI adapter ...

Page 84: ...ter User Guide file T htdocs NETWORK BroadCom 71921 NetXtremeII en iscsi htm 9 26 2012 3 29 03 PM 10 Click on Advanced 11 On the General tab select the Broadcom NetXtreme Ii C NIC iSCSI adapter from Local adapter 12 Click OK to close Advanced settings ...

Page 85: ... software BASP will not allow the iSCSI offload enabled network port interface to be a part of a GEC or LACP 802 3ad team but SLB teams are allowed iSCSI Offload FAQs Q How do I assign an IP address for iSCSI offload A Use the Configurations tab in Broadcom Advanced Control Suite BACS Q What tools should be used to create the connection to the target A Use Microsoft iSCSI Software Initiator versio...

Page 86: ... response packet is given in the dump data 11 Error Target returned an invalid login response packet The login response packet is given in the dump data 12 Error Target provided invalid data for login redirect Dump data contains the data returned by the target 13 Error Target offered an unknown AuthMethod Dump data contains the data returned by the target 14 Error Target offered an unknown digest ...

Page 87: ...pond in time for a SCSI command sent through a WMI request 48 Error Target failed to respond in time to a NOP request 49 Error Target failed to respond in time to a Task Management request 50 Error Target failed to respond in time to a Text Command sent to renegotiate iSCSI parameters 51 Error Target failed to respond in time to a logout request sent in response to an asynchronous message from the...

Page 88: ...when processing iSCSI logon request The request was not retried Error status is given in the dump data 71 Information Initiator did not start a session recovery upon receiving the request Dump data contains the error status 72 Error Unexpected target portal IP types Dump data contains the expected IP type Please read all Restrictions and Disclaimers Back to Contents Page ...

Page 89: ...etwork teaming services offered by the Broadcom software shipped with Dell s servers and storage products The goal of Broadcom teaming services is to provide fault tolerance and link aggregation across a team of two or more adapters The information in this document is provided to assist IT professionals during the deployment and troubleshooting of system applications that require network fault tol...

Page 90: ...pts Network Addressing Teaming and Network Addresses Description of Teaming Types TOE Teaming The concept of grouping multiple physical devices to provide fault tolerance and load balancing is not new It has been around for years Storage devices use RAID technology to group individual hard drives Switch ports can be grouped together using technologies such as Cisco Gigabit EtherChannel IEEE 802 3a...

Page 91: ...dress in the ARP Reply In Windows operating systems the IPCONFIG all command shows the IP and MAC address of the virtual adapter and not the individual physical adapters The protocol IP address is assigned to the virtual network interface and not to the individual physical adapters For switch independent teaming modes all physical adapters that make up a virtual adapter must use the unique MAC add...

Page 92: ...s in the team It uses a modified gratuitous ARP to advertise a different MAC address for the team IP Address in the sender physical and protocol address This G ARP is unicast with the MAC and IP Address of a client machine in the target physical and protocol address respectively This causes the target client to update its ARP cache with a new MAC address map to the team IP address G ARPs are not b...

Page 93: ...irtual link The failure or replacement of a link in an LACP trunk will not cause loss of connectivity The traffic will simply be failed over to the remaining links in the trunk SLB Auto Fallback Disable This type of team is identical to the Smart Load Balance and Failover type of team with the following exception when the standby member is active if a primary member comes back on line the team con...

Page 94: ...for each virtual device may be lower Software Components Teaming is implemented via an NDIS intermediate driver in the Windows Operating System environment This software component works with the miniport driver the NDIS layer and the protocol stack to enable the teaming architecture see Figure 2 The miniport driver controls the host LAN controller directly to enable functions such as sends receive...

Page 95: ...n domains The switch is responsible for forwarding Ethernet packets between hosts based solely on Ethernet MAC addresses A physical network adapter that is attached to a switch may operate in half duplex or full duplex mode To support Generic Trunking and 802 3ad Link Aggregation a switch must specifically support such functionality If the switch does not support these protocols it may still be us...

Page 96: ...Yesb Yesb Yesb Yesb Load balances non IP No Yes IPX outbound traffic only Yes Yes Same MAC address for all team members No No Yes Yes Same IP address for all team members Yes Yes Yes Yes Load balancing by IP address No Yes Yes Yes Load balancing by MAC address No Yes used for no IP IPX Yes Yes Allows TOE functionality to co exist when all team members support TOEc Yes Yes No No a SLB with one prim...

Page 97: ...operates below protocol stacks such as TCP IP and IPX and appears as a virtual adapter This virtual adapter inherits the MAC Address of the first port initialized in the team A Layer 3 address must also be configured for the virtual adapter The primary function of BASP is to balance inbound for SLB and outbound traffic for all teaming modes among the physical adapters installed on the system selec...

Page 98: ...lves an efficient hash computation over known protocol fields The resulting hash value is used to index into an Outbound Flow Hash Table The selected Outbound Flow Hash Entry contains the index of the selected physical adapter responsible for transmitting this flow The source MAC address of the packets will then be modified to the MAC address of the selected physical adapter The modified packet is...

Page 99: ...he same subnet When an inbound IP Datagram arrives the appropriate Inbound Flow Head Entry is located by hashing the source IP address of the IP Datagram Two statistics counters stored in the selected entry are also updated These counters are used in the same fashion as the outbound counters by the load balancing engine periodically to reassign the flows to the physical adapter On the inbound code...

Page 100: ...itch independence implies that there is no specific support for this function required in the switch allowing SLB to be compatible with all switches Under SLB all adapters in the team have separate MAC addresses The load balancing algorithm operates on Layer 3 addresses of the source and destination nodes which enables SLB to load balance both incoming and outgoing traffic The BASP intermediate dr...

Page 101: ...l Extreme Networks Load Sharing and Bay Networks or IEEE 802 3ad Link Aggregation static mode Since load balancing is implemented on Layer 2 addresses all higher protocols such as IP IPX and NetBEUI are supported Therefore this is the recommended teaming mode when the switch supports generic trunking modes over SLB Configuration Recommendations Static trunking supports connecting the teamed ports ...

Page 102: ...ore specified target network device s The probe target s responds when it receives the link packet If a team member does not detect the response within a specified amount of time this indicates that the link has been lost and the teaming software discontinues passing traffic through that team member Later if that team member begins to detect a response from a probe target this indicates that the l...

Page 103: ...over event Loss of link only Failover time 500 ms Fallback time 1 5 sb approximate MAC address Same for all adapters Multivendor teaming Yes a Some switches require matching link speeds to correctly negotiate between trunk connections b Make sure that Port Fast or Edge Port is enabled Speeds Supported for Each Type of Team The various link speeds that are supported for each type of team are listed...

Page 104: ...he team must support the property listed in Table 7 in order for the team to support the property Checksum Offload Checksum Offload is a property of the Broadcom network adapters that allows the TCP IP UDP checksums for send and receive traffic to be calculated by the adapter hardware rather than by the host CPU In high traffic situations this can allow a system to handle more connections more eff...

Page 105: ...into logical subparts Each defined VLAN behaves as its own separate network with its traffic and broadcasts isolated from the others thus increasing bandwidth efficiency within each logical group VLANs also enable the administrator to enforce appropriate security and quality of service QoS policies The BASP supports the creation of 64 VLANs per team or adapter 63 tagged and 1 untagged The operatin...

Page 106: ...am with two active members All servers Blue Gray and Red have a continuous ping to each other Figure 3 is a setup without the interconnect cable in place between the two switches Figure 4 has the interconnect cable in place and Figure 5 is an example of a failover event with the Interconnect cable in place These scenarios describe the behavior of teaming across the two switches and the importance ...

Page 107: ...lows traffic from to Blue and Gray to reach each other without any problems Note the additional entries in the CAM table for both switches The link interconnect is critical for the proper operation of the team As a result it is highly advisable to have a link aggregation trunk to interconnect the two switches to ensure high availability for the connection Figure 4 Teaming Across Switches With Inte...

Page 108: ... transparent to end stations which do not detect whether they are connected to a single LAN segment or a switched LAN of multiple segments Spanning Tree Protocol STP is a Layer 2 protocol designed to run on bridges and switches The specification for STP is defined in IEEE 802 1d The main purpose of STP is to ensure that you do not run into a loop situation when you have redundant paths in your net...

Page 109: ...ng or transitions to forwarding A TCN BPDU does not initiate an STP recalculation It only affects the aging time of the forwarding table entries in the switch It will not change the topology of the network or create loops End nodes such as servers or clients trigger a topology change when they power off and then power back on Port Fast Edge Port To reduce the effect of TCNs on the network for exam...

Page 110: ...ld potentially fail and network functionality is maintained Clients could be connected directly to the hub and fault tolerance would still be maintained server performance however would be degraded Figure 6 Team Connected to a Single Hub Generic and Dynamic Trunking FEC GEC IEEE 802 3ad FEC GEC and IEEE 802 3ad teams cannot be connected to any hub configuration These team types must be connected t...

Page 111: ...tiple adapters may be used for each of these purposes private intracluster communications and public external client communications All Broadcom teaming modes are supported with Microsoft Cluster Software for the public adapter only Private network adapter teaming is not supported Microsoft indicates that the use of teaming on the private interconnect of a server cluster is not supported because o...

Page 112: ... be used for communication between the compute nodes I O Ethernet can be used for file sharing and serving the data to the compute nodes This can be done simply using an NFS server or using parallel file systems such as PVFS Management Administration Ethernet is used for out of band ERA and in band OMSA management of the nodes in the cluster It can also be used for job scheduling and monitoring In...

Page 113: ...andard offering Link aggregation is commonly used between switches especially for large configurations Jumbo frames although not a part of our standard offering may provide performance improvement for some applications due to reduced CPU overhead Oracle In our Oracle Solution Stacks we support adapter teaming in both the private network interconnect between RAC nodes and public network with client...

Page 114: ...r client servers the backup server can simultaneously stream four backup jobs one per client to a multidrive autoloader Because of the single link between the switch and the backup server however a 4 stream backup can easily saturate the adapter and link If the adapter on the backup server operates at 1 Gbps 125 MB s and each client is able to stream data at 20 MB s during tape backup the throughp...

Page 115: ...nd one to Client Server Blue The route that Client Server Blue uses to send data to the backup server is dependant on its ARP cache which points to the backup server MAC address Because Adapter A of the backup server is already under load from its backup operation with Client Sever Red the Backup Server invokes its SLB algorithm to inform Client Server Blue through an G ARP to update its ARP cache...

Page 116: ...tor a team Mirror all uplink ports from the team at the switch If the team spans two switches mirror the interlink trunk as well Sample all mirror ports independently On the analyzer use an adapter and driver that does not filter QoS and VLAN information Teaming Configuration Tips When troubleshooting network connectivity or teaming functionality issues ensure that the following information is tru...

Page 117: ...mended to test again for failover and fallback 15 Test the performance behavior of the team before placing into a production environment 16 Network teaming is not supported when running iSCSI traffic via Microsoft iSCSI initiator or iSCSI offload MPIO should be used instead of Broadcom network teaming for these ports 17 For information on iSCSI boot and iSCSI offload restrictions see iSCSI Protoco...

Page 118: ... work over a virtual adapter team Answer Wake on LAN functionality operates in an environment before the operating system is loaded WOL occurs when the system is off or in standby so no team is configured Question What is the maximum number of ports that can be teamed together Answer Up to eight ports can be assigned to a team Question What is the maximum number of teams that can be configured on ...

Page 119: ...n the switch ports connected to the team to prevent the loss of communications caused by STP Question Where do I monitor real time statistics for an adapter team in a Windows server Answer Use the Broadcom Advanced Control Suite BACS to monitor general IEEE 802 3 and custom counters Question What features are not supported on a multivendor team Answer TOE VLAN tagging and RSS are not supported on ...

Page 120: ...gured for 100Mb full duplex link The adapter has been manually configured for the selected line speed and duplex settings No action is required 10 Informational Network controller configured for 1Gb half duplex link The adapter has been manually configured for the selected line speed and duplex settings No action is required 11 Informational Network controller configured for 1Gb full duplex link T...

Page 121: ...ble 9 Intermediate Driver Event Log Messages System Event Message Number Severity Message Cause Corrective Action 1 Informational Event logging enabled for Broadcom Advanced Server Program driver No action is required 2 Error Unable to register with NDIS The driver cannot register with the NDIS interface Unload other NDIS drivers 3 Error Unable to instantiate the management interface The driver ca...

Page 122: ...adapter has been added to or activated in a team No action is required 18 Informational Network adapter is de activated and is no longer participating in network traffic The driver does not recognize the installed adapter No action is required 19 Informational The LiveLink feature in BASP connected the link for the network adapter The connection with the remote target s for the LiveLink enabled te...

Page 123: ...uplex settings No action is required 10 Error Unable to register the interrupt service routine The device driver cannot install the interrupt handler Reboot the operating system remove other device drivers that may be sharing the same IRQ 11 Error Unable to map IO space The device driver cannot allocate memory mapped I O to access driver registers Remove other adapters from the system reduce the a...

Page 124: ...lude Reduced cabling and ports when used to replace many 1G NICs Server segmentation with separate subnets VLANs High server availability with NIC failover and NIC link bandwidth aggregation Server I O virtualization with a virtual OS and monolithic OS support Changes to the OS is not required SLB type teaming is supported Supported Operating Systems for NIC Partitioning The Broadcom NetXtreme II ...

Page 125: ...Description Function Description Option Ethernet Protocol Enables disables Ethernet protocol Enable Disable iSCSI Offload Protocol Enables disables iSCSI protocol Enable Disable FCoE Offload protocol Enables disables FCoE protocol Enable Disable Bandwidth Weight Configures the weight or importance of a particular function There are four functions per port and the weight is used to arbitrate betwee...

Page 126: ...ssion Selection ETS DCB supports storage management computing and communications fabrics onto a single physical fabric that is simpler to deploy upgrade and maintain than in standard Ethernet networks DCB technology allows the capable Broadcom C NICs to provide lossless data delivery lower latency and standards based bandwidth sharing of data center physical links The DCB supports FCoE iSCSI Netwo...

Page 127: ...fline Modifying the boot order can be accomplished through system BIOS configuration accessed with F2 during POST Below shows the system BIOS boot sequence menu for a Dell M710HD Specify Boot Protocol if required NOTE IMPORTANT When running in NIC Partitioning NPAR mode FCoE boot is only supported when the first function on each port is assigned an FCoE personality FCoE boot is not supported when ...

Page 128: ...ot 1 During POST press CTRL S at the Broadcom NetXtreme Ethernet Boot Agent banner to invoke the CCM utility 2 Select the device through which boot is to be configured NOTE IMPORTANT When running in NIC Partitioning NPAR mode FCoE boot is only supported when the first function on each port is assigned an FCoE personality FCoE boot is not supported when the FCoE personality is assigned to any other...

Page 129: ...on the device FCoE boot is only supported on DCBX capable configurations As such DCB DCBX must be enabled and the directly attached link peer must also be DCBX capable with parameters that allow for full DCBX synchronization 4 For Dell 57712 NDC based systems for example M710HD M915 set the boot protocol through system BIOS configuration in the integrated devices pane as described above ...

Page 130: ...ocs NETWORK BroadCom 71921 NetXtremeII en fcoe htm 9 26 2012 3 29 33 PM 1 Configure the desired boot target and LUN From the Target Information Menu select the first available path 2 Enable the Connect field Enter the target WWPN and Boot LUN information for the target to be used for boot ...

Page 131: ...isioned per initiator WWPN Two main paths are available for approaching storage access Pre Provisioning CTRL R Method Pre Provisioning With pre provisioning note the initiator WWPN and manually modify fabric zoning and storage selective LUN presentation to allow the appropriate access for the initiator The initiator WWPN can be seen at the bottom of the screen in the FCoE boot target configuration...

Page 132: ... access to the LUN the boot process will automatically proceed NOTE This does not preclude the need to put the boot initiator into one time disable mode as described in One Time Disable One Time Disable Broadcom s FCoE ROM is implemented as Boot Entry Vector BEV In this implementation the Option ROM only connects to the target once it has been selected by BIOS as the chosen boot device This is dif...

Page 133: ... are not inbox for Windows 2008 R2 SP1 or Windows 2008 SP2 the EVBD and OFC drivers need to be loaded during installation Go through the normal procedures for OS installation When no disk devices are found Windows will prompt you to load additional drivers At this point connect a USB flash drive containing the full contents of the provided EVBD and OFC boot driver folders 1 Load the EVBD driver fi...

Page 134: ...tinue with the rest of the installation After installation is complete and booted to SAN execute the provided Windows driver installer and reboot Installation is now complete NOTE The boot initiator must be configured to point at the desired installation LUN and the boot initiator must have successfully logged and determined the readiness of the LUN prior to starting installation If these requirem...

Page 135: ... package and ensure a connection to the desired SAN boot LUN 4 For multipathd device mapper configurations enable multipath services by using the following commands a Set boot multipath to run level B chkconfig boot multipath on b Set boot device mapper to run level B chkconfig boot device mapper on c Set multipathd to run levels 0 6 chkconfig level 0123456 multipathd on 5 For PowerPath configurat...

Page 136: ...rnet Broadcom NetXtreme II Network Adapter User Guide file T htdocs NETWORK BroadCom 71921 NetXtremeII en fcoe htm 9 26 2012 3 29 33 PM 10 Modify etc fstab to point to the same device paths for the root and swap mount points ...

Page 137: ...g boot 7 Create backups of boot grub menu lst 8 Add a new boot entry to boot grub menu lst by pointing INITRD to the new INITRD that was created in step 7 boot fcoe initrd img 9 Now that the local drive is reconfigured to support FCoE boot Copy the entire local hard drive contents to the SAN LUN via dd dd if SOURCE of DEST bs 1MB where SOURCE is the local disk e g dev sda and DEST is the SAN LUN e...

Page 138: ...CB support for the various fabrics on the network customize the ETS PFC FCoE and DCBX parameters For Windows operating systems use either Broadcom Advanced Control Suite BACS or Broadcom s Comprehensive Configuration Management CCM utility to configure the DCB parameters For Linux operating systems use Broadcom s Comprehensive Configuration Management CCM utility See Using Broadcom Advanced Contro...

Page 139: ...The user can then allocate each group a certain bandwidth For example 60 to FCoE and 40 to iSCSI The transmission scheduler in the peer will ensure that in the event of congestion the FCoE traffic will be able to use at least 60 of the link bandwidth and iSCSI to use 40 See additional references at http www ieee802 org 1 pages 802 1az html Priority Flow Control PFC Priority Flow Control PFC provid...

Page 140: ...If DCB is enabled on the interface DCBX is automatically enabled and carried out automatically once a link is established If DCBX fails to synchronize with a compatible peer the adapter will automatically fall back to default NIC behavior no priority tagging no PFC no ETS By default the port will advertise itself as willing and as such will accept all DCB settings as advertised by the switch If PF...

Page 141: ... values and view traffic statistics for network objects Broadcom Advanced Server Program BASP which runs within Broadcom Advanced Control Suite is used to configure teams for load balancing fault tolerance and virtual local area networks VLANs BASP functionality is available only on systems that use at least one Broadcom network adapter Starting Broadcom Advanced Control Suite In Control Panel cli...

Page 142: ...sts are the installed network adapters with the manageable elements such as physical port VBD NDIS FCoE and iSCSI below the adapters The icon next to each device in the Explorer View pane shows its status An icon next to a device name that appears normal means the device is connected and working X A red X that appears on the device s icon indicates the device is currently not connected to the netw...

Page 143: ...efresh Host Refreshes the selected host View menu Explorer View Displays hides the Explorer View pane Tool Bar Displays hides the tool bar Status Bar Displays hides the status bar Broadcom Logo Displays hides the Broadcom Logo on BACS to optimize the maximum viewable space Tools menu Options Used for configuring BACS preferences Teams Create Teams Creates new teams with either the Teaming Wizard o...

Page 144: ...ray icon BACS places an icon in the Windows taskbar when the program is installed Use the Options window to turn this icon on or off 1 From the Tools menu select Options 2 Select or clear Enable BACSTray the option is enabled by default 3 Click OK Setting the teaming mode 1 From the Tools menu select Options 2 Select Expert Mode if you do not need the assistance of the teaming wizard to create tea...

Page 145: ...t BACS to save the information for this host The host will appear in the Explorer Pane whenever you reopen BACS and you will not need to enter the host IP address or host name when connecting to the host For security reasons you must enter the User name and Password every time 8 Click OK Managing the Host At the host level you can view host information and configure parameters from the following t...

Page 146: ...ist Displays all iSCSI portal IP addresses configured on the selected host NOTE Some information may not be available for all Broadcom network adapters To configure the host Select the host in the Explorer View pane and then select the Configuration tab to configure host level parameters Configuration Tab System Management Chimney Offload State Enable or disable chimney offload at the host level r...

Page 147: ...d then select the Information tab to view adapter level information Viewing Resource Information The Resources section of the Information tab displays information about connections and other essential functions for the selected network adapter NOTE Some information may not be available for all Broadcom network adapters Information Tab Resources Bus Type The type of input output I O interconnect us...

Page 148: ...ber that is associated with the adapter Valid numbers range from 2 to 25 Memory Address The memory mapped address that is assigned to the adapter This value can never be 0 MSI Version This is the Message Signaled Interrupts MSI version being used The option MSI corresponds to the PCI 2 2 specification that supports 32 messages and a single MSI address value The option MSI X corresponds to the PCI ...

Page 149: ...e Auto Tx Pause Rx Pause Tx Rx pause and Disable The configuration is done at the port level and applies to all functions under the port The flow control value is a default value for the port The effective configuration can be different based on the switch port configuration and whether or not DCB DCBX is enabled Link Speed Configure the link speed The default speed is 1Gb for 1Gb adapters and 10G...

Page 150: ...elected in the Object Explorer panel following four tabs will be displayed in the context view panel Information Tab Configuration tab Statistics Tab Diagnostic Tab Viewing Port Level Information Selecting Ethernet controller in the object explorer will allow user to view various types of information at the port level 1 Select PortX where X is either 0 or 1 below Adapter in the object explorer 2 V...

Page 151: ...eter will display the iSCSI MAC address IPv4 DHCP The IP address is from a DHCP server if the value is Enable IP Address The network address associated with the adapter If the IP address is all 0s the associated driver has not been bound with Internet Protocol IP IPv6 DHCP The IP address is from a DHCP server if the value is Enable IPv6 IP Address The IPv6 network address associated with the adapt...

Page 152: ...ing a large data packet into a series of smaller packets with headers appended to them CO Checksum Offload CO allows the TCP IP UDP checksums for send and receive traffic to be calculated by the adapter hardware rather than by the host CPU LiveLink IP Address The network address of the LiveLink enabled adapter Local Connection Identifies the module to which the blade server is attached Chassis SW ...

Page 153: ...old value ensuring that this limit will not be exceeded during transmission The valid range for this value is between 1 and 100 The maximum bandwidth value is defined as a percentage of the physical link speed It is possible for the sum of all maximum bandwidth values across the four functions of a single port to exceed the physical link speed value of either 10 Gbps or 1 Gbps This case is conside...

Page 154: ...the diagnostic tests once 1 Click the name of the adapter to test in the Explorer View pane and select the Diagnostics tab 2 From the Select a test to run list select Diagnostic Tests 3 Select the diagnostic tests you want to run Click Select All to select all tests or Clear All to clear all test selections 4 Select the number of times to run the tests from Number of loops 5 Click Run test s 6 In ...

Page 155: ... able to send packets to and receive packets from the adapter Test LED This test causes all of the port LEDs to blink 5 times for the purpose of identifying the adapter Analyzing Cables The Cable Analysis option on the Diagnostics tab lets you monitor the conditions of each wire pair in an Ethernet Category 5 cable connection within an Ethernet network The analysis measures the cable quality and c...

Page 156: ...alk along two or more cable PCB signal paths Open One or both pins are open for a twisted pair Short Two pins from the same twisted pair are shorted together Noise Persistent noise present most likely caused by Forced 10 100 GB Link Gigabit link is up and running N A Algorithm failed to reach a conclusion Link The link connection speed and mode Status The status after the test is run either comple...

Page 157: ...ameters view attached FCoE targets and LUN information by selecting FCoE object in object explorer panel The available tabs for the NDIS function are as follows At the NDIS level you can view parameters configure parameters and run tests from the following tabs Information Configuration Diagnostics Statistics Viewing NDIS Information Select the NDIS driver in the Explorer View pane and then select...

Page 158: ... network adapter Offload Capabilities The offload capabilities supported by the adapter This information is only available for Broadcom NetXtreme II adapters TOE TCP Offload Engine TOE allows simultaneous operation of up to 1024 fully offloaded TCP connections for 1 Gbps network adapters and 1880 fully offloaded TCP connections for 10 Gbps network adapters to the hardware iSCSI iSCSI offload for b...

Page 159: ...rames PAUSE frames allow the network adapter and a switch to control the transmit rate The side that is receiving the PAUSE frame momentarily stops transmitting By enabling TOE network performance improves but with the increased performance TOE performance is more susceptible to packet loss when flow control is disabled Enable flow control to reduce the number of packets lost NOTE If Jumbo Packet ...

Page 160: ...roperty is only available for Broadcom NetXtreme II adapters Jumbo Packet Enables the network adapter to transmit and receive oversized Ethernet frames that are greater than 1514 bytes but less than or equal to 9000 bytes in length 9600 bytes for network adapters that operate at 10 Gbps This property requires the presence of a switch that is able to process jumbo frames This property is only avail...

Page 161: ...switch speed to 10 Gbit s SW_Config_1G Sets the switch speed to 1 Gbit s Speed Duplex The Speed Duplex property sets the connection speed and mode to that of the network Note that Full Duplex mode allows the adapter to transmit and receive network data simultaneously 10 Mb Full Sets the speed at 10 Mbit s and the mode to Full Duplex 10 Mb Half Sets the speed at 10 Mbit s and the mode to Half Duple...

Page 162: ...de By default the WOL Speed property is set to Auto This property is only available for Broadcom NetXtreme adapters 10 Mb Sets the speed to 10 Mbit s This is the network speed when the system is in a standby mode awaiting a wake up frame 100 Mb Sets the speed to 100 Mbit s Auto default Sets the speed for optimum network connection NOTES Wake on LAN is supported at 10 Mbit s or 100 Mbit s Wake on L...

Page 163: ... If you perform an upgrade of the device drivers re enable iSCSI Crash Dump If iSCSI Boot is configured to boot in the HBA path then this parameter cannot be changed Number of Receive Descriptors The number of receive descriptors with options of Default Minimum and Maximum Receive descriptors are data segments that allow the network adapter to allocate receive packets to memory Number of Transmit ...

Page 164: ...property is the same as Ethernet Wirespeed and is only available when the blade server is attached to a pass through module Chassis PHY Flow Control This property is the same as Flow Control and is only available when the blade server is attached to a pass through module Chassis PHY Speed Duplex This property is the same as Speed Duplex excludes 1 Gb Full Auto and is only available when the blade ...

Page 165: ...tatistics and then select the name of the missing section Click Refresh to get the most recent values for each statistic Click Reset to change all values to zero for the current BACS session NOTES Team statistics are not compiled for a Broadcom network adapter if it is disabled Some statistics may not be available for all Broadcom network adapters General Statistics General Statistics show the tra...

Page 166: ...ted to a broadcast group address This count does not include frames received with frame too long FCS length or alignment errors nor frames lost because of internal MAC sublayer errors This counter is incremented as indicated by the Receive OK status Frames Rx with CRC Error The number of frames received with CRC errors Initiator Login Statistics iSCSI login enables a connection for iSCSI use betwe...

Page 167: ...ssion format error The number of sessions with errors due to inconsistent fields reserved fields not 0 non existent LUN etc Sessions failed The number of failed sessions Custom Custom statistics Total Offload iSCSI Connections The total number of offloaded iSCSI connections Session Statistics The statistics in this area only pertain to the named session Session Name The name used for the session b...

Page 168: ...is reported as Transmit OK and the value of the attempts variable is greater than 2 and less than or equal to the attempt limit Frames Tx after Deferral A count of the frames that were delayed being transmitted on the first attempt because the medium was busy The frames involved in any collision are not counted Custom Statistics NOTE Custom statistics are available only for an enabled Broadcom net...

Page 169: ... between the server and the client To view resource reservations 1 Click the name of the Broadcom NetXtreme II system device in the Explorer View pane 2 From the Resource Reservations section select the property you want to set 3 Click Apply to confirm the changes to all properties Click Reset to return the properties to their original values To configure resource reservations 1 Select Reserved Re...

Page 170: ... Services section of your Broadcom network adapter user guide Teaming can be accomplished by either of the following methods Using the Broadcom Teaming Wizard Using Expert Mode NOTES For further information regarding teaming protocols see Teaming in your Broadcom network adapter user guide If you do not enable LiveLink when configuring teams disabling Spanning Tree Protocol STP at the switch is re...

Page 171: ...C 802 3ad Draft Static team type SLB Auto Fallback Disable This team is identical to Smart Load Balance and Failover with the following exception when the standby member is active if a primary member comes back online the team continues using the standby member rather than switching back to the primary member This type of team is supported only for situations in which the network cable is disconne...

Page 172: ... you want to always use Expert Mode to create a team select Default to Expert Mode on next start See Using Expert Mode 2 To continue using the wizard click Next 3 Type the team name and then click Next If you want to review or change any of your settings click Back Click Cancel to discard your settings and exit the wizard NOTE The team name cannot exceed 39 characters cannot begin with spaces and ...

Page 173: ... Next If the team type is not an SLB type team then a dialog box appears Verify that the network switch connected to the team members is configured correctly for the team type click OK and continue NOTE NetXtreme II network adapters with iSCSI enabled is supported only in an SLB team type To continue with the creation of non SLB team types first disable iSCSI by deselecting iSCSI Offload Engine fr...

Page 174: ...e supported for the adapter The TOE LSO Jumbo MTU and CO properties are enabled for a team only when all of the members support and are configured for the feature If this is the case then the team offload capabilities appear on the bottom of the screen NOTES If an adapter is included as a member of a team and you change any advanced property then you must rebuild the team to ensure that the team s...

Page 175: ...he adapters as a standby member optional select Use the following member as a standby member then choose the standby member from the list of adapters 7 The Auto Fallback Disable mode feature allows the team to continue using the standby member rather than switching back to the primary member if the primary member comes back online To enable this feature select Enable Auto Fallback Disable mode Cli...

Page 176: ...the probe target at the top of the list click Edit Target IP Address type the target IP address in the IP Address box for one or all probe targets and then click OK Click Next NOTE Only the first probe target is required You can specify up to three additional probe targets to serve as backups by assigning IP addresses to the other probe targets 12 Select a listed team member click Edit Member IP A...

Page 177: ...etXtremeII en bacs htm 9 26 2012 3 29 48 PM 14 Type the VLAN name and then click Next NOTE The team name cannot exceed 39 characters cannot begin with spaces and cannot contain any of the following characters 15 To tag the VLAN select Tagged and then click Next Otherwise click Untagged click Next and continue with the wizard to ...

Page 178: ...K BroadCom 71921 NetXtremeII en bacs htm 9 26 2012 3 29 48 PM add additional VLANs see Step 17 of this procedure 16 Type the VLAN tag value and then click Next The value must be between 1 and 4094 17 Select Yes to add or manage another VLAN and then click Next Repeat until you do not want to add or manage any ...

Page 179: ...nd 1 VLAN that is not tagged Adding several VLANS may slow down the reaction time of the Windows interface due to memory and processor time usage for each VLAN The degree to which Windows performance may suffer depends on system configuration 18 To apply and commit the changes to the team select Commit changes to system and Exit the wizard To apply your changes but continue using the wizard select...

Page 180: ...OTE At any point in the Broadcom Teaming Wizard procedure click Preview to get a visual representation of what the team will look like before committing any changes 19 Click the team name in the Team Management pane to view the team s properties in the Information tab transfer and receive data in the Statistics tab and team customization options in the Configurations tab ...

Page 181: ...menu In the Options window click the General tab then select Expert Mode or Wizard Mode the default is Wizard Mode Creating a Team NOTE Enabling Dynamic Host Configuration Protocol DHCP is not recommended for members of an SLB type of team 1 From the Teams menu select Create a Team or right click one of the devices in the Unassigned Adapters section and select Create a Team This option is not avai...

Page 182: ...perties are enabled for a team only when all of the members support and are configured for the feature If this is the case then the team offload capabilities appear on the bottom of the screen NOTES If an adapter is included as a member of a team and you change any advanced property then you must rebuild the team to ensure that the team s advanced properties are properly set If an adapter with a T...

Page 183: ...ber click the Fallback button on the Team Properties tab When configuring an SLB team although connecting team members to a hub is supported for testing it is recommended to connect team members to a switch Not all network adapters made by others are supported or fully certified for teaming 13 Configure the team IP address a From Control Panel double click Network Connections b Right click the nam...

Page 184: ... have one network adapter that can belong to multiple subnets With a VLAN you can couple the functionality of load balancing for the load balance members and you can employ a failover adapter You can define up to 64 VLANs per team 63 VLANs that are tagged and 1 VLAN that is not tagged VLANs can only be created when all teams members are Broadcom adapters If you try to create a VLAN with a non Broa...

Page 185: ...delete a VLAN 1 Select the VLAN to delete 2 From the Teams menu select Remove VLAN 3 Click Apply 4 Click Yes when the message is displayed indicating that the network connection will be temporarily interrupted NOTE If you delete a team any VLANs configured for that team are also deleted Configuring LiveLink for a Smart Load Balancing and Failover and SLB Auto Fallback Disable Team LiveLink is a fe...

Page 186: ... 0 is equivalent to an untagged network 7 Select Probe Target 1 and type the target IP address for one or all probe targets NOTE Only the first probe target is required You can specify up to 3 additional probe targets to serve as backups by assigning IP addresses to the other probe targets 8 Select one of the listed team members and type the member IP address NOTE All of the member IP addresses mu...

Page 187: ...r a non interactive command line interface CLI mode or an interactive mode As with BACS BACSCLI provides information about each network adapter and enables you to perform detailed tests run diagnostics view statistics and modify property values BACSCLI also allows you the ability to team network adapters together for load balancing and failover For a complete list of available commands and example...

Page 188: ... MS DOS 6 22 Software uxdiag exe BCM5708 BCM5709 or uediag exe BCM57710 Performing Diagnostics At the MS DOS prompt type uxdiag for BCM5708 BCM5709 network adapters or uediag for BCM57710 network adapters followed by the command options The uxdiag command options are shown in Table 1 and the uediag command options are shown in Table 2 For example to run all diagnostic tests on adapter 1 except Gro...

Page 189: ...0F uxdiag mbav 1 0 Enables disables MBA VLAN 1 Enable 0 Disable uxdiag mbavval n Sets MBA VLAN 65536 uxdiag mfw 1 0 Enables disables management firmware 1 Enable 0 Disable uxdiag t groups tests Disables certain groups tests uxdiag T groups tests Enables certain groups tests uxdiag ver Displays the version of Broadcom NetXtreme II User Diagnostics uxdiag and all installed adapters uxdiag wol 1 0 En...

Page 190: ...Sets the MBA boot protocol 0 PXE 1 RPL 2 BOOTP 3 iSCSI_Boot uediag mbav 1 0 Enables disables MBA VLAN 1 Enable 0 Disable uediag mbavval n Sets MBA VLAN 65536 uediag mfw 1 0 Enables disables management firmware 1 Enable 0 Disable uediag t groups tests Disables certain groups tests uediag T groups tests Enables certain groups tests uediag ver Displays the version of Broadcom NetXtreme II User Diagno...

Page 191: ...8 TAS Payload Buffer B9 RBUF via GRC B10 RBUF via Indirect Access B11 RBUF Cluster List B12 TSCH List B13 CSCH List B14 RV2P Scratchpads B15 TBDC Memory B16 RBDC Memory B17 CTX Page Table B18 CTX Memory Group C Block Tests C1 CPU Logic and DMA Interface Verifies the basic logic functionality of all the on chip CPUs It also exercises the DMA interface exposed to those CPUs The internal CPU tries to...

Page 192: ...ated by the host a timer event generated internally toggling any GPIO bits or accessing NVM Group D Ethernet Traffic Tests D1 MAC Loopback Enables MAC loopback mode in the adapter and transmits 5000 Layer 2 packets of various sizes As the packets are received back by Broadcom NetXtreme II User Diagnostics they are checked for errors Packets are returned through the MAC receive path and never reach...

Page 193: ...ategory 5 balanced cabling as specified in ISO IEC 11801 2002 and ANSI EIA TIA 568 B 2 Category 5 is the minimum requirement Category 5e and Category 6 are fully supported Table 2 10GBASE T Cable Specifications Port Type Connector Media Maximum Distance 10GBASE T RJ 45 Category 61 UTP Category 6A1 UTP 50m 164 feet 100m 328 feet 1 10GBASE T signaling requires four twisted pairs of Category 6 or Cat...

Page 194: ...the power requirements for the BCM57710 BCM57711 BCM57712 add in NIC Table 8 BCM57710 BCM57711 BCM57712 NIC Power Requirements Link NIC 12V Current Draw A NIC 3 3V Current Draw A NIC Power W 1 Idle no link 0 60 0 28 8 12 Low power mode 0 50 0 35 7 16 10GBASE T link 1 23 1 79 20 67 10GBASE T traffic 1 24 1 95 21 32 Note 1 Power measured in watts W is a direct calculation of total current draw A mul...

Page 195: ...pecifications Parameter Condition Operating Temperature 0 C to 55 C Air Flow Requirement LFM 0 Storage Temperature 40 C to 65 C Storage Humidity 5 to 95 condensing Vibration and Shock IEC 68 FCC Part 68 302 NSTA 1A Electrostatic Electromagnetic Susceptibility EN 61000 4 2 EN 55024 Table 13 BCM957810A1006G Environmental Specifications Parameter Condition Operating Temperature 0 C to 55 C Air Flow R...

Page 196: ...ursuant to Part 15 of the FCC Rules These limits are designed to provide reasonable protection against harmful interference in a residential installation The equipment generates uses and can radiate radio frequency energy and if not installed and used in accordance with the instructions may cause harmful interference to radio communications However there is no guarantee that interference will not ...

Page 197: ...ce in a non residential installation However there is no guarantee that interference will not occur in a particular installation If this equipment does cause harmful interference with radio or television reception which can be determined by turning the equipment off and on you are encouraged to try to correct the interference by one or more of the following measures Reorient the receiving antenna ...

Page 198: ...USA This equipment is a Class A product based on the standard of the Voluntary Control Council for interference by Information Technology Equipment VCCI If used in a domestic environment radio disturbance may arise Install and use the equipment according to the instruction manual VCCI Class A Statement Japan CE Notice Class B Broadcom NetXtreme II Gigabit Ethernet Controller BCM95708A0804F BCM9570...

Page 199: ...Regulatory Information Broadcom NetXtreme II Network Adapter User Guide file T htdocs NETWORK BroadCom 71921 NetXtremeII en regs htm 9 26 2012 3 30 12 PM ...

Page 200: ...Regulatory Information Broadcom NetXtreme II Network Adapter User Guide file T htdocs NETWORK BroadCom 71921 NetXtremeII en regs htm 9 26 2012 3 30 12 PM ...

Page 201: ...Regulatory Information Broadcom NetXtreme II Network Adapter User Guide file T htdocs NETWORK BroadCom 71921 NetXtremeII en regs htm 9 26 2012 3 30 12 PM ...

Page 202: ...Regulatory Information Broadcom NetXtreme II Network Adapter User Guide file T htdocs NETWORK BroadCom 71921 NetXtremeII en regs htm 9 26 2012 3 30 12 PM ...

Page 203: ...poration 190 Mathilda Place Sunnyvale California 94086 USA This Class B digital apparatus complies with Canadian ICES 003 Notice The Industry Canada regulations provide that changes or modifications not expressly approved by Broadcom could void your authority to operate this equipment Industry Canada Class A Broadcom NetXtreme II Gigabit Ethernet Controller BCM95709A0916G Broadcom NetXtreme II 10 ...

Page 204: ...mentations d Industry Canada vos droits d utilisation de cet équipement peuvent être annulés si des changements ou modifications non expressément approuvés par Broadcom y sont apportés Industry Canada classe A Broadcom NetXtreme II Gigabit Ethernet Controller BCM95709A0916G Broadcom NetXtreme II 10 Gigabit Ethernet Controller BCM957710A1022G BCM957710A1021G BCM957711A1113G BCM957711A1102G Broadcom...

Page 205: ...e California 94086 USA Note that this device has been approved for non business purposes and may be used in any environment including residential areas A Class Device Broadcom NetXtreme II Gigabit Ethernet Controller BCM95709A0916G Broadcom NetXtreme II 10 Gigabit Ethernet Controller BCM957710A1022G BCM957710A1021G BCM957711A1113G BCM957711A1102G Broadcom Corporation 190 Mathilda Place Sunnyvale C...

Page 206: ...Regulatory Information Broadcom NetXtreme II Network Adapter User Guide file T htdocs NETWORK BroadCom 71921 NetXtremeII en regs htm 9 26 2012 3 30 12 PM BSMI ...

Page 207: ...ontroller and the BCM957710A1023G E02D001 and BCM957711A1123G E03D001 Broadcom NetXtreme II 10 Gigabit Ethernet Controllers have received the following regulatory compliance certifications FCC Class A USA VCCI Class A Japan CE Class A European Union Canadian Regulatory Information Class A Canada Korea Communications Commission KCC Notice Republic of Korea FCC Notice FCC Class A Broadcom NetXtreme ...

Page 208: ...ce in a non residential installation However there is no guarantee that interference will not occur in a particular installation If this equipment does cause harmful interference with radio or television reception which can be determined by turning the equipment off and on you are encouraged to try to correct the interference by one or more of the following measures Reorient the receiving antenna ...

Page 209: ...2012 3 30 12 PM CE Notice Class A Broadcom NetXtreme II Gigabit Ethernet Controller BCM95709SA0908G Broadcom NetXtreme II 10 Gigabit Ethernet Controller BCM957710A1023G BCM957711A1123G E03D001 E02D001 Dell Inc Worldwide Regulatory Compliance Engineering and Environmental Affairs One Dell Way PS4 30 Round Rock Texas 78682 USA 512 338 4400 ...

Page 210: ...Regulatory Information Broadcom NetXtreme II Network Adapter User Guide file T htdocs NETWORK BroadCom 71921 NetXtremeII en regs htm 9 26 2012 3 30 12 PM ...

Page 211: ...Regulatory Information Broadcom NetXtreme II Network Adapter User Guide file T htdocs NETWORK BroadCom 71921 NetXtremeII en regs htm 9 26 2012 3 30 12 PM ...

Page 212: ...Regulatory Information Broadcom NetXtreme II Network Adapter User Guide file T htdocs NETWORK BroadCom 71921 NetXtremeII en regs htm 9 26 2012 3 30 12 PM ...

Page 213: ... BCM957711A1123G E03D001 E02D001 Dell Inc Worldwide Regulatory Compliance Engineering and Environmental Affairs One Dell Way PS4 30 Round Rock Texas 78682 USA 512 338 4400 This Class A digital apparatus complies with Canadian ICES 003 Notice The Industry Canada regulations provide that changes or modifications not expressly approved by Dell Inc could void your authority to operate this equipment I...

Page 214: ...is Dans le cadre des réglementations d Industry Canada vos droits d utilisation de cet équipement peuvent être annulés si des changements ou modifications non expressément approuvés par Dell Inc y sont apportés Korea Communications Commission KCC Notice Republic of Korea Only A Class Device Broadcom NetXtreme II Gigabit Ethernet Controller BCM95709SA0908G 5709s mezz Broadcom NetXtreme II 10 Gigabi...

Page 215: ...oadCom 71921 NetXtremeII en regs htm 9 26 2012 3 30 12 PM End of Dell provided certification information The remainder of this document conforms to the general Restrictions and Disclaimers listed at the beginning of this user guide Please read all Restrictions and Disclaimers Back to Contents Page ...

Page 216: ...n is transmitted across the physical link for instructions and information on running tests in an MS DOS environment see User Diagnostics for Windows environments see Running Diagnostic Tests BACS Diagnostic Tests Failures If any of the following tests fail while running the diagnostic tests from BACS this may indicate a hardware issue with the NIC or LOM that is installed in the system Control Re...

Page 217: ...ly Verify that the cable length and rating comply with the requirements listed in Connecting the Network Cables Check the adapter installation by reviewing Installation of the Add In NIC Verify that the adapter is properly seated in the slot Check for specific hardware problems such as obvious damage to board components or the PCI edge connector Check the configuration settings and change them if ...

Page 218: ...t both the adapter and the switch are forced to the same speed or that at least one link partner is configured for auto negotiation Windows Network connectivity can be tested using the Testing the Network feature in Broadcom Advanced Control Suite An alternate method is to use the ping command to determine if the network connection is working 1 Click Start and then click Run 2 Type cmd in the Open...

Page 219: ...work OS limitation IPv6 LSO parent and child partition No Yes When bound to a virtual network OS limitation IPv6 CO parent and child partition No Yes When bound to a virtual network OS limitation IPv6 TOE No Yes When bound to a virtual network OS limitation iSCSI offload No Yes OS limitation Jumbo frames No Yes OS limitation RSS No No OS limitation NOTE Ensure that Integrated Services which is a c...

Page 220: ...ifies Hyper V supported features that are configurable for NetXtreme II teamed network adapters This table is not an all inclusive list of Hyper V features Table 2 Configurable Teamed Network Adapter Hyper V Features Feature Supported in Windows Server 2008 Supported in Windows Server 2008 R2 Comments Limitation Smart Load Balancing and Failover SLB team type Yes Yes Multi member SLB team allowed ...

Page 221: ... configuration Hyper V VLAN tagging will only work if bound to an untagged BASP virtual adapter When making changes to a team or removing a team remove the team s binding from all guest OSs that use any of the VNICs in the team change the configuration and then rebind the team s VNICs to the guest OS This can be done in the Hyper V Manager Removing the Broadcom NetXtreme II Device Drivers Uninstal...

Page 222: ... team with greater than two members on the server and connecting an HP2524 switch with LACP enabled as passive or active The HP switch shows an LACP channel being brought up successfully with only two team members All other team member links disconnect and reconnect This does not occur with a Cisco Catalyst 6500 Problem A Generic Trunking GEC FEC 802 3ad Draft Static type of team may lose some net...

Page 223: ...sure the development tools for the Linux distribution you are using are installed before compiling driver source code Miscellaneous Problem When setting the Jumbo MTU property to 5000 bytes or greater and forcing Flow Control on network adapters that support a link speed of 10 Gbps the system performance performs at less than optimal levels Solution If Jumbo MTU is set to 5000 bytes or greater ens...

Page 224: ...g four or more network adapters Problem Remote installation of Windows Server 2008 to an iSCSI target via iSCSI offload fails to complete and the computer restarts repeatedly Solution This is a Microsoft issue For more information on applying the Microsoft hotfix see Microsoft knowledge base article KB952942 at http support microsoft com kb 952942 Problem Performance drops when a BCM5709C network ...

Reviews:

No comments

Related manuals for Broadcom NetXtreme Family of Adapters

Makita 3606 Parts Breakdown preview
3606
Brand: Makita Pages: 2
3Com TokenLink 3C359B Release Note preview
TokenLink 3C359B
Brand: 3Com Pages: 4
3Com TokenLink 3C359B Quick Start Manual preview
TokenLink 3C359B
Brand: 3Com Pages: 8
3Com TokenLink 3C339 Release Note preview
TokenLink 3C339
Brand: 3Com Pages: 2
3Com EtherLink 3C985B-SX Installation And User Manual preview
EtherLink 3C985B-SX
Brand: 3Com Pages: 44
3Com 3CR990 Administration Manual preview
3CR990
Brand: 3Com Pages: 88
3Com 3C16080 Important Information preview
3C16080
Brand: 3Com Pages: 2
3Com 3C905C-TX-M User Manual preview
3C905C-TX-M
Brand: 3Com Pages: 111
3Com TokenLink 3C359 Release Note preview
TokenLink 3C359
Brand: 3Com Pages: 4
3Com 3C421600A Quick Setup Manual preview
3C421600A
Brand: 3Com Pages: 74
3Com 3C421600A Installation Manual preview
3C421600A
Brand: 3Com Pages: 6
TP-Link TD-8817 Specifications preview
TD-8817
Brand: TP-Link Pages: 3
NetComm 3GM1WN Quick Start Manual preview
3GM1WN
Brand: NetComm Pages: 3
NETGEAR DG834GT - 108 Mbps Super G Wireless ADSL Router Specifications preview
DG834GT - 108 Mbps Super G Wireless ADSL Router
Brand: NETGEAR Pages: 2
ZyXEL Communications P-974H - V3.70 Manual preview
P-974H - V3.70
Brand: ZyXEL Communications Pages: 116
Teletronics International TT 900 User Manual preview
TT 900
Brand: Teletronics International Pages: 57
National Instruments NI 447 Series User Manual preview
NI 447 Series
Brand: National Instruments Pages: 80
ADTRAN EXPRESS 6503 User Manual preview
EXPRESS 6503
Brand: ADTRAN Pages: 20

Brands by name

Popular brands

Load more brands