background image

Broadcom Gigabit Ethernet Teaming Services

NetXtreme 

User Guide

 

Broadcom

®

 

April 2017 • 2CS57XX-CDUM514-R

Page 130

Troubleshooting Teaming Problems

Teaming Configuration Tips

Troubleshooting Guidelines

When running a protocol analyzer over a virtual adapter teamed interface, the MAC address shown in the 
transmitted frames may not be correct. The analyzer does not show the frames as constructed by BASP and 
shows the MAC address of the team and not the MAC address of the interface transmitting the frame. It is 
suggested to use the following process to monitor a team: 

1.

Mirror all uplink ports from the team at the switch. 

2.

If the team spans two switches, mirror the interlink trunk as well. 

3.

Sample all mirror ports independently. 

4.

On the analyzer, use an adapter and driver that does not filter QoS and VLAN information. 

Teaming Configuration Tips

When troubleshooting network connectivity or teaming functionality issues, ensure that the following information 
is true for your configuration. 

1.

It is recommended that, for an SLB team, all adapters be the same link speed. 

2.

If LiveLink is not enabled, disable Spanning Tree Protocol or enable an STP mode that bypasses the initial 
phases (for example, Port Fast, Edge Port) for the switch ports connected to a team. 

3.

All switches that the team is directly connected to must have the same hardware revision, firmware revision, 
and software revision to be supported. 

4.

To be teamed, adapters should be members of the same VLAN. In the event that multiple teams are 
configured, each team should be on a separate network. 

5.

Do not enter a multicast or broadcast address in the Locally Administered Address field. 

6.

Do not assign a Locally Administered Address on any physical adapter that is a member of a team. 

7.

Verify that power management is disabled on all physical members of any team (the 

Allow the computer 

to turn off this device to save power

 box on the 

Power Management

 tab in adapter 

Properties

 should 

be cleared—see 

Setting Power Management Options

 in “Windows Driver and Application Installation”). 

8.

Remove any static IP address from the individual physical team members before the team is built. 

9.

A team that requires maximum throughput should use LACP or GEC\FEC. In these cases, the intermediate 
driver is only responsible for the outbound load balancing while the switch performs the inbound load 
balancing. 

10.

Aggregated teams (802.3ad \ LACP and GEC\FEC) must be connected to only a single switch that supports 
IEEE 802.3a, LACP or GEC/FEC. 

Summary of Contents for NetXtreme BCM57 Series

Page 1: ...Broadcom NetXtreme BCM57XX User Guide Last revised April 2017 2CS57XX CDUM514 R...

Page 2: ...ries For more information please visit www broadcom com Broadcom reserves the right to make changes without further notice to any products or data herein to improve reliability function or design Info...

Page 3: ...ol Suite 15 Supported Operating Environments 15 Network Link and Activity Indication 15 Section 3 Windows Driver and Management Application Installation 17 Installing the Driver Software 18 Using Sile...

Page 4: ...Teaming with Channel Bonding 37 Linux Management Application Installation 38 Overview 38 Communication Protocols 38 Installing WS MAN or CIM XML on Linux Server 39 Step 1 Install OpenPegasus 39 Step 2...

Page 5: ...anaging the Host 57 Information Tab Host Information 57 Managing the Network Adapter 59 Viewing Adapter Information 59 Viewing Driver Information 60 Viewing Resource Information 61 Viewing Hardware In...

Page 6: ...ailover 99 Link Aggregation 802 3ad 99 Generic Trunking FEC GEC 802 3ad Draft Static 99 SLB Auto Fallback Disable 100 Limitations of Smart Load Balancing and Failover SLB Auto Fallback Disable Types o...

Page 7: ...neral Network Considerations 121 Teaming Across Switches 121 Switch Link Fault Tolerance 121 Spanning Tree Algorithm 123 Topology Change Notice TCN 124 Port Fast Edge Port 124 Teaming with Microsoft N...

Page 8: ...IPv4 145 DHCP iSCSI Boot Configuration for IPv6 148 Configuring the DHCP Server 148 Preparing the iSCSI Boot Image 149 Booting 152 Other iSCSI Boot Considerations 152 Changing the Speed Duplex Settin...

Page 9: ...64 Running a Cable Length Test 164 Testing Network Connectivity 165 Windows 165 Linux 165 Broadcom Boot Agent 165 Broadcom Advanced Server Program BASP 166 Kernel Debugging over Ethernet 166 Miscellan...

Page 10: ...ered OFF and unplugged before you touch internal components Install or remove adapters in a static free environment The use of a properly grounded wrist strap or other personal antistatic devices and...

Page 11: ...ur particular server 1 Review the Safety Precautions and Preinstallation Checklist Before installing the adapter ensure the system power is OFF and unplugged from the power outlet and that proper elec...

Page 12: ...over cables when connecting machines back to back A straight through Category 5 cable allows the machines to communicate when connected directly together Table 1 10 100 1000BASE T Cable Specifications...

Page 13: ...figuring Teaming for instructions on configuring teaming and creating VLANs on Windows operating systems Features The following is a list of the Broadcom NetXtreme Gigabit Ethernet adapter features fo...

Page 14: ...y scan support Power Management Wake on LAN Magic Packet Wake Up Frame specific pattern is supported Adaptive Interrupt Frequency The adapter driver intelligently adjusts host interrupt frequency base...

Page 15: ...roperty values and view traffic statistics for each adapter BACS is used on Windows operating systems to configure teaming and to add VLANs See Using Broadcom Advanced Control Suite for detailed infor...

Page 16: ...Functionality and Features NetXtreme User Guide Broadcom April 2017 2CS57XX CDUM514 R Page 16...

Page 17: ...Windows Driver and Management Application Installation Installing the Driver Software Modifying the Driver Software Repairing or Reinstalling the Driver Software Removing the Device Drivers Viewing o...

Page 18: ...om support Use the self extracting zip file Note These instructions are based on the assumption that your Broadcom NetXtreme adapter was not factory installed If your controller was installed at the f...

Page 19: ...vers for new adapters For information on installing drivers for new adapters see Repairing or Reinstalling the Driver Software 5 Click Next to continue 6 Click on an icon to change how a feature is in...

Page 20: ...Drivers When removing the device drivers any management application that is installed is also removed To remove the device drivers 1 In Control Panel double click Add or Remove Programs 2 Click Broad...

Page 21: ...tem will not shut down the device The operating system attempts to shut down every possible device only when the computer attempts to go into hibernation To have the controller stay on at all times do...

Page 22: ...ailable communication protocols for each network configuration The instructions in this chapter address only the scenario where Windows managed hosts are communicating with Windows clients In these sc...

Page 23: ...RootSDDL O NSG BAD P A GA BA S P AU FA GA WD AU SA GWGX WD BA stands for BUILTIN Administrators To add another user group to the WinRM allowed connect list you can modify the RootSDDL to include the n...

Page 24: ...client also must be configured with the self signed certificate See Perform HTTPS Configuration if you plan to use HTTPS 1 Click Start or press the Windows logo key and select Run 2 Enter gpedit msc t...

Page 25: ...at xyxy xxx xxx including the brackets Optional Email Address Enter the following additional attributes to be sent with your certificate request A challenge password password1 An optional company name...

Page 26: ...the certificate 1 Click Start or press the Windows logo key and select Run 2 Enter MMC and click OK 3 Click File Add Remove Snap in 4 Click Add 5 Select Certificates and click Add 6 Select Computer a...

Page 27: ...K c Select the self signed certificate from the Personal store For example if the certificate is created with a host name the host name will appear d Double click the certificate to open it e Click th...

Page 28: ...y the firewall rules as follows Windows Server 2008 R2 1 From the Administrative Tools menu open Windows Firewall with Advanced Security 2 Right click Inbound Rules and select New Rule The new rule wi...

Page 29: ...l Group Policy editor c Under Computer Configuration open the Administrative Templates folder and then open the Windows Components folder d Select Windows Remote Management WinRM e Under Windows Remot...

Page 30: ...ard k Browse to select the pfx file you generated in To generate a self signed certificate for the Windows Server Change the selection in the Files of type list to Personal Information Exchange pfxas...

Page 31: ...ser is not on the list click Add and add the user from the location local machine domain etc where the account resides Step 2 Grant DCOM Remote Launch and Activate Permission In the Windows domain env...

Page 32: ...erties click the COM Security tab 6 Under Launch and Activation Permissions click Edit Limits 7 Follow these steps if your name or your group does not appear in the Groups or user names list a In the...

Page 33: ...com April 2017 2CS57XX CDUM514 R Page 33 Special Configuration for WMI on Different Systems In Windows Vista and Windows 7 in order to let all users in the administrator group connect using the WMI na...

Page 34: ...river Messages Teaming with Channel Bonding Linux Management Application Installation Packaging The Linux TG3 driver is released in the following packaging formats file names Source RPM tg3 version 3d...

Page 35: ...mbuild bb SPECS tg3 spec for RPM version 4 x x error cannot create sourcedir usr src redhat SOURCE The most likely cause of the error is that the rpm build package has not been installed Locate the rp...

Page 36: ...he Linux operating system distribution Unloading Removing the TG3 Driver Unloading Removing the Driver from an RPM Installation Removing the Driver from a TAR Installation Unloading Removing the Drive...

Page 37: ...v 4202 PHY 57xx PCI Express 10 100 1000BaseT Ethernet 00 xx xx xx xx xx eth RXcsums 1 LinkChg REG 0 MIirq 0 ASF 0 Split 0 Wirespeed 1 TSOcap 1 eth dma_rwctrl 76180000 ACPI PCI interrupt 0000 02 02 0 A...

Page 38: ...r is installed on a server or managed host that contains one or more NICs The provider collects information on the NICs and makes it available for retrieval from a management PC on which the client so...

Page 39: ...M Red Hat Only From Source Red Hat and SuSE On the SUSE Linux Enterprise Server 11 SLES11 OS you must use the source RPM From the Inbox RPM Red Hat Only In Red Hat Linux an Inbox OpenPegasus RPM is av...

Page 40: ...add the following environment variable export PEGASUS_ENABLE_PROTOCOL_WSMAN true CIM XML and WSMAN in OpenPegasus use the same ports for HTTP or HTTPS The default port numbers for HTTP and HTTPS are 5...

Page 41: ...This file is located in the root directory The environment variables will be set when a user logs in using PuTTY On the Linux system itself for each terminal where the environment variables are not s...

Page 42: ...tication The systems users have to be added to OpenPegasus using cimuser to connect via BACS cimuser a u username w password Example cimuser a u root w linux1 Enable HTTP 1 If CIM server is not starte...

Page 43: ...Ports 3 In the Port and Protocol Dialog box select User Defined 4 In the Port Port Range field add the port number 5 In the Protocol field add the protocol as TCP or UDP etc 6 Click Apply for the fire...

Page 44: ...April 2017 2CS57XX CDUM514 R Page 44 Example For CIM XML use the following values Source Network 0 0 means all Protocol TCP Destination Port 5988 5989 Source Port Leave blank Step 6 Install BACS and...

Page 45: ...d for the Common Name enter the Windows Server host name or IP address Enter the following command sample responses are show openssl req new key server key out server csr If this command does not work...

Page 46: ...mat Enter the following command openssl pkcs12 export in server crt inkey server key out hostname pfx You will be prompted for the following Enter Export Password Verifying Enter Export Password Enter...

Page 47: ...s fails then the certificate is not installed correctly and an error message displays indicating to take corrective action Installing the Broadcom Advanced Control Suite The Broadcom Advanced Control...

Page 48: ...d to set the number of Rx and Tx net queues BCM57XX devices that support NetQueue are the BCM5718 BCM5719 and BCM5720 Allowed values for x are 1 to 15 1 15 will force the number of NetQueues for the g...

Page 49: ...Table 4 VMware Driver Defaults Parameter Default Value Speed Autonegotiation with all speeds advertised Flow Control Autonegotiation with rx and tx advertised MTU 1500 range 46 9000 Rx Ring Size 200...

Page 50: ...seT Ethernet 00 xx xx xx xx xx vmnic0 RXcsums 1 LinkChg REG 0 MIirq 0 ASF 0 Split 0 Wirespeed 1 TSOcap 1 vmnic0 dma_rwctrl 76180000 ACPI PCI interrupt 0000 02 02 0 A GSI 26 level low IRQ 233 Link Up a...

Page 51: ...ault tolerance and virtual local area networks VLANs BASP functionality is available only on systems that use at least one Broadcom network adapter BASP operates on Windows operating systems only The...

Page 52: ...the task bar under System Tools If you are having difficulty launching BACS on a Linux system see the related topic in Troubleshooting BACS BACS Interface The BACS interface is comprised of the follow...

Page 53: ...bjects in the same hierarchical manner as drivers and its subcomponents This simplifies the management of various elements of the converged network interface controller The top level of the hierarchy...

Page 54: ...can view for the object selected in the Explorer View pane The parameters are grouped by tabs and categories depending on the parameter type The available tabs are Information Configuration Diagnosti...

Page 55: ...BACS tray icon in Windows On Windows systems BACS places an icon in the Windows taskbar when the program is installed Use the Options window to turn this icon on or off 1 From the Tools menu select Op...

Page 56: ...2 Type the remote host s name or IP address in the Host box 3 Select the protocol from the Protocol list The protocol options for Windows are WMI WSMan or Try All The protocol options for Linux are Ci...

Page 57: ...n Select the host in the Explorer View pane and then select the Information tab to view host level information Information Tab Host Information Host Name Displays the name of the host OS Version Info...

Page 58: ...Using Broadcom Advanced Control Suite 4 NetXtreme User Guide Broadcom April 2017 2CS57XX CDUM514 R Page 58...

Page 59: ...ration Viewing Adapter Information The Vital Signs section of the Information tab has useful information about the network adapters that are installed in your system such as the link status of the ada...

Page 60: ...ted in the Explorer View pane then click the Information tab Driver Status The status of the adapter driver Loaded Normal operating mode The adapter driver has been loaded by Windows and is functionin...

Page 61: ...tab Bus Type The type of input output I O interconnect used by the adapter Slot No The slot number on the system board occupied by the adapter This item is not available for PCI Express type adapters...

Page 62: ...nterrupt Request The interrupt line number that is associated with the adapter Valid numbers range from 2 to 25 Memory Address The memory mapped address that is assigned to the adapter This value can...

Page 63: ...verifies if the driver is installed correctly and tests connectivity to a gateway or other specified IP address on the same subnet The network test uses TCP IP to send ICMP packets to remote systems t...

Page 64: ...trol Registers This test verifies the read and write capabilities of the network adapter registers by writing various values to the registers and verifying the results The adapter driver uses these re...

Page 65: ...to Auto 2 Click the name of the adapter to test in the Explorer View pane 3 From the Select a test to run list select Cable Analysis If the Cable Analysis option is not available then from the Contex...

Page 66: ...ate selection options are different for different properties 4 Click Apply to confirm the changes to all properties Click Reset to return the properties to their original values 802 1p QOS Enables qua...

Page 67: ...g does not enable WOL Priority VLAN Allows enabling both the prioritization of network traffic and VLAN tagging VLAN tagging only occurs when the VLAN ID setting is configured with a value other than...

Page 68: ...Tx traffic only there is a risk of inbound traffic Rx from a different VLAN being passed up to the operating system However based on the premise of a properly configured network above the IP segmentat...

Page 69: ...ticast Frames Rx A count of frames that were successfully received and are directed to an active nonbroadcast group address This does not include frames received with frame too long FCS length or alig...

Page 70: ...ed in the Team Management pane Notes For further information regarding teaming protocols see Teaming in your Broadcom network adapter user guide If you do not enable LiveLink when configuring teams di...

Page 71: ...change any of your settings click Back Click Cancel to discard your settings and exit the wizard Note If you prefer to work without the wizard for now click Expert Mode If you want to always use Expe...

Page 72: ...R Page 72 4 Select the type of team you want to create If the team type is an SLB type team click Next If the team type is not an SLB type team then a dialog box appears Verify that the network switc...

Page 73: ...operties are supported for the adapter The LSO and CO properties are enabled for a team only when all of the members support and are configured for the feature If this is the case then the team offloa...

Page 74: ...ptional select Use the following member as a standby member then choose the standby member from the list of adapters 7 The Auto Fallback Disable mode feature allows the team to continue using the stan...

Page 75: ...Using Broadcom Advanced Control Suite 4 NetXtreme User Guide Broadcom April 2017 2CS57XX CDUM514 R Page 75 8 If you want to configure LiveLink select Yes otherwise select No then click Next...

Page 76: ...IP Address type the target IP address in the IP Address box for one or all probe targets and then click OK Click Next 12 Select a listed team member click Edit Member IP Address and then type the mem...

Page 77: ...click Next and continue with the wizard from the Finish screen see Step 18 on page 80 of this procedure VLANs enable you to add multiple virtual adapters that are on different subnets The benefit of...

Page 78: ...reme User Guide Broadcom April 2017 2CS57XX CDUM514 R Page 78 15 To tag the VLAN select Tagged and then click Next Otherwise click Untagged click Next and continue with the wizard to add additional VL...

Page 79: ...Using Broadcom Advanced Control Suite 4 NetXtreme User Guide Broadcom April 2017 2CS57XX CDUM514 R Page 79 16 Type the VLAN tag value and then click Next The value must be between 1 and 4094...

Page 80: ...select Commit changes to system and Exit the wizard To apply your changes but continue using the wizard select Save changes and continue to manage more teams Click Finish Note You can define up to 64...

Page 81: ...e 4 NetXtreme User Guide Broadcom April 2017 2CS57XX CDUM514 R Page 81 Note At any point in the Broadcom Teaming Wizard procedure click Preview to get a visual representation of what the team will loo...

Page 82: ...ol Suite 4 NetXtreme User Guide Broadcom April 2017 2CS57XX CDUM514 R Page 82 19 Click the team name in the Team Management pane to view the team s properties in the Information tab transfer and recei...

Page 83: ...ols menu then select Expert Mode or Wizard Mode the default is Wizard Mode Creating a Team 1 From the Teams menu select Create Team or right click one of the devices in the Unassigned Adapters section...

Page 84: ...e adapter selected in the Load Balance Members list 7 You can assign any other available adapter to be a standby member by selecting it from the Standby Member list The Large Send Offload LSO Checksum...

Page 85: ...have an impact on the team s performance Therefore it is recommended that only driver enabled network adapters be added as members to a team Notes The team name cannot exceed 39 characters cannot beg...

Page 86: ...team or a VLAN using Expert Mode To modify a team 1 From the Team menu click Edit Team or right click one of the teams in the list and select Edit Team This option is only available if a team has alre...

Page 87: ...upted Adding a VLAN You can add virtual LANs VLANs to a team This enables you to add multiple virtual adapters that are on different subnets The benefit of this is that your system can have one networ...

Page 88: ...ss until all VLANs are defined then click OK to create them 8 Click Yes when the message is displayed indicating that the network connection will be temporarily interrupted Viewing VLAN Properties and...

Page 89: ...e below applies when you are in Expert Mode To delete a VLAN 1 Select the VLAN to delete 2 From the Teams menu select Remove VLAN 3 Click Apply 4 Click Yes when the message is displayed indicating tha...

Page 90: ...be maximum retries list 6 Set the Probe VLAN ID to correspond with the VLAN where the probe target s resides This will apply the appropriate VLAN tag to the link packet based on the shared configurati...

Page 91: ...uration To restore a configuration 1 From the File menu select Team Restore 2 Click the name of the file to be restored and then click Open 3 Click Apply 4 Click Yes when the message is displayed indi...

Page 92: ...ed in the Team Management pane then click the Statistics tab Click Refresh to get the most recent values for each statistic Click Reset to change all values to zero Tx Packet This is the number of pac...

Page 93: ...ng a console in either a non interactive command line interface CLI mode or an interactive mode As with BACS BACSCLI provides information about each network adapter and enables you to perform detailed...

Page 94: ...Although VLANs are commonly used to create individual broadcast domains and or separate IP subnets it is sometimes useful for a server to have a presence on more than one VLAN simultaneously Broadcom...

Page 95: ...all of them Accounting Server Available to VLAN 3 only The Accounting Server is isolated from all traffic on VLANs 1 and 2 The switch port connected to the server has tagging turned off PCs 1 and 2 At...

Page 96: ...em Only one instance of the BACS client can be running at a time If you are sure that no other BACS client is running then a previous instance may have quit unexpectedly Solution This message displays...

Page 97: ...s Glossary of Terms and Acronyms Teaming Concepts Software Components Hardware Requirements Supported Features by Team Type Selecting a Team Type Teaming Mechanisms Architecture Types of Teams Driver...

Page 98: ...ult tolerance redundant adapter operation in the event that a network connection fails When multiple adapters are installed in the same system they can be grouped with up to 16 teams Each team can con...

Page 99: ...Static type of team is very similar to the Link Aggregation 802 3ad type of team in that all adapters in the team are configured to receive packets for the same MAC address The Generic Trunking FEC GE...

Page 100: ...links Failover teaming provides redundant adapter operation fault tolerance in the event that a network connection fails If the primary adapter in a team is disconnected because of failure of the ada...

Page 101: ...nk for a Smart Load Balancing and Failover and SLB Auto Fallback Disable Team The teaming software periodically probes issues a link packet from each team member one or more specified target network a...

Page 102: ...CDUM514 R Page 102 Section 8 Broadcom Gigabit Ethernet Teaming Services Introduction Teaming Mechanisms Teaming and Other Advanced Networking Properties General Network Considerations Application Con...

Page 103: ...omain name service G ARP Gratuitous Address Resolution Protocol Generic Trunking FEC GEC 802 3ad Draft Static Switch dependent load balancing and failover type of team in which the intermediate driver...

Page 104: ...yer 3 addresses are referred to as the protocol or logical address assigned to the software stack IP is an example of a Layer 3 protocol In addition Layer 4 Transport Layer uses port numbers for each...

Page 105: ...modes all physical adapters that make up a virtual adapter must use the unique MAC address assigned to them when transmitting data That is the frames that are sent by each of the physical adapters in...

Page 106: ...is is required to comply with the IEEE 802 3 standard If two adapters transmit using the same MAC address then a duplicate MAC address situation would occur that the switch could not handle Receive lo...

Page 107: ...es not allow for receive load balancing to occur in the adapter team In general HSRP allows for two routers to act as one router advertising a virtual IP and virtual MAC address One physical router is...

Page 108: ...ontrolled addition and removal of physical links for the link aggregation so that no frames are lost or duplicated The removal of aggregate link members is provided by the marker protocol that can be...

Page 109: ...e NDIS layer NDIS provides a set of library functions to enable the communications between either miniport drivers or intermediate drivers and the protocol stack A protocol address such as an IP addre...

Page 110: ...Layer 3 or higher protocols although it often also works as a Layer 2 device with switching capabilities The teaming of ports connected directly to a router is not supported Supported Features by Tea...

Page 111: ...speeds adapters that support a common speed s but can operate at different speeds Yes Yes No must be the same speed Yes Load balances TCP IP No Yes Yes Yes Mixed vendor teaming Yesb Yesb Yesb Yesb Loa...

Page 112: ...and fault tolerance Teaming offers link aggregation and fault tolerance to meet both of these requirements Preference teaming should be selected in the following order Link Aggregation as the first ch...

Page 113: ...his virtual adapter inherits the MAC Address of the first port initialized in the team A Layer 3 address must also be configured for the virtual adapter The primary function of BASP is to balance inbo...

Page 114: ...lancing inbound load balancing can only be applied to IP addresses that are located in the same subnet as the load balancing server Inbound load balancing exploits a unique characteristic of Address R...

Page 115: ...1 TCP PhysAdapter1 10 0 0 1 UDP PhysAdatper1 10 0 0 1 Or the streams may look like this IGMP PhysAdapter1 10 0 0 1 ICMP PhysAdapter1 10 0 0 1 TCP PhysAdapter2 10 0 0 1 UDP PhysAdatper3 10 0 0 1 The ac...

Page 116: ...Yes Link speed support Different speeds Frame protocol IP Incoming packet management BASP Outgoing packet management BASP Failover event Loss of link or LiveLink event Failover time 500 ms Fallback ti...

Page 117: ...f adapters per team 8 Hot replace Yes Hot add Yes Hot remove Yes Link speed support Different speeds Frame protocol All Incoming packet management Switch Outgoing packet management BASP Failover event...

Page 118: ...ly Settings to check include VLANs and QoS Packet Tagging Jumbo Frames and the various offloads The advanced adapter properties and teaming support are listed in Table 14 a All adapters on the team mu...

Page 119: ...ith the correctly sequenced header based on the single header originally provided Jumbo Frames The BASP intermediate driver supports jumbo frames provided that all of the physical adapters in the team...

Page 120: ...Execution Environment PXE The Preboot Execution Environment PXE allows a system to boot from an operating system image over the network By definition PXE is invoked before an operating system is loade...

Page 121: ...tches and the importance of the interconnect link The diagrams show the secondary team member sending the ICMP echo requests yellow arrows while the primary team member receives the respective ICMP ec...

Page 122: ...1 101 Gray SLB Team 192 168 1 102 ARP Table 100 49 C9 102 5E CA ARP Table 100 49 C9 101 82 82 Red SLB Team 192 168 1 100 Top Switch CAM Table Eth 1 82 83 Eth2 49 C9 Eth 4 5E C9 Bottom Switch CAM Table...

Page 123: ...nge the spanning tree algorithm reconfigures the spanning tree topology and re establishes the link by activating the standby path Spanning tree operation is transparent to end stations which do not d...

Page 124: ...link goes from blocking to forwarding This change could take up to 50 seconds At the end of the STP re calculation a new path would be available for communications between end stations However because...

Page 125: ...ng with Microsoft NLB WLBS The SLB mode of teaming does not work in Microsoft s Network Load Balancing NLB unicast mode only in multicast mode Due to the mechanism used by the NLB service the recommen...

Page 126: ...are recommended to use the same brand of adapters Teaming and Network Backup Load Balancing and Failover Fault Tolerance When you perform network backups in a nonteamed environment overall throughput...

Page 127: ...er inbound load balancing algorithm 2 The physical adapter interface on Client Server Red will be used to transmit the data The Broadcom intermediate driver outbound load balancing algorithm determine...

Page 128: ...kup operations to continue without interruption during the link failure All failover processes within the network are transparent to tape backup software applications To understand how backup data str...

Page 129: ...514 R Page 129 Figure 8 Network Backup With SLB Teaming Across Two Switches Backup Server 1 NIC Team SAN Client Server Blue Tape Backup A B GE Switch 1 GE Switch 2 LACP or GEC A B A B NIC Team NIC Tea...

Page 130: ...STP mode that bypasses the initial phases for example Port Fast Edge Port for the switch ports connected to a team 3 All switches that the team is directly connected to must have the same hardware re...

Page 131: ...ubleshooting Guidelines Before you call for support make sure you have completed the following steps for troubleshooting network connectivity problems when the server is using adapter teaming 1 Make s...

Page 132: ...d 802 3ad teams as stated earlier Question Can I team a fiber adapter with a copper Gigabit Ethernet adapter Answer Yes with SLB and yes if the switch allows for it in FEC GEC and 802 3ad Question Wha...

Page 133: ...annot operate across switches because they require all physical adapters to share the same Ethernet MAC address Question How do I upgrade the intermediate driver BASP Answer The intermediate driver ca...

Page 134: ...Answer In all operating systems the most accurate method for checking the driver revision is to physically locate the driver file and check the properties Question Can SLB detect a switch failure in a...

Page 135: ...iled to allocate memory for the device block Check system memory resource usage The driver cannot allocate memory from the operating system Close running applications to free memory 2 Failed to alloca...

Page 136: ...ng system does not support the IEEE 802 3 medium Reboot the operating system run a virus check run a disk check chkdsk and reinstall the operating system 13 Unable to register the interrupt service ro...

Page 137: ...vent Message Number Message Cause Corrective Action 1 Unable to register with NDIS The driver cannot register with the NDIS interface Unload other NDIS drivers 2 Unable to instantiate the management i...

Page 138: ...apter A standby adapter has been activated Replace the failed physical adapter 13 Network adapter does not support Advanced Failover The physical adapter does not support the Broadcom NIC Extension NI...

Page 139: ...ng Systems for iSCSI Boot The Broadcom NetXtreme Gigabit Ethernet adapters support iSCSI boot on the following operating systems Windows Server operating system Enterprise Linux distribution iSCSI Boo...

Page 140: ...ion using DHCP Enabled or use a static IP configuration Disabled IP Autoconfiguration This option is specific to IPv6 Controls whether the iSCSI boot host software will configure a stateless link loca...

Page 141: ...DHCP Disabled For IPv4 IP Autoconfiguration Disabled For IPv6 Link Up Delay Time Controls how long the iSCSI boot host software waits in seconds after an Ethernet link is established before sending an...

Page 142: ...v4 and IPv6 addresses should be 0 0 0 0 and respectively Subnet Mask Prefix Default Gateway Primary DNS Secondary DNS iSCSI Name corresponds to the iSCSI initiator name to be used by the client system...

Page 143: ...IP parameters via DHCP Enabled For IPv4 IP Autoconfiguration Enabled For IPv6 iSCSI parameters via DHCP Enabled CHAP Authentication Disabled Boot to iSCSI target Disabled DHCP Vendor ID BRCM ISAN Link...

Page 144: ...t Software NetXtreme User Guide Broadcom April 2017 2CS57XX CDUM514 R Page 144 3 Select Exit and Save Configurations Note Information on the Initiator Parameters and 1st Target Parameters screens are...

Page 145: ...h or longer 6 Select ESC to return to the Main menu 7 Select ESC and select Exit and Save Configuration Configuring the DHCP Server to Support iSCSI Boot The DHCP server is an optional component and i...

Page 146: ...n 17 or option 43 Table 18 DHCP Option 17 Parameter Definition Parameter Definition iscsi A literal string servername The IP address or FQDN of the iSCSI target Separator protocol The IP protocol used...

Page 147: ...adcom April 2017 2CS57XX CDUM514 R Page 147 Note If using Option 43 you also need to configure Option 60 The value of Option 60 should match the DHCP Vendor ID value The DHCP Vendor ID value is BRCM I...

Page 148: ...ic information provides more configuration options to the iSCSI client In this configuration three additional suboptions are provided that assign the initiator IQN to the iSCSI boot client along with...

Page 149: ...ice and the DVDROM as the second device 4 Configure the iSCSI target to allow a connection from the remote device Ensure that the target has sufficient disk space to hold the new O S installation 5 Bo...

Page 150: ...into the NVRAM of the adapter 3 Configure the BIOS on the remote system to have the Broadcom MBA as the first bootable device and the DVDROM as the second device 4 Configure the iSCSI target to allow...

Page 151: ...option 7 If driver update is desired follow the instructions to load the driver CD otherwise skip this step 8 At the networking device prompt choose the desired network adapter port and press OK 9 At...

Page 152: ...r an iSCSI boot and the operating system is present on the iSCSI target the last step is to perform the actual boot The system will boot to Windows or Linux over the network and operate as if it were...

Page 153: ...m An iSCSI target is not recognized as an installation target when you try to install Windows Server 2008 by using an IPv6 connection Solution This is a known third party issue See Microsoft Knowledge...

Page 154: ...able to remotely boot and use network resources NFS mount and so forth and to perform Linux installations In the case of a remote boot the Linux universal driver binds seamlessly with the Broadcom Uni...

Page 155: ...ARROW LEFT ARROW and RIGHT ARROW keys to move to and change the values for other menu items as desired 5 Press F4 to save your settings 6 Press ESC when you are finished Using UEFI 1 Restart your syst...

Page 156: ...ARROW DOWN ARROW LEFT ARROW and RIGHT ARROW keys to move to and change the values for other menu items as desired 7 Select Back to go to Main menu 8 Select Finish to save and exit Setting Up the BIOS...

Page 157: ...will provide team information and information of physical network adapters in the team Broadcom Advanced Server Program provides events through event logs Users can use the Event Viewer provided by W...

Page 158: ...e statistics include detailed information such as data packets transmitted and received for the physical virtual VLAN team adapters The alarm trap forwards information about the changes in configurati...

Page 159: ...ger needs to load the Broadcom Extended information MIB file to allow monitoring of the information described above This file bcmif mib is included on the Broadcom NetXtreme adapter installation CD Th...

Page 160: ...RJ 45 Category 52 UTP 100m 328 ft 1 1000BASE T signaling requires 4 twisted pairs of Category 5 balanced cabling as specified in ISO IEC 11801 1995 and ANSI EIA TIA 568 A 1995 and tested for additiona...

Page 161: ...sical link For Windows environments see Running Diagnostic Tests BACS Diagnostic Tests Failures If any of the following tests fail while running the diagnostic tests from the Running Diagnostic Tests...

Page 162: ...ilures are the result of a configuration problem on the network or with the IP addresses Below are common steps when troubleshooting the network 1 Verify that the cable is attached and you have proper...

Page 163: ...tings and change them if they are in conflict with another device Verify that your system is using the latest BIOS Try inserting the adapter in another slot If the new position works the original slot...

Page 164: ...y Linux To verify that the TG3 Linux driver is loaded properly run lsmod grep tg3 If the driver is loaded a line similar to the one below is displayed where size is the size of the driver in bytes and...

Page 165: ...interface It is possible to use netstat i to check the statistics on the Ethernet interface Go to Linux Driver Software for information on ifconfig and netstat Ping an IP host on the network to verif...

Page 166: ...Ethernet Problem When attempting to perform kernel debugging over an Ethernet network on a Windows 8 0 or Windows Server 2012 system the system will not boot This problem may occur with some adapters...

Page 167: ...The equipment generates uses and can radiate radio frequency energy and if not installed and used in accordance with the instructions may cause harmful interference to radio communications However th...

Page 168: ...quipment VCCI If used near a radio or television receiver in a domestic environment it may cause radio interference Install and use the equipment according to the instruction manual VCCI Class B State...

Page 169: ...Regulatory Information NetXtreme User Guide Broadcom April 2017 2CS57XX CDUM514 R Page 169...

Page 170: ...Regulatory Information NetXtreme User Guide Broadcom April 2017 2CS57XX CDUM514 R Page 170...

Page 171: ...Regulatory Information NetXtreme User Guide Broadcom April 2017 2CS57XX CDUM514 R Page 171...

Page 172: ...egulations provide that changes or modifications not expressly approved by Broadcom could void your authority to operate this equipment Industry Canada classe B Cet appareil num rique de la classe B e...

Page 173: ...CDUM514 R Page 173 MIC Notice Republic of Korea Only B CLASS Device Broadcom NetXtreme Gigabit Ethernet Controller BCM95721A211 BCM95722A2202 Note that this device has been approved for non business...

Page 174: ...Regulatory Information NetXtreme User Guide Broadcom April 2017 2CS57XX CDUM514 R Page 174 BSMI...

Reviews: