IBM Nortel Networks L2/3 Manual Download Page 24

Page: 24 / 190

Nortel Networks L2/3 Ethernet Switch Module for IBM

Eserver

BladeCenter

Figure 2-5 Gigabit Ethernet path

2.3 IBM

Eserver

HS20 architecture

In this section, we discuss the architectural design of the IBM

Eserver

BladeCenter HS20.

This is presented as just one example of the blade design for a typical dual-processor server.

IBM

BladeCenter™ -

Gigabit Ethernet path

Midplane (Upper Section)

Midplane (Lower Section)

SW Module 1

1………..14

SW Module 3

1………..14

SW Module 2

1………..14

SW Module 4

Network

Interface

Daughter

Card

SERDES

Ethernet

SERDES

Ethernet

LAN 1

LAN 3

LAN 4

LAN 2

Processor blade

Summary of Contents for Nortel Networks L2/3

Page 1: ...Networks L2 3 Ethernet Switch Module for IBM Eserver BladeCenter Rufus Credle Stephan Fleck Scott Lorditch Jeremy Oliver Full Layer 2 switching and Layer 3 routing Six external multimode fiber or cop...

Page 2: ......

Page 3: ...International Technical Support Organization Nortel Networks L2 3 Ethernet Switch Module for IBM Eserver BladeCenter September 2005...

Page 4: ...duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp First Edition September 2005 This edition applies to Nortel Networks Layer 2 3 Copper and Fiber GbE Switch Modules for...

Page 5: ...tworks Layer 2 3 GbE Switch Module architecture 21 4 1 Nortel GbESM architecture overview 22 4 2 Nortel Networks L2 3 GbESM block diagram 24 4 2 1 Nortel Networks L2 3 GbESM ports specific roles 25 Ch...

Page 6: ...mments 65 7 5 Base configurations for examples in this document 66 7 5 1 Hardware and software used for lab environment 66 7 5 2 Preconfiguration preparation 67 7 5 3 Base configuration common to all...

Page 7: ...Problem resolution 161 9 4 Troubleshooting tools 161 Chapter 10 Service and support 165 10 1 Placing a call to IBM 166 10 2 Online services 166 10 3 Ordering information 166 10 4 Other support sites...

Page 8: ...vi Nortel Networks L2 3 Ethernet Switch Module for IBM Eserver BladeCenter...

Page 9: ...in this publication at any time without notice Any references in this information to non IBM Web sites are provided for convenience only and do not in any manner serve as an endorsement of those Web s...

Page 10: ...ation in the United States other countries or both Intel Intel logo Intel Inside logo and Intel Centrino logo are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the Un...

Page 11: ...pers that discuss network operating systems ERP solutions voice technology high availability and clustering solutions Web application servers pervasive computing and IBM and OEM e business application...

Page 12: ...with research in PHY technologies of computer networking Thanks to the following people for their contributions to this project Tamikia Barrows Jeanne Tucker Margaret Ticknor ITSO Raleigh Center Isha...

Page 13: ...is Redpaper or other Redbooks in one of the following ways Use the online Contact us review redbook form found at ibm com redbooks Send your comments in an email to redbook us ibm com Mail your commen...

Page 14: ...xii Nortel Networks L2 3 Ethernet Switch Module for IBM Eserver BladeCenter...

Page 15: ...enter chassis Nortel Networks L2 3 GbESM provides both full L2 switching and L3 routing capabilities and significant added value not found in commodity switching solutions This value includes VLAN tag...

Page 16: ...ility security and manageability are addressed Combined with the integration of IBM Tivoli Nortel and Cisco management products these architectures bring higher value solutions with lower operational...

Page 17: ...an resources Companies that need to deploy new e commerce and e business applications can achieve speed while ensuring flexibility scalability and availability For enterprise requirements such as file...

Page 18: ...ows the IBM Eserver BladeCenter chassis HS40 HS20 JS20 and LS20 IBM Eserver BladeCenter chassis The BladeCenter is a high density blade solution that provides maximum performance availability and mana...

Page 19: ...et your demanding business needs This enables you to choose from the array of IBM TotalStorage storage solution products which include Fibre Channel products and Storage Area Networks Network Attached...

Page 20: ...ime Diagnostics Electronic Service Agent Tape Drive Management Assistant For more information about advanced server management see http www 1 ibm com servers eserver xseries systems_management xseries...

Page 21: ...an IBM Eserver BladeCenter are independent of each other see Figure 2 3 Having a dual midplane ensures that there is no single point of failure and the blades remain operational Figure 2 3 Internal pi...

Page 22: ...hernet MGT1 Management Module 2 Ethernet 1 Switch Module 1 Ethernet MGT2 Management Module 2 Ethernet 2 Switch Module 2 Ethernet MGT2 Management Module 2 Ethernet 3 Expansion Switch Module 3 Ethernet...

Page 23: ...blade 2 LAN 3 Expansion Switch Module 3 input INT2 Processor blade 2 LAN 4 Expansion Switch Module 4 input INT2 On processor blade LAN 1 and LAN 2 are the on board SERDES Gbit Ethernet interfaces and...

Page 24: ...gn of the IBM Eserver BladeCenter HS20 This is presented as just one example of the blade design for a typical dual processor server IBM BladeCenter Gigabit Ethernet path Midplane Upper Section Midpla...

Page 25: ...ry bus I O functions on the 8843 include Video I2C USB SCSI Gigabit Ethernet and USB floppy CD ROM DVD mouse and keyboard The LPC bus is used to connect to the POST BIOS EEPROM on the 8843 The size of...

Page 26: ...nfigured by exploiting the I2C bus An advanced menu allows for the fine tuning of the module by either opening another window of the Web browser or running a Java applet that allows for connectivity t...

Page 27: ...92 168 70 126 Default is 192 168 70 127 Can be disabled Web interface Web interface Web interface Web interface ANSI interface ANSI interface MM external Ethernet port Any of the four external ports R...

Page 28: ...14 Nortel Networks L2 3 Ethernet Switch Module for IBM Eserver BladeCenter...

Page 29: ...rights reserved 15 Chapter 3 Nortel Networks Layer 2 3 GbE Switch Modules This chapter discusses the Nortel Networks Layer 2 3 Copper and Fiber GbE Switch Modules for IBM Eserver BladeCenter and its s...

Page 30: ...er GbE interfaces for outside communication shown in Figure 3 1 The switch is managed via two internal 100 Mbps ports for communication to the BladeCenter management module A RS232 serial console mana...

Page 31: ...simplifies provisioning The risk of traffic finding a route to a denied destination is reduced if Layer 3 routing is contained in the switch module in the chassis Without Layer 3 filtering several ext...

Page 32: ...tegrated GbE switch module Integrates Nortel networking capabilities to reduce data center complexity and increases networking manageability and availability Leverages the leadership capabilities Blad...

Page 33: ...h either switch module are Nortel Networks Layer 2 3 Copper Gigabit Ethernet Switch Module for IBM Eserver BladeCenter 26K6526 or Nortel Networks Layer 2 3 Fiber Gigabit Ethernet Switch Module for IBM...

Page 34: ...20 Nortel Networks L2 3 Ethernet Switch Module for IBM Eserver BladeCenter...

Page 35: ...yright IBM Corp 2005 All rights reserved 21 Chapter 4 Nortel Networks Layer 2 3 GbE Switch Module architecture This chapter provides a system overview of the Nortel Networks Layer 2 3 GbE Switch Modul...

Page 36: ...Nortel Networks L2 3 GbESM architecture overview Figure 4 2 on page 23 shows the architecture for Ethernet connectivity The two Nortel GbESMs can be housed within the BladeCenter chassis Each Nortel G...

Page 37: ...Nortel GbESMs in the same BladeCenter chassis exchange Layer 2 frames across the Management Module The Nortel GbESM processes BPDUs that reach it via the Management Module if Spanning Tree is enabled...

Page 38: ...tel Networks Layer 2 3 GbE Switch Module The Nortel GbESM has two Gigabit Ethernet Aggregator GEAs for switching It has 1 MB on chip cache for packet buffers and supports 20 Gigabit Ethernet ports 14...

Page 39: ...EXT2 EXT3 EXT4 EXT5 EXT6 1 2 3 4 5 6 BladeServerSlot1 BladeServerSlot2 BladeServerSlot3 BladeServerSlot4 BladeServerSlot5 BladeServerSlot6 BladeServerSlot7 BladeServerSlot8 BladeServerSlot9 BladeServ...

Page 40: ...the blade servers This cannot be changed at this time but future revisions of code may support the ability to set these ports to a no negotiate condition and force the link to 1000 full 1 B S S 1 2 1...

Page 41: ...d and configured on VLAN 1 These ports default to Disabled when in a new IBM Eserver BladeCenter You must use the Management Module Web interface under I O Module tasks Advanced settings to set Extern...

Page 42: ...g that is provided by the Management Module for a new IBM Eserver BladeCenter is as follows Switch bay 1 192 168 70 127 24 Switch bay 2 192 168 70 128 24 Switch bay 3 192 168 70 129 24 Switch bay 4 19...

Page 43: ...ons that help with the management and deployment of the Nortel GbESM in an IBM Eserver BladeCenter We also discuss the management paths and rules for connecting to and accessing the Nortel GbESM 5 Not...

Page 44: ...anagement of the Management Module within the BladeCenter chassis In other words it is virtually impossible to successfully deploy the Nortel GbESM if you do not understand and properly configure cert...

Page 45: ...n the Figure 5 1 on page 30 On the Nortel GbESM the Ethernet management MGT1 and MGT2 ports which connect the switch to the Management Module are placed in VLAN 4095 It is not possible to change this...

Page 46: ...should be used with these settings 9600 baud no parity 8 data bits 1 stop bit 9600 N 8 1 5 1 2 In band management The second mode of operation that is commonly used is in band management In this case...

Page 47: ...GbESM beyond the address that is provided through the Management Module and attached to VLAN 4095 This additional IP address should be attached to one of the active VLANs configured on the switch and...

Page 48: ...nagement functions including Configuring the management IP address of the switch Enabling or disabling the external ports and management via these ports Configuring Power On Self Test POST options Rem...

Page 49: ...e commands to obtain dumps of the current state of the switch for technical support Figure 5 4 CLI Main Menu Global commands The remainder of the options on the Main Menu diff apply save revert and ex...

Page 50: ...for editing the configuration typing in your changes A for the apply command which makes the changes part of the running configuration S for the save command which writes the changed configuration to...

Page 51: ...oot gtimg 2 Enter where the new image file will be placed We are upgrading the boot image file so enter boot That is the location for the boot image file 3 Enter the IP address of the TFTP server 4 En...

Page 52: ...file to a TFTP server 1 Enter cfg ptcfg at the command line 2 Enter the IP address of the TFTP server 3 Enter the filename to which you want to save the file A second way to capture the current confi...

Page 53: ...le modes of authentication which are supported on the Nortel Networks L2 3 GbESM The default mode is to support passwords without individual user IDs When accessing the CLI in this mode there is only...

Page 54: ...available in the Alteon OS 21 0 Application Guide 5 2 3 Browser Based Interface We now take a brief look at the Browser Based Interface BBI on the Nortel Networks L2 3 GbESM Almost everything that can...

Page 55: ...tions for the switch are located 5 If you have made any changes to the switch and wish to save them click Apply to apply the changes to the current running config 6 Click Save to save the changes 5 2...

Page 56: ...sses that are configured through the Management Module Web interface should be on the same subnet as the Management Module internal and external port IP addresses to allow for access through the Manag...

Page 57: ...6 IBM Eserver BladeCenter system initial setup This chapter discusses the network topology and the hardware that is configured to provide a tested and working configuration to help implement your Nort...

Page 58: ...Module Firmware Update Version 1 18 or later To acquire the firmware go to http www ibm com pc support site wss document do lndocid MIGR 54939 Be sure to read the notes that are associated with the fi...

Page 59: ...rt of the Management Module Accessing the Management Module Web interface After you establish the physical connection to the Management Module configure the management station with an available IP add...

Page 60: ...ge the external network interface eth0 If you do not you will have IP address conflicts and will not be able to access your Management Modules In Figure 6 2 we configured the external interface to be...

Page 61: ...e switches As for HS40 which has a total of four NICs as standard each two NICs link to one switch A switch in bay 3 or bay 4 is required when a Gigabit Ethernet Expansion Card is being installed on t...

Page 62: ...orts Use this field to enable or disable the external ports of this I O module When the external ports are disabled no traffic can go through these ports If this field is set to Disabled on the Manage...

Page 63: ...e To determine the latest level of the Nortel switch operating system software that is available from IBM complete the following steps 1 Go to the following Web address http www ibm com support 2 Clic...

Page 64: ...that contains a self starting program which allows you to maintain your system firmware and Windows device drivers at the most current levels defined on the CD UpdateXpress detects currently applied d...

Page 65: ...ing Monitors Firmware VPD on the Management Module Web interface which opens a window similar to the one shown in Figure 6 6 on page 52 Note In our example we dealt with pristine HS20 systems Therefor...

Page 66: ...rosoft Windows 2003 Broadcom driver installation Windows 2003 does not ship with the drivers needed to run the Broadcom Ethernet NICs The drivers must be updated for the NICs to be usable To obtain th...

Page 67: ...com redpapers pdfs redp3869 pdf 6 2 3 Broadcom Advanced Control Suite installation Network interface card NIC teaming is one method for providing high availability and fault tolerance in IBM Eserver...

Page 68: ...for IBM Eserver BladeCenter Figure 6 7 Broadcom selection window 2 Click MANAGEMENT PROGRAMS and a window similar to Figure 6 8 opens Figure 6 8 Select Features window 3 Select Control Suite and BASP...

Page 69: ...lade server integrated system management processor firmware update Version 1 09 Broadcom NetXtreme firmware level 3 21 Nortel Networks Layer 2 3 Copper and Fiber GbE Switch Modules for IBM Eserver Bla...

Page 70: ...56 Nortel Networks L2 3 Ethernet Switch Module for IBM Eserver BladeCenter...

Page 71: ...er discusses the Best Practices for implementing and configuring Nortel Networks Layer 2 3 Fiber and Copper GbE Switch Modules in Nortel Networks Cisco Systems and Extreme Networks network environment...

Page 72: ...ovide support for Serial over LAN functionality The external ports have tagging disabled 7 1 2 Link Aggregation and LACP 802 3ad and 802 3 2002 These standards define techniques for grouping two or mo...

Page 73: ...ngs compared to RIP2 and therefore RIP1 has largely fallen out of favor These shortcomings include limitations on the size of network which can be supported and the completeness of the route informati...

Page 74: ...om the Institute of Electrical and Electronic Engineering IEEE You can find them at http standards ieee org getieee802 Some newly approved or draft standards require the payment of a fee to obtain the...

Page 75: ...ng the backup switch to take over in the event the primary switch is cut off from its upstream neighbors One key issue with Layer 3 designs is the need for L3 routers to know where to forward traffic...

Page 76: ...upstream connections has no place to forward the server blades traffic and therefore discards it The Nortel GbESM also supports a feature called Hot Standby which provides similar function to trunk fa...

Page 77: ...r activate standby members if necessary In the IBM Eserver BladeCenter NIC teaming will detect the failure of a NIC chip on the server blade the loss of connection to a switch module via the midplane...

Page 78: ...a configured priority When VRRP first becomes active the switch with the highest priority will become the Master switch The master switch sends out periodic hello packets announcing that it is still o...

Page 79: ...more robust HA design Note that the failure of a NIC within the blade server the failure of a link between the GbESM and the blade server and the hard failure of a GbESM would all result in a link do...

Page 80: ...the assumption that the IBM Eserver BladeCenter is being deployed in a mission critical data center environment where high availability and performance are of utmost importance Also the 3560G Cisco s...

Page 81: ...witches were used to show examples of the Nortel GbESMs configured with a different switch vendor Two Nortel Networks Layer 2 3 Fiber Gigabit Ethernet Switch Module for IBM Eserver BladeCenter 26K6528...

Page 82: ...ld be 10 99 0 245 The 99 identifies VLAN 99 which is a management VLAN created for the examples The last octet being 245 distinguishes the IP address as one belonging to Core1 Core1 will always have t...

Page 83: ...7 2 shows the BASP configuration for blade server 2 Figure 7 2 Blade server 2 BASP configuration Blade server 3 is configured so that the first Ethernet interface has its IP address on VLAN 20 The se...

Page 84: ...2 1Q tagging and trunk failover Core 1 Core 2 G0 23 G0 1 Management Network Management Workstation G0 2 Ext2 Ext1 GbESM _2 GbESM _1 Int1 Int2 Int3 Int4 Links between Management Modules and GbESMs not...

Page 85: ...each Cisco switch connects two ports g0 1 and g0 2 to its adjoining Nortel GbESM EXT1 and EXT2 These aggregated links are to carry VLAN 5 10 20 and 99 VLAN 99 is meant to be a management VLAN and the...

Page 86: ...10 10 0 246 255 255 255 0 interface Vlan20 ip address 10 20 0 245 255 255 255 0 ip address 10 20 0 246 255 255 255 0 interface Vlan99 ip address 10 99 0 245 255 255 255 0 ip address 10 99 0 246 255 25...

Page 87: ...n 5 10 20 99 switchport mode trunk interface g0 24 no switchport ip address 9 42 171 245 255 255 255 0 ip address 9 42 171 246 255 255 255 0 ip default gateway 9 42 171 3 The host name was set in orde...

Page 88: ...s should have PVID set to 5 Example 7 6 PVIDs set c port EXT1 pvid 5 c port EXT2 pvid 5 c port INT1 pvid 20 c port INT3 pvid 10 pvid 20 c port INT4 pvid 99 There is one change on GbESM_2 for INT3 This...

Page 89: ...een EXT1 and EXT2 to interface with each Cisco switch use the following also trunk failover is enabled with the syntax c l2 trunk 1 fail ena c l2 trunk 1 add ext1 add ext2 ena fail ena The Nortel GbES...

Page 90: ...ion snapshots Complete configuration files are shown for the GbESM Example 7 9 and upstream Core switches Example 7 10 on page 77 One configuration for each type of switch is shown with notes where th...

Page 91: ...9 ena addr 10 99 0 243 addr 10 99 0 244 mask 255 255 255 0 broad 10 99 0 255 vlan 99 c l3 gw 1 ena addr 10 99 0 245 addr 10 99 0 246 script end DO NOT EDIT THIS LINE Example 7 10 Basic topology Core s...

Page 92: ...te channel group 1 mode on interface GigabitEthernet0 2 switchport trunk encapsulation dot1q switchport trunk native vlan 5 switchport trunk allowed vlan 5 10 20 99 switchport mode trunk switchport no...

Page 93: ...ip address 9 42 171 246 255 255 255 0 interface GigabitEthernet0 25 interface GigabitEthernet0 26 interface GigabitEthernet0 27 interface GigabitEthernet0 28 interface Vlan1 no ip address shutdown in...

Page 94: ...ttached and failback occurred 7 7 Advanced Layer 2 topology sample configurations This example is an extension to the basic configuration described in 7 6 Basic Layer 2 entry topology on page 69 becau...

Page 95: ...nt2 Int2 Int4 1 2 Int3 Int3 Int4 Links between Management Modules and GbESMs not shown Team 10 99 0 244 10 99 0 243 G0 11 PO1 Cisco 3560G G0 23 VLAN 5 10 20 99 G0 24 G0 24 Team PO2 G0 2 G0 11 G0 12 G0...

Page 96: ...bled or shut down prior to making the configuration changes This will reduce the likelihood of any temporary Spanning Tree loops and possible network down conditions that might result in the process o...

Page 97: ...active if desired standby would be another option for the lower port of the pair c l2 lacp port EXT1 mode active c l2 lacp port EXT5 mode active Look for the admin key used on the lower ports EXT1 and...

Page 98: ...Consequently only the aggregation mode must be changed for ports G0 1 and G0 2 could be done for the virtual interface Po1 instead interface range G0 1 2 channel group 1 mode active end Remember that...

Page 99: ...election process c l2 stg 2 clear c l2 stg 2 brg prior 65535 c l2 stg 2 add 5 c l2 stg 3 clear c l2 stg 3 brg prior 65535 c l2 stg 3 add 10 c l2 stg 4 clear c l2 stg 4 brg prior 65535 c l2 stg 4 add 2...

Page 100: ...port EXT5 ena oper port EXT6 ena Enabling the ports on Core1 and Core2 conf t int range g0 1 2 g0 11 12 no shut Verify the Spanning Tree status As shown in Example 7 11 the port status and the VLAN a...

Page 101: ...5 EXT2 5 10 20 99 EXT3 19 n n 1 EXT3 1 EXT4 20 n n 1 EXT4 1 EXT5 21 y n 5 EXT5 5 10 20 99 EXT6 22 y n 5 EXT6 5 10 20 99 The info l2 stg command shows the Spanning Tree status for every active Spannin...

Page 102: ...EXT1 2 20 15 300 Parameters Priority Hello MaxAge FwdDel Aging 65535 2 20 15 300 Port Priority Cost State Designated Bridge Des Port INT2 128 4 FORWARDING ffff 00 11 f9 36 b7 00 8002 INT3 128 4 FORWA...

Page 103: ...3 fd 6a c9 80 8270 Automatic path cost Spanning Tree Group 16 On STP PVST VLANs 4095 Current Root Path Cost Port Hello MaxAge FwdDel Aging 8000 00 11 f9 36 b7 00 0 null 2 20 15 300 Parameters Priority...

Page 104: ...from a topology change include recent enhancements to the Spanning Tree Protocol such as Rapid Spanning Tree IEEE 801 1w which is discussed in the next section or alternatively a Layer 3 based solutio...

Page 105: ...LAN_Green def INT2 INT3 EXT1 EXT2 EXT5 EXT6 def INT2 EXT1 EXT2 EXT5 EXT6 on GbESM_2 c l2 vlan 20 ena name VLAN_Red def INT1 INT2 EXT1 EXT2 EXT5 EXT6 def INT1 INT2 INT3 EXT1 EXT2 EXT5 EXT6 on GbESM_2 c...

Page 106: ...no aaa new model ip subnet zero ip routing no ip domain lookup no file verify auto spanning tree mode pvst no spanning tree optimize bpdu transmission spanning tree extend system id spanning tree vla...

Page 107: ...terface GigabitEthernet0 4 interface GigabitEthernet0 5 interface GigabitEthernet0 6 interface GigabitEthernet0 7 interface GigabitEthernet0 8 interface GigabitEthernet0 9 interface GigabitEthernet0 1...

Page 108: ...chport trunk allowed vlan 2 10 20 99 switchport mode trunk switchport nonegotiate interface GigabitEthernet0 26 switchport trunk encapsulation dot1q switchport trunk native vlan 5 switchport trunk all...

Page 109: ...see Figure 7 5 on page 81 allows STP to be disabled on the BladeCenter Switch Modules Rapid PVST was configured on the Cisco devices and STP was switched off completely STG and MRST on both GbESMs Pre...

Page 110: ...port status and vlan assignment by typing the info link and info port command on the GbESM The commands info l2 stg and info l2 trunk shows the Spanning Tree status Verify that no ports of the GbESMs...

Page 111: ...or the GbESMs Version 1 0 1 6 Base MAC address 00 11 f9 36 b7 00 GbESM_1 c sys hprompt ena c sys access user uid 1 name USERID pswd 5754473e1340022a1e37a6f7d0f0a1d8aa8b437633b51ae68eb6d669ce9fd9f7 ena...

Page 112: ...p port EXT2 mode active adminkey 17 c l2 lacp port EXT5 mode active c l2 lacp port EXT6 mode active adminkey 21 c l3 if 99 ena addr 10 99 0 243 addr 10 99 0 244 on GbESM_2 mask 255 255 255 0 broad 10...

Page 113: ...trunk switchport nonegotiate spanning tree cost 100 interface Port channel2 switchport trunk encapsulation dot1q switchport trunk native vlan 5 switchport trunk allowed vlan 5 10 20 99 switchport mode...

Page 114: ...active interface GigabitEthernet0 13 interface GigabitEthernet0 14 interface GigabitEthernet0 15 interface GigabitEthernet0 16 interface GigabitEthernet0 17 interface GigabitEthernet0 18 interface Gig...

Page 115: ...n99 ip address 10 99 0 245 255 255 255 0 ip address 10 99 0 245 255 255 255 0 on Core2 ip default gateway 9 42 171 3 ip classless ip route 0 0 0 0 0 0 0 0 9 42 171 3 ip http server ip http secure serv...

Page 116: ...unning 802 1D classic spanning tree or 802 1w rapid spanning tree The commands under c l2 mrst cist define the parameters for this interoperability These commands also govern the interactions of bound...

Page 117: ...nfo l2 cist Common Internal Spanning Tree VLANs 1 9 11 19 21 29 31 39 41 4094 Current Root Path Cost Port MaxAge FwdDel 3000 00 12 7f ea 76 00 0 17 20 15 Cist Regional Root Path Cost 3000 00 12 7f ea...

Page 118: ...rio Nbr Type Fa1 0 1 Desg FWD 200000 128 3 P2p MST1 vlans mapped 10 30 Bridge address 0012 7fea 7600 priority 4097 4096 sysid 1 Root this switch for MST1 Interface Role Sts Cost Prio Nbr Type Fa1 0 1...

Page 119: ...tg 1 add 10 30 c l2 stg 2 clear c l2 stg 2 add 20 40 c l2 stg 16 clear c l3 if 1 ena addr 172 16 1 3 mask 255 255 255 0 broad 172 16 1 255 c l3 if 10 ena addr 172 16 10 3 mask 255 255 255 0 broad 172...

Page 120: ...model switch 1 provision ws c3750 24ts vtp domain BC vtp mode transparent ip subnet zero no file verify auto spanning tree mode mst spanning tree extend system id spanning tree mst configuration name...

Page 121: ...down interface FastEthernet1 0 14 shutdown interface FastEthernet1 0 15 shutdown interface FastEthernet1 0 16 shutdown interface FastEthernet1 0 17 shutdown interface FastEthernet1 0 18 shutdown inter...

Page 122: ...s There is no need to identify its VLAN association Additional VLANs and associated subnets are required for the connections to the Core switches The uplink connections do not share the VLANs 10 20 or...

Page 123: ...g traffic within the chassis include greater security because there are no patch panels which can be tampered with and lower latency since the traffic traverses a smaller number of switches between so...

Page 124: ...lly facing VRRP addresses are still valid Uplink failure where traffic flows either via the other switch and through a cross over link connecting the two GbESM switches or with hot standby and trackin...

Page 125: ...ne none VRRP GbESMs 10 35 0 100 10 46 0 100 10 10 0 100 10 20 0 100 Core 2 Management Network Management Workstation BladeCenter 1 2 1 1 2 2 1 2 3 Int1 Int1 Int2 Int2 Int4 1 2 Int3 Int3 Int4 Links bet...

Page 126: ...gateways will be 10 35 0 245 and 10 46 0 246 and are shown in the configuration text below The two GbESMs and the two Core switches each use configurations shown in Example 7 21 and Example 7 22 on pa...

Page 127: ...f 10 ena vlan 10 addr 10 10 0 243 addr 10 10 0 244 on GbESM 2 mask 255 255 255 0 cfg l3 if 20 ena vlan 20 addr 10 20 0 243 addr 10 20 0 244 for GbESM 2 mask 255 255 255 0 these are for the uplink subn...

Page 128: ...rface range g0 11 12 channel group 2 mode on interface range Po2 g0 11 12 switchport access vlan 35 switchport mode access interface vlan 35 ip address 10 35 0 245 255 255 255 0 Configuration for Core...

Page 129: ...ple 7 23 VRRP Configuration for GbESMs turn VRRP on and then create VRRP instances cfg l3 vrrp on cfg l3 vrrp vr 1 vrid 1 if 10 addr 10 10 0 100 prio 101 the above is only on GbESM 1 defaults to 100 o...

Page 130: ...olely for the connection between the two switches This is to avoid triggering the hot standby failover inappropriately The same configuration is used for both GbESM modules except where noted Example...

Page 131: ...the VLAN network objects will have its own default gateway VLAN 10 will use 10 10 0 100 VLAN 20 will use 10 20 0 100 Blade server 3 has the NIC attached to GbESM 1 on VLAN 10 and the NIC attached to...

Page 132: ...n n 1 EXT4 1 EXT5 21 n n 36 EXT5 36 EXT6 22 n n 36 EXT6 36 GbESM_1 Information i link Alias Port Speed Duplex Flow Ctrl Link TX RX INT1 1 1000 full yes yes up INT2 2 1000 full yes yes up INT3 3 1000...

Page 133: ...r 4 vrid 4 10 46 0 100 if 46 renter prio 113 master GbESM_1 Information i l3 ip IP information AS number 0 Interface information 10 10 10 0 243 255 255 255 0 10 10 0 255 vlan 10 up 20 10 20 0 243 255...

Page 134: ...ump taken 0 09 11 Thu Jan 1 2070 Version 1 0 1 6 Base MAC address 00 11 f9 36 b7 00 GbESM_1 c sys hprompt ena c sys access user uid 1 name USERID pswd 8348a3908340a280be85e2f340f00172d60dd8c4673414252...

Page 135: ...c l3 if 10 ena addr 10 10 0 243 addr 10 10 0 244 on GbESM 2 mask 255 255 255 0 broad 10 10 0 255 vlan 10 c l3 if 20 ena addr 10 20 0 243 addr 10 20 0 244 on GbESM 2 mask 255 255 255 0 broad 10 20 0 2...

Page 136: ...0 35 0 100 c l3 vrrp vr 4 ena vrid 4 if 46 prio 101 the above is only on GbESM 1 defaults to 100 on GbESM 2 addr 10 46 0 100 c l3 vrrp hotstan ena c l3 vrrp group ena if 50 on GbESM 1 only default to...

Page 137: ...t nonegotiate interface Port channel2 switchport access vlan 35 vlan 46 on core 2 switchport trunk encapsulation dot1q switchport mode access switchport nonegotiate interface GigabitEthernet0 1 switch...

Page 138: ...5 255 0 246 on core 2 interface GigabitEthernet0 24 no switchport ip address 9 42 171 245 255 255 255 0 246 on core 2 interface Vlan1 no ip address shutdown interface Vlan35 core 1 only ip address 10...

Page 139: ...onfiguration This configuration is robust and suited for environments requiring High Availability Its behavior in two key failure modes is Switch failure In the event of a switch failure the second sw...

Page 140: ...e 10 36 0 246 none 10 46 0 246 none none Core 1 Core 2 Management Network Management Workstation Int1 Int1 Int2 Int2 Int4 Int3 Int3 Int4 Links between Management Modules and GbESMs not shown G0 11 PO1...

Page 141: ...n layer 3 functions on and define default gateways cfg l3 frwd on cfg l3 gw 1 addr 10 35 0 245 ena cfg l3 gw 2 addr 10 36 0 246 ena create new vlans for uplink ports and reassign ports as needed cfg l...

Page 142: ...5 ena cfg l2 vlan 46 ena cfg port ext1 tag dis cfg port ext2 tag dis cfg port ext3 tag ena cfg port ext5 tag dis cfg port ext6 tag dis cfg l2 vlan 46 def ext1 ext2 cfg l2 vlan 45 def ext5 ext6 cfg l2...

Page 143: ...ccess interface range Po2 g0 11 12 switchport access vlan 45 switchport mode access interface vlan 35 ip address 10 35 0 245 255 255 255 0 interface vlan 45 ip address 10 45 0 245 255 255 255 0 Config...

Page 144: ...0 0 The redistribute static command was included in our testing to ensure that the route from our lab network to the rest of the building would be known by all switches in the test environment It migh...

Page 145: ...ed As with the configuration examples you can use the ping and tracert traceroute commands to test end to end connectivity GbESM commands to verify RIP The i l3 route dump command as shown in Example...

Page 146: ...tric 2 10 35 0 0 24 via 10 20 0 244 metric 3 10 36 0 0 24 via 10 20 0 244 metric 3 10 45 0 0 24 via 10 10 0 244 metric 2 10 46 0 0 24 via 10 10 0 244 metric 2 10 99 0 0 24 via 10 36 0 246 metric 2 GbE...

Page 147: ...7 37 on page 132 i l3 ospf dump provides detailed OSPF information The i l3 ospf nbr command lists the neighboring switches that the GbESM is connected to via OSPF Unlike RIP OSPF uses persistent conn...

Page 148: ...55 255 broadcast broadcast GbESM_1 IP Routing i l3 ospf OSPF Information Menu general Show general information aindex Show area s information if Show interface s information virtual Show details of vi...

Page 149: ...1 244 1 Full 10 10 0 244 20 9 42 171 244 1 Full 10 20 0 244 36 10 56 0 246 1 Full 10 36 0 246 OSPF LS Database OSPF LSDB breakdown for router with ID 10 10 0 243 Area IDRouterNetworkSum NetASBRNSSASub...

Page 150: ...0 24 10 0 0 0 24 is subnetted 7 subnets O 10 10 0 0 110 2 via 10 46 0 244 00 25 13 Vlan46 110 2 via 10 36 0 243 00 25 13 Vlan36 O 10 20 0 0 110 2 via 10 46 0 244 00 25 13 Vlan46 110 2 via 10 36 0 243...

Page 151: ...ayer 3 GbESM configuration with dynamic routing GbESM_1 Main c d script start Layer 2 3 Gigabit Ethernet Switch Module for IBM eServer BladeCenter 4 DO NOT EDIT THIS LINE Configuration dump taken 0 04...

Page 152: ...f 10 ena addr 10 10 0 243 10 10 0 244 on GbESM 2 mask 255 255 255 0 broad 10 10 0 255 vlan 10 c l3 if 20 ena addr 10 20 0 243 10 20 0 244 on GbESM 2 mask 255 255 255 0 broad 10 20 0 255 vlan 20 c l3 i...

Page 153: ...son d trigg e metric 1 mcast e c l3 rip if 20 auth none c l3 rip if 35 ena supply e listen e default listen version 2 c l3 rip if 35 poison d trigg e metric 1 mcast e c l3 rip if 35 auth none c l3 rip...

Page 154: ...nd Building configuration Current configuration 2935 bytes version 12 2 no service pad service timestamps debug uptime service timestamps log uptime no service password encryption hostname Core1 enabl...

Page 155: ...igabitEthernet0 9 switchport access vlan 99 switchport mode access interface GigabitEthernet0 11 switchport access vlan 45 46 on core 2 switchport trunk encapsulation dot1q switchport mode access swit...

Page 156: ...r OSPF router rip redistribute static network 10 0 0 0 the below is for OSPF remove it for RIP core 2 uses 10 36 0 0 and 10 46 0 0 router ospf 9 network 10 35 0 0 0 0 255 255 area 0 0 0 9 network 10 4...

Page 157: ...figuration Full Detail Configuration Summit400 48t Configuration generated Tue Jun 14 05 33 14 2005 Software Version 7 2e 1 Build 10 non ssh by Release_Master on 03 26 04 18 29 56 configure sys recove...

Page 158: ...9 0 247 255 255 255 0 configure vlan VLAN99 add port 1 tagged configure vlan VLAN99 add port 11 tagged configure vlan VLAN99 add port 23 tagged Boot information use image primary Configuration Informa...

Page 159: ...les vlan VLAN10 enable icmp time exceeded vlan VLAN10 enable icmp parameter problem vlan VLAN10 enable icmp timestamp vlan VLAN10 enable icmp address mask vlan VLAN10 configure ip mtu 1500 vlan VLAN10...

Page 160: ...igure rip vlan Default export filter None configure rip add vlan VLAN99 configure rip txmode v2only vlan VLAN99 configure rip rxmode any vlan VLAN99 configure rip vlan VLAN99 cost 1 configure rip vlan...

Page 161: ...nfigure ospf vlan Default authentication none configure ospf vlan VLAN99 area 0 0 0 9 configure ospf vlan VLAN99 timer 5 1 10 40 configure ospf vlan VLAN99 authentication none configure ospf vlan VLAN...

Page 162: ...Views Configuration SNMPV3 VACM Access Configuration SNMPV3 USM Groups Configuration SNMPV3 Community Table Configuration SNMPV3 Target Addr Configuration SNMPV3 Target Params Configuration SNMPV3 No...

Page 163: ...off enable log target nvram configure log target memory buffer number of messages 1000 configure log target memory buffer filter DefaultFilter severity debug data configure log target memory buffer m...

Page 164: ...150 Nortel Networks L2 3 Ethernet Switch Module for IBM Eserver BladeCenter...

Page 165: ...ture description and configuration This chapter provides a brief introduction to the Serial over LAN SOL feature for the IBM Eserver BladeCenter It also discusses the configuration of the Nortel Netwo...

Page 166: ...r Management Module This gives the ability to have one SOL session active on all 14 blade servers in the BladeCenter chassis and also have six additional CLI sessions for the Management Module itself...

Page 167: ...ses to communicate with the blade system management processor BSMP of each blade server is based on the IP address set in this field 8 4 SOL use during Nortel Networks L2 3 GbESM experiments SOL was e...

Page 168: ...for administration of the blade server itself The blade server can be restarted services can be started or shutdown IP addresses can be changed the kernel log can be dumped and so forth To see a norm...

Page 169: ...p 2005 All rights reserved 155 Chapter 9 Nortel Networks Layer 2 3 GbE Switch Module troubleshooting In this chapter we discuss troubleshooting techniques that you can use in support of the Nortel Net...

Page 170: ...ed on both sides of the connection This is an important best practice for any switch to switch connections in a production network not just between the Nortel Networks L2 3 GbESM and its upstream conn...

Page 171: ...leshooting Experience has shown that the greater the communication between administrative groups the more likely an issue can be resolved sooner rather than later Where do you start when troubleshooti...

Page 172: ...am 9 3 1 Problem definition In this step we make an effort to define our problem by asking the following questions Who is affected What are the symptoms of the problem What problems could cause these...

Page 173: ...umps Collect the following dump types TechSupport dump maint tsdmp Includes output from the following dumps Configuration dump cfg dump Information dump info dump Statistics dump stats dump Panic dump...

Page 174: ...When will the work be done Can configuration changes be made during core business hours or is a maintenance window required Who needs to approve the change What is the back out plan if the problem is...

Page 175: ...the location of the break in connectivity This tool is included with Windows all variants of UNIX and is also available on many network device CLIs Telnet SSH Telnet SSH allows you to connect to devic...

Page 176: ...ng server for application network and operating system logging is available for Linux and Windows That tool is 3Com 3CDaemon TFTP FTP Syslog Note ExamDiff is a freeware difference tool that you can do...

Page 177: ...Pro Net X ray Shomiti Tools available for Linux UNIX Ethereal TCPDump Snoop Note Microsoft Web Stress Tool is a free load generator WebBench is a free load generator and performance benchmark tool Loa...

Page 178: ...itch documents Here are some GbE documents available for use when troubleshooting GbE Switch Command Reference GbE Switch Application Guide GbE Switch Module Training Course Labs and Notes GbE Switch...

Page 179: ...Copyright IBM Corp 2005 All rights reserved 165 Chapter 10 Service and support This chapter explains the support methods that you can use if you have issues with the Nortel Networks L2 3 GbESM 10...

Page 180: ...tacts at the following Web site and select your country http www ibm com planetwide On this Web site look for the appropriate telephone number under technical support and call IBM for assistance 10 3...

Page 181: ...167 10 4 Other support sites Listed here are other helpful Web sites Nortel Networks Technical Support http www130 nortelnetworks com cgi bin eserv cs main jsp Nortel Networks Products http products n...

Page 182: ...168 Nortel Networks L2 3 Ethernet Switch Module for IBM Eserver BladeCenter...

Page 183: ...dby Router Protocol HTTP Hypertext Transfer Protocol Abbreviations and acronyms HTTPS Hypertext Transfer Protocol over Secure Socket Layer I2C Inter IC IBM International Business Machines Corporation...

Page 184: ...synchronous dynamic RAM SERDES serializer deserializer is an integrated circuit SLB Smart Load Balancing SMP symmetric multiprocessing SNMPv3 Simple Network Management Protocol version 3 SoL Serial ov...

Page 185: ...cation Guide Alteon OS 21 x Browser Based Interface Quick Guide Alteon OS 21 x Command Reference IBM Eserver BladeCenter Management Module User s Guide IBM Eserver BladeCenter Management Module Instal...

Page 186: ...l Suite BACS http www ibm com pc support site wss document do lndocid MIGR 43815 IBM Driver matrixes http www 307 ibm com pc support site wss DRVR MATRIX html IEEE Standards Organization http standard...

Page 187: ...n eserv cs main jsp Nortel Networks Products http products nortel com go product_index jsp How to get IBM Redbooks You can search for view or download Redbooks Redpapers Hints and Tips draft publicati...

Page 188: ...174 Nortel Networks L2 3 Ethernet Switch Module for IBM Eserver BladeCenter...

Page 189: ......

Page 190: ...switch options enable the consolidation of full Layer 2 3 LAN switching and routing capabilities The Nortel Networks switch modules also provide an upgrade path to full Layer 4 7 services by including...

Search results

Summary of Contents for Nortel Networks L2/3

Reviews:

Related manuals for Nortel Networks L2/3

Brands by name

Popular brands

IBM Nortel Networks L2/3, Manual

Search results

Summary of Contents for Nortel Networks L2/3

Reviews:

Related manuals for Nortel Networks L2/3

Brands by name

Popular brands