Cisco Nexus B22HP Design And Deployment Manual Download Page 38

Page: 38 / 41

Page 38 of 41

channel-group 104

interface Ethernet1/3

interface Ethernet1/4

interface Ethernet1/5

interface Ethernet1/6

interface Ethernet1/7

interface Ethernet1/8

interface Ethernet1/9

switchport mode trunk

channel-group 20

interface Ethernet1/10

switchport mode trunk

channel-group 20

interface Ethernet1/11

switchport access vlan 182

interface Ethernet1/12

interface Ethernet1/13

interface Ethernet1/14

interface Ethernet1/15

interface Ethernet1/16

interface Ethernet1/17

interface Ethernet1/18

interface Ethernet1/19

interface Ethernet1/20

interface Ethernet1/21

Summary of Contents for Nexus B22HP

Page 1: ...ghts reserved This document is Cisco Public Information Page 1 of 41 Cisco Nexus B22HP Design and Deployment Guide September 2011 For further information questions and comments please contact ccbu pricing cisco com Design and Deployment Guide ...

Page 2: ...Configuring a vPC 10 Server Network Teaming 13 Creating Host Side vPC for Server Links with LACP 13 Configuring the HP Blade Server Microsoft Windows 2008 Release 2 14 Fibre Channel over Ethernet 17 Configuring FCoE 17 Configuring the Cisco Nexus 5000 Series and B22HP for FCoE 19 Debug Commands 24 show fex 24 show fex detail 25 show interface brief 26 show interface ethernet 103 1 1 28 show vlan 2...

Page 3: ... B22 provides the following benefits Highly scalable consistent server access This distributed modular system creates a scalable server access environment with no reliance on Spanning Tree Protocol and with consistency between blade and rack servers Simplified operations The availability of one single point of management and policy enforcement using upstream Cisco Nexus 5000 Series Switches eases ...

Page 4: ...e same parent Cisco Nexus 5500 switch platform This approach may be necessary when certain types of traffic must be restricted to either the left or right Cisco Nexus 5500 switch platform for instance to maintain SAN A and SAN B separation Also in this example the connections to individual blade servers are in active standby mode which helps ensure traffic flow consistency but does not fully utili...

Page 5: ...ht Server Mezzanine Card to IOM Bay Card IOM LAN on motherboard LOM IOM bays 1 and 2 Mezzanine card 1 IOM bays 3 and 4 Mezzanine card 2 IOM bay 5 and 6 After the Cisco Nexus B22HP fabric extenders are installed the onboard administrator OA should be updated to at least Version 3 5 to help ensure that all functions and graphics are present No configuration is required from the chassis onboard admin...

Page 6: ...c interfaces These fabric interfaces are equally divided among the 16 server side host ports If fewer fabric ports are allocated then more server ports are assigned to a single fabric link The advantage of this configuration is that the traffic path and the amount of allocated bandwidth are always known for a particular set of servers Since static pinning will group host side ports into individual...

Page 7: ...atic If a fabric interface fails all its associated host interfaces are brought down and will remain down until the fabric interface is restored PortChannel Fabric Interface Connection The PortChannel fabric interface provides an alternative method of connection between the parent switch and the Cisco Nexus B22HP fabric extender In this mode of operation the physical fabric links are bundled into ...

Page 8: ...ystem NX OS Software TAC support http www cisco com tac Copyright c 2002 2011 Cisco Systems Inc All rights reserved The copyrights to certain works contained in this software are owned by other third parties and used and distributed under license Certain components of this software are licensed under the GNU General Public License GPL version 2 0 or the GNU Lesser General Public License LGPL Versi...

Page 9: ...x associate 103 N5548 Bottom config if channel group 3 N5548 Bottom config if interface ethernet 1 2 N5548 Bottom config if switchport mode fex fabric N5548 Bottom config if fex associate 103 N5548 Bottom config if channel group 3 6 Repeat the steps on the second Cisco Nexus 5000 Series Switch connected to the fabric extender in interconnect bay 4 N5548 Top configure terminal N5548 Top config feat...

Page 10: ...orts IEEE 802 3ad PortChannels vPC technology enables networks to be designed with multiple links for redundancy while also allowing those links to connect to different endpoints for added resiliency Figure 3 More information about vPC technology can be found at http www cisco com en US products ps9670 products_implementation_design_guides_list html Figure 3 Blade Server Configuration Options Conf...

Page 11: ... keepalive destination 172 25 182 103 source 172 25 182 104 Note Management VRF will be used as the default VRF 4 Configure the vPC peer link N5548 Bottom interface port channel 20 N5548 Bottom config if interface ethernet 1 9 N5548 Bottom config if channel group 20 N5548 Bottom config if interface ethernet 1 10 N5548 Bottom config if channel group 20 N5548 Bottom config if interface port channel ...

Page 12: ...ig if 5 Check the vPC status N5548 Bottom config if show vpc Legend local vPC is down forwarding via vPC peer link vPC domain id 5 Peer status peer adjacency formed ok vPC keep alive status peer is alive Configuration consistency status success Per vlan consistency status success Type 2 consistency status success vPC role primary Number of vPCs configured 0 Peer Gateway Disabled Dual active exclud...

Page 13: ...e providing active active links to servers thus enabling aggregate 40 Gbps bandwidth with dual links Figure 4 Figure 4 Fabric Link and Server Topologies Creating Host Side vPC for Server Links with LACP 1 Enable LACP on both parent switches 5548 Bottom config feature lacp 2 Create the blade server vPC and add the member interface nexus 5548 Bottom configure terminal Enter configuration commands on...

Page 14: ... rights reserved This document is Cisco Public Information Page 14 of 41 Configuring the HP Blade Server Microsoft Windows 2008 Release 2 1 Open the Control Panel and open HP Network Config Utility 2 Select the network ports and click Team ...

Page 15: ...This document is Cisco Public Information Page 15 of 41 3 After the team is formed click Properties 4 From the Team Type Selection drop down menu choose 802 3ad Dynamic with Fault Tolerance to match the Cisco Nexus vPC configuration with LACP Then click OK ...

Page 16: ...h shows that channel group 201 is in the P Up in port channel state on each switch A check from the HP Network Configuration Utility will show the status Available for each link that is up in the PortChannel 5548 Bottom show port channel summary Flags D Down P Up in port channel members I Individual H Hot standby LACP only s Suspended r Module removed S Switched R Routed U Up port channel Group Po...

Page 17: ...center The Cisco Nexus B22HP is the building block that enables FCoE traffic to travel outside the HP BladeSystem chassis Best practice considerations for unified fabric are listed in the Cisco Nexus 5000 Series NX OS Operations Guide at http www cisco com en US docs switches datacenter nexus5000 sw operations n5k_ops_guide html Configuring FCoE Follow these steps to configure FCoE 1 Enable the FC...

Page 18: ...g pages 1 Enable FCoE on the CNA By default the HP NC551 and NC553 CNAs have their personality set to iSCSI The personality needs to be changed to FCoE to support FCoE traffic You make this change in the BIOS of the system and the BIOS of the mezzanine cards Choose System Options Choose NIC Personality Options From the NIC Personality Options menu choose FCoE ...

Page 19: ...oE with Drivers Loaded Configuring the Cisco Nexus 5000 Series and B22HP for FCoE This example assumes that a server in bay 2 is using IOM 3 and 4 for FCoE connectivity 1 Enable the FCoE feature on the Cisco Nexus 5000 Series Switch N5548 Bottom config terminal Enter configuration commands one per line End with CNTL Z switch config feature fcoe FC license checked out successfully fc_plugin extract...

Page 20: ... default nq policy N5548 Bottom config sys qos N5548 Top config system qos N5548 Top config sys qos service policy type qos input fcoe default in policy N5548 Top config sys qos service policy type queuing input fcoe default in policy N5548 Top config sys qos service policy type queuing output fcoe default out policy N5548 Top config sys qos service policy type network qos fcoe default nq policy N...

Page 21: ...nfig if 4 Create the FCoE VSAN and map it to the VLAN N5548 Bottom config vlan 200 N5548 Bottom config vlan fcoe vsan 200 N5548 Bottom config vlan N5548 Top config vlan 201 N5548 Top config vlan fcoe vsan 201 N5548 Top config vlan 5 Configure the VLANs allowed to transverse the vPC links N5548 Bottom config interface port channel 20 N5548 Bottom config if switchport trunk allowed vlan 1 200 N5548 ...

Page 22: ...terface N5548 Bottom config vsan database N5548 Bottom config vsan db vsan 200 interface fc 1 32 N5548 Bottom config vsan db N5548 Top config vsan database N5548 Top config vsan db vsan 201 interface fc 1 32 N5548 Top config vsan db 9 Create the necessary zone and zone sets with appropriate members N5548 Bottom config zone name zone1 vsan 200 N5548 Bottom config zone member pwwn 50 00 40 20 02 f4 ...

Page 23: ...an 200 N5548 Top config zoneset zoneset activate name zoneset2 vsan 201 The following commands can now be used to check connectivity between the blade server and the Cisco Nexus B22HP N5548 Bottom show flogi database INTERFACE VSAN FCID PORT NAME NODE NAME vfc1032 200 0x550000 10 00 b4 99 ba fb 41 41 20 00 b4 99 ba fb 41 41 Total number of flogi 1 N5548 Bottom N5548 Bottom show fcns database VSAN ...

Page 24: ...o the SAN Figure 6 Server with FCoE Connected to Volumes on a Fibre Channel Array Debug Commands show fex Displays the status of the fabric extenders that are powered on and connected Cisco Nexus B22HP installed but parent switch not configured N5548 Bottom show fex FEX FEX FEX FEX Number Description State Model Serial Discovered N2K B22HP P FOC1515ZZU4 N5548 Bottom ...

Page 25: ...the fabric extender module including the IOM bay number rack name and enclosure information of the HP BladeSystem c Class chassis N5548 Top show fex detail FEX 104 Description FEX0104 state Online FEX version 5 0 3 N2 2 Switch version 5 0 3 N2 2 FEX Interim version 5 0 3 N2 2 Switch Interim version 5 0 3 N2 2 Extender Model N2K B22HP P Extender Serial FOC151425GA Part No 73 13780 05 Bay 4 Rack Unn...

Page 26: ...ter received 06 08 2011 15 33 26 493406 Registration response sent 06 08 2011 15 33 26 736842 Module Online Sequence 06 08 2011 15 33 29 625679 Module Online N5548 Top show interface brief N5548 Top show interface brief Ethernet VLAN Type Mode Status Reason Speed Port Interface Ch Eth1 1 1 eth fabric up none 10G D Eth1 2 1 eth fabric up none 10G D 4 Eth1 3 1 eth fabric up none 10G D Eth1 4 1 eth f...

Page 27: ...0G D Eth1 26 1 eth access down SFP not inserted 10G D Eth1 27 1 eth access down SFP not inserted 10G D Eth1 28 1 eth access down SFP not inserted 10G D Eth1 29 1 eth access down SFP not inserted 10G D Eth1 30 1 eth access down SFP not inserted 10G D Eth1 31 1 eth access down SFP not inserted 10G D Eth1 32 1 eth access down SFP not inserted 10G D Port channel VLAN Type Mode Status Reason Speed Prot...

Page 28: ...ess up none 10G D Eth104 1 10 1 eth access down Incompatible No server auto D Eth104 1 11 1 eth access up none 10G D Eth104 1 12 1 eth access down Incompatible No server auto D Eth104 1 13 1 eth access down Incompatible No server auto D Eth104 1 14 1 eth access down Incompatible No server auto D Eth104 1 15 1 eth access down Incompatible No server auto D Eth104 1 16 1 eth access down fabricIfDown ...

Page 29: ...ackets 0 broadcast packets 0 output packets 0 bytes 0 jumbo packets 0 output errors 0 collision 0 deferred 0 late collision 0 lost carrier 0 no carrier 0 babble 0 Tx pause 0 interface resets show vlan N5548 Bottom config if show vlan VLAN Name Status Ports 1 default active Eth1 3 Eth1 4 Eth1 5 Eth1 6 Eth1 7 Eth1 8 Eth1 9 Eth1 10 Eth1 11 Eth1 12 Eth1 13 Eth1 14 Eth1 15 Eth1 16 Eth1 17 Eth1 18 Eth1 ...

Page 30: ...P FOC151425G7 103 Eth1 20 Active 2 N2K B22HP P FOC151425D9 103 Eth1 21 Active 1 N2K B22HP P FOC151425D9 103 Eth1 22 Active 3 N2K B22HP P FOC151425D9 103 Eth1 23 Active 4 N2K B22HP P FOC151425D9 103 Eth1 24 Active 5 N2K B22HP P FOC151425D9 103 Eth1 25 Active 7 N2K B22HP P FOC151425D9 103 Eth1 26 Active 6 N2K B22HP P FOC151425D9 103 Eth1 27 Active 8 N2K B22HP P FOC151425D9 105 Eth1 29 Active 1 N2K B...

Page 31: ... ip domain lookup hostname N5548 Bottom class map type qos class fcoe class map type queuing class fcoe match qos group 1 class map type queuing class all flood match qos group 2 class map type queuing class ip multicast match qos group 2 class map type network qos class fcoe match qos group 1 class map type network qos class all flood match qos group 2 class map type network qos class ip multicas...

Page 32: ...source 172 25 182 103 vsan database vsan 200 fcdomain fcid database vsan 200 wwn 10 00 78 e3 b5 f6 b3 59 fcid 0x550000 dynamic vsan 1 wwn 50 00 40 20 02 f4 65 2b fcid 0x6b0000 dynamic vsan 200 wwn 50 00 40 20 02 f4 65 2b fcid 0x550001 dynamic interface port channel20 switchport mode trunk vpc peer link spanning tree port type network interface port channel103 switchport mode fex fabric fex associa...

Page 33: ... associate 103 channel group 103 interface Ethernet1 3 interface Ethernet1 4 interface Ethernet1 5 interface Ethernet1 6 interface Ethernet1 7 interface Ethernet1 8 interface Ethernet1 9 switchport mode trunk channel group 20 interface Ethernet1 10 switchport mode trunk channel group 20 interface Ethernet1 11 interface Ethernet1 12 interface Ethernet1 13 interface Ethernet1 14 interface Ethernet1 ...

Page 34: ...Ethernet1 24 interface Ethernet1 25 interface Ethernet1 26 interface Ethernet1 27 interface Ethernet1 28 interface Ethernet1 29 interface Ethernet1 30 interface Ethernet1 31 interface mgmt0 ip address 172 25 182 103 24 interface Ethernet103 1 1 switchport mode trunk switchport trunk native vlan 182 channel group 201 mode active interface Ethernet103 1 2 interface Ethernet103 1 3 interface Ethernet...

Page 35: ... 15 interface Ethernet103 1 16 line console line vty boot kickstart bootflash n5000 uk9 kickstart 5 0 3 N2 2 bin boot system bootflash n5000 uk9 5 0 3 N2 2 bin interface fc1 32 Full Zone Database Section for vsan 200 zone name zone1 vsan 200 member pwwn 50 00 40 20 02 f4 65 2b member pwwn 10 00 78 e3 b5 f6 b3 59 zoneset name zoneset1 vsan 200 member zone1 zoneset activate name zoneset1 vsan 200 N5...

Page 36: ...st match qos group 2 class map type network qos class fcoe match qos group 1 class map type network qos class all flood match qos group 2 class map type network qos class ip multicast match qos group 2 system qos service policy type network qos fcoe default nq policy service policy type qos input fcoe default in policy service policy type queuing input fcoe default in policy service policy type qu...

Page 37: ...0 21 02 f4 65 2b fcid 0xd90001 dynamic interface port channel20 switchport mode trunk vpc peer link spanning tree port type network interface port channel104 switchport mode fex fabric fex associate 104 interface port channel201 switchport mode trunk vpc 201 switchport trunk native vlan 182 interface vfc1 bind interface port channel201 no shutdown vsan database vsan 201 interface vfc1 vsan 201 int...

Page 38: ...rnet1 7 interface Ethernet1 8 interface Ethernet1 9 switchport mode trunk channel group 20 interface Ethernet1 10 switchport mode trunk channel group 20 interface Ethernet1 11 switchport access vlan 182 interface Ethernet1 12 interface Ethernet1 13 interface Ethernet1 14 interface Ethernet1 15 interface Ethernet1 16 interface Ethernet1 17 interface Ethernet1 18 interface Ethernet1 19 interface Eth...

Page 39: ...et1 28 interface Ethernet1 29 interface Ethernet1 30 interface Ethernet1 31 interface mgmt0 ip address 172 25 182 104 24 interface Ethernet104 1 1 switchport mode trunk switchport trunk native vlan 182 channel group 201 mode active interface Ethernet104 1 2 interface Ethernet104 1 3 interface Ethernet104 1 4 interface Ethernet104 1 5 interface Ethernet104 1 6 interface Ethernet104 1 7 interface Et...

Page 40: ...enabled customers to benefits from both top of rack ToR and end of row EoR designs while reducing the costs associated with cabling and cooling in EoR models without introducing any additional management points unlike with traditional ToR designs This unique architecture has been tremendously successful in the first generation of fabric extenders and rack mount servers The Cisco Nexus B22 Blade Fa...

Page 41: ...r2_config_gd_rel_503_N2_1_chapter17 html Cisco Nexus 5000 Series NX OS Layer 2 Switching Configuration Guide Release 5 0 3 N2 1 http www cisco com en US docs switches datacenter nexus5000 sw layer2 503_n2_1 503_n2_1nw b_Cisco_n5k _layer2_config_gd_rel_503_N2_1 html Cisco Nexus 5000 Series Switches Configuration Guides http www cisco com en US products ps9670 products_installation_and_configuration...

Search results

Summary of Contents for Nexus B22HP

Reviews:

Related manuals for Nexus B22HP

Brands by name

Popular brands

Cisco Nexus B22HP, Design And Deployment Manual

Search results

Summary of Contents for Nexus B22HP

Reviews:

Related manuals for Nexus B22HP

Brands by name

Popular brands