background image

Deploying FCoE (FIP Snooping) on Dell Force 10 MXL 

89 

 

Appendix B - Network switch versions 

Version information for the network switches used in creating this document are as follows:  

 

Switch Firmware Versions 

Table 1.

Network switch 

Dell Force10 MXL 

Cisco 5020 

Software version 

E8-1-3-123 

5.1(3)N1(1) 

 

References 

Cisco Systems, Inc. (2011). 

Cisco Nexus 5000 Series NX-OS SAN Switching Configuration Guide, Release 

5.1(3)N1(1).

 San Jose: Cisco Systems, Inc. 

http://www.cisco.com/en/US/docs/switches/datacenter/nexus5000/sw/san_switching/513_n1

_1/b_Cisco_n5k_nxos_sanswitching_config_guide_rel513_n1_1.html 

Cisco Systems, Inc. (2009, 07). 

Virtual PortChannel Quick Configuration Guide.

 Retrieved Jun 18, 2012, 

from Cisco.com: 

http://www.cisco.com/en/US/prod/collateral/switches/ps9441/ps9670/configuration_guide_c
07-543563.html

 

Cisco Systems, Inc. (2010, 01). 

Cisco 4000 Series Design Guide.

 Retrieved 06 19, 2012, from Cisco.com: 

http://www.cisco.com/en/US/prod/collateral/switches/ps9441/ps10596/deployment_guide_c
07-574724.html

 

Cisco. (2009, 07). 

Virtual PortChannel Quick Configuration Guide.

 Retrieved Jun 18, 2012, from 

Cisco.com: 

http://www.cisco.com/en/US/prod/collateral/switches/ps9441/ps9670/configuration_guide_c
07-543563.html

 

Fibre Channel over Ethernet Initialization Protocol, Cisco, 

http://www.cisco.com/en/US/prod/collateral/switches/ps9441/ps9670/white_paper_c11-
560403.html 

IEEE. (2008, November 24). 802.1Qaz/D0.2. Draft Standard for Local and Metropolitan Area Networks – 

Virtual. 

IEEE. (2009, Feb 9). 802.1Qbb/D1.0. Draft Standard for Local and Metropolitan Area Networks – Virtual. 

IEEE. (2011, Sep 15). 

802.1Qaz - Enhanced Transmission Selection

. Retrieved May 30, 2012, from 

IEEE802.org:

 

http://www.ieee802.org/1/pages/802.1az.html

 

T11/08-264v0 FCoE: Increasing FCoE Robustness using FIP-Snooping and FPMA, T11, 

http://www.t11.org/ftp/t11/pub/fc/bb-5/08-264v0.pdf 

T11/09-291v0 FIP VLAN discovery updates, T11,

 

http://www.t11.org/ftp/t11/pub/fc/bb-5/09-291v1.pdf

 

Содержание Force10 MXL 10 GbE

Страница 1: ...Kevin Locklear Manjesh Siddamurthy Network Enabled Solutions Deploying FCoE FIP Snooping on Dell Force 10 MXL A Dell Deployment Guide ...

Страница 2: ...served Dell and its affiliates cannot be responsible for errors or omissions in typography or photography Dell the Dell logo and PowerEdge are trademarks of Dell Inc Intel is a registered trademark of Intel Corporation in the U S and other countries Other trademarks and trade names may be used in this document to refer to either the entities claiming the marks and names or their products Dell disc...

Страница 3: ...nfiguring the Dell Force10 MXL for FIP Snooping 41 Scenario 3 Configuring multiple uplinks LAG PortChannel for Cisco Nexus 5000 series switch NPV mode environment 46 Configuring the Cisco Nexus 5000 series switch with firmware ver 5 x in NPV mode for a multiple link LAG link aggregation connection from the Dell Force10 MXL 47 Configuring the Dell Force10 MXL for FIP snooping with Cisco Nexus 5000 ...

Страница 4: ...Snooping on Dell Force 10 MXL 4 PFC 68 ETS 69 IOM 69 NPIV 69 NPV 69 VSAN 69 Appendix B Full CLI examples 70 Force10 MXL CLI example 70 Cisco Nexus 5548UP CLI example 81 Appendix B Network switch versions 89 References 89 ...

Страница 5: ...ontroller Server Overview Properties WWN MAC information for Blade Server 3 s B fabric CNA port 2 B2 22 Figure 15 show interface brief command 23 Figure 16 show spanning tree summary command 24 Figure 17 show flogi database command 24 Figure 18 Example of show zoneset active command 25 Figure 19 show interfaces status results 25 Figure 20 show fip snooping config 26 Figure 21 show fip snooping fcf...

Страница 6: ...isco Nexus 5000 Series switch primary switch without FCoE configuration can be copied and pasted 53 Figure 46 CLI configuration example vPC on Cisco Nexus 5000 Series switch secondary switch without FCoE configuration can be copied and pasted 54 Figure 47 Flowchart of MXL configuration to connection into dual Nexus vPC configuration 56 Figure 48 CLI configuration example configuring Dell Force10 M...

Страница 7: ...will pass FCoE traffic for storage availability This document provides an easy to use guide for configuring FIP Snooping on the Dell Force10 MXL Dell Force10 MXL Figure 1 Dell Force10 MXL Blade Switch 10 40GbE and available modules Figure 1 IO Bay 2 IO Bay 1 Fixed QSFP Ports FlexIO Modules that can be used as part of the Dell Force10 MXL switch Figure 2 FlexIO 10GbE SFP FlexIO 40GbE QSFP FlexIO 10...

Страница 8: ...Port Mapping QSFP 2 X 40Gb QSFP 8 X 10 SFP SFP 4 X 10Gb 10G BaseT 4 X 10Gb breakout cable IO Bay Two 56 55 54 53 53 52 52 52 51 51 51 50 50 50 49 49 49 49 IO Bay One 48 47 46 45 45 44 44 44 43 43 43 42 42 42 41 41 41 41 Fixed QSFP Ports 40 39 38 37 37 36 35 34 33 33 32 1G 10G Internal Ports 32 32 32 32 31 31 31 31 2 2 2 2 1 1 1 1 ...

Страница 9: ...sessions for all applicable devices Session Not Present See Validation and Troubleshooting Plan and purchase equipment Server CNA Configuration The suggested configurations used to deploy this solution are presented in a sequential order for reading but as the above figure represents this is more of a simultaneous process There are dependencies that will be occurring during the configuration that ...

Страница 10: ... stacking should be disabled Please refer to the Dell Force10 MXL user s guide or the Dell Force10 MXL Stacking guide for further details on disabling or changing stacking ports If the configuration is used in this manner proper congestion behavior lossless Ethernet and reliability cannot be guaranteed CNA s Used for this deployment document Qlogic QMD8262 Qlogic QME8242 Broadcom 57810s Intel x520...

Страница 11: ...5 6 7 8 N55 M8P8FP Cisco Nexus 5000 Series Dell Compellent FC SAN solution Dell Force10 MXL Dell PowerEdge M1000e Blade Server Chassis B2 C2 A2 B1 C1 A1 4 1 7 5 2 8 6 3 9 CMC2 CMC1 KVM 1 2 3 4 5 6 Gb Gb 2 1 CMC iKVM Gb Gb 2 1 CMC CONSOLE MODE WS CBS3130G S 24 23 22 21 20X 19X 18X 17X STK 2 1 M M B R M S T R S T C K S Y S T CONSOLE MODE WS CBS3130G S 24 23 22 21 20X 19X 18X 17X STK 2 1 M M B R M S ...

Страница 12: ...itial Requirements Nexus 5000 Series switch firmware 5 0 or greater Drivers must be installed on all server operating systems including any applicable storage driver Plan for configurations of network and storage Plan native and FCoE Vlan s Plan for either FCF switch zoning or NPV SAN FC switch zoning Plan VSAN s to be used on Cisco FCF Gather FCoE FIP MAC address and FCoE WWN information for all ...

Страница 13: ...ations Check for FLOGI s from CNA s and storage device Missing FLOGI entries Verify configured VSAN database entry contains both VFC and FC connections Cisco Nexus Verify VFC is enabled no shutdown command on Cisco Nexu Re verify that FCoE VLAN matches on both MXL and Cisco Nexus Missing Basic Ethernet Connectivity Check basic ethernet connectivity on the applicable VLAN In many of the business en...

Страница 14: ...igure downlink server facing ports feature fip snooping fip snooping enable protocol lldp Service class dynamic dot1p interface TenGigabitEthernet 0 1 portmode hybrid switchport protocol lldp dcbx port role auto downstream spanning tree pvst edge port no shutdown Configure uplink FCF switch facing ports interface TenGigabitEthernet 0 52 portmode hybrid switchport fip snooping port mode fcf protoco...

Страница 15: ...orts using FCoE See above configuration for reference feature fip snooping protocol lldp exit service class dynamic dot1p default vlan id 20 interface TenGigabitEthernet 0 1 portmode hybrid switchport protocol lldp dcbx port role auto downstream exit spanning tree pvst edge port no shutdown exit interface TenGigabitEthernet 0 52 portmode hybrid switchport fip snooping port mode fcf protocol lldp n...

Страница 16: ...tion mode o interface TenGigabitEthernet 0 52 portmode hybrid configuring portmode hybrid will allow for the native VLAN untagged and a tagged VLAN to exist on the port together This is similar to switchport mode trunk in industry standard CLI switchport this configures the port as a layer 2 port fip snooping port mode fcf enables the port for fip snooping from an FCF connection protocol lldp this...

Страница 17: ...VLAN 1000 exit exits interface configuration mode NOTE Critical steps The copy running configuration startup configuration command should be issued after important steps so that the switch will retain the configuration settings when the switch is next rebooted or if a power loss occurs It is also a good practice to copy a well validated working configuration to a separate location such as the mana...

Страница 18: ...o shutdown Configure VSAN database matching VFC and FC interfaces vsan database vsan 2 interface vfc1 vsan 2 interface fc2 15 Configure individual ports from MXL interface ethernet 1 1 switchport mode trunk switchport trunk native vlan 20 switchport trunk allowed vlan 20 1000 no shut Configure zones and zonesets zone name blade1 vsan 2 member interface fc2 15 member pwwn xx xx xx xx xx xx xx xx zo...

Страница 19: ...Series NX OS SAN Switching Configuration Guide The CLI entries above only cover the areas that must be added to enable FCoE capabilities on the ports being used of a Cisco Nexus 5020 and Nexus 5548 This topic will be covered after the Step by Step explanation of the CLI example feature fcoe feature npiv system default switchport trunk mode auto vlan 20 vlan 1000 fcoe vsan 2 vsan database vsan 2 vs...

Страница 20: ...1 this binds interface Ethernet 1 1 to the virtual fc interface which in this case is vfc1 This is one form of binding the VFC The other form would be to bind the VFC to the FCoE FIP MAC address of the CNA being used Examples of this will be included later in the document no shutdown turns the virtual interface on since default is shutdown o interface fc2 15 selects the fc2 15 interface no shutdow...

Страница 21: ...e used with the Dell PowerEdge Blade Servers With the card installed it will necessary to insure that the ISCSI portion of the driver is not installed From the factory the ISCSI stack will not be installed so it would simply be a matter of adding in the FCoE portion of the driver for storage use If the ISCSI stack is installed the Intel CNA may possibly have FCoE deployment problems If it is insta...

Страница 22: ...mand line dcbx version CEE will configure the port to only use the CEE version of DCBX and not negotiate other values This setting is currently necessary for the Intel x520 CNA for use with FCoE and applicable storage M1000e Chassis Management Controller Server Overview Properties WWN MAC Figure 14 information for Blade Server 3 s B fabric CNA port 2 B2 ...

Страница 23: ...command Figure 15 Nexus5548 top show interface brief Interface Vsan Admin Admin Status SFP Oper Oper Port Mode Trunk Mode Speed Channel Mode Gbps fc2 15 2 auto auto up swl F 4 fc2 16 2 auto auto up swl F 4 Ethernet VLAN Type Mode Status Reason Speed Port Interface Ch Eth1 1 20 eth trunk up none 10G D 2 Eth1 2 20 eth trunk up none 10G D 2 Eth1 3 1 eth access up none 10G D Eth1 4 1 eth access down S...

Страница 24: ...tch The VFC should show the expected port and node WWN of the CNA being used in the server The following command will show the status of the zones that have been put into place Type show zoneset active This command will show the current activated zoneset and all the participating zones with their individual members Nexus5548 top show spanning tree summary Switch is in rapid pvst mode Root bridge f...

Страница 25: ...k general status of the ports and links by using show interfaces status show interfaces status results Figure 19 On the Force10 MXL the fip snooping configuration can be checked by using show fip snooping config This will show that the FIP snooping feature is enabled and global configuration is set It will also display the current default or configured FC MAP Nexus5548 top show zoneset active zone...

Страница 26: ...e 22 Using the Force10 MXL the fip snooping sessions can be validated using show fip snooping sessions This command will display the following items that are in an FCoE session Enode MAC address Enode interface FCF s MAC address FCF s connecting interface FCoE VLAN being used FCoE MAC addrss FC ID Port WWPN and Port WWNN being used for the session MXL B1 Rack3015 show fip snooping config FIP Snoop...

Страница 27: ... Port WWPN Port WWNN 5c f9 12 34 56 78 Te 0 3 54 7f ee 56 55 49 Te 0 52 1000 0e fc 00 55 00 04 55 00 04 20 01 5c f9 dd 16 ef 26 20 00 5c f9 dd 16 ef 26 MXL B1 Rack3015 show fip snooping statistics Vlan 20 Number of Vlan Requests 23 Number of Vlan Notifications 17 Number of Multicast Discovery Solicits 0 Number of Unicast Discovery Solicits 0 Number of FLOGI 0 Number of FDISC 0 Number of FLOGO 0 Nu...

Страница 28: ...mber of Unicast Discovery Advertisement 19 Number of FLOGI Accepts 9 Number of FLOGI Rejects 0 Number of FDISC Accepts 0 Number of FDISC Rejects 0 Number of FLOGO Accepts 0 Number of FLOGO Rejects 0 Number of CVL 3 Number of FCF Discovery Timeouts 0 Number of VN Port Session Timeouts 0 Number of Session failures due to Hardware Config 0 TenGigabitEthernet 0 3 Number of Vlan Requests 5 Number of Vl...

Страница 29: ... Recommendation TLV disabled P PFC Configuration TLV enabled p PFC Configuration TLV disabled F Application priority for FCOE enabled f Application Priority for FCOE disabled I Application priority for iSCSI enabled i Application Priority for iSCSI disabled Interface TenGigabitEthernet 0 3 Port Role is Auto Downstream DCBX Operational Status is Enabled with ETS Mismatch Is Configuration Source FAL...

Страница 30: ... the uplink into the top of rack FCF switch Some key items in these results will be Priority list is 3 Remote Willing status is this should be willing enabled for the Host CNA and willing is disabled for FCF Nexus switch Other important items to not is PFC DCBX Oper status FCOE TLV TX Status is enabled Local DCBX Status DCBX Operational Version is 0 DCBX Max Version Supported is 0 Sequence Number ...

Страница 31: ...s disabled Local FCOE PriorityMap is 0x8 Local ISCSI PriorityMap is 0x0 Remote FCOE PriorityMap is 0x8 Remote ISCSI PriorityMap is 0x10 11 Input TLV pkts 28 Output TLV pkts 5 Error pkts 1202 Pause Tx pkts 0 Pause Rx pkts Interface TenGigabitEthernet 0 52 Admin mode is on Admin is enabled Remote is enabled Priority list is 3 Remote Willing Status is disabled Local is enabled Priority list is 3 Oper...

Страница 32: ...tEthernet 0 52 is the uplink into the top of rack FCF switch Some key items in these results will be TC grp Priority Bandwidth and TSA Note that only these two interfaces are seen typically this command will list them all show interfaces ets detail Figure 29 MXL B1 Rack3015 show interfaces ets detail Interface TenGigabitEthernet 0 3 Max Supported TC Groups is 4 Number of Traffic Classes is 8 Admin...

Страница 33: ...0 ETS 2 3 4 5 6 7 Oper status is internally propagated ETS DCBX Oper status is Up State Machine Type is Feature Conf TLV Tx Status is enabled 1 Input Conf TLV Pkts 1 Output Conf TLV Pkts 1 Error Conf TLV Pkts Interface TenGigabitEthernet 0 52 Max Supported TC Groups is 4 Number of Traffic Classes is 8 Admin mode is on Admin Parameters Admin is enabled TC grp Priority Bandwidth TSA 0 0 1 2 3 4 5 6 ...

Страница 34: ... use for storage Remote Parameters Remote is enabled TC grp Priority Bandwidth TSA 0 0 1 2 4 5 6 7 50 ETS 1 3 50 ETS 2 3 4 5 6 7 15 Remote Willing Status is disabled Local Parameters Local is enabled TC grp Priority Bandwidth TSA 0 0 1 2 3 4 5 6 7 100 ETS 1 2 3 4 5 6 7 15 Oper status is init ETS DCBX Oper status is Up with Mismatch State Machine Type is Feature Conf TLV Tx Status is enabled 23 Inp...

Страница 35: ... native for the FCoE ports The initial FIP negotiations will occur on this VLAN See MXL CLI section or Cisco Nexus 5000 series CLI section for detail on this ENode s or FCF entries are not present on the Force10 MXL switch See above basic connectivity problems see above Applicable FCoE or storage driver is not configured in the server OS for the CNA This could be an indication that the storage sid...

Страница 36: ...LI section for explanation of applying this configuration CNA s that have NPAR capabilities may not have the partitions configured appropriately for FCoE See CNA documentation for applicable partition settings for FCoE use FLOGI entries for CNA s are not present on Cisco Nexus 5000 series switch See above basic connectivity problems see above Verify above section on ENode s or FCF present on MXL s...

Страница 37: ...2 1 M M B R M S T R S T C K S Y S T 1 2 3 4 CONSOLE PowerConnect M8024 k 17 18 19 20 1 2 3 4 CONSOLE PowerConnect M8024 k 17 18 19 20 1 2 3 4 CONSOLE PowerConnect M8024 k 17 18 19 20 1 2 3 4 CONSOLE PowerConnect M8024 k 17 18 19 20 1 2 3 4 CONSOLE PowerConnect M8024 k 17 18 19 20 1 2 3 4 CONSOLE PowerConnect M8024 k 17 18 19 20 1 2 3 4 CONSOLE PowerConnect M8024 k 17 18 19 20 B2 C2 A2 B1 C1 A1 4 1...

Страница 38: ...e matching VFC and FC interfaces vsan database vsan 2 interface vfc1 vsan 2 interface fc2 15 vsan 2 interface fc2 16 Configure individual ports for FCoE LAG PortChannel from MXL interface ethernet 1 5 6 switchport mode trunk switchport trunk native vlan 20 switchport trunk allowed vlan 20 1000 channel group 20 mode active no shut interface port channel20 switchport mode trunk switchport trunk nati...

Страница 39: ...0 interface vfc1 bind interface port channel1 no shutdown interface Ethernet1 1 switchport mode trunk switchport trunk native vlan 20 switchport trunk allowed vlan 1000 channel group 1 mode active interface Ethernet1 2 switchport mode trunk switchport trunk native vlan 20 switchport trunk allowed vlan 1000 channel group 1 mode active zone name blade1 vsan 2 member interface fc2 15 member pwwn xx x...

Страница 40: ...ative VLAN 20 to the trunk switchport trunk allowed vlan 1000 add allowed VLAN 1000 to the trunk channel group 1 mode active this interface is part of port channel 1 o zone name blade1 vsan 2 this will set the name for your zone blade1 can be any chosen name vsan 2 will match the vsan you have created member interface fc2 15 this adds the fc2 15 interface as a member of the zone member pwwn xx xx ...

Страница 41: ...server facing ports feature fip snooping fip snooping enable protocol lldp Service class dynamic dot1p interface TenGigabitEthernet 0 1 portmode hybrid switchport protocol lldp dcbx port role auto downstream spanning tree pvst edge port no shutdown Configure port channel interface Port channel 5 no ip address mtu 2500 portmode hybrid switchport fip snooping port mode fcf no shutdown Configure defa...

Страница 42: ...ace TenGigabitEthernet 0 2 no ip address mtu 2500 portmode hybrid switchport protocol lldp dcbx port role auto downstream spanning tree pvst edge port no shutdown exit interface TenGigabitEthernet 0 51 no ip address mtu 2500 port channel protocol LACP port channel 5 mode active protocol lldp no advertise dcbx tlv ets reco dcbx port role auto upstream no shutdown exit interface TenGigabitEthernet 0...

Страница 43: ... ports to be added to the port channel have current settings configured including portmode hybrid and switchport these settings will need to be removed If they are not removed the configuration settings will not be successful interface Port channel 5 no ip address mtu 2500 portmode hybrid switchport fip snooping port mode fcf no shutdown interface Vlan 20 mtu 2500 untagged TenGigabitEthernet 0 1 3...

Страница 44: ...he lldp protocol settings dcbx port role auto downstream with this command the port role is established as a dcbx capable dowsnstream port to communicate with blade server CNA ports spanning tree pvst edge port configure port as an edge port for spanning tree behavior no shutdown configures the port as active exit exits interface configuration mode o interface TenGigabitEthernet 0 51 port channel ...

Страница 45: ...rface configuration mode o interface Vlan 1000 Initializes VLAN 1000 for use This VLAN will be the FCoE VLAN that will pass the storage traffic after the intial FIP negotiations occur on the native or default VLAN tagged TenGigabitEthernet 0 1 3 This adds these ports to the tagged VLAN 1000 tagged Port channel 5 fip snooping enable Enables FIP snooping for this VLAN which will set all ports involv...

Страница 46: ... PowerConnect M8024 k 17 18 19 20 1 2 3 4 CONSOLE PowerConnect M8024 k 17 18 19 20 1 2 3 4 CONSOLE PowerConnect M8024 k 17 18 19 20 1 2 3 4 CONSOLE PowerConnect M8024 k 17 18 19 20 3 CISCO NEXUS N5548P 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 STAT ID 1 10 GIGABIT ETHERNET 1 2 4 8G FIBRE CHANNEL 1 2 3 4 5 6 7 8 1 2 3 4 5 6 7 8 N55 M8P8FP B2 C2 A2 B1 C1 ...

Страница 47: ...ce Method Multiple port link Cisco 5548 configuration can be copied and pasted Figure 40 feature npv feature npiv vlan 20 vlan 1000 fcoe vsan 2 vsan database vsan 2 vsan 2 interface vfc1 vsan 2 interface vfc2 vsan 2 interface fc2 15 vsan 2 interface fc2 16 interface port channel1 switchport mode trunk switchport trunk native vlan 20 switchport trunk allowed vlan 1000 interface vfc1 bind mac addres...

Страница 48: ...hange in behavior some of the typical commands used when looking at the device logins will also change and may not have the same capability However the FC switch that the Cisco Nexus ToR switch is connected to in this case a Brocade FC8 switch will have a view from the FC perspective of the CNA s connected at the other end in the blade servers with a proper configuration in place The zoning and FC...

Страница 49: ...ONSOLE MODE WS CBS3130G S 24 23 22 21 20X 19X 18X 17X STK 2 1 M M B R M S T R S T C K S Y S T 1 2 3 4 CONSOLE PowerConnect M8024 k 17 18 19 20 1 2 3 4 CONSOLE PowerConnect M8024 k 17 18 19 20 1 2 3 4 CONSOLE PowerConnect M8024 k 17 18 19 20 1 2 3 4 CONSOLE PowerConnect M8024 k 17 18 19 20 1 2 3 4 CONSOLE PowerConnect M8024 k 17 18 19 20 1 2 3 4 CONSOLE PowerConnect M8024 k 17 18 19 20 1 2 3 4 CONS...

Страница 50: ...6 27 28 29 30 31 32 1 10 GIGABIT ETHERNET 1 2 4 8G FIBRE CHANNEL 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 N55 M16UP Management LAN LAG PortChannel LAG PortChannel vPC Peer Link Nex5K 1 Nex5K 2 MXL 1 MXL 2 In the above figure it can be observed that MXL 1 and MXL 2 each have a 4 port LAG PortChannel uplinking into the two Cisco Nexus switches This number of links is not set in stone and can be change...

Страница 51: ...t 1 1 2 channel group 1 interface ethernet 1 17 18 channel group 2 interface po4096 vpc 100 Connect to second Cisco Nexus 5000 Series Switch and perform same steps with on destination and role priority changes feature vpc feature lacp vpc domain 1 role priority 2000 peer keepalive destination 172 25 188 60 interface po4096 vpc peer link switchport mode trunk switchport trunk allowed vlan 1 100 int...

Страница 52: ... FCoE links it will be a good practive to insure that the FCoE VLAN s are not passed across the peer link In some instances the PortChannel for the peer link will be configured for all VLAN s It will be necessary in this situation to reconfigure to not include the FCoE VLAN s as mentioned Role priority this is an optional step but recommended as it will establish primary and secondary switch roles...

Страница 53: ...tChannels and configuration settings The role priority is explained further in the detailed steps feature vpc feature lacp vpc domain 1 role priority 1000 peer keepalive destination 172 25 188 61 interface po4096 vpc peer link switchport mode trunk interface po1 switchport mode trunk vpc 1 interface po2 switchport mode trunk vpc 2 interface ethernet 1 1 2 channel group 1 interface ethernet 1 17 18...

Страница 54: ... will be the address for the primary switch The rest of the settings should exactly match the primary switch so that they are sharing the same PortChannels and vPC s across the two switches feature vpc feature lacp vpc domain 1 role priority 2000 peer keepalive destination 172 25 188 60 interface po4096 vpc peer link switchport mode trunk interface po1 switchport mode trunk vpc 1 interface po2 swi...

Страница 55: ...PortChannel 4096 configuration vpc peer link sets this PortChannel to be the vpc peer link between the 2 Nexus Switches switchport mode trunk established switchport mode trunk for all VLANs o interface po1 moves into the PortChannel 1 configuration switchport mode trunk established switchport mode trunk for all VLANs vpc 1 sets this PortChannel to be a member of vpc 1 o interface po2 moves into th...

Страница 56: ...Nexus switch facing ports interface Port channel 5 no ip address portmode hybrid switchport no shutdown Configure default VLAN for switch Key Items Both MXL switches MXL 1 and MXL 2 from our example will the basic settings configured for Ethernet traffic on the downlink server facing ports The 4 uplinks te 0 49 52 to the Cisco Nexus switches will all be configured for the same PortChannel even tho...

Страница 57: ...tmode hybrid and switchport settings are not configured on the individual uplink ports but only on the PortChannel If these configurations are done on the individual ports they will have to be removed for later configuration configure default vlan id 20 interface TenGigabitEthernet 0 1 no shutdown exit interface Port channel 5 portmode hybrid switchport no shutdown interface TenGigabitEthernet 0 4...

Страница 58: ...e active no shutdown configures the port as active exit exit from interface configuration mode o interface TenGigabitEthernet 0 51 port channel protocol LACP configures the port for LACP port channel port channel 5 mode active sets the port channel to 5 and sets mode to be active no shutdown configures the port as active exit exit from interface configuration mode o interface TenGigabitEthernet 0 ...

Страница 59: ...role priority was not manually configured or it will show if there is an error in which switch is acting as primary Number of vPC configured this will the number of vPC links configured vPC Peer link status this will status of the peer link including the active VLAN s crossing that peer link vPC status this is an overview of some of the previous information showing the ID port status consistency r...

Страница 60: ...CHANNEL 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 N55 M16UP 3 CISCO NEXUS N5548UP STAT ID 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 1 10 GIGABIT ETHERNET 1 2 4 8G FIBRE CHANNEL 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 N55 M16UP Management LAN LAG PortChannel LAG PortChannel vPC Peer Link Nex5K 1 Nex5K 2 MXL 1 MXL 2 FCoE SAN A VSAN 2 FCoE VLAN 1000 FCoE SAN B...

Страница 61: ...om MXL interface ethernet 1 5 6 switchport mode trunk switchport trunk native vlan 20 switchport trunk allowed vlan 20 1000 channel group 20 mode active no shut interface port channel20 switchport mode trunk switchport trunk native vlan 20 switchport trunk allowed vlan 20 1000 no shutdown Create additional LAG PortChannel for FCoE connection from MXL Configure zones and zonesets zone name blade1 v...

Страница 62: ... trunk native vlan 20 switchport trunk allowed vlan 1000 interface vfc1 bind interface port channel20 no shutdown interface fc2 15 no shutdown interface fc2 16 no shutdown interface Ethernet1 5 switchport mode trunk switchport trunk native vlan 20 switchport trunk allowed vlan 1000 channel group 20 mode active no shut interface Ethernet1 6 switchport mode trunk switchport trunk native vlan 20 swit...

Страница 63: ...the VFC to the FCoE FIP MAC address of the CNA being used Examples of this will be included later in the document no shutdown turns the virtual interface on since default is shutdown o interface fc2 15 selects the fc2 15 interface which will typically be the first fibre channel port on the Nexus 5020 no shutdown turns the fc2 15 interface on since default is shutdown o interface Ethernet 1 1 selec...

Страница 64: ...hybrid switchport protocol lldp dcbx port role auto downstream spanning tree pvst edge port no shutdown Configure uplink FCF switch facing ports interface range TenGigabitEthernet 0 43 0 44 port channel protocol LACP port channel 10 mode active protocol lldp no advertise dcbx tlv ets reco dcbx port role auto upstream no shutdown default vlan id 20 Configure VLAN interfaces for switch and assign po...

Страница 65: ...vst edge port no shutdown exit interface TenGigabitEthernet 0 43 port channel protocol LACP port channel 10 mode active protocol lldp no advertise dcbx tlv ets reco dcbx port role auto upstream exit no shutdown exit interface TenGigabitEthernet 0 44 port channel protocol LACP port channel 10 mode active protocol lldp no advertise dcbx tlv ets reco dcbx port role auto upstream exit no shutdown exit...

Страница 66: ...ACP configures the port for LACP port channel port channel 10 mode active sets the port channel to 5 and sets mode to be active protocol lldp this moves into the lldp protocol settings o no advertise dcbx tlv ets reco this settings establishes that the ETS recommended configuration TLV s should not be advertised for manual type settings Instead they should be determined via negotiations o dcbx por...

Страница 67: ...gotiations occur on the native or default VLAN tagged TenGigabitEthernet 0 1 52 This adds these ports to the tagged VLAN 1000 fip snooping enable Enables FIP snooping for this VLAN which will set all ports involved to have MTU or Jumbo Frames mini of size 2500 no shutdown activates VLAN 1000 exit exits interface configuration mode Validation This complex configuration is validated in two different...

Страница 68: ... secures the end to end path between the ENode device and the FCF The ENode will only be able to talk with the FCF in which it has logged into FIP Snooping bridge FSB With a switch configured to performing FIP Snooping the industry term for this switch is FSB or FIP Snooping bridge It is performing FIP Snooping as described in the previous term FCF FCoE forwarders FCFs act as an Ethernet and FC sw...

Страница 69: ...witch is as an IOM for the M1000e blade server chassis NPIV N port identifier virtualization which enables multiple N port fabric logins at the same time on the same physical FC link Cisco Systems Inc 2011 This term is in reference to the Cisco Nexus 5000 series switches implementation of NPIV NPIV must be enabled to share multiple logins across a single port link or a port channel multiple line l...

Страница 70: ...username admin password 7 fea175715f6aa1df privilege 15 default vlan id 10 stack unit 0 provision MXL 10 40GbE stack unit 0 port 41 portmode quad stack unit 0 port 45 portmode quad interface TenGigabitEthernet 0 1 no ip address mtu 2500 portmode hybrid switchport protocol lldp dcbx port role auto downstream no shutdown interface TenGigabitEthernet 0 2 no ip address mtu 2500 portmode hybrid switchp...

Страница 71: ... 10 no ip address shutdown interface TenGigabitEthernet 0 11 no ip address shutdown interface TenGigabitEthernet 0 12 no ip address shutdown interface TenGigabitEthernet 0 13 no ip address shutdown interface TenGigabitEthernet 0 14 no ip address shutdown interface TenGigabitEthernet 0 15 no ip address shutdown interface TenGigabitEthernet 0 16 no ip address shutdown interface TenGigabitEthernet 0 ...

Страница 72: ...o ip address shutdown interface TenGigabitEthernet 0 25 no ip address shutdown interface TenGigabitEthernet 0 26 no ip address shutdown interface TenGigabitEthernet 0 27 no ip address shutdown interface TenGigabitEthernet 0 28 no ip address shutdown interface TenGigabitEthernet 0 29 no ip address shutdown interface TenGigabitEthernet 0 30 no ip address shutdown interface TenGigabitEthernet 0 31 no...

Страница 73: ...wn interface TenGigabitEthernet 0 45 no ip address no shutdown interface TenGigabitEthernet 0 46 no ip address no shutdown interface TenGigabitEthernet 0 47 no ip address no shutdown interface TenGigabitEthernet 0 48 no ip address no shutdown interface TenGigabitEthernet 0 49 no ip address shutdown interface TenGigabitEthernet 0 50 no ip address shutdown interface TenGigabitEthernet 0 51 no ip add...

Страница 74: ...ernet 0 56 no ip address shutdown interface ManagementEthernet 0 0 ip address 172 25 188 143 16 no shutdown interface Vlan 10 mtu 2500 untagged TenGigabitEthernet 0 7 15 52 interface Vlan 1000 no ip address mtu 2500 tagged TenGigabitEthernet 0 7 15 52 fip snooping enable no shutdown service class dynamic dot1p ip ssh server enable ip ssh server version 2 feature fip snooping protocol lldp line con...

Страница 75: ...tname MXL_B1 enable password 7 b125455cf679b2089a964cf3e8637550fe9d00118c7d1ad8 username root password 7 d7acc8a1dcd4f698 privilege 15 username admin password 7 fea175715f6aa1df privilege 15 stack unit 0 provision MXL 10 40GbE interface TenGigabitEthernet 0 1 no ip address portmode hybrid switchport shutdown interface TenGigabitEthernet 0 2 no ip address portmode hybrid switchport shutdown interfa...

Страница 76: ...nGigabitEthernet 0 9 no ip address portmode hybrid switchport shutdown interface TenGigabitEthernet 0 10 no ip address portmode hybrid switchport shutdown interface TenGigabitEthernet 0 11 no ip address portmode hybrid switchport shutdown interface TenGigabitEthernet 0 12 no ip address portmode hybrid switchport shutdown interface TenGigabitEthernet 0 13 no ip address portmode hybrid switchport sh...

Страница 77: ...ode hybrid switchport shutdown interface TenGigabitEthernet 0 19 no ip address portmode hybrid switchport shutdown interface TenGigabitEthernet 0 20 no ip address portmode hybrid switchport shutdown interface TenGigabitEthernet 0 21 no ip address portmode hybrid switchport shutdown interface TenGigabitEthernet 0 22 no ip address portmode hybrid switchport shutdown interface TenGigabitEthernet 0 23...

Страница 78: ...erface TenGigabitEthernet 0 28 no ip address portmode hybrid switchport shutdown interface TenGigabitEthernet 0 29 no ip address portmode hybrid switchport shutdown interface TenGigabitEthernet 0 30 no ip address portmode hybrid switchport shutdown interface TenGigabitEthernet 0 31 no ip address portmode hybrid switchport shutdown interface TenGigabitEthernet 0 32 no ip address portmode hybrid Mor...

Страница 79: ...nGigabitEthernet 0 46 no ip address shutdown interface TenGigabitEthernet 0 47 no ip address shutdown interface TenGigabitEthernet 0 48 no ip address shutdown interface TenGigabitEthernet 0 49 no ip address port channel protocol LACP port channel 12 mode active no shutdown interface TenGigabitEthernet 0 50 no ip address port channel protocol LACP port channel 12 mode active no shutdown interface T...

Страница 80: ...rface ManagementEthernet 0 0 ip address 172 25 188 41 16 no shutdown interface Port channel 1 description to_Nexus5k_vPC no ip address portmode hybrid switchport no shutdown interface Port channel 12 no ip address portmode hybrid switchport no shutdown interface Vlan 1 ip address dhcp untagged TenGigabitEthernet 0 1 32 untagged Port channel 1 12 no shutdown interface Vlan 11 no ip address tagged P...

Страница 81: ... 0bcPjaAd t3MSaSb34 4QiOx il5VM0 role network admin ip domain lookup hostname Technet5548 1 class map type qos class fcoe class map type queuing class fcoe match qos group 1 class map type queuing class all flood match qos group 2 class map type queuing class ip multicast match qos group 2 class map type network qos class fcoe match qos group 1 class map type network qos class all flood match qos ...

Страница 82: ...nterface port channel2 switchport mode trunk switchport trunk native vlan 20 switchport trunk allowed vlan 1000 interface vfc3 bind mac address 14 fe b5 8e 5b f2 no shutdown interface vfc4 bind mac address 14 fe b5 8e 5b f0 no shutdown interface vfc5 bind mac address 14 fe b5 8e 5c 09 no shutdown interface vfc6 bind mac address 14 fe b5 8e 5c 0b no shutdown interface vfc7 bind mac address 14 fe b5...

Страница 83: ... interface Ethernet1 3 interface Ethernet1 4 interface Ethernet1 5 interface Ethernet1 6 interface Ethernet1 7 interface Ethernet1 8 interface Ethernet1 9 interface Ethernet1 10 interface Ethernet1 11 interface Ethernet1 12 interface Ethernet1 13 interface Ethernet1 14 interface Ethernet1 15 interface Ethernet1 16 interface Ethernet1 17 interface Ethernet1 18 interface Ethernet1 19 interface Ether...

Страница 84: ...trunk switchport trunk native vlan 20 switchport trunk allowed vlan 1000 channel group 2 mode active interface Ethernet1 30 switchport mode trunk switchport trunk native vlan 20 switchport trunk allowed vlan 1000 channel group 2 mode active interface mgmt0 ip address 172 25 188 100 16 line console line vty boot kickstart bootflash n5000 uk9 kickstart 5 0 3 N2 2a bin boot system bootflash n5000 uk9...

Страница 85: ... group 2 system qos service policy type queuing input fcoe default in policy service policy type queuing output fcoe default out policy service policy type qos input fcoe default in policy service policy type network qos fcoe default nq policy slot 1 port 31 32 type fc snmp server user admin network admin auth md5 0x18e86ba84d1d511fcb6fe4b5e02dc408 priv 0x18e86ba84d1d511fcb6fe4b5e02dc408 localized...

Страница 86: ...n database vsan 2 interface vfc2 vsan 2 interface fc1 31 vsan 2 interface fc1 32 interface fc1 31 no shutdown interface fc1 32 no shutdown interface Ethernet1 1 switchport mode trunk switchport trunk allowed vlan 11 12 channel group 11 mode active interface Ethernet1 2 switchport mode trunk switchport trunk allowed vlan 11 12 channel group 11 mode active interface Ethernet1 3 interface Ethernet1 4...

Страница 87: ... mode active interface Ethernet1 18 switchport mode trunk channel group 500 mode active interface Ethernet1 19 switchport mode trunk channel group 500 mode active interface Ethernet1 20 switchport mode trunk channel group 500 mode active interface Ethernet1 21 interface Ethernet1 22 interface Ethernet1 23 interface Ethernet1 24 interface Ethernet1 25 switchport mode trunk switchport trunk allowed ...

Страница 88: ...72 25 188 60 16 line console line vty boot kickstart bootflash ks513N21a bin boot system bootflash 513N21a bin interface fc1 31 interface fc1 32 Full Zone Database Section for vsan 2 zone name second vsan 2 member pwwn 20 01 5c f9 dd 16 ef 05 member pwwn 21 10 00 20 c2 11 14 3e zoneset name set2 vsan 2 member second zoneset activate name set2 vsan 2 ...

Страница 89: ...n Guide Retrieved 06 19 2012 from Cisco com http www cisco com en US prod collateral switches ps9441 ps10596 deployment_guide_c 07 574724 html Cisco 2009 07 Virtual PortChannel Quick Configuration Guide Retrieved Jun 18 2012 from Cisco com http www cisco com en US prod collateral switches ps9441 ps9670 configuration_guide_c 07 543563 html Fibre Channel over Ethernet Initialization Protocol Cisco h...

Отзывы: