Dell Force10 MXL 10 GbE Deployment Manual Download Page 18

Page: 18 / 89

Deploying FCoE (FIP Snooping) on Dell Force 10 MXL

Configuring the Cisco 5000 series switch with firmware ver 5.x for a single connection from
the Dell Force10 MXL

Cisco Nexus 5000 series configuration sequence

Figure 10.

Enable additional

features

Connect Cisco

Nexus 5000 Series

Switch

Configure VSAN(s)

and FCoE VLAN(s)

feature fcoe
feature npiv
feature telnet
feature lacp

Slot 2
port 15-16 type fc
copy run start
reload -

* caution

this is rebooting the
switch, but is necessary
for this step

vsan database
vsan 2
vlan 1000
fcoe vsan 2

Configure VFC interfaces for

binding to PortChannel

interface vfc1
bind interface
ethernet 1/1
no shutdown

Configure VSAN

database matching VFC

and FC interfaces

vsan database
vsan 2 interface vfc1
vsan 2 interface fc2/15

Configure individual

ports from MXL

interface ethernet 1/1
switchport mode trunk
switchport trunk native vlan
20
switchport trunk allowed
vlan 20,1000
no shut

Configure zones and zonesets

zone name blade1  vsan 2
    member interface fc2/15
    member pwwn
xx:xx:xx:xx:xx:xx:xx:xx

zoneset name set1 vsan 2
member blade1

zoneset activate name set1 vsan 2

Configure FC ports and

settings if using unified

ports

Key Items:

CAUTION

The reload step that is necessary for changing the unified ports to FC ports will

cause a reboot of the switch and loss of any traffic previously running on the Nexus
switch. This is only applicaple for the Cisco Nexus 5000 Series switches with unified ports
such as the Cisco Nexus 5548UP.

Summary of Contents for Force10 MXL 10 GbE

Page 1: ...Kevin Locklear Manjesh Siddamurthy Network Enabled Solutions Deploying FCoE FIP Snooping on Dell Force 10 MXL A Dell Deployment Guide ...

Page 2: ...served Dell and its affiliates cannot be responsible for errors or omissions in typography or photography Dell the Dell logo and PowerEdge are trademarks of Dell Inc Intel is a registered trademark of Intel Corporation in the U S and other countries Other trademarks and trade names may be used in this document to refer to either the entities claiming the marks and names or their products Dell disc...

Page 3: ...nfiguring the Dell Force10 MXL for FIP Snooping 41 Scenario 3 Configuring multiple uplinks LAG PortChannel for Cisco Nexus 5000 series switch NPV mode environment 46 Configuring the Cisco Nexus 5000 series switch with firmware ver 5 x in NPV mode for a multiple link LAG link aggregation connection from the Dell Force10 MXL 47 Configuring the Dell Force10 MXL for FIP snooping with Cisco Nexus 5000 ...

Page 4: ...Snooping on Dell Force 10 MXL 4 PFC 68 ETS 69 IOM 69 NPIV 69 NPV 69 VSAN 69 Appendix B Full CLI examples 70 Force10 MXL CLI example 70 Cisco Nexus 5548UP CLI example 81 Appendix B Network switch versions 89 References 89 ...

Page 5: ...ontroller Server Overview Properties WWN MAC information for Blade Server 3 s B fabric CNA port 2 B2 22 Figure 15 show interface brief command 23 Figure 16 show spanning tree summary command 24 Figure 17 show flogi database command 24 Figure 18 Example of show zoneset active command 25 Figure 19 show interfaces status results 25 Figure 20 show fip snooping config 26 Figure 21 show fip snooping fcf...

Page 6: ...isco Nexus 5000 Series switch primary switch without FCoE configuration can be copied and pasted 53 Figure 46 CLI configuration example vPC on Cisco Nexus 5000 Series switch secondary switch without FCoE configuration can be copied and pasted 54 Figure 47 Flowchart of MXL configuration to connection into dual Nexus vPC configuration 56 Figure 48 CLI configuration example configuring Dell Force10 M...

Page 7: ...will pass FCoE traffic for storage availability This document provides an easy to use guide for configuring FIP Snooping on the Dell Force10 MXL Dell Force10 MXL Figure 1 Dell Force10 MXL Blade Switch 10 40GbE and available modules Figure 1 IO Bay 2 IO Bay 1 Fixed QSFP Ports FlexIO Modules that can be used as part of the Dell Force10 MXL switch Figure 2 FlexIO 10GbE SFP FlexIO 40GbE QSFP FlexIO 10...

Page 8: ...Port Mapping QSFP 2 X 40Gb QSFP 8 X 10 SFP SFP 4 X 10Gb 10G BaseT 4 X 10Gb breakout cable IO Bay Two 56 55 54 53 53 52 52 52 51 51 51 50 50 50 49 49 49 49 IO Bay One 48 47 46 45 45 44 44 44 43 43 43 42 42 42 41 41 41 41 Fixed QSFP Ports 40 39 38 37 37 36 35 34 33 33 32 1G 10G Internal Ports 32 32 32 32 31 31 31 31 2 2 2 2 1 1 1 1 ...

Page 9: ...sessions for all applicable devices Session Not Present See Validation and Troubleshooting Plan and purchase equipment Server CNA Configuration The suggested configurations used to deploy this solution are presented in a sequential order for reading but as the above figure represents this is more of a simultaneous process There are dependencies that will be occurring during the configuration that ...

Page 10: ... stacking should be disabled Please refer to the Dell Force10 MXL user s guide or the Dell Force10 MXL Stacking guide for further details on disabling or changing stacking ports If the configuration is used in this manner proper congestion behavior lossless Ethernet and reliability cannot be guaranteed CNA s Used for this deployment document Qlogic QMD8262 Qlogic QME8242 Broadcom 57810s Intel x520...

Page 11: ...5 6 7 8 N55 M8P8FP Cisco Nexus 5000 Series Dell Compellent FC SAN solution Dell Force10 MXL Dell PowerEdge M1000e Blade Server Chassis B2 C2 A2 B1 C1 A1 4 1 7 5 2 8 6 3 9 CMC2 CMC1 KVM 1 2 3 4 5 6 Gb Gb 2 1 CMC iKVM Gb Gb 2 1 CMC CONSOLE MODE WS CBS3130G S 24 23 22 21 20X 19X 18X 17X STK 2 1 M M B R M S T R S T C K S Y S T CONSOLE MODE WS CBS3130G S 24 23 22 21 20X 19X 18X 17X STK 2 1 M M B R M S ...

Page 12: ...itial Requirements Nexus 5000 Series switch firmware 5 0 or greater Drivers must be installed on all server operating systems including any applicable storage driver Plan for configurations of network and storage Plan native and FCoE Vlan s Plan for either FCF switch zoning or NPV SAN FC switch zoning Plan VSAN s to be used on Cisco FCF Gather FCoE FIP MAC address and FCoE WWN information for all ...

Page 13: ...ations Check for FLOGI s from CNA s and storage device Missing FLOGI entries Verify configured VSAN database entry contains both VFC and FC connections Cisco Nexus Verify VFC is enabled no shutdown command on Cisco Nexu Re verify that FCoE VLAN matches on both MXL and Cisco Nexus Missing Basic Ethernet Connectivity Check basic ethernet connectivity on the applicable VLAN In many of the business en...

Page 14: ...igure downlink server facing ports feature fip snooping fip snooping enable protocol lldp Service class dynamic dot1p interface TenGigabitEthernet 0 1 portmode hybrid switchport protocol lldp dcbx port role auto downstream spanning tree pvst edge port no shutdown Configure uplink FCF switch facing ports interface TenGigabitEthernet 0 52 portmode hybrid switchport fip snooping port mode fcf protoco...

Page 15: ...orts using FCoE See above configuration for reference feature fip snooping protocol lldp exit service class dynamic dot1p default vlan id 20 interface TenGigabitEthernet 0 1 portmode hybrid switchport protocol lldp dcbx port role auto downstream exit spanning tree pvst edge port no shutdown exit interface TenGigabitEthernet 0 52 portmode hybrid switchport fip snooping port mode fcf protocol lldp n...

Page 16: ...tion mode o interface TenGigabitEthernet 0 52 portmode hybrid configuring portmode hybrid will allow for the native VLAN untagged and a tagged VLAN to exist on the port together This is similar to switchport mode trunk in industry standard CLI switchport this configures the port as a layer 2 port fip snooping port mode fcf enables the port for fip snooping from an FCF connection protocol lldp this...

Page 17: ...VLAN 1000 exit exits interface configuration mode NOTE Critical steps The copy running configuration startup configuration command should be issued after important steps so that the switch will retain the configuration settings when the switch is next rebooted or if a power loss occurs It is also a good practice to copy a well validated working configuration to a separate location such as the mana...

Page 18: ...o shutdown Configure VSAN database matching VFC and FC interfaces vsan database vsan 2 interface vfc1 vsan 2 interface fc2 15 Configure individual ports from MXL interface ethernet 1 1 switchport mode trunk switchport trunk native vlan 20 switchport trunk allowed vlan 20 1000 no shut Configure zones and zonesets zone name blade1 vsan 2 member interface fc2 15 member pwwn xx xx xx xx xx xx xx xx zo...

Page 19: ...Series NX OS SAN Switching Configuration Guide The CLI entries above only cover the areas that must be added to enable FCoE capabilities on the ports being used of a Cisco Nexus 5020 and Nexus 5548 This topic will be covered after the Step by Step explanation of the CLI example feature fcoe feature npiv system default switchport trunk mode auto vlan 20 vlan 1000 fcoe vsan 2 vsan database vsan 2 vs...

Page 20: ...1 this binds interface Ethernet 1 1 to the virtual fc interface which in this case is vfc1 This is one form of binding the VFC The other form would be to bind the VFC to the FCoE FIP MAC address of the CNA being used Examples of this will be included later in the document no shutdown turns the virtual interface on since default is shutdown o interface fc2 15 selects the fc2 15 interface no shutdow...

Page 21: ...e used with the Dell PowerEdge Blade Servers With the card installed it will necessary to insure that the ISCSI portion of the driver is not installed From the factory the ISCSI stack will not be installed so it would simply be a matter of adding in the FCoE portion of the driver for storage use If the ISCSI stack is installed the Intel CNA may possibly have FCoE deployment problems If it is insta...

Page 22: ...mand line dcbx version CEE will configure the port to only use the CEE version of DCBX and not negotiate other values This setting is currently necessary for the Intel x520 CNA for use with FCoE and applicable storage M1000e Chassis Management Controller Server Overview Properties WWN MAC Figure 14 information for Blade Server 3 s B fabric CNA port 2 B2 ...

Page 23: ...command Figure 15 Nexus5548 top show interface brief Interface Vsan Admin Admin Status SFP Oper Oper Port Mode Trunk Mode Speed Channel Mode Gbps fc2 15 2 auto auto up swl F 4 fc2 16 2 auto auto up swl F 4 Ethernet VLAN Type Mode Status Reason Speed Port Interface Ch Eth1 1 20 eth trunk up none 10G D 2 Eth1 2 20 eth trunk up none 10G D 2 Eth1 3 1 eth access up none 10G D Eth1 4 1 eth access down S...

Page 24: ...tch The VFC should show the expected port and node WWN of the CNA being used in the server The following command will show the status of the zones that have been put into place Type show zoneset active This command will show the current activated zoneset and all the participating zones with their individual members Nexus5548 top show spanning tree summary Switch is in rapid pvst mode Root bridge f...

Page 25: ...k general status of the ports and links by using show interfaces status show interfaces status results Figure 19 On the Force10 MXL the fip snooping configuration can be checked by using show fip snooping config This will show that the FIP snooping feature is enabled and global configuration is set It will also display the current default or configured FC MAP Nexus5548 top show zoneset active zone...

Page 26: ...e 22 Using the Force10 MXL the fip snooping sessions can be validated using show fip snooping sessions This command will display the following items that are in an FCoE session Enode MAC address Enode interface FCF s MAC address FCF s connecting interface FCoE VLAN being used FCoE MAC addrss FC ID Port WWPN and Port WWNN being used for the session MXL B1 Rack3015 show fip snooping config FIP Snoop...

Page 27: ... Port WWPN Port WWNN 5c f9 12 34 56 78 Te 0 3 54 7f ee 56 55 49 Te 0 52 1000 0e fc 00 55 00 04 55 00 04 20 01 5c f9 dd 16 ef 26 20 00 5c f9 dd 16 ef 26 MXL B1 Rack3015 show fip snooping statistics Vlan 20 Number of Vlan Requests 23 Number of Vlan Notifications 17 Number of Multicast Discovery Solicits 0 Number of Unicast Discovery Solicits 0 Number of FLOGI 0 Number of FDISC 0 Number of FLOGO 0 Nu...

Page 28: ...mber of Unicast Discovery Advertisement 19 Number of FLOGI Accepts 9 Number of FLOGI Rejects 0 Number of FDISC Accepts 0 Number of FDISC Rejects 0 Number of FLOGO Accepts 0 Number of FLOGO Rejects 0 Number of CVL 3 Number of FCF Discovery Timeouts 0 Number of VN Port Session Timeouts 0 Number of Session failures due to Hardware Config 0 TenGigabitEthernet 0 3 Number of Vlan Requests 5 Number of Vl...

Page 29: ... Recommendation TLV disabled P PFC Configuration TLV enabled p PFC Configuration TLV disabled F Application priority for FCOE enabled f Application Priority for FCOE disabled I Application priority for iSCSI enabled i Application Priority for iSCSI disabled Interface TenGigabitEthernet 0 3 Port Role is Auto Downstream DCBX Operational Status is Enabled with ETS Mismatch Is Configuration Source FAL...

Page 30: ... the uplink into the top of rack FCF switch Some key items in these results will be Priority list is 3 Remote Willing status is this should be willing enabled for the Host CNA and willing is disabled for FCF Nexus switch Other important items to not is PFC DCBX Oper status FCOE TLV TX Status is enabled Local DCBX Status DCBX Operational Version is 0 DCBX Max Version Supported is 0 Sequence Number ...

Page 31: ...s disabled Local FCOE PriorityMap is 0x8 Local ISCSI PriorityMap is 0x0 Remote FCOE PriorityMap is 0x8 Remote ISCSI PriorityMap is 0x10 11 Input TLV pkts 28 Output TLV pkts 5 Error pkts 1202 Pause Tx pkts 0 Pause Rx pkts Interface TenGigabitEthernet 0 52 Admin mode is on Admin is enabled Remote is enabled Priority list is 3 Remote Willing Status is disabled Local is enabled Priority list is 3 Oper...

Page 32: ...tEthernet 0 52 is the uplink into the top of rack FCF switch Some key items in these results will be TC grp Priority Bandwidth and TSA Note that only these two interfaces are seen typically this command will list them all show interfaces ets detail Figure 29 MXL B1 Rack3015 show interfaces ets detail Interface TenGigabitEthernet 0 3 Max Supported TC Groups is 4 Number of Traffic Classes is 8 Admin...

Page 33: ...0 ETS 2 3 4 5 6 7 Oper status is internally propagated ETS DCBX Oper status is Up State Machine Type is Feature Conf TLV Tx Status is enabled 1 Input Conf TLV Pkts 1 Output Conf TLV Pkts 1 Error Conf TLV Pkts Interface TenGigabitEthernet 0 52 Max Supported TC Groups is 4 Number of Traffic Classes is 8 Admin mode is on Admin Parameters Admin is enabled TC grp Priority Bandwidth TSA 0 0 1 2 3 4 5 6 ...

Page 34: ... use for storage Remote Parameters Remote is enabled TC grp Priority Bandwidth TSA 0 0 1 2 4 5 6 7 50 ETS 1 3 50 ETS 2 3 4 5 6 7 15 Remote Willing Status is disabled Local Parameters Local is enabled TC grp Priority Bandwidth TSA 0 0 1 2 3 4 5 6 7 100 ETS 1 2 3 4 5 6 7 15 Oper status is init ETS DCBX Oper status is Up with Mismatch State Machine Type is Feature Conf TLV Tx Status is enabled 23 Inp...

Page 35: ... native for the FCoE ports The initial FIP negotiations will occur on this VLAN See MXL CLI section or Cisco Nexus 5000 series CLI section for detail on this ENode s or FCF entries are not present on the Force10 MXL switch See above basic connectivity problems see above Applicable FCoE or storage driver is not configured in the server OS for the CNA This could be an indication that the storage sid...

Page 36: ...LI section for explanation of applying this configuration CNA s that have NPAR capabilities may not have the partitions configured appropriately for FCoE See CNA documentation for applicable partition settings for FCoE use FLOGI entries for CNA s are not present on Cisco Nexus 5000 series switch See above basic connectivity problems see above Verify above section on ENode s or FCF present on MXL s...

Page 37: ...2 1 M M B R M S T R S T C K S Y S T 1 2 3 4 CONSOLE PowerConnect M8024 k 17 18 19 20 1 2 3 4 CONSOLE PowerConnect M8024 k 17 18 19 20 1 2 3 4 CONSOLE PowerConnect M8024 k 17 18 19 20 1 2 3 4 CONSOLE PowerConnect M8024 k 17 18 19 20 1 2 3 4 CONSOLE PowerConnect M8024 k 17 18 19 20 1 2 3 4 CONSOLE PowerConnect M8024 k 17 18 19 20 1 2 3 4 CONSOLE PowerConnect M8024 k 17 18 19 20 B2 C2 A2 B1 C1 A1 4 1...

Page 38: ...e matching VFC and FC interfaces vsan database vsan 2 interface vfc1 vsan 2 interface fc2 15 vsan 2 interface fc2 16 Configure individual ports for FCoE LAG PortChannel from MXL interface ethernet 1 5 6 switchport mode trunk switchport trunk native vlan 20 switchport trunk allowed vlan 20 1000 channel group 20 mode active no shut interface port channel20 switchport mode trunk switchport trunk nati...

Page 39: ...0 interface vfc1 bind interface port channel1 no shutdown interface Ethernet1 1 switchport mode trunk switchport trunk native vlan 20 switchport trunk allowed vlan 1000 channel group 1 mode active interface Ethernet1 2 switchport mode trunk switchport trunk native vlan 20 switchport trunk allowed vlan 1000 channel group 1 mode active zone name blade1 vsan 2 member interface fc2 15 member pwwn xx x...

Page 40: ...ative VLAN 20 to the trunk switchport trunk allowed vlan 1000 add allowed VLAN 1000 to the trunk channel group 1 mode active this interface is part of port channel 1 o zone name blade1 vsan 2 this will set the name for your zone blade1 can be any chosen name vsan 2 will match the vsan you have created member interface fc2 15 this adds the fc2 15 interface as a member of the zone member pwwn xx xx ...

Page 41: ...server facing ports feature fip snooping fip snooping enable protocol lldp Service class dynamic dot1p interface TenGigabitEthernet 0 1 portmode hybrid switchport protocol lldp dcbx port role auto downstream spanning tree pvst edge port no shutdown Configure port channel interface Port channel 5 no ip address mtu 2500 portmode hybrid switchport fip snooping port mode fcf no shutdown Configure defa...

Page 42: ...ace TenGigabitEthernet 0 2 no ip address mtu 2500 portmode hybrid switchport protocol lldp dcbx port role auto downstream spanning tree pvst edge port no shutdown exit interface TenGigabitEthernet 0 51 no ip address mtu 2500 port channel protocol LACP port channel 5 mode active protocol lldp no advertise dcbx tlv ets reco dcbx port role auto upstream no shutdown exit interface TenGigabitEthernet 0...

Page 43: ... ports to be added to the port channel have current settings configured including portmode hybrid and switchport these settings will need to be removed If they are not removed the configuration settings will not be successful interface Port channel 5 no ip address mtu 2500 portmode hybrid switchport fip snooping port mode fcf no shutdown interface Vlan 20 mtu 2500 untagged TenGigabitEthernet 0 1 3...

Page 44: ...he lldp protocol settings dcbx port role auto downstream with this command the port role is established as a dcbx capable dowsnstream port to communicate with blade server CNA ports spanning tree pvst edge port configure port as an edge port for spanning tree behavior no shutdown configures the port as active exit exits interface configuration mode o interface TenGigabitEthernet 0 51 port channel ...

Page 45: ...rface configuration mode o interface Vlan 1000 Initializes VLAN 1000 for use This VLAN will be the FCoE VLAN that will pass the storage traffic after the intial FIP negotiations occur on the native or default VLAN tagged TenGigabitEthernet 0 1 3 This adds these ports to the tagged VLAN 1000 tagged Port channel 5 fip snooping enable Enables FIP snooping for this VLAN which will set all ports involv...

Page 46: ... PowerConnect M8024 k 17 18 19 20 1 2 3 4 CONSOLE PowerConnect M8024 k 17 18 19 20 1 2 3 4 CONSOLE PowerConnect M8024 k 17 18 19 20 1 2 3 4 CONSOLE PowerConnect M8024 k 17 18 19 20 3 CISCO NEXUS N5548P 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 STAT ID 1 10 GIGABIT ETHERNET 1 2 4 8G FIBRE CHANNEL 1 2 3 4 5 6 7 8 1 2 3 4 5 6 7 8 N55 M8P8FP B2 C2 A2 B1 C1 ...

Page 47: ...ce Method Multiple port link Cisco 5548 configuration can be copied and pasted Figure 40 feature npv feature npiv vlan 20 vlan 1000 fcoe vsan 2 vsan database vsan 2 vsan 2 interface vfc1 vsan 2 interface vfc2 vsan 2 interface fc2 15 vsan 2 interface fc2 16 interface port channel1 switchport mode trunk switchport trunk native vlan 20 switchport trunk allowed vlan 1000 interface vfc1 bind mac addres...

Page 48: ...hange in behavior some of the typical commands used when looking at the device logins will also change and may not have the same capability However the FC switch that the Cisco Nexus ToR switch is connected to in this case a Brocade FC8 switch will have a view from the FC perspective of the CNA s connected at the other end in the blade servers with a proper configuration in place The zoning and FC...

Page 49: ...ONSOLE MODE WS CBS3130G S 24 23 22 21 20X 19X 18X 17X STK 2 1 M M B R M S T R S T C K S Y S T 1 2 3 4 CONSOLE PowerConnect M8024 k 17 18 19 20 1 2 3 4 CONSOLE PowerConnect M8024 k 17 18 19 20 1 2 3 4 CONSOLE PowerConnect M8024 k 17 18 19 20 1 2 3 4 CONSOLE PowerConnect M8024 k 17 18 19 20 1 2 3 4 CONSOLE PowerConnect M8024 k 17 18 19 20 1 2 3 4 CONSOLE PowerConnect M8024 k 17 18 19 20 1 2 3 4 CONS...

Page 50: ...6 27 28 29 30 31 32 1 10 GIGABIT ETHERNET 1 2 4 8G FIBRE CHANNEL 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 N55 M16UP Management LAN LAG PortChannel LAG PortChannel vPC Peer Link Nex5K 1 Nex5K 2 MXL 1 MXL 2 In the above figure it can be observed that MXL 1 and MXL 2 each have a 4 port LAG PortChannel uplinking into the two Cisco Nexus switches This number of links is not set in stone and can be change...

Page 51: ...t 1 1 2 channel group 1 interface ethernet 1 17 18 channel group 2 interface po4096 vpc 100 Connect to second Cisco Nexus 5000 Series Switch and perform same steps with on destination and role priority changes feature vpc feature lacp vpc domain 1 role priority 2000 peer keepalive destination 172 25 188 60 interface po4096 vpc peer link switchport mode trunk switchport trunk allowed vlan 1 100 int...

Page 52: ... FCoE links it will be a good practive to insure that the FCoE VLAN s are not passed across the peer link In some instances the PortChannel for the peer link will be configured for all VLAN s It will be necessary in this situation to reconfigure to not include the FCoE VLAN s as mentioned Role priority this is an optional step but recommended as it will establish primary and secondary switch roles...

Page 53: ...tChannels and configuration settings The role priority is explained further in the detailed steps feature vpc feature lacp vpc domain 1 role priority 1000 peer keepalive destination 172 25 188 61 interface po4096 vpc peer link switchport mode trunk interface po1 switchport mode trunk vpc 1 interface po2 switchport mode trunk vpc 2 interface ethernet 1 1 2 channel group 1 interface ethernet 1 17 18...

Page 54: ... will be the address for the primary switch The rest of the settings should exactly match the primary switch so that they are sharing the same PortChannels and vPC s across the two switches feature vpc feature lacp vpc domain 1 role priority 2000 peer keepalive destination 172 25 188 60 interface po4096 vpc peer link switchport mode trunk interface po1 switchport mode trunk vpc 1 interface po2 swi...

Page 55: ...PortChannel 4096 configuration vpc peer link sets this PortChannel to be the vpc peer link between the 2 Nexus Switches switchport mode trunk established switchport mode trunk for all VLANs o interface po1 moves into the PortChannel 1 configuration switchport mode trunk established switchport mode trunk for all VLANs vpc 1 sets this PortChannel to be a member of vpc 1 o interface po2 moves into th...

Page 56: ...Nexus switch facing ports interface Port channel 5 no ip address portmode hybrid switchport no shutdown Configure default VLAN for switch Key Items Both MXL switches MXL 1 and MXL 2 from our example will the basic settings configured for Ethernet traffic on the downlink server facing ports The 4 uplinks te 0 49 52 to the Cisco Nexus switches will all be configured for the same PortChannel even tho...

Page 57: ...tmode hybrid and switchport settings are not configured on the individual uplink ports but only on the PortChannel If these configurations are done on the individual ports they will have to be removed for later configuration configure default vlan id 20 interface TenGigabitEthernet 0 1 no shutdown exit interface Port channel 5 portmode hybrid switchport no shutdown interface TenGigabitEthernet 0 4...

Page 58: ...e active no shutdown configures the port as active exit exit from interface configuration mode o interface TenGigabitEthernet 0 51 port channel protocol LACP configures the port for LACP port channel port channel 5 mode active sets the port channel to 5 and sets mode to be active no shutdown configures the port as active exit exit from interface configuration mode o interface TenGigabitEthernet 0 ...

Page 59: ...role priority was not manually configured or it will show if there is an error in which switch is acting as primary Number of vPC configured this will the number of vPC links configured vPC Peer link status this will status of the peer link including the active VLAN s crossing that peer link vPC status this is an overview of some of the previous information showing the ID port status consistency r...

Page 60: ...CHANNEL 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 N55 M16UP 3 CISCO NEXUS N5548UP STAT ID 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 1 10 GIGABIT ETHERNET 1 2 4 8G FIBRE CHANNEL 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 N55 M16UP Management LAN LAG PortChannel LAG PortChannel vPC Peer Link Nex5K 1 Nex5K 2 MXL 1 MXL 2 FCoE SAN A VSAN 2 FCoE VLAN 1000 FCoE SAN B...

Page 61: ...om MXL interface ethernet 1 5 6 switchport mode trunk switchport trunk native vlan 20 switchport trunk allowed vlan 20 1000 channel group 20 mode active no shut interface port channel20 switchport mode trunk switchport trunk native vlan 20 switchport trunk allowed vlan 20 1000 no shutdown Create additional LAG PortChannel for FCoE connection from MXL Configure zones and zonesets zone name blade1 v...

Page 62: ... trunk native vlan 20 switchport trunk allowed vlan 1000 interface vfc1 bind interface port channel20 no shutdown interface fc2 15 no shutdown interface fc2 16 no shutdown interface Ethernet1 5 switchport mode trunk switchport trunk native vlan 20 switchport trunk allowed vlan 1000 channel group 20 mode active no shut interface Ethernet1 6 switchport mode trunk switchport trunk native vlan 20 swit...

Page 63: ...the VFC to the FCoE FIP MAC address of the CNA being used Examples of this will be included later in the document no shutdown turns the virtual interface on since default is shutdown o interface fc2 15 selects the fc2 15 interface which will typically be the first fibre channel port on the Nexus 5020 no shutdown turns the fc2 15 interface on since default is shutdown o interface Ethernet 1 1 selec...

Page 64: ...hybrid switchport protocol lldp dcbx port role auto downstream spanning tree pvst edge port no shutdown Configure uplink FCF switch facing ports interface range TenGigabitEthernet 0 43 0 44 port channel protocol LACP port channel 10 mode active protocol lldp no advertise dcbx tlv ets reco dcbx port role auto upstream no shutdown default vlan id 20 Configure VLAN interfaces for switch and assign po...

Page 65: ...vst edge port no shutdown exit interface TenGigabitEthernet 0 43 port channel protocol LACP port channel 10 mode active protocol lldp no advertise dcbx tlv ets reco dcbx port role auto upstream exit no shutdown exit interface TenGigabitEthernet 0 44 port channel protocol LACP port channel 10 mode active protocol lldp no advertise dcbx tlv ets reco dcbx port role auto upstream exit no shutdown exit...

Page 66: ...ACP configures the port for LACP port channel port channel 10 mode active sets the port channel to 5 and sets mode to be active protocol lldp this moves into the lldp protocol settings o no advertise dcbx tlv ets reco this settings establishes that the ETS recommended configuration TLV s should not be advertised for manual type settings Instead they should be determined via negotiations o dcbx por...

Page 67: ...gotiations occur on the native or default VLAN tagged TenGigabitEthernet 0 1 52 This adds these ports to the tagged VLAN 1000 fip snooping enable Enables FIP snooping for this VLAN which will set all ports involved to have MTU or Jumbo Frames mini of size 2500 no shutdown activates VLAN 1000 exit exits interface configuration mode Validation This complex configuration is validated in two different...

Page 68: ... secures the end to end path between the ENode device and the FCF The ENode will only be able to talk with the FCF in which it has logged into FIP Snooping bridge FSB With a switch configured to performing FIP Snooping the industry term for this switch is FSB or FIP Snooping bridge It is performing FIP Snooping as described in the previous term FCF FCoE forwarders FCFs act as an Ethernet and FC sw...

Page 69: ...witch is as an IOM for the M1000e blade server chassis NPIV N port identifier virtualization which enables multiple N port fabric logins at the same time on the same physical FC link Cisco Systems Inc 2011 This term is in reference to the Cisco Nexus 5000 series switches implementation of NPIV NPIV must be enabled to share multiple logins across a single port link or a port channel multiple line l...

Page 70: ...username admin password 7 fea175715f6aa1df privilege 15 default vlan id 10 stack unit 0 provision MXL 10 40GbE stack unit 0 port 41 portmode quad stack unit 0 port 45 portmode quad interface TenGigabitEthernet 0 1 no ip address mtu 2500 portmode hybrid switchport protocol lldp dcbx port role auto downstream no shutdown interface TenGigabitEthernet 0 2 no ip address mtu 2500 portmode hybrid switchp...

Page 71: ... 10 no ip address shutdown interface TenGigabitEthernet 0 11 no ip address shutdown interface TenGigabitEthernet 0 12 no ip address shutdown interface TenGigabitEthernet 0 13 no ip address shutdown interface TenGigabitEthernet 0 14 no ip address shutdown interface TenGigabitEthernet 0 15 no ip address shutdown interface TenGigabitEthernet 0 16 no ip address shutdown interface TenGigabitEthernet 0 ...

Page 72: ...o ip address shutdown interface TenGigabitEthernet 0 25 no ip address shutdown interface TenGigabitEthernet 0 26 no ip address shutdown interface TenGigabitEthernet 0 27 no ip address shutdown interface TenGigabitEthernet 0 28 no ip address shutdown interface TenGigabitEthernet 0 29 no ip address shutdown interface TenGigabitEthernet 0 30 no ip address shutdown interface TenGigabitEthernet 0 31 no...

Page 73: ...wn interface TenGigabitEthernet 0 45 no ip address no shutdown interface TenGigabitEthernet 0 46 no ip address no shutdown interface TenGigabitEthernet 0 47 no ip address no shutdown interface TenGigabitEthernet 0 48 no ip address no shutdown interface TenGigabitEthernet 0 49 no ip address shutdown interface TenGigabitEthernet 0 50 no ip address shutdown interface TenGigabitEthernet 0 51 no ip add...

Page 74: ...ernet 0 56 no ip address shutdown interface ManagementEthernet 0 0 ip address 172 25 188 143 16 no shutdown interface Vlan 10 mtu 2500 untagged TenGigabitEthernet 0 7 15 52 interface Vlan 1000 no ip address mtu 2500 tagged TenGigabitEthernet 0 7 15 52 fip snooping enable no shutdown service class dynamic dot1p ip ssh server enable ip ssh server version 2 feature fip snooping protocol lldp line con...

Page 75: ...tname MXL_B1 enable password 7 b125455cf679b2089a964cf3e8637550fe9d00118c7d1ad8 username root password 7 d7acc8a1dcd4f698 privilege 15 username admin password 7 fea175715f6aa1df privilege 15 stack unit 0 provision MXL 10 40GbE interface TenGigabitEthernet 0 1 no ip address portmode hybrid switchport shutdown interface TenGigabitEthernet 0 2 no ip address portmode hybrid switchport shutdown interfa...

Page 76: ...nGigabitEthernet 0 9 no ip address portmode hybrid switchport shutdown interface TenGigabitEthernet 0 10 no ip address portmode hybrid switchport shutdown interface TenGigabitEthernet 0 11 no ip address portmode hybrid switchport shutdown interface TenGigabitEthernet 0 12 no ip address portmode hybrid switchport shutdown interface TenGigabitEthernet 0 13 no ip address portmode hybrid switchport sh...

Page 77: ...ode hybrid switchport shutdown interface TenGigabitEthernet 0 19 no ip address portmode hybrid switchport shutdown interface TenGigabitEthernet 0 20 no ip address portmode hybrid switchport shutdown interface TenGigabitEthernet 0 21 no ip address portmode hybrid switchport shutdown interface TenGigabitEthernet 0 22 no ip address portmode hybrid switchport shutdown interface TenGigabitEthernet 0 23...

Page 78: ...erface TenGigabitEthernet 0 28 no ip address portmode hybrid switchport shutdown interface TenGigabitEthernet 0 29 no ip address portmode hybrid switchport shutdown interface TenGigabitEthernet 0 30 no ip address portmode hybrid switchport shutdown interface TenGigabitEthernet 0 31 no ip address portmode hybrid switchport shutdown interface TenGigabitEthernet 0 32 no ip address portmode hybrid Mor...

Page 79: ...nGigabitEthernet 0 46 no ip address shutdown interface TenGigabitEthernet 0 47 no ip address shutdown interface TenGigabitEthernet 0 48 no ip address shutdown interface TenGigabitEthernet 0 49 no ip address port channel protocol LACP port channel 12 mode active no shutdown interface TenGigabitEthernet 0 50 no ip address port channel protocol LACP port channel 12 mode active no shutdown interface T...

Page 80: ...rface ManagementEthernet 0 0 ip address 172 25 188 41 16 no shutdown interface Port channel 1 description to_Nexus5k_vPC no ip address portmode hybrid switchport no shutdown interface Port channel 12 no ip address portmode hybrid switchport no shutdown interface Vlan 1 ip address dhcp untagged TenGigabitEthernet 0 1 32 untagged Port channel 1 12 no shutdown interface Vlan 11 no ip address tagged P...

Page 81: ... 0bcPjaAd t3MSaSb34 4QiOx il5VM0 role network admin ip domain lookup hostname Technet5548 1 class map type qos class fcoe class map type queuing class fcoe match qos group 1 class map type queuing class all flood match qos group 2 class map type queuing class ip multicast match qos group 2 class map type network qos class fcoe match qos group 1 class map type network qos class all flood match qos ...

Page 82: ...nterface port channel2 switchport mode trunk switchport trunk native vlan 20 switchport trunk allowed vlan 1000 interface vfc3 bind mac address 14 fe b5 8e 5b f2 no shutdown interface vfc4 bind mac address 14 fe b5 8e 5b f0 no shutdown interface vfc5 bind mac address 14 fe b5 8e 5c 09 no shutdown interface vfc6 bind mac address 14 fe b5 8e 5c 0b no shutdown interface vfc7 bind mac address 14 fe b5...

Page 83: ... interface Ethernet1 3 interface Ethernet1 4 interface Ethernet1 5 interface Ethernet1 6 interface Ethernet1 7 interface Ethernet1 8 interface Ethernet1 9 interface Ethernet1 10 interface Ethernet1 11 interface Ethernet1 12 interface Ethernet1 13 interface Ethernet1 14 interface Ethernet1 15 interface Ethernet1 16 interface Ethernet1 17 interface Ethernet1 18 interface Ethernet1 19 interface Ether...

Page 84: ...trunk switchport trunk native vlan 20 switchport trunk allowed vlan 1000 channel group 2 mode active interface Ethernet1 30 switchport mode trunk switchport trunk native vlan 20 switchport trunk allowed vlan 1000 channel group 2 mode active interface mgmt0 ip address 172 25 188 100 16 line console line vty boot kickstart bootflash n5000 uk9 kickstart 5 0 3 N2 2a bin boot system bootflash n5000 uk9...

Page 85: ... group 2 system qos service policy type queuing input fcoe default in policy service policy type queuing output fcoe default out policy service policy type qos input fcoe default in policy service policy type network qos fcoe default nq policy slot 1 port 31 32 type fc snmp server user admin network admin auth md5 0x18e86ba84d1d511fcb6fe4b5e02dc408 priv 0x18e86ba84d1d511fcb6fe4b5e02dc408 localized...

Page 86: ...n database vsan 2 interface vfc2 vsan 2 interface fc1 31 vsan 2 interface fc1 32 interface fc1 31 no shutdown interface fc1 32 no shutdown interface Ethernet1 1 switchport mode trunk switchport trunk allowed vlan 11 12 channel group 11 mode active interface Ethernet1 2 switchport mode trunk switchport trunk allowed vlan 11 12 channel group 11 mode active interface Ethernet1 3 interface Ethernet1 4...

Page 87: ... mode active interface Ethernet1 18 switchport mode trunk channel group 500 mode active interface Ethernet1 19 switchport mode trunk channel group 500 mode active interface Ethernet1 20 switchport mode trunk channel group 500 mode active interface Ethernet1 21 interface Ethernet1 22 interface Ethernet1 23 interface Ethernet1 24 interface Ethernet1 25 switchport mode trunk switchport trunk allowed ...

Page 88: ...72 25 188 60 16 line console line vty boot kickstart bootflash ks513N21a bin boot system bootflash 513N21a bin interface fc1 31 interface fc1 32 Full Zone Database Section for vsan 2 zone name second vsan 2 member pwwn 20 01 5c f9 dd 16 ef 05 member pwwn 21 10 00 20 c2 11 14 3e zoneset name set2 vsan 2 member second zoneset activate name set2 vsan 2 ...

Page 89: ...n Guide Retrieved 06 19 2012 from Cisco com http www cisco com en US prod collateral switches ps9441 ps10596 deployment_guide_c 07 574724 html Cisco 2009 07 Virtual PortChannel Quick Configuration Guide Retrieved Jun 18 2012 from Cisco com http www cisco com en US prod collateral switches ps9441 ps9670 configuration_guide_c 07 543563 html Fibre Channel over Ethernet Initialization Protocol Cisco h...

Search results

Summary of Contents for Force10 MXL 10 GbE

Reviews:

Related manuals for Force10 MXL 10 GbE

Brands by name

Popular brands

Dell Force10 MXL 10 GbE, Deployment Manual

Search results

Summary of Contents for Force10 MXL 10 GbE

Reviews:

Related manuals for Force10 MXL 10 GbE

Brands by name

Popular brands