background image

 

 

 

 

 
 

HP Virtual Connect Ethernet Cookbook:   
Single and Multi Enclosure Domain (Stacked) 
Scenarios 

 

 

 

Part number  603028-003 
Third edition August  2010  
 

 

Summary of Contents for Integrity BL890c - i2 Server

Page 1: ...HP Virtual Connect Ethernet Cookbook Single and Multi Enclosure Domain Stacked Scenarios Part number 603028 003 Third edition August 2010 ...

Page 2: ...2 212 Commercial Computer Software Computer Software Documentation and Technical Data for Commercial Items are licensed to the U S Government under vendor s standard commercial license Microsoft Windows and Windows Server are U S registered trademarks of Microsoft Corporation Intel Pentium and Itanium are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United St...

Page 3: ...ndows 26 Overview 26 Requirements 26 Installation and configuration 28 Optionally Configuring Additional Uplinks to a vNet LACP 32 Summary 38 Results 38 Scenario 1 3 Multiple Simple Networks Providing Redundancy and Link Aggregation 802 3ad LACP with VLAN Tunneling VMware ESX 40 Overview 40 Requirements 40 Configuring Uplinks to a vNet LACP 40 Installation and configuration 42 Summary 49 Results 4...

Page 4: ...ed Uplink Sets SUS and Mapped VLANs Windows 2003 2008 100 Overview 100 Requirements 100 Installation and configuration 102 Summary 109 Result 109 Adding additional NICs to an existing server Profile 116 Summary 119 Result 119 Scenario 2 2 Flex 10 VLAN Tagging 802 1Q with Multiple Shared Uplink Sets SUS and Mapped VLANs Windows 2008 Hyper V 122 Overview 122 Requirements 123 Installation and configu...

Page 5: ...configuration 173 Summary 180 Results 181 Scenario 3 2 Flex 10 with Multi Enclosure stacking VLAN Tagging 802 1Q with Multiple Shared Uplink Sets SUS VMware ESX 4 Enclosures 183 Overview 183 Requirements 184 Installation and configuration 186 Summary 199 Result 199 Appendix A Scenario based Cisco command line reference 203 Appendix B Scenario based ProCurve command line reference 214 Appendix C Ac...

Page 6: ...ocks to use when designing Virtual Connect solutions Although these scenarios are shown individually some scenarios could be combined to create a more complex and versatile Virtual Connect environment however keeping in mind the difference between mapped and tunneled VLANs discussed later in this paper are mutually exclusive This is not meant to be a complete or detailed guide to Virtual Connect b...

Page 7: ...onnections however this guide is focused completely on the Ethernet configuration For Fibre Channel connectivity please refer to the Virtual Connect Fibre Channel Cookbook http bizsupport1 austin hp com bc docs support SupportManual c01702940 c01702940 pdf www hp com go blades Virtual Connect 2 30 Firmware Release Shared Uplink Sets provide administrators the ability to distribute VLANs into discr...

Page 8: ...ply per domain 320 Unique VLANs per Virtual Connect Ethernet module 128 Unique VLANs per Shared Uplink Set 28 Unique Server Mapped VLANs per Server Profile Network Connection Please see the Virtual Connect 2 30 Release Notes for future details on these and other new features ...

Page 9: ...ely ignored by Virtual Connect and the frame is forwarded to the appropriate connection server NIC s or uplinks depending on frame direction flow In this case the end server would need to be configured to interpret the VLAN tags This could be a server with a local operating system in which the network stack would need to be configured to understand which VLAN the server was in or a virtualization ...

Page 10: ... to the guests Using Mapped VLAN Tags minimizes the number of uplinks required In order to utilize the Multiple Networks feature of Virtual Connect the Map VLAN Tags feature needs to be turned on under the Ethernet Settings Advanced tab within the Virtual Connect manager or the Virtual Connect CLI SUS Restrictions and limitations When configuring a Shared Uplink Set the following limitations apply...

Page 11: ...mits These VLANs can be presented to a Server NIC as either a single Network where VC will remove the tags and present an untagged frame to the NIC or as multiple Networks where VC will present all frames with their VLAN tags in which case the host system will need to interpret the tags one network could be configured as untagged Create a vNet the behavior of a vNet also changes a vNet can now onl...

Page 12: ...gle HP BladeSystem c7000 enclosure with TWO Virtual Connect Ethernet modules and a half height BladeSystem Server The server will connect to the Virtual Connect models with two 1Gb NICs NIC 1 will connect to the VC module in Bay 1 and NIC 2 will connect to the VC module in Bay 2 A pair of managed network switches should also be provided the switches should also be trunked together It is assumed th...

Page 13: ...rtual Connect modules within the enclosure and could then connect to the same upstream switch or two different upstream switches depending on your redundancy needs An alternative would be to configure TWO separate vNets each with a single uplink configured Each option has its advantages and disadvantages We will review the first option in this scenario In addition several vNets can be configured t...

Page 14: ...3ad LACP Windows 14 Figure 1 2 Physical View Shows a single Ethernet uplink from Port 1 on Module 1 to Port 1 on the first network switch and a single uplink from Port 1 on Module 2 to Port 1 on the second network switch Item Description 1 Switch Cross Connect 2 c7000 Enclosure rear view ...

Page 15: ...ding untagged frames As an alternative if the switch ports were configured as TRUNK ports and forwarding multiple VLANS Virtual Connect would forward those tagged frames to the host NICs configured for this network The connected host would then need to be configured to interpret those VLAN tags This scenario assumes the switch port is configured as an Access port and the frames are presented to Vi...

Page 16: ...ets on newly active links which enables the external Ethernet switches to identify the new connection and update their MAC caches appropriately This transmission sequence repeats a few times at the MAC refresh interval five seconds is the recommended interval and completes in about one minute Configuring the VC Module for VLAN Tunneling via GUI Ethernet settings Enable Tunnel VLAN Tags within Virt...

Page 17: ...nt path to the network As each uplink originates from a different VC module one uplink will be Active and the second will be in Standby This configuration provides the ability to lose an uplink cable network switch or depending on how the NICs are configured at the server teamed or un teamed even a VC module Note Smart Link In this configuration Smartlink should NOT be enabled Smartlink is used to...

Page 18: ...file Create a server profile called App 1 In the Network Port 1 drop down box select vNet PROD In the Network Port 2 drop down box select vNet PROD In the Assign the Profile to a Server Bay select Bay 1 and apply Defining a Server Profile with NIC Connections via CLI The following command s can be copied and pasted into an SSH based CLI session with Virtual Connect Create and Assign Server Profile...

Page 19: ...Scenario 1 1 Simple vNet with Active Standby Uplinks and Optional Link Aggregation 802 3ad LACP Windows 19 Figure 1 7 Server Profile View Bay 1 ...

Page 20: ...e upstream switch to be configured on these ports for link aggregation control protocol LACP and be configured in the same link aggregation group When some of the uplinks configured within a vNet connect a VC module to different upstream switches or from multiple VC modules to a single or multiple switches some links will be active and the remaining will be Standby potentially providing additional...

Page 21: ...Adding uplinks to an existing vNet via GUI Edit the vNet named vNet PROD In the left pane of the Virtual Connect Manager screen click on the Network vNet Prod Select Add Port then add the following ports a Enclosure 1 Bay 1 Port 2 b Enclosure 1 Bay 2 Port 2 Leave Connection Mode as Auto Select Apply Note By connecting FOUR Uplinks from this vNet we have provided additional bandwidth and a redundan...

Page 22: ...d to information If the connected switch supports LLDP the connected to information should be displayed as below Figure 1 11 Link aggregation confirmed Bay 1 Note All connections within an active active LACP group will have the same LAG ID To view this go to the Interconnect bay and view Uplink Port Information If you are having trouble establishing an active active connection confirm the LAG ID ...

Page 23: ...ir of 1Gb uplinks These NICs could now be configured as individual NICs Figure 1 8 with their own IP address or as a pair of TEAMED NICs Figure 1 9 Either NIC could be active As a result this server could access the network through either NIC or either uplink cable depending on which is active at the time When additional bandwidth was required additional uplinks were added to the existing vNet thi...

Page 24: ...cted to the network through vNet PROD The following graphics provide an example of a Windows 2003 server with TWO NICs teamed and connected to the network One NIC will be active while the other is in standby In the event of an Uplink or switch failure VC will fail over to the standby uplinks Figure 1 14 Both NICs using the HP Network Configuration Utility ...

Page 25: ...cenario 1 1 Simple vNet with Active Standby Uplinks and Optional Link Aggregation 802 3ad LACP Windows 25 Figure 1 15 Both NICs for Profile App 1are teamed and connected to the network through vNet PROD ...

Page 26: ...ment network fail over or redundancy In this scenario we will configure TWO separate vNets each with a single uplink configured from each VC module We will later connect additional uplinks to provide additional bandwidth In addition several vNets can be configured to support the required networks to the servers within the BladeSystem enclosure These networks could be used to separate the various n...

Page 27: ...n 802 3ad LACP Windows 27 Figure 1 16 Physical View Shows a single Ethernet uplink from Port 1 on Module 1 to Port 1 on the first network switch and a single uplink from Port 1 on Module 2 to Port 1 on the second network switch Item Description 1 Switch Cross Connect 2 c7000 Enclosure rear view ...

Page 28: ...re configured as ACCESS ports either presenting the Default VLAN or a specific VLAN and will for forwarding untagged frames As an alternative if the switch ports were configured as TRUNK ports and forwarding multiple VLANS Virtual Connect would forward those tagged frames to the host NICs configured for this network The connected host would then need to be configured to interpret those VLAN tags T...

Page 29: ...net packets on newly active links which enables the external Ethernet switches to identify the new connection and update their MAC caches appropriately This transmission sequence repeats a few times at the MAC refresh interval five seconds is the recommended interval and completes in about one minute Configuring the VC Module for VLAN Tunneling via GUI Ethernet settings Enable Tunnel VLAN Tags wit...

Page 30: ...t path to the network As each uplink originates from a different VC module and vNet both uplinks will be active This configuration provides the ability to lose an uplink cable network switch or depending on how the NICs are configured at the server teamed or un teamed even a VC module Note Smart Link In this configuration Smartlink SHOULD be enabled Smartlink is used to turn off downlink ports wit...

Page 31: ...rk vNet PROD 1 Note The Port Status and Connected to information If the connected switch supports LLDP the connected to information should be displayed as below Figure 1 20 Define Ethernet Network vNet PROD 2 Note The Port Status and Connected to information If the connected switch supports LLDP the connected to information should be displayed as below ...

Page 32: ...s the upstream switch to be configured on these ports for link aggregation control protocol LACP and be configured in the same link aggregation group When some of the uplinks configured within a vNet connect a VC module to different upstream switches or from multiple VC modules to a single or multiple switches some links will be active and the remaining will be Standby potentially providing additi...

Page 33: ...s TRUNK ports and forwarding multiple VLANS Virtual Connect would forward those tagged frames to the host NICs configured for this network The connected host would then need to be configured to interpret those VLAN tags When adding the additional uplinks to the vNet the switch ports connected to Virtual Connect will need to be configured for LACP and configured for the same Link Aggregation Group ...

Page 34: ...pied and pasted into an SSH based CLI session with Virtual Connect Edit the vNet vNet PROD 1 and configure uplinks as discussed above add uplinkport enc0 1 2 Network vNet PROD 1 speed auto Edit the vNet vNet PROD 2 and configure uplinks as discussed above add uplinkport enc0 2 2 Network vNet PROD 2 speed auto Figure 1 23 Adding uplinks to an existing vNet vNet PROD 1 Note The Port Status and Conne...

Page 35: ...onnected to information If the connected switch supports LLDP the connected to information should be displayed as below Figure 1 25 Link aggregation confirmed Bay 1 Note All connections within an active active LACP group will have the same LAG ID To view this go to the Interconnect bay and view Uplink Port Information If you are having troubles establishing an active active connection confirm the ...

Page 36: ... the Network Port 1 drop down box select vNet PROD 1 In the Network Port 2 drop down box select vNet PROD 2 In the Assign the Profile to a Server Bays select Bay 1 and apply Defining a Server Profile with NIC Connections via CLI The following command s can be copied and pasted into an SSH based CLI session with Virtual Connect Create and Assign Server Profile App 1 add profile App 1 nodefaultenetc...

Page 37: ...Scenario 1 2 Multiple Simple Networks with Active Active Uplinks and Optional Link Aggregation 802 3ad LACP Windows 37 Figure 1 27 Define Server Profile App 1 Figure 1 28 View Bay 1 ...

Page 38: ...1Gb uplinks These NICs could now be configured as individual NICs with their own IP address or as a pair of TEAMED NICs Either NIC could be active As a result this server could access the network through either NIC or either uplink cable depending on which NIC is active at the time When additional bandwidth was required additional uplinks were added to each vNet As additional servers are added to ...

Page 39: ...twork One NIC will be active the other NIC will be in standby in the event of an Uplink switch or VC module failure the teaming software will fail the NIC over to the alternate path as required Figure 1 30 Team both NICs using the HP Network Configuration Utility Figure 1 31 Both NICs for Profile App 1are teamed and could connect connected to the network through either vNet PROD 1 or vNet PROD 2 d...

Page 40: ...deSystem c7000 enclosure with one of more server blades and TWO Virtual Connect Ethernet modules installed in Bays 1 2 are required In addition we will require ONE or TWO external Network switches As Virtual Connect does not appear to the network as a switch and is transparent to the network any standard managed switch will work with Virtual Connect Configuring Uplinks to a vNet LACP When all upli...

Page 41: ...N Tunneling VMware ESX 41 Figure 1 32 Physical View Shows two Ethernet uplinks from Ports 1 2 on Module 1 to Ports 1 2 on the first network switch and two uplinks from Ports 1 and 2 on Module 2 to Ports 1 2 on the second network switch Item Description 1 Switch Cross Connect 2 c7000 Enclosure rear view ...

Page 42: ...tional uplinks to the vNet the switch ports connected to Virtual Connect will need to be configured for LACP and configured for the same Link Aggregation Group VC CLI commands Many of the configuration settings within VC can be also be accomplished via a CLI command set In order to connect to VC via a CLI open an SSH connection to the IP address of the active VCM Once logged in VC provides a CLI w...

Page 43: ... MAC refresh interval five seconds is the recommended interval and completes in about one minute Note Fast MAC Cache Fail over is less critical with this scenario as no uplinks are configured in standby mode all uplinks are active Configuring the VC Module for VLAN Tunneling via GUI Ethernet settings Enable Tunnel VLAN Tags within Virtual Connect On the Virtual Connect Manager screen Left pane cli...

Page 44: ...ferent VC module within each vNet both uplinks pairs will be active This configuration provides the ability to lose an uplink cable pair network switch or depending on how the NICs are configured at the server teamed or un teamed even a VC module Note Smart Link In this configuration Smartlink SHOULD be enabled Smartlink is used to turn off downlink ports within Virtual Connect if ALL available up...

Page 45: ...nk Aggregation 802 3ad LACP with VLAN Tunneling VMware ESX 45 Figure 1 35 Adding uplinks to an existing vNet vNet PROD 1 Note The Port Status and Connected to information If the connected switch supports LLDP the connected to information should be displayed as below ...

Page 46: ...nd Connected to information If the connected switch supports LLDP the connected to information should be displayed as below Figure 1 37 Link aggregation confirmed Bay 1 Note All connections within an active active LACP group will have the same LAG ID To view this go to the Interconnect bay and view Uplink Port Information If you are having troubles establishing an active active connection confirm ...

Page 47: ...1 In the Network Port 1 drop down box select vNet PROD 1 In the Network Port 2 drop down box select vNet PROD 2 In the Assign the Profile to a Server Bays select Bay 1 and apply Defining a Server Profile with NIC Connections via CLI The following command s can be copied and pasted into an SSH based CLI session with Virtual Connect Create and Assign Server Profile ESX 1 add profile ESX 1 nodefaulte...

Page 48: ...Scenario 1 3 Multiple Simple Networks Providing Redundancy and Link Aggregation 802 3ad LACP with VLAN Tunneling VMware ESX 48 Figure 1 39 Define a Server Profile ESX 1 Figure 1 40 View Bay 1 ...

Page 49: ... bandwidth is required additional uplinks could be added to each vNet If additional VLANs needed to be supported by these vNets simply configure the upstream switch ports for the new VLANs then configure the ESX vSwitch with additional port groups to support these VLANs no additional Virtual Connect configuration is required As additional servers are added to the enclosure simply create additional...

Page 50: ...iguring the ESX vSwitch for Multiple Networks VLANs If additional VLANs need to be supported simply configure the upstream switch ports for those VLANs then configure the vSwitch as below to support those additional VLANs When configuring the virtual guest edit the Network Adapter configuration and select which VLAN this guest will connect to ...

Page 51: ...tiple Simple Networks Providing Redundancy and Link Aggregation 802 3ad LACP with VLAN Tunneling VMware ESX 51 Figure 1 43 The guest Virtualization Manager s network adapter is then configured for the appropriate VLAN ...

Page 52: ...nstalled in Bays 1 2 are required In addition we will require ONE or TWO external Network switches As Virtual Connect does not appear to the network as a switch and is transparent to the network any standard managed switch will work with Virtual Connect Configuring Uplinks to a vNet LACP When all uplinks configured within a vNet connect a VC module to an upstream switch ALL links could be active p...

Page 53: ...d Windows 53 Figure 1 44 Physical View Shows two Ethernet uplinks from Ports 1 and 2 on Module 1 to Ports 1 and 2 on the first network switch and two uplinks from Ports 1 and 2 on Module 2 to Ports 1 and 2 on the second network switch Item Description 1 Switch Cross Connect 2 c7000 Enclosure rear view ...

Page 54: ...g to VC with VLAN tags When adding the additional uplinks to the SUS the switch ports connected to Virtual Connect will need to be configured for LACP and configured for the same Link Aggregation Group VC CLI commands Many of the configuration settings within VC can also be accomplished via a CLI command set In order to connect to VC via a CLI open an SSH connection to the IP address of the active...

Page 55: ...mpletes in about one minute Configuring the VC Module for Map VLAN Tags via GUI Ethernet settings Enable Map VLAN Tags within Virtual Connect On the Virtual Connect Manager screen Left pane click Ethernet Settings Advanced Settings Select Map VLAN Tags Select Fast MAC Cache Fail over with a refresh of 5 Select Apply Configuring the VC Module for Map VLAN Tags via CLI Ethernet settings The followin...

Page 56: ... teamed or untamed even a VC module However only one uplink pair will be active at a time Note Smart Link In this configuration Smartlink should NOT be enabled Smartlink is used to turn off downlink ports within Virtual Connect if ALL available uplinks to a vNet or SUS are down Defining a new Shared Uplink Set via CLI Create Shared Uplink Set VLAN Trunk 1 and configure an uplink on VC Module 1 Por...

Page 57: ...7 Define Shared Uplink Set VLAN Trunk 1 Figure 1 48 Link aggregation confirmed Bay 1 Note All connections within an active active LACP group will have the same LAG ID To view this go to the Interconnect bay and view Uplink Port Information If you are having troubles establishing an active active connection confirm the LAG ID ...

Page 58: ...tions to a single VLAN via CLI The following command s can be copied and pasted into an SSH based CLI session with Virtual Connect Create and Assign Server Profile App 1 add profile App 1 nodefaultenetconn add enet connection App 1 pxe Enabled add enet connection App 1 pxe Disabled set enet connection App 1 1 Network PROD A set enet connection App 1 2 Network PROD A assign profile App 1 enc0 1 Not...

Page 59: ...Scenario 1 4 VLAN Tagging 802 1Q with a Shared Uplink Set SUS with Link Aggregation using LACP 802 3ad Windows 59 Figure 1 50 Define a Server Profile App 1 Figure 1 51 View Bay 1 ...

Page 60: ...NICs Either NIC could be active As a result this server could access the network through either NIC or either uplink cable depending on which NIC is active at the time As additional servers are added to the enclosure simply create additional profiles configure the NICs for the appropriate network and apply them to the appropriate server bays Results The following graphic provides an example of a W...

Page 61: ...nario 1 4 VLAN Tagging 802 1Q with a Shared Uplink Set SUS with Link Aggregation using LACP 802 3ad Windows 61 Figure 1 54 Both NICs for Profile App 1are teamed and connected to the network through PROD A ...

Page 62: ...s installed in Bays 1 2 are required In addition we will require ONE or TWO external Network switches As Virtual Connect does not appear to the network as a switch and is transparent to the network any standard managed switch will work with Virtual Connect Configuring Uplinks to a vNet LACP When all uplinks configured within a vNet connect a VC module to an upstream switch ALL links could be activ...

Page 63: ... VMware ESX 63 Figure 1 55 Physical View Shows two Ethernet uplinks from Ports 1 and 2 on Module 1 to Ports 1 and 2 on the first network switch and two uplinks from Ports 1 and 2 on Module 2 to Ports 1 and 2 on the second network switch Item Description 1 Switch Cross Connect 2 c7000 Enclosure rear view ...

Page 64: ... and configured for the same Link Aggregation Group VC CLI commands Many of the configuration settings within VC can also be accomplished via a CLI command set In order to connect to VC via a CLI open an SSH connection to the IP address of the active VCM Once logged in VC provides a CLI with help menus Through this scenario the CLI commands to configure VC for each setting will also be provided Co...

Page 65: ...rnet Settings Advanced Settings Select Map VLAN Tags Select Fast MAC Cache Fail over with a refresh of 5 Select Apply Configuring the VC Module for Map VLAN Tags via CLI Ethernet settings The following command can be copied and pasted into an SSH based CLI session with Virtual Connect Set Advanced Ethernet Settings to Map VLAN Tags and Enable Fast MAC cache fail over set enet vlan vlantagcontrol m...

Page 66: ...andwidth and the ability to lose an uplink cable network switch or depending on how the NICs are configured at the server teamed or untamed even a VC module However only one uplink pair will be active at a time Note Smart Link In this configuration Smartlink should NOT be enabled Smartlink is used to turn off downlink ports within Virtual Connect if ALL available uplinks to a vNet or SUS are down ...

Page 67: ...ed to information If the connected switch supports LLDP the connected to information should be displayed as below Figure 1 59 Link aggregation confirmed Bay 1 Note All connections within an active active LACP group will have the same LAG ID To view this go to the Interconnect bay and view Uplink Port Information If you are having troubles establishing an active active connection confirm the LAG ID...

Page 68: ...ck Define Server Profile to create a Server Profile Create a server profile called App 1 In the Network Port 1 drop down box select Multiple Networks When the Server VLAN Tag to vNet Mappings popup appears configure as follows In the vNet Name drop down select PROD A and check Untagged Click Add Mapping Select PROD B Click Add Mapping Select PROD C Click Add Mapping Select PROD D Click OK In the N...

Page 69: ...tfcconn add enet connection ESX 1 pxe Enabled add enet connection ESX 1 pxe Disabled add server port map ESX 1 1 PROD A VLanId 101 Untagged True add server port map ESX 1 1 PROD B VLanId 102 add server port map ESX 1 1 PROD C VLanId 103 add server port map ESX 1 1 PROD D VLanId 104 add server port map ESX 1 2 PROD A VLanId 101 Untagged True add server port map ESX 1 2 PROD B VLanId 102 add server ...

Page 70: ...01 will be forwarded to the server NIC with the tags removed This would work well for the console NICs so that the console does not need to be configured to understand the VLAN tags It we did not un tag VLAN 101 then the ESX console would need to be configured for this VLAN Summary We created a Virtual Connect Shared Uplink Set SUS to support 4 VLANs 101 104 The SUS was created with Active and sta...

Page 71: ...NICs connected to the network Both NICs are configured to support VLANs 101 104 VLAN 101 is the default VLAN and is not tagged Port Groups are added to support each VLAN Figure 1 63 Both NICs for Profile ESX 1 are connected to the network through Multiple Networks VLANs are configured as Port Groups within the virtual switch Figure 1 64 Configuring the ESX vSwitch for Multiple Networks VLANs ...

Page 72: ...Aggregation using LACP 802 3ad VMware ESX 72 When configuring the virtual guest edit the Network Adapter configuration and select which VLAN this guest will connect to Figure 1 65 Edit the configuration of the Guest network adapter and configure it for the appropriate VLAN ...

Page 73: ... modules installed in Bays 1 2 are required In addition we will require ONE or TWO external Network switches As Virtual Connect does not appear to the network as a switch and is transparent to the network any standard managed switch will work with Virtual Connect Configuring Uplinks to a vNet LACP When all uplinks configured within a vNet connect a VC module to an upstream switch ALL links could b...

Page 74: ... 802 3ad VMware ESX 74 Figure 1 66 Physical View Shows two Ethernet uplinks from Ports 1 and 2 on Module 1 to Ports 1 and 2 on the first network switch and two uplinks from Ports 1 and 2 on Module 2 to Ports 1 and 2 on the second network switch Item Description 1 Switch Cross Connect 2 c7000 rear view ...

Page 75: ... tags When adding the additional uplinks to the SUS the switch ports connected to Virtual Connect will need to be configured for LACP and configured for the same Link Aggregation Group VC CLI commands Many of the configuration settings within VC can also be accomplished via a CLI command set In order to connect to VC via a CLI open an SSH connection to the IP address of the active VCM Once logged ...

Page 76: ...y This transmission sequence repeats a few times at the MAC refresh interval five seconds is the recommended interval and completes in about one minute Configuring the VC Module for Map VLAN Tags via GUI Ethernet settings Enable Map VLAN Tags within Virtual Connect On the Virtual Connect Manager screen Left pane click Ethernet Settings Advanced Settings Select Map VLAN Tags Select Fast MAC Cache F...

Page 77: ...Add Port then add the following ports a Enclosure 1 Bay 2 Port 1 b Enclosure 1 Bay 2 Port 2 Add Networks as follows a PROD A 2 VLAN ID 101 b PROD B 2 VLAN ID 102 c PROD C 2 VLAN ID 103 d PROD D 2 VLAN ID 104 Enable Smart Link for All networks Leave Connection Mode as Auto Note By creating a SUS we have provided the ability to present one or many VLANs to a server NIC As two uplinks are configure f...

Page 78: ...d network PROD C 1 uplinkset VLAN Trunk 1 VLanID 103 Set Network PROD C 1 SmartLink Enabled add network PROD D 1 uplinkset VLAN Trunk 1 VLanID 104 Set Network PROD D 1 SmartLink Enabled Create Shared Uplink Set VLAN Trunk 2 and configure an uplink on VC Module 2 Ports 1 and 2 add uplinkset VLAN Trunk 2 add uplinkport enc0 2 1 Uplinkset VLAN Trunk 2 speed auto add uplinkport enc0 2 2 Uplinkset VLAN...

Page 79: ...gure 1 69 Define Shared Uplink Set VLAN Trunk 1 Note The Port Status and Connected to information If the connected switch supports LLDP the connected to information should be displayed as below Note Smart Link is enabled if ALL uplinks to this SUS fail then server downlinks will be turned off initiating a NIC teaming fail over ...

Page 80: ...gure 1 70 Define Shared Uplink Set VLAN Trunk 2 Note The Port Status and Connected to information If the connected switch supports LLDP the connected to information should be displayed as below Note Smart Link is enabled if ALL uplinks to this SUS fail then server downlinks will be turned off initiating a NIC teaming fail over ...

Page 81: ...ure 1 71 Link aggregation confirmed Bay 1 Note All connections within an active active LACP group will have the same LAG ID To view this go to the Interconnect bay and view Uplink Port Information If you are having troubles establishing an active active connection confirm the LAG ID Figure 1 72 Link aggregation confirmed Bay 2 ...

Page 82: ...llows In the vNet Name drop down select PROD A 2 and check Untagged Click Add Mapping Select PROD B 2 Click Add Mapping Select PROD C 2 Click Add Mapping Select PROD D 2 Click OK In the Assign the Profile to a Server Bays select Bay 1 and apply Defining a Server Profile with NICs Connections to Multiple VLANs via CLI The following command s can be copied and pasted into an SSH based CLI session wi...

Page 83: ...tion using LACP 802 3ad VMware ESX 83 Figure 1 73 Server Profile ESX 1 with Multiple Networks configured Figure 1 74 Configuring NIC Port 1 with Multiple Networks PROD A 1 is not tagged Note that both NICs are configured with the same settings below except NIC 2 is connected to PROD x 2 ...

Page 84: ...the tags removed This would work well for the console NICs so that the console does not need to be configured to understand the VLAN tags It we did not un tag VLAN 101 then the ESX console would need to be configured for this VLAN Summary We created a Virtual Connect Shared Uplink Set SUS to support 4 VLANs 101 104 The SUS was created with Active and standby uplinks to provide both additional band...

Page 85: ... an example of an ESX Server with TWO NICs connected to the network Both NICs are configured to support VLANs 101 104 VLAN 101 is the default VLAN and is not tagged Port Groups are added to support each VLAN Figure 1 76 Both NICs for Profile ESX 1are connected to the network through Multiple Networks VLANs are configured as Port Groups within the virtual switch ...

Page 86: ...link Sets SUS and Link Aggregation using LACP 802 3ad VMware ESX 86 Figure 1 77 Configuring the ESX vSwitch for Multiple Networks VLANs When configuring the virtual guest edit the Network Adapter configuration and select which VLAN this guest will connect to ...

Page 87: ...LAN Tagging 802 1Q with Multiple Shared Uplink Sets SUS and Link Aggregation using LACP 802 3ad VMware ESX 87 Figure 1 78 Edit the configuration of the Guest network adapter and configure it for the appropriate VLAN ...

Page 88: ...etwork to a single port on each VC module No special upstream switch configuration is required as the switch is in the factory default configuration Requirements In order to implement this scenario an HP BladeSystem c7000 enclosure with one of more server blades and TWO Virtual Connect Ethernet modules installed in Bays 1 2 are required In addition we will require ONE or TWO external Network switc...

Page 89: ... Physical View Shows a single Ethernet uplink from Port 1 on Module 1 to Port 1 on the first network switch and a single uplink from Port 1 on Module 2 to Port 1 on the second network switch Item Description 1 Switch Cross Connect 2 C7000 Enclosure rear view ...

Page 90: ...e appendices assumes the following information The switch ports are configured as ACCESS ports either presenting the Default VLAN or a specific VLAN and will for forwarding untagged frames VC CLI commands Many of the configuration settings within VC can also be accomplished via a CLI command set In order to connect to VC via a CLI open an SSH connection to the IP address of the active VCM Once log...

Page 91: ... enables the external Ethernet switches to identify the new connection and update their MAC caches appropriately This transmission sequence repeats a few times at the MAC refresh interval five seconds is the recommended interval and completes in about one minute Configuring the VC Module Ethernet settings Private Networks is supported on both Tunnel VLAN tags AND Map VLAN tags so either setting co...

Page 92: ...nd the second will be in Standby This configuration provides the ability to lose an uplink cable network switch or depending on how the NICs are configured at the server teamed or un teamed even a VC module Note Smart Link In this configuration Smartlink should NOT be enabled Smartlink is used to turn if downlink ports within Virtual Connect if ALL available uplinks to a vNet or SUS are down Defin...

Page 93: ... the Assign the Profile to a Server Bays select Bay 1 and apply On the Virtual Connect Manager screen click Define Server Profile to create a Server Profile Create a server profile called Web 2 In the Network Port 1 drop down box select vNet PROD In the Network Port 2 drop down box select vNet PROD In the Assign the Profile to a Server Bays select Bay 2 and apply On the Virtual Connect Manager scr...

Page 94: ...efaultenetconn add enet connection Web 1 pxe Enabled Network vNet PROD add enet connection Web 1 pxe Disabled Network vNet PROD assign profile Web 1 enc0 1 add profile Web 2 nodefaultenetconn add enet connection Web 2 pxe Enabled Network vNet PROD add enet connection Web 2 pxe Disabled Network vNet PROD assign profile Web 2 enc0 2 add profile Web 3 nodefaultenetconn add enet connection Web 3 pxe E...

Page 95: ... NICs connected to the vNet PROD network Even though these servers are connect to the same vNet as the Private VLANs check box is enabled on this network these servers will not be able to talk directly to each other within this VC Network To do so an external router would be required Results The following graphic provides an example of a Windows 2003 server with TWO NICs connected to the network e...

Page 96: ...Scenario 1 7 Private Networks Simple vNet 96 Figure 1 85 Both NICs for Profile Web 1are connected to the network through vNet PROD ...

Page 97: ...nected to the network One NIC will be active in the event of an Uplink switch or VC module failure the teaming software will fail the NIC over to the alternate path if required Figure 1 86 Team both NICs using the HP Network Configuration Utility Figure 1 87 Both NICs for Profile Web 1are teamed and connected to the network through vNet PROD ...

Page 98: ...to as many as four 4 independent configurable physical NICs per port These NICs can be configured at speeds of between 100Mb and 10Gb providing the ability to tune bandwidth to the specific need such as management VMotion or production networks With current technology all networks would be provided with the same 1Gb speed and would require independent discrete NICs With Flex 10 we can now provide ...

Page 99: ...Chapter 2 Flex 10 Scenario 99 Item Description 1 Half Height BladeSystem Server 2 VC Ethernet Modules ...

Page 100: ...VLAN Non VLAN traffic untouched to the host Tunneling Mode or Virtual Connect can handle all VLAN tagging Server Mapped VLANs Each has their advantages as discussed in the Introduction to Virtual Connect section earlier in this document This scenario using Map VLAN Tags will focus more on the Virtual Connect Flex 10 technology In this scenario we have two10Gb uplinks configured with multiple VLANs...

Page 101: ...Ns Windows 2003 2008 101 Figure 2 2 Physical View Shows one 10Gb Ethernet uplink from Ports 1 on Module 1 to Port 1 on the first network switch and one 10Gb uplink from Port 1 on Module 2 to Port 1 on the second network switch Item Description 1 Switch Cross Connect 2 c7000 Enclosure rear view ...

Page 102: ...tch ports are configured as TRUNK ports to support VLANs 101 102 103 and 104 All frames will be forwarding to VC with VLAN tags Note when adding the additional uplinks to the SUS the switch ports connected to Virtual Connect will need to be configured for LACP and configured for the same Link Aggregation Group VC CLI commands Many of the configuration settings within VC can also be accomplished vi...

Page 103: ...dvanced Settings Select Map VLAN Tags Select Fast MAC Cache Fail over with a refresh of 5 Optionally select a preferred Maximum link speed Select Apply Configuring the VC Module for Map VLAN Tags via CLI Ethernet settings The following command s can be copied and pasted into an SSH based CLI session with Virtual Connect Set Advanced Ethernet Settings to Map VLAN Tags and set Force server connectio...

Page 104: ...ay 1 Port X1 Add Networks as follows a PROD A 1 VLAN ID 101 b PROD B 1 VLAN ID 102 c PROD C 1 VLAN ID 103 d PROD D 1 VLAN ID 104 Enable SmartLink on ALL networks Click Apply Defining a new Shared Uplink Set VLAN Trunk 2 Connect Port X1 of VC module 2 to Port 1 on switch 2 Create a SUS named VLAN Trunk 2 and connect it to Flex 10 Port X1 on Module 2 On the Virtual Connect Home page select Define Sh...

Page 105: ...s add uplinkset VLAN Trunk 2 add uplinkport enc0 2 X1 Uplinkset VLAN Trunk 2 speed auto Create Networks Prod A 2 through Prod D 2 for Shared Uplink Set VLAN Trunk 2 add network PROD A 2 uplinkset VLAN Trunk 2 VLanID 101 Set Network PROD A 2 SmartLink Enabled add network PROD B 2 uplinkset VLAN Trunk 2 VLanID 102 Set Network PROD B 2 SmartLink Enabled add network PROD C 2 uplinkset VLAN Trunk 2 VLa...

Page 106: ... and add VLANs Note The Connected to field in the graphic above displays the MAC address and port number of the switch this uplink is connected to This information is provided through LLDP discover and is not available in all switch products This information can be very helpful when determining which switches and ports VC is connected to Figure 2 6 Active Active SUS ...

Page 107: ...posite VC module which provides the ability to create an Active Active uplink scenario Alternatively we could have created a single SUS and assigned both of these uplink ports to the same SUS however this would have provided an Active Standby uplink scenario example below Figure 2 8 Example of an Active Standby SUS Defining a Server Profile We will create a server profile with two server NICs Each...

Page 108: ...ltenetconn nodefaultfcconn add enet connection Server 1 pxe Enabled Network PROD A 1 add enet connection Server 1 pxe Disabled Network PROD A 2 assign profile Server 1 enc0 1 Figure 2 9 Define a Server Profile Server NIC Speed and LOM Mappings What has been shown and discussed to this point is standard Virtual Connect functionality We will now focus more of the specific Flex 10 features Note the A...

Page 109: ...and LOM Mappings Summary This profile will present Network Port 1 to PROD A 1 which is configured on VC Flex 10 module 1 and Network Port 1 with Network Port 2 to PROD A 2 which is configured on VC Flex 10 module 2 Both PROD A 1 and PROD A 2 are configured to support VLAN 101 so these two NICs are connected to the same VLAN but taking a different path out of the enclosure These two NICs could now ...

Page 110: ...n VC will appear with a red x as not connected You can go into Network Connections for the Windows 2003 server and Disable any NICs that are not currently in use Windows assigns the NICs as NIC 1 8 whereas four of the NICs will reside on LOM 1 and four on LOM 2 You may need to refer to the VC server profile for the NIC MAC addresses to verify which NIC is which Figure 2 12 Windows 2003 Extra Netwo...

Page 111: ...gure 2 13 Windows 2003 Network Connections 2 Connections Note In windows 2003 the NIC speeds may not be shown accurately when speeds are configured in 100MB increments above 1Gb IE if a NIC is configured for 2 5Gb within Flex 10 it will be displayed in Windows 2003 as a 2Gb NIC Windows 2008 does not have this limitation ...

Page 112: ...ctually configured and in use Windows 2008 Networking Configuration Example The following graphics show a Windows 2008 server with TWO Flex 10 NICs configured as single NICs at FULL 10Gb speed You will also notice that he server currently believes there are 8 NICs within this server However only TWO NICs are currently configured within Virtual Connect Flex 10 Figure 2 15 Windows 2008 Network Conne...

Page 113: ...Network Connections for the Windows 2008 server and Disable any NICs that are not currently in use Windows assigns the NICs as NIC 1 8 whereas four of the NICs will reside on LOM 1 and four on LOM 2 You may need to refer to the VC server profile for the NIC MAC addresses to verify which NIC is which Figure 2 16 Windows 2008 Extra Network Connections Disabled Figure 2 17 Windows 2003 Network Connec...

Page 114: ...ng In this example we have only TWO NICs available so selecting NICs for teaming will be quite simple However if multiple NICs are available ensure that the correct pair of NICs is teamed You will note the BAY Port indication within each NIC You would typically TEAM a NIC from Bay 1 to Bay 2 for example NIC teaming functions the same in both Windows 2003 and Windows 2008 The graphics below are fro...

Page 115: ...2 1 Flex 10 VLAN Tagging 802 1Q with Multiple Shared Uplink Sets SUS and Mapped VLANs Windows 2003 2008 115 Figure 2 19 View Network Connections NIC Team 1 Figure 2 20 View Network Connections NIC Team 1 Windows ...

Page 116: ...e of the specific Flex 10 features by providing additional NICs to the Windows server without adding additional server hardware The server must be powered off in order to add NICs to the profile however editing of the profile changing network connections link speed etc can be done with the server running Figure 2 21 Server Blade profile was initially configured with only TWO NICs We have now added...

Page 117: ...ed the speeds accordingly Scroll to the bottom of the profile Click Apply If the server is off power it back on the view the server from the iLO or OA consoles and not the additional NICs Defining a Server Profile via CLI The following command s can be copied and pasted into an SSH based CLI session with Virtual Connect Provision and configure TWO additional NICs for Profile Server 1 Set speed to ...

Page 118: ...o 2 1 Flex 10 VLAN Tagging 802 1Q with Multiple Shared Uplink Sets SUS and Mapped VLANs Windows 2003 2008 118 Figure 2 22 Setting the Network connection Port Speed Figure 2 23 Server NIC speed and LOM Mappings ...

Page 119: ...dditional NICs could be configured for specific link speeds between 100Mb and 10Gb per NIC When the blade occupying enclosure Bay 1 is powered up it will have 4 physical NICs connected to networks PROD A 1 PROD A 2 PROD B 1 and PROD B 2 If additional NICs are required simply go to the Virtual Connect profile and add the required number of NICs configure them for the appropriate networks speed and ...

Page 120: ...plink Sets SUS and Mapped VLANs Windows 2003 2008 120 Figure 2 25 Windows 2003 Network Connections NIC Speed Note Even though the Profile is set to 2 5Gb and 7 5Gb respectively Windows 2003 does not display values correctly Windows 2008 displays the correct values ...

Page 121: ...Multiple Shared Uplink Sets SUS and Mapped VLANs Windows 2003 2008 121 Figure 2 26 Windows 2008 Network Connections 4 Active Connections Figure 2 27 Windows 2008 Network Connections NIC Speed Note Windows 2008 displays the correct link speed values ...

Page 122: ...ess can be handled in two different ways Virtual Connect can either pass VLAN Non VLAN traffic untouched to the host Tunneling Mode or Virtual Connect can handle all VLAN tagging Server Mapped VLANs Each has their advantages as discussed in the Introduction to Virtual Connect section earlier in this document This scenario using Map VLAN Tags will focus on the Virtual Connect Flex 10 technology In ...

Page 123: ...n Bays 1 2 are required In addition we will require ONE or TWO external Network switches As Virtual Connect does not appear to the network as a switch and is transparent to the network any standard managed switch will work with Virtual Connect Figure 2 28 Physical View Shows one 10Gb Ethernet uplink from Ports 1 on Module 1 to Port 1 on the first network switch and one 10Gb uplink from Port 1 on M...

Page 124: ...d to configure the switch in either a Cisco IOS or a ProCurve network infrastructure The configuration information provided in the appendices assumes the following information The switch ports are configured as TRUNK ports to support VLANs 101 102 103 104 and 105 All frames will be forwarding to VC with VLAN tags Note when adding the additional uplinks to the SUS the switch ports connected to Virt...

Page 125: ...igurable speed of a NIC Enable Map VLAN Tags within Virtual Connect On the Virtual Connect Manager screen Left pane click Ethernet Settings Advanced Settings Select Map VLAN Tags Select Fast MAC Cache Fail over with a refresh of 5 Optionally select a preferred Maximum link speed Select Apply Configuring the VC Module for Map VLAN Tags via CLI Ethernet settings The following command s can be copied...

Page 126: ...Enclosure 1 Bay 1 Port X1 Add Networks as follows a PROD A 1 VLAN ID 101 b PROD B 1 VLAN ID 102 c PROD C 1 VLAN ID 103 d PROD D 1 VLAN ID 104 e PROD E 1 VLAN ID 105 Enable Smartlink on ALL Networks Click Apply Defining a new Shared Uplink Set VLAN Trunk 2 Connect Port X1 of VC module 2 to Port 1 on switch 2 Create a SUS named VLAN Trunk 2 and connect it to Flex 10 Port X1 on Module 2 On the Virtua...

Page 127: ...eate the Second Shared Uplink Set VLAN Trunk 2 Create Shared Uplink Set VLAN Trunk 2 and configure uplinks add uplinkset VLAN Trunk 2 add uplinkport enc0 2 X1 Uplinkset VLAN Trunk 2 speed auto Create Networks Prod A 2 through Prod D 2 for Shared Uplink Set VLAN Trunk 2 add network PROD A 2 uplinkset VLAN Trunk 2 VLanID 101 Set Network PROD A 2 SmartLink Enabled add network PROD B 2 uplinkset VLAN ...

Page 128: ...module is plugged in Ports X7 or X8 Figure 2 31 Define a Shared Uplink Set VLAN Trunk 1 and add VLANs Note The Connected to field in the graphic above displays the MAC address and port number of the switch this uplink is connected to This information is provided through LLDP discover and is not available in all switch products This information can be very helpful when determining which switches an...

Page 129: ...e Standby SUS Defining a Server Profile We will create a server profile with two server NICs Each server NIC will connect to a specific network On the main menu select Define then Server Profile Create a server profile called Server 1 In the Network Port 1 drop down box select PROD A 1 configure the speed as custom at 2 5Gb In the Network Port 2 drop down box select PROD A 2 configure the speed as...

Page 130: ...ver 1 pxe Disabled Network PROD A 2 SpeedType Custom Speed 2500 add enet connection Server 1 pxe Disabled add server port map Server 1 3 PROD C 1 VLanId 102 add server port map Server 1 3 PROD C 1 VLanId 103 add server port map Server 1 3 PROD D 1 VLanId 104 add server port map Server 1 3 PROD E 1 VLanId 105 add enet connection Server 1 pxe Disabled add server port map Server 1 4 PROD C 2 VLanId 1...

Page 131: ...ned to Prod 101 1 no other NIC on LOM 1 can be assigned to Prod 101 1 This is discussed in further details in the Flex 10 technology brief mentioned earlier in this document As additional NICs are added to a profile that is assigned to a server with a 10Gb Flex NIC the assignment will alternate between LOM 1 x and LOM 2 x The first NIC will be LOM 1 a the second will be LOM 2 a then LOM 1 b LOM 2 ...

Page 132: ...Scenario 2 2 Flex 10 VLAN Tagging 802 1Q with Multiple Shared Uplink Sets SUS and Mapped VLANs Windows 2008 Hyper V 132 Figure 2 35 Adjusting the NIC speed Figure 2 36 Configuring Multiple Networks ...

Page 133: ... note that the Hyper V role should be installed BEFORE the HP ProLiant Network teaming Software is installed Result The following graphics provide an example of a Windows 2008R2 server with 4 NICs configured and connected to the VC Networks as discussed earlier The Disabled network connections are the 4 remaining and un configured FlexNICs This configuration has provided us with 4 NICs total Two o...

Page 134: ...iple Shared Uplink Sets SUS and Mapped VLANs Windows 2008 Hyper V 134 Figure 2 37 Windows 2008 Network Connections 4 Active Connections Figure 2 38 Windows 2008R2 Network Connections NIC Speed Note Windows 2008R2 displays the correct link speed values ...

Page 135: ...g Software and run the utility Notice the NIC Names that were set earlier You can also highlight each NIC and select properties to verify the MAC address of the NIC before creating the team Configuring NIC teaming To create the NIC team for the Management network Select NIC 1 and NIC 2 click TEAM Click on the TEAM name and rename it to Management then save the TEAM Click on the remaining two NICs ...

Page 136: ...roLiant Network Configuration Utility with both teams created Creating the VLANs within NIC Teaming Highlight the Production NIC team and click the VLAN 802 1Q button on the right and create a VLAN for each VLAN that this NIC team will support Figure 2 42 HP ProLiant Network Configuration Utility VLAN configurations for Production Team ...

Page 137: ... V 137 Creating the Hyper V Virtual Network Run the Hyper V Manager open the Virtual Network Manager and create a new External Virtual Network for each VLAN that was created within the NIC team enable the VLAN ID check box and enter the VLAN ID for this VLAN Click Apply Figure 2 43 Hyper V Virtual Network Manager ...

Page 138: ...tification and enter the appropriate VLAN ID for this system and apply the settings Figure 2 44 Configure Virtualization Manager network settings Once this Virtualization Manager is powered on the management NIC team would be connected to the management network through NIC 1 2 The Production VLANs network will present the Virtualization Manager with a connection that the VLAN as configured Frames ...

Page 139: ...nk Sets SUS and Mapped VLANs Windows 2008 Hyper V 139 Verify that the Guest is connected to the correct VLAN Open a console to the Virtualization Manager and verify that it is in the correct VLAN Figure 2 45 Verify guest VM received an IP address for the correct VLAN ...

Page 140: ...ent ways Virtual Connect can either pass VLAN Non VLAN traffic untouched to the host Tunneling Mode or Virtual Connect can handle all VLAN tagging Server Mapped VLANs Each has their advantages as discussed in the Introduction to Virtual Connect section earlier in this document This scenario using Map VLAN Tags will focus more on the Virtual Connect Flex 10 technology In this scenario we have two10...

Page 141: ... 2 are required In addition we will require ONE or TWO external Network switches As Virtual Connect does not appear to the network as a switch and is transparent to the network any standard managed switch will work with Virtual Connect Figure 2 46 Physical View Shows one 10Gb Ethernet uplink from Ports 1 on Module 1 to Port 1 on the first network switch and one 10Gb uplink from Port 1 on Module 2 ...

Page 142: ...1 102 103 104 and 105 All frames will be forwarding to VC with VLAN tags When adding the additional uplinks to the SUS the switch ports connected to Virtual Connect will need to be configured for LACP and configured for the same Link Aggregation Group VC CLI commands Many of the configuration settings within VC can also be accomplished via a CLI command set In order to connect to VC via a CLI open...

Page 143: ... Maximum link speed Select Apply Configuring the VC Module for Map VLAN Tags via CLI Ethernet settings The following command s can be copied and pasted into an SSH based CLI session with Virtual Connect Set Advanced Ethernet Settings to Map VLAN Tags and set Force server connections to disabled set enet vlan vlantagcontrol map sharedservervlanid false set mac cache Enabled True Refresh 5 Note Do n...

Page 144: ... A 1 VLAN ID 101 b PROD B 1 VLAN ID 102 c PROD C 1 VLAN ID 103 d PROD D 1 VLAN ID 104 e PROD E 1 VLAN ID 105 Enable SmartLink on ALL Networks Click Apply Defining a new Shared Uplink Set VLAN Trunk 2 Connect Port X1 of VC module 2 to Port 1 on switch 2 Create a SUS named VLAN Trunk 2 and connect it to Flex 10 port X1 on Module 2 On the Virtual Connect Home page select Define Shared Uplink Set Inse...

Page 145: ...port enc0 2 X1 Uplinkset VLAN Trunk 2 speed auto Create Networks Prod A 2 through Prod D 2 for Shared Uplink Set VLAN Trunk 2 add network PROD A 2 uplinkset VLAN Trunk 2 VLanID 101 Set Network PROD A 2 SmartLink Enabled add network PROD B 2 uplinkset VLAN Trunk 2 VLanID 102 Set Network PROD B 2 SmartLink Enabled add network PROD C 2 uplinkset VLAN Trunk 2 VLanID 103 Set Network PROD C 2 SmartLink ...

Page 146: ...Connected to field in the graphic above displays the MAC address and port number of the switch this uplink is connected to This information is provided through LLDP discover and is not available in all switch products This information can be very helpful when determining which switches and ports VC is connected to ...

Page 147: ...NIC will connect to a specific network On the main menu select Define then Server Profile Create a server profile called Server 1 In the Network Port 1 drop down box select PROD A 1 configure the speed as custom at 500Mb In the Network Port 2 drop down box select PROD A 2 configure the speed as custom at 500Mb In the Network Port 3 drop down box select PROD B 1 configure the speed as custom at 2 5...

Page 148: ...pe Custom Speed 500 add enet connection Server 1 pxe Disabled Network PROD B 1 SpeedType Custom Speed 2500 add enet connection Server 1 pxe Disabled Network PROD B 2 SpeedType Custom Speed 2500 add enet connection Server 1 pxe Disabled add server port map Server 1 5 PROD C 1 VLanId 103 add server port map Server 1 5 PROD D 1 VLanId 104 add server port map Server 1 5 PROD E 1 VLanId 105 add enet co...

Page 149: ...Prod 101 1 no other NIC on LOM 1 can be assigned to Prod 101 1 This is discussed in further details in the Flex 10 technology brief mentioned earlier in this document As additional NICs are added to a profile that is assigned to a server with a 10Gb Flex NIC the assignment will alternate between LOM 1 x and LOM 2 x The first NIC will be LOM 1 a the second will be LOM 2 a then LOM 1 b LOM 2 b etc t...

Page 150: ...Scenario 2 3 Flex 10 VLAN Tagging 802 1Q with Multiple Shared Uplink Sets SUS and Mapped VLANs ESX 4 150 Figure 2 54 Adjusting the NIC speed Figure 2 55 Configuring Multiple Networks ...

Page 151: ... or down Result VMware ESX Configuration Example The following graphics show an ESX server with two Flex 10 NICs configured as 6 NICs NICs speeds are also configured accordingly and connected to vSwitches with port groups to present the VLANs accordingly When configuring the vSwitches for ESX you will notice that 8 NICs actually already exist however NICs 7 8 vmnic6 vmnic7 are shown as down as the...

Page 152: ... Multiple Shared Uplink Sets SUS and Mapped VLANs ESX 4 152 ESX 4 Networking Configuration Example The following graphics show an ESX 4 server with two Flex 10 NICs configured as six NICs Figure 2 57 vSwitch Configuration the ESX Host with 6 NICs ...

Page 153: ... ESX vSwitch for Multiple Networks VLANs Note That vSwitch2 has two NICs configured to redundantly support VLANs 103 104 and 105 Note If implementing ESX 3 5 on Flex 10 first review VMWARE KB 1007982 and ensure Network Failure Detection is set to Beacon Probing When configuring the guest NIC simply chose which VLAN this guest will reside on Note If implementing ESX 4 0 on Flex 10 ensure that ESX d...

Page 154: ...Scenario 2 3 Flex 10 VLAN Tagging 802 1Q with Multiple Shared Uplink Sets SUS and Mapped VLANs ESX 4 154 Figure 2 59 Selection of the Virtual Network VLAN as required ...

Page 155: ... pass VLAN Non VLAN traffic untouched to the host Tunneling Mode or Virtual Connect can handle all VLAN tagging Server Mapped VLANs Each has their advantages as discussed in the Introduction to Virtual Connect section earlier in this document This scenario using Tunneled VLAN Tags will focus on how Virtual Connect can be sued to manage hundreds of VLANs In this scenario we have two10Gb uplinks con...

Page 156: ...1 2 are required In addition we will require ONE or TWO external Network switches As Virtual Connect does not appear to the network as a switch and is transparent to the network any standard managed switch will work with Virtual Connect Figure 2 60 Physical View Shows one 10Gb Ethernet uplink from Ports 1 on Module 1 to Port 1 on the first network switch and one 10Gb uplink from Port 1 on Module 2...

Page 157: ...nformation provided in the appendices assumes the following information The switch ports are configured as TRUNK ports Part1 of each network switch is configured to support VLANs 101 102 and 103 Port 2 of each network switch is configured to support VLANs 2000 through 3000 All frames will be forwarding to VC with VLAN tags If adding additional uplinks to the SUS or vnet the switch ports connected ...

Page 158: ...um configurable speed of a NIC Enable Tunnel VLAN Tags within Virtual Connect On the Virtual Connect Manager screen Left pane click Ethernet Settings Advanced Settings Select Tunnel VLAN Tags Select Fast MAC Cache Fail over with a refresh of 5 Optionally select a preferred Maximum link speed Select Apply Configuring the VC Module for VLAN Tunneling via CLI Ethernet settings The following command c...

Page 159: ...ink Set Name as VLAN Trunk 1 Select Add Port then add the following port a Enclosure 1 Bay 1 Port X1 Add Networks as follows a PROD A 1 VLAN ID 101 b PROD B 1 VLAN ID 102 c PROD C 1 VLAN ID 103 Enable SmartLink on ALL Networks Click Apply Defining a new Shared Uplink Set VLAN Trunk 2 Connect Port X1 of VC module 2 to Port 1 on switch 2 Create a SUS named VLAN Trunk 2 and connect it to Flex 10 Port...

Page 160: ...Network to create a vNet Enter the Network Name of VLAN Many 2 a Select Smart Link b Select Enable VLAN Tunneling Select Add Port then add the following ports a Enclosure 1 Bay 2 Port X2 Leave Connection Mode as Auto Select Apply Note By creating TWO vNets we have provided a redundant path to the network As each uplink originates from a different VC module within each vNet both uplinks will be act...

Page 161: ...rtLink Enabled add network PROD B 2 uplinkset VLAN Trunk 2 VLanID 102 Set Network PROD B 2 SmartLink Enabled add network PROD C 2 uplinkset VLAN Trunk 2 VLanID 103 Set Network PROD C 2 SmartLink Enabled Defining a new vNet via CLI The following command s can be copied and pasted into an SSH based CLI session with Virtual Connect Create the vNet VLAN Many and configure uplinks as discussed above ad...

Page 162: ...add VLANs Note The Connected to field in the graphic above displays the MAC address and port number of the switch this uplink is connected to This information is provided through LLDP discover and is not available in all switch products This information can be very helpful when determining which switches and ports VC is connected to Figure 2 64 Active Active SUS ...

Page 163: ...ctions out of VC When we create the server profiles you will see how the NICs will connect to VLANs accessed through the opposite VC module which provides the ability to create an Active Active uplink scenario Alternatively we could have created a single SUS and assigned both of these uplink ports to the same SUS however this would have provided an Active Standby uplink scenario Figure 2 65 Exampl...

Page 164: ... VNET Many 2 configure the speed as custom at 3 9Gb In the Assign Profile to Server Bay box locate the Select Location drop down and select Bay 1 then apply Note you should now have a server profile assigned to Bay 1 with 8 Server NICs connected to the various networks Defining a Server Profile via CLI The following command s can be copied and pasted into an SSH based CLI session with Virtual Conn...

Page 165: ... 102 NICs 5 6 are connected to PROD C 1 PROD C 2 iSCSI or NFS Network which are mapped to VLAN 103 Note Frames for VLANs 101 through 103 will be passed to the server NICs untagged so the host will not be required to interpret the VLAN tag NICs 7 8 are connected to VLAN Many 1 VLAN Many 2 Product VLANs which are mapped to VLANs 2000 through 3000 Note Frames for VLANs 2000 through 3000 will be passe...

Page 166: ... graphics show an ESX server with two Flex 10 NICs configured as 8 NICs NICs speeds are also configured accordingly and connected to vSwitches with port groups to present the VLANs accordingly When configuring the vSwitches for ESX you will notice that 8 NICs actually already exist as per the Virtual Connect server Profile Figure 2 68 Configuring ESX 4 vSwitch ...

Page 167: ...Multiple Shared Uplink Sets SUS and Tunneled VLANs ESX 4 167 ESX 4 Networking Configuration Example The following graphics show an ESX 4 server with two Flex 10 NICs configured as six NICs Figure 2 69 vSwitch Configuration the ESX Host with 8 NICs ...

Page 168: ... ESX vSwitch for Multiple Networks VLANs Note That vSwitch 3 has two NICs configured to redundantly support VLANs 103 104 and 105 Note If implementing ESX 3 5 on Flex 10 first review VMWARE KB 1007982 and ensure Network Failure Detection is set to Beacon Probing Note If implementing ESX 4 0 on Flex 10 ensure that ESX driver version 1 52 is installed also ensure that NIC firmware 5 2 7 is also inst...

Page 169: ...Scenario 2 4 Flex 10 VLAN Tagging 802 1Q with Multiple Shared Uplink Sets SUS and Tunneled VLANs ESX 4 169 Figure 2 71 Selection of the Virtual Network VLAN as required ...

Page 170: ...nect stacked domain configuration The initial scenarios will each enclosure will have TWO Virtual Connect Ethernet VC F modules and a half height BladeSystem server The server will connect to the Virtual Connect models with two 1Gb NICs NIC 1 will connect to the VC module in Bay 1 and NIC 2 will connect to the VC module in Bay 2 Enclosure 1 is externally connected to enclosure two using 10Gb CX 4 ...

Page 171: ...a vNet from multiple VC modules those uplinks would connect from different Virtual Connect modules within the enclosure stack and could then connect to the same upstream switch or two different upstream switches depending on your redundancy needs An alternative would be to configure TWO separate vNets each with a set of uplinks configured Each option has its advantages and disadvantages This scena...

Page 172: ... 2 in Enclosure 2 to Ports 1 and 2 on the second network switch Item Description 1 Switch Cross Connect 2 1Gb uplinks 10Gb Uplinks could also be used 3 Enclosure 1 rear view 4 Enclosure 2 rear view Figure 3 2 Logical View Shows TWO Ethernet uplinks from Ports 1 and 2 on Module 1 in Enclosure 1 to Ports 1 and 2 on the first network switch and TWO uplinks from Ports 1 and 2 on Module 2 in Enclosure ...

Page 173: ...et In order to connect to VC via a CLI open an SSH connection to the IP address of the active VCM Once logged in VC provides a CLI with help menus Throughout this scenario the CLI commands to configure VC for each setting will also be provided Configuring the VC module Physically connect Port 1 of Network switch 1 to Port 1 on the VC module in Bay 1 Physically connect Port 1 of the second Network ...

Page 174: ...l HP BladeSystem c7000 enclosures can be imported The enclosures being imported must have no Virtual Connect domain configured and should be considered as bare metal However the Onboard Administrator OA must be configured and the VC modules within the enclosure must have TCP IP addresses configured To import the second enclosure Login to the existing Virtual Connect domain of the first enclosure a...

Page 175: ...enclosure 10 0 0 50 UserName Administrator Password password Note Type YES when prompted Note the IP Address User name and password is for the OA of the enclosure being imported The Double Dense statement is can be sued if BL2x220c Double Dense Blades are used IE Import enclosure 10 0 0 50 UserName Administrator Password password DoubleDense Enable Figure 3 4 Importing an enclosure into an existin...

Page 176: ...cenario 3 1 Multi Enclosure stacking with Multiple Simple vNets Redundant Uplinks and LACP 2 Enclosures 176 Figure 3 6 The figure below shows importing the enclosure Figure 3 7 The enclosure is imported ...

Page 177: ...et Enter the Network Name of vNet PROD 1 a Note select Smart Link but do not select Private Networks Select Add Port then add the following ports a Enclosure 1 Bay 1 Port 1 b Enclosure 1 Bay 1 Port 2 Leave Connection Mode as Auto Select Apply Create a vNet and name it vNet PROD 2 Enter the Network Name of vNet PROD 1 a Note select Smart Link but do not select Private Networks Select Add Port then ...

Page 178: ... are configured at the server teamed or un teamed even a VC module Defining a new vNet via CLI The following command s can be copied and pasted into an SSH based CLI session with Virtual Connect Create the vNet vNet PROD 1 and configure uplinks as discussed above add Network vNet PROD 1 add uplinkport enc0 1 1 Network vNet PROD 1 speed auto add uplinkport enc0 1 2 Network vNet PROD 1 speed auto se...

Page 179: ...ic network On the Virtual Connect Manager screen click Define Server Profile to create a Server Profile Create a server profile called App 1 In the Network Port 1 drop down box select vNet PROD In the Network Port 2 drop down box select vNet PROD In the Assign the Profile to a Server Bay select Bay 1 and apply Defining a Server Profile with NIC Connections via CLI The following command s can be co...

Page 180: ...t any network loops When VC profile App 1 is applied to the server in bay1 and is powered up it has one NIC through each module connected to vNet PROD which connects to the network infrastructure through the 1Gb uplinks These NICs could now be configured as individual NICs figure 1 8 with their own IP address or as a pair of TEAMED NICs figure 1 9 Either NIC could be active As a result this server...

Page 181: ...both NICs could be actively working on the network Figure 3 12 Both NICs for Profile App 1are connected to the network through vNet PROD The following graphics provide an example of a Windows 2003 server with TWO NICs teamed and connected to the network One NIC will be active while the other is in standby In the event of an Uplink or switch failure VC will fail over to the standby uplinks IF VC we...

Page 182: ... with Multiple Simple vNets Redundant Uplinks and LACP 2 Enclosures 182 Figure 3 13 Team both NICs using the HP Network Configuration Utility Figure 3 14 Both NICs for Profile App 1are teamed and connected to the network through vNet PROD ...

Page 183: ...which is referred to a Multi enclosure stacking ME while leveraging Virtual Connect Flex 10 technology In this scenario we have two10Gb uplinks configured with multiple VLANs We will configure a VMware ESX server with SIX NICs 3 per NIC port configured at various speed Some NICs will be connected to specific VLANs so frames will be presented without tags others will be configured with multiple net...

Page 184: ...scenario four HP BladeSystem c7000 enclosure with one of more Blade G6 servers with 10Gb NICs and TWO Virtual Connect Flex 10 Ethernet modules installed in Bays 1 2 are required In addition we will require ONE or TWO external Network switches As Virtual Connect does not appear to the network as a switch and is transparent to the network any standard managed switch will work with Virtual Connect Fi...

Page 185: ...ng link 8 10 Gb Uplink 9 Internal Dual 10Gb Stacking links Figure 3 16 Server Blade profile with TWO Flex 10 NICs configured Each NIC is connected to a Shared Uplink Set VLAN Trunk 1 and VLAN Trunk 2 the additional NICs are connected to other networks which are also part of the Shared Uplink Sets The VLAN Trunks are connected at 10Gb to a network switch through Port X2 on VC module 1 enclosure 1 a...

Page 186: ...iguring VC for mapped VLAN tags Multiple Networks over a single link support These features provide the ability to set a Custom or Preferred network speed value for each NIC These are VC domain wide settings and when configured will limit the maximum configurable speed of a NIC Enable Map VLAN Tags within Virtual Connect On the Virtual Connect Manager screen Left pane click Ethernet Settings Advan...

Page 187: ...al Connect domain of the first enclosure and select Domain Enclosures in the left pane Press the Find button Enter the IP address and credentials for the OA of the enclosure you wish to import Select the enclosure then press the Import button this may take a few minutes to complete From the left pane select Stacking Links and verify there are no stacking link errors If additional enclosures need t...

Page 188: ...of a larger script When run each command will ask for a yes to confirm the enclosure importation once the enclosure has been found Import enclosure 10 0 0 60 UserName Administrator Password password Import enclosure 10 0 0 30 UserName Administrator Password password Import enclosure 10 0 0 40 UserName Administrator Password password Figure 3 18 Importing an enclosure into an existing VC Domain Fig...

Page 189: ...o 3 2 Flex 10 with Multi Enclosure stacking VLAN Tagging 802 1Q with Multiple Shared Uplink Sets SUS VMware ESX 4 Enclosures 189 Figure 3 20 Importing the enclosure Figure 3 21 Importing additional enclosures ...

Page 190: ...ort 1 on switch 1 Create a SUS named VLAN Trunk 1 and connect it to Flex 10 Port X2 on Module 1 enclosure 1 On the Virtual Connect Home page select Define Shared Uplink Set Insert Uplink Set Name as VLAN Trunk 1 Select Add Port then add the following port a Enclosure 1 Bay 1 Port X2 Add Networks as follows a PROD A 1 VLAN ID 101 b PROD B 1 VLAN ID 102 c PROD C 1 VLAN ID 103 d PROD D 1 VLAN ID 104 ...

Page 191: ...ink Set VLAN Trunk 1 The following command s can be copied and pasted into an SSH based CLI session with Virtual Connect Note This uplink will connect from Enclosure 1 Bay 1 Create Shared Uplink Set VLAN Trunk 1 and configure uplinks add uplinkset VLAN Trunk 1 add uplinkport enc0 1 X2 Uplinkset VLAN Trunk 1 speed auto Create Networks Prod A 1 through Prod D 1 for Shared Uplink Set VLAN Trunk 1 add...

Page 192: ...LanID 104 set network PROD D 2 SmartLink Enabled add network PROD E 2 uplinkset VLAN Trunk 2 VLanID 105 set network PROD E 2 SmartLink Enabled Note It is important to point out at this time if you are familiar with VC scripting or have existing VC scripts that you had used on Virtual Connect 1 10 modules and may want to use with Flex 10 the numbering of the Flex 10 external ports is different than...

Page 193: ...d Uplink Set VLAN Trunk 1 and add VLANs Note The Connected to field in the graphic above displays the MAC address and port number of the switch this uplink is connected to This information is provided through LLDP discover and is not available in all switch products This information can be very helpful when determining which switches and ports VC is connected to ...

Page 194: ...ach server NIC will connect to a specific network On the main menu select Define then Server Profile Create a server profile called Server 1 In the Network Port 1 drop down box select PROD A 1 configure the speed as custom at 500Mb In the Network Port 2 drop down box select PROD A 2 configure the speed as custom at 500Mb In the Network Port 3 drop down box select PROD B 1 configure the speed as cu...

Page 195: ...ROD A 2 SpeedType Custom Speed 500 add enet connection Server 1 pxe Disabled Network PROD B 1 SpeedType Custom Speed 2500 add enet connection Server 1 pxe Disabled Network PROD B 2 SpeedType Custom Speed 2500 add enet connection Server 1 pxe Disabled add server port map Server 1 5 PROD C 1 VLanId 103 add server port map Server 1 5 PROD D 1 VLanId 104 add server port map Server 1 5 PROD E 1 VLanId ...

Page 196: ...with Multiple Shared Uplink Sets SUS VMware ESX 4 Enclosures 196 Alternatively the profile could be assigned to any server bay within the enclosure stack Create Server Profile Server 1 to the 4th enclosure bay 11 Figure 3 27 Assign the server Profile to Enclosure 3 slot 11 ...

Page 197: ...be assigned to Prod 101 1 no other NIC on LOM 1 can be assigned to Prod 101 1 This is discussed in further details in the Flex 10 technology brief mentioned earlier in this document As additional NICs are added to a profile that is assigned to a server with a 10Gb Flex NIC the assignment will alternate between LOM 1 x and LOM 2 x The first NIC will be LOM 1 a the second will be LOM 2 a then LOM 1 ...

Page 198: ...io 3 2 Flex 10 with Multi Enclosure stacking VLAN Tagging 802 1Q with Multiple Shared Uplink Sets SUS VMware ESX 4 Enclosures 198 Figure 3 29 Adjusting the NIC speed Figure 3 30 Configuring Multiple Networks ...

Page 199: ...e the speed of a NIC could be adjusted up or down Result VMware ESX Configuration Example The following graphics show an ESX server with two Flex 10 NICs configured as 6 NICs NICs speeds are also configured accordingly and connected to vSwitches with port groups to present the VLANs accordingly When configuring the vSwitches for ESX you will notice that 8 NICs actually already exist however NICs 7...

Page 200: ...ing 802 1Q with Multiple Shared Uplink Sets SUS VMware ESX 4 Enclosures 200 ESX 4 Networking Configuration Example The following graphics show an ESX 4 server with two Flex 10 NICs configured as six NICs Figure 3 32 vSwitch Configuration the ESX Host with 6 NICs ...

Page 201: ...Configuring the ESX vSwitch for Multiple Networks VLANs Note That vSwitch 3 has two NICs configured to redundantly support VLANs 103 104 and 105 Note If implementing ESX 3 5 on Flex 10 first review VMWARE KB 1007982 and ensure Network Failure Detection is set to Beacon Probing Note If implementing ESX 4 0 on Flex 10 ensure that ESX driver version 1 52 is installed also ensure that NIC firmware 5 2...

Page 202: ...Scenario 3 2 Flex 10 with Multi Enclosure stacking VLAN Tagging 802 1Q with Multiple Shared Uplink Sets SUS VMware ESX 4 Enclosures 202 Figure 3 34 Selection of the Virtual Network VLAN as required ...

Page 203: ... configuration Command Shortcut Description enable en Privilege mode configure terminal config t Configure via terminal interface gigabitethernet0 1 int gi1 0 1 Focus on Port 1 switchport mode access sw mo ac Set port 1 for Single VLAN mode switchport access vlan 1 sw ac vl 1 Allow Port 1 access to VLAN 1 spanning tree portfast trunk this is an access port is this required sp portf tr Enable portf...

Page 204: ... 10 spanning tree portfast trunk this is an access port is this required sp portf tr Enable portfast on Port 1 exit ex Remove focus from Port 1 interface gigabitethernet0 2 int gi0 2 Focus on Port 2 switchport mode access sw mo ac Set port 2 for Single VLAN mode channel protocol lacp channel p l Configure Port 2 for 802 3ad LACP channel group 10 mode active channel g 10 mo ac Enable channel group ...

Page 205: ... Table 1b Scenario 1 Part 2 Cisco IOS command line configuration Command Shortcut Description copy running config startup config For permanent changes only cop ru st Save the running configuration to NVRAM Otherwise the changes will be lost on the next reboot ...

Page 206: ...nnel group 10 mode active channel g 10 mo ac Enable channel group 10 spanning tree portfast trunk sp portf tr Enable portfast on Port 1 exit ex Remove focus from Port 1 interface gigabitethernet0 2 int gi0 2 Focus on Port 2 switchport trunk allowed vlan 101 104 sw tr ac vl 101 104 Configure Port 2 for VLANs 101 through 104 switchport mode trunk sw mo tr Enable trunking on Port 2 channel protocol l...

Page 207: ...LACP channel group 10 mode active channel g 10 mo ac Enable channel group 10 spanning tree portfast trunk sp portf tr Enable portfast on Port 1 exit ex Remove focus from Port 1 interface gigabitethernet0 2 int gi0 2 Focus on Port 2 switchport trunk allowed vlan 101 104 sw tr al vl 101 104 Configure port 2 for VLANs 101 through 104 switchport mode trunk sw mo tr Enable trunking on Port 2 channel pr...

Page 208: ...re via terminal interface gigabitethernet0 1 int gi1 0 1 Focus on Port 1 switchport mode access sw mo ac Set port 1 for Single VLAN mode switchport access vlan 1 sw ac vl 1 Allow port 1 access to VLAN 1 spanning tree portfast trunk this is an access port is this required sp portf tr Enable portfast on Port 1 exit exit Remove focus from Port 1 exit exit Exit config mode show vlan brief sh vl br Dis...

Page 209: ...ure terminal config t Configure via terminal interface gigabitethernet0 1 int gi1 0 1 Focus on Port 1 switchport trunk allowed vlan 101 104 sw tr al vl 101 104 Configure port for VLANs 101 through 104 switchport mode trunk sw mo tr Enable trunking on Port 1 spanning tree portfast trunk sp portf tr Enable portfast on Port 1 exit ex Remove focus from Port 1 exit ex Exit config mode show vlan brief s...

Page 210: ...igure terminal config t Configure via terminal interface gigabitethernet0 1 int gi1 0 1 Focus on Port 1 switchport trunk allowed vlan 101 105 sw tr al vl 101 105 Configure port for VLANs 101 through 105 switchport mode trunk sw mo tr Enable trunking on Port 1 spanning tree portfast trunk sp portf tr Enable portfast on Port 1 exit ex Remove focus from Port 1 exit ex Exit config mode show vlan brief...

Page 211: ...e next reboot Table 9 Scenario 2 3 2 3 Cisco IOS command line configuration 802 1Q 802 3ad Command Shortcut Description enable en Privilege mode configure terminal config t Configure via terminal interface gigabitethernet0 1 int gi1 0 1 Focus on Port 1 switchport trunk allowed vlan 101 103 sw tr al vl 101 103 Configure port for VLANs 101 through 103 switchport mode trunk sw mo tr Enable trunking o...

Page 212: ... 1 sw ac vl 1 Allow Port 1 access to VLAN 1 spanning tree portfast trunk this is an access port is this required sp portf tr Enable portfast on Port 1 exit ex Remove focus from Port 1 enable en Privilege mode configure terminal config t Configure via terminal interface gigabitethernet0 2 int gi0 2 Focus on Port 2 switchport mode access sw mo ac Set Port 2 for Single VLAN mode channel protocol lacp...

Page 213: ...s on Port 1 switchport trunk encapsulation dot1q sw tr enc dot Configure Port 1 for tagged VLANs switchport trunk allowed vlan 101 105 sw tr ac vl 101 105 Configure port for VLANs 101 through 105 switchport mode trunk sw mo tr Enable trunking on Port 1 spanning tree portfast trunk sp portf tr Enable portfast on Port 1 exit ex Remove focus from Port 1 show lacp 10 internal sh la 10 i Show the LACP ...

Page 214: ...erminal conf Configure in global mode span span Enables spanning tree MSTP mode by default vlan 1 untagged Ethernet 1 vlan 1 untag 1 Allow VLAN 1 on Port 1 and set Port 1 to untagged mode spanning tree 1 admin edge port span 1 admin edge Set Port 1 to be an edge port non bridging port Note port is set by default in auto edge mode which automatically sets port to Edge if no BPDU are received after ...

Page 215: ...g tree MSTP mode by default trunk 1 2 trk1 lacp trunk 1 2 trk1 lacp Configure LACP port trunk 1 to include Ports 1 2 vlan 1 untagged Ethernet trk1 vlan 1 untag trk1 Allow VLAN 1 on Port 1 2 and set to untagged mode spanning tree ethernet trk1 admin edge port span e trk1 admin edge Set Port 1 to be an edge port non bridging port Note port is set by default in auto edge mode which automatically sets...

Page 216: ...an 102 tag trk1 Allow VLAN 101 on Ports 1 and 2 and configure Ports 1 and 2 for untagged VLAN mode vlan 103 tagged trk1 vlan 103 tag trk1 Allow VLAN 101 on Ports 1 and 2 and configure Ports 1 and 2 for untagged VLAN mode vlan 104 tagged trk1 vlan 104 tag trk1 Allow VLAN 101 on Ports 1 and 2 and configure Ports 1 and 2 for untagged VLAN mode spanning tree ethernet trk1 admin edge port span e trk1 a...

Page 217: ...1 vlan 102 tag trk1 Allow VLAN 101 on Ports 1 and 2 and configure Ports 1 and 2 for untagged VLAN mode vlan 103 tagged trk1 vlan 103 tag trk1 Allow VLAN 101 on Ports 1 and 2 and configure Ports 1 and 2 for untagged VLAN mode vlan 104 tagged trk1 vlan 104 tag trk1 Allow VLAN 101 on Ports 1 and 2 and configure Ports 1 and 2 for untagged VLAN mode spanning tree ethernet trk1 admin edge port span e tr...

Page 218: ...pan span Enables spanning tree MSTP mode by default vlan 1 untagged Ethernet 1 vlan 1 untag 1 Allow VLAN 1 on Port 1 and set Port 1 to untagged mode spanning tree 1 admin edge port span 1 admin edge Set Port 1 to be an edge port non bridging port Note port is set by default in auto edge mode which automatically sets port to Edge if no BPDU are received after 3 sec show interface brief 1 sh int br ...

Page 219: ... by default vlan 101 tagged 1 vlan 101 tag 1 Allow VLAN 101 on Port 1 and set Port 1 to tagged mode vlan 102 tagged 1 vlan 102 tag 1 Add VLAN 102 on Port 1 and set Port 1 to tagged mode vlan 103 tagged 1 vlan 103 tag 1 Allow VLAN 103 on Port 1 and set Port 1 to tagged mode vlan 104 tagged 1 vlan 104 tag 1 Add VLAN 104 on Port 1 and set Port 1 to tagged mode vlan 1 vlan 1 Set focus to VLAN 1 no unt...

Page 220: ...101 tag 1 Allow VLAN 101 on Port 1 and set Port 1 to tagged mode vlan 102 tagged 1 vlan 102 tag 1 Add VLAN 102 on Port 1 and set Port 1 to tagged mode vlan 103 tagged 1 vlan 103 tag 1 Allow VLAN 103 on Port 1 and set Port 1 to tagged mode vlan 104 tagged 1 vlan 104 tag 1 Add VLAN 104 on Port 1 and set Port 1 to tagged mode vlan 105 tagged 1 vlan 105 tag 1 Add VLAN 105 on Port 1 and set Port 1 to t...

Page 221: ... 1 and set Port 1 to tagged mode Command Shortcut Description vlan 2042 tagged 2 vlan 2000 tag 2 Add VLAN 2042 on Port 2 and set Port 1 to tagged mode vlan 2042 tagged 2 vlan 2042 tag 2 Add VLAN 2042 on Port 2 and set Port 1 to tagged mode vlan 2309 tagged 2 vlan 2309 tag 2 Allow VLAN 2309 on Port 2 and set Port 2 to tagged mode vlan 2740 tagged 2 vlan 2740 tag 2 Add VLAN 2740 on Port 2 and set Po...

Page 222: ...pan Enables spanning tree MSTP mode by default trunk 1 2 trk1 lacp trunk 1 2 trk1 lacp Configure LACP port trunk 1 to include Ports 1 2 vlan 1 untagged Ethernet trk1 vlan 1 untag trk1 Allow VLAN 1 on Port 1 2 and set to untagged mode spanning tree ethernet trk1 admin edge port span e trk1 admin edge Set Port 1 to be an edge port non bridging port Note port is set by default in auto edge mode which...

Page 223: ...1 Allow VLAN 101 on Port 1 and set Port 1 to tagged mode vlan 102 tagged 1 vlan 102 tag 1 Add VLAN 102 on Port 1 and set Port 1 to tagged mode vlan 103 tagged 1 vlan 103 tag 1 Allow VLAN 103 on Port 1 and set Port 1 to tagged mode vlan 104 tagged 1 vlan 104 tag 1 Add VLAN 104 on Port 1 and set Port 1 to tagged mode vlan 105 tagged 1 vlan 105 tag 1 Add VLAN 105 on Port 1 and set Port 1 to tagged mo...

Page 224: ...Link Connection Speed Maximum Flex NIC speed value assigned to vNet by the network administrator Can NOT be manually overridden on the server profile Multiple Networks Link Speed Settings Global Preferred and Maximum Flex NIC speed values that override defined vNet values when multiple vNets are assigned to the same Flex NIC MZ1 or MEZZ1 LOM Mezzanine Slot 1 LAM on Motherbard systemboard NIC Netwo...

Page 225: ...runking Industry Combining ports to provide one or more of the following benefits greater bandwidth load balancing and redundancy VLAN A virtual network within a physical network VLAN Tagging Tagging marking an Ethernet frame with an identity number representing a virtual network VLAN Trunking Protocol VTP A Cisco proprietary protocol used for configuring and administering VLANs on Cisco network d...

Page 226: ...he following commands must be executed individually and cannot be part of a larger script The IP address login and password information used in this command are from the OA of the enclosure being imported Import enclosure 10 0 0 60 UserName Administrator Password password Import enclosure 10 0 0 30 UserName Administrator Password password Import enclosure 10 0 0 40 UserName Administrator Password ...

Page 227: ...et Prod Net and configure multiple uplinks on VC Module 1 Ports 1 2 and 3 add uplinkset Prod Net add uplinkport enc0 1 1 Uplinkset Prod Net speed auto add uplinkport enc0 1 2 Uplinkset Prod Net speed auto add uplinkport enc0 1 3 Uplinkset Prod Net speed auto Create Networks PROD A through PROD D supporting VLANs 101 through 104 on Shared Uplink Set Prod Net add network VLAN_10 uplinkset Prod Net V...

Page 228: ...as Shared Uplink Sets check box to enabled Result is that only VLANs from this shared uplink will be available to this NIC add server port map App 1 1 VLAN_10 Uplinkset Prod Net add server port map App 1 1 VLAN_20 Uplinkset Prod Net Create Server Profile App 1 Both NICs are configured on network VLAN_20 add profile App 1 nodefaultenetconn add enet connection App 1 pxe Enabled add enet connection A...

Page 229: ... pxe Disabled add server port map Server 1 7 Prod 104 1 VLanId 104 add server port map Server 1 7 Prod 105 1 VLanId 105 add enet connection Server 1 pxe Disabled add server port map Server 1 8 Prod 104 2 VLanId 104 add server port map Server 1 8 Prod 105 2 VLanId 105 Assign profile Server 1 enc0 1 Add TWO fc connections to Profile ESX 1 with a specific WWN add fc connection ESX 1 Fabric SAN_3 Addr...

Reviews: