background image

 

Appendix A: Network switch configuration  95 

Create VLANs 

Complete this section on both Cisco Nexus 56128P switch 1 and Cisco Nexus 56128P switch 2. 
From the configuration terminal mode, run the following commands to create the needed VLANs for the 

solution. 

vlan <<mgmt_net_vlan>> 

 name MGMT-VLAN 

 exit 

  

vlan <<vmotion_net_vlan>> 

 name vMotion-VLAN 

 exit 

 

vlan <<iscsi_net_vlan>> 

 name iSCSI-VLAN 

 exit 

 

vlan <<vm_production_net_1_vlan>> 

 name VM-Production-VLAN1 

 exit 

 

copy running-config startup-config 

 

Add individual port descriptions for troubleshooting 

To add individual port descriptions for troubleshooting activity and verification, complete the following 

steps in configure Terminal mode for each switch. 

Cisco Nexus 56128p Switch 1

 

From configure terminal, run the following commands. 

interface Ethernet 1/1 

 description HC380-node1-FLEXLom-1 

 exit 

interface Ethernet 1/2 

 description HC380-node2-FLEXLom-1 

 exit 

interface Ethernet 1/3 

 description HC380-node3-FLEXLom-1 

 exit 

copy running-config startup-config 

Cisco Nexus 56128p Switch 2

 

From configure terminal, run the following commands. 

interface Ethernet 1/1 

 description HC380-node1-FLEXLom-2 

 exit 

interface Ethernet 1/2 

 description HC380-node2-FLEXLom-2 

 exit 

interface Ethernet 1/3 

 description HC380-node3-FLEXLom-2 

 exit 

copy running-config startup-config 

 

Create port profiles 

Complete this section on both Cisco Nexus 56128P switch 1 and Cisco Nexus 56128P switch 2. 

Summary of Contents for Hyper Converged 380

Page 1: ... This document is for the person who installs administers and troubleshoots servers and is skilled in network configuration and virtual environments Hewlett Packard Enterprise assumes you are qualified in the servicing of computer equipment and trained in recognizing hazards in products with hazardous energy levels Part Number 860192 003 September 2016 Edition 3 ...

Page 2: ...he Hewlett Packard Enterprise website Confidential computer software Valid license from Hewlett Packard Enterprise required for possession use or copying Consistent with FAR 12 211 and 12 212 Commercial Computer Software Computer Software Documentation and Technical Data for Commercial Items are licensed to the U S Government under vendor s standard commercial license Microsoft and Windows are eit...

Page 3: ...urce 24 Rack warnings 25 Installing the node into the rack 26 Cabling the system 27 General virtualization configuration all 1 GbE appliance 28 General virtualization 10GbE appliance and VDI configurations 29 CloudSystem configuration 30 Configuring the system 32 Configuring the HC380 system 32 Configuring the network switches 32 Powering on all nodes 33 Configuring a laptop or workstation to acce...

Page 4: ...tion 69 Configure the new node in the CMC 70 Configure the volume in vCenter 70 Configure the VDS of vCenter 71 Activate the compute host cluster 72 Troubleshooting 73 Troubleshooting OneView InstantOn 73 Certificate error when launching vCenter web client 73 HC380 nodes are not discovered 73 OneView InstantOn hangs during deployment 73 vCenter license status on Health screen is red 74 OneView Ins...

Page 5: ...onfiguring the switches 92 Validating the switch configuration 96 Uplink into existing network infrastructure 100 Configuration worksheet 100 Appendix B CloudSystem 9 0 Management Host Networking 102 Appendix C CloudSystem 9 0 Compute Host Networking 103 Appendix D CloudSystem 9 0 Consoles 104 Appendix E CloudSystem Network Diagram 106 Appendix F Remote vCenter setup 107 Appendix G Management grou...

Page 6: ...Contents 6 Remote support 120 Insight Remote Support installation 120 Acronyms and abbreviations 121 Documentation feedback 123 Index 124 ...

Page 7: ...lowing tasks Initial installation and deployment tasks o Plan for the installation by using the preinstallation worksheets to collect the information required o Install the hardware into your datacenter environment o Connect the appliance to your network and connect to the system o Deploy the system using the HPE OneView InstantOn configuration utility o Install HC380 Management UI o Complete the ...

Page 8: ...s the single most important item to a successful installation Whether you are integrating into an existing data center infrastructure or isolating the appliance from other resources you must consider not only the initial appliance installation but also plan for any future expansion IMPORTANT The networking choices made during the initial installation may not be reversible at a later time without a...

Page 9: ... whether you are using CloudSystem Since the OneView InstantOn configuration utility accepts a starting IP address and automatically increments the IP addresses by the number of nodes in the initial configuration or expansion some of the IP addresses must be contiguous For examples and worksheets to help you plan your networks see Appendix H IP addresses for sample cluster on page 110 Planning you...

Page 10: ...addresses are not required to be contiguous but Hewlett Packard Enterprise recommends that they be in the same address range to enable expansion at a later date Use one of the following calculations to help you determine the number of IPv4 addresses you need for your ESXi management network where N is the number of nodes in your cluster N 3 for General virtualization and VDI N 31 for CloudSystem U...

Page 11: ...6 contiguous IPv4 addresses For a two node cluster you will need 2 contiguous IPv4 addresses For a three node cluster you will need 3 contiguous IPv4 addresses Storage network IP addresses The storage network requires five contiguous IPv4 addresses for the first node and three contiguous IPv4 addresses for every additional node These IP addresses are used by the HC380 Management VM iSCSI initiator...

Page 12: ...OneView for vCenter integrated During OneView InstantOn configuration OneView InstantOn checks that the specified vCenter Server has OneView for vCenter configured and will not continue until this check is complete For additional information see Appendix F Remote vCenter setup on page 107 NOTE A remote vCenter setup is not supported with CloudSystem Before deploying the HC380 with the remote vCent...

Page 13: ...port the additional system hosts datacenter and Virtual Machines that will be installed or added expanded NOTE To determine the supported limits for each version see the VMware vCenter Server documentation HPE iLO 4 Although iLO 4 is not required for daily use Hewlett Packard Enterprise recommends that you configure the iLO of each HC380 server as part of the initial setup iLO is required when per...

Page 14: ...tiguous IP addresses Use the worksheets for an initial installation and for an expansion ESXi Network Components To help you plan the ESXi management network see ESXi management network IP addresses on page 9 ESXi network components Value Starting IP address used by the HC380 Management VM during initial installation or by the first ESXi node being added during an expansion Subnet Mask Gateway vSp...

Page 15: ...that screen These values are used to configure the Management VM so that HP OneView InstantOn can verify that the remote server can be accessed and that the remote instance of HPE OneView for VMware vCenter is installed at the correct minimum version The HC380 Management VM IP address subnet mask and gateway are automatically populated on the OneView InstantOn IP assignment screen as the starting ...

Page 16: ...em Value StoreVirtual user name Must contain 3 30 characters begin with a letter and can include numbers or the _ characters StoreVirtual password Must contain 5 40 characters and not include the characters vSphere license optional Only needed if connecting to a local vCenter Storage network DNS Storage network NTP optional Storage network mail server Storage network mail server port Sender email ...

Page 17: ...All of the iLO IP addresses must be accessible from the ESXi management network For more information about iLO see HPE iLO 4 on page 13 iLO address worksheet Use the worksheet to record the node serial number and the iLO IP address associated to that serial number During an expansion you can use this same worksheet and then manually enter the IPv4 addresses into HC380 Management UI Settings area f...

Page 18: ...or VDI workload configurations you can skip this spreadsheet While the Block and Object networks are not used the installation process requires a VLAN for each network Assign two unused VLAN IDs for these networks that do not interfere with any of your other networks For more information see Appendix E CloudSystem Network Diagram on page 106 Item Value Data Center Management Network DCM IP Range 2...

Page 19: ...rovider 2 VLAN ID Provider 2 CIDR Provider 3 VLAN ID Provider 3 CIDR Provider 4 VLAN ID Provider 4 CIDR Tenant Networks Tenant 1 VLAN ID Tenant 1 CIDR Tenant 2 VLAN ID Tenant 2 CIDR Tenant 3 VLAN ID Tenant 3 CIDR Tenant 4 VLAN ID Tenant 4 CIDR Block Storage Networks Block Storage VLAN ID Object Proxy Network Object Proxy VLAN ID ...

Page 20: ...vary depending on your specific configuration Front panel Front panel with HDDs or SSDs in all three storage bays Item Description 1 Bay 3 with 8 HDDs or SSDs optional 2 Bay 2 with 8 HDDs or SSDs optional 3 Bay 1 with 8 HDDs or SSDs Front panel hybrid configuration with 6 HDDs and 2 SSDs in each storage bay Item Description 1 Bay 3 with 6 HDDs and 2 SSDs optional 2 Bay 2 with 6 HDDs and 2 SSDs opt...

Page 21: ... for connection to a laptop or workstation for setup on management VM 7 1 GbE RJ 45 port 3 not used during initial configuration available for customer network 8 1 GbE RJ 45 port 4 not used during initial configuration available for customer network 9 nVIDIA graphics card VDI only optional 10 Power supply 1 PS1 11 Power supply 2 PS2 12 Rear panel HDDs VDI only optional All 1 GbE appliance General ...

Page 22: ...Power supply 1 PS1 11 Power supply 2 PS2 CloudSystem rear panel components Item Description 1 10 GbE NIC Port 2 2 10 GbE NIC Port 1 3 10 GbE NIC Ports 4 and 3 4 10 GbE NIC Ports 6 and 5 5 iLO connector 6 1 GbE RJ 45 port 1 do not use during initial configuration 7 1 GbE RJ 45 port 2 for connection to a laptop or workstation for setup on management VM 8 1 GbE RJ 45 port 3 not used during initial co...

Page 23: ...enings When vertical space in the rack is not filled by a server or rack component the gaps between the components cause changes in airflow through the rack and across the servers Cover all gaps with blanking panels to maintain proper airflow CAUTION Always use blanking panels to fill empty vertical spaces in the rack This arrangement ensures proper airflow Using a rack without blanking panels res...

Page 24: ...o the rack Consult the electrical authority having jurisdiction over wiring and installation requirements of your facility CAUTION Protect the server from power fluctuations and temporary interruptions with a regulating uninterruptible power supply This device protects the hardware from damage caused by power surges and voltage spikes and keeps the system in operation during a power failure When i...

Page 25: ...a DC power source 1 Cut the DC power cord ends no shorter than 150 cm 59 06 in 2 If the power source requires ring tongues use a crimping tool to install the ring tongues on the power cord wires IMPORTANT The ring terminals must be UL approved and accommodate 12 gauge wires IMPORTANT The minimum nominal thread diameter of a pillar or stud type terminal must be 3 5 mm 0 138 in the diameter of a scr...

Page 26: ...o the server For information on identifying connectors see one of the following o General virtualization and VDI rear panel components on page 21 o CloudSystem rear panel components on page 22 WARNING To reduce the risk of electric shock fire or damage to the equipment do not plug telephone or telecommunications connectors into RJ 45 connectors 3 Connect the power cord to the rear of the server 4 ...

Page 27: ...utlet and the point where the cord extends from the node Cabling the system This section provides some cabling examples to help you properly cable your appliance Your configuration may differ from the examples but the details should provide guidance for you to properly cable the appliance in your environment After completing the network connections be sure to connect the power cables to the system...

Page 28: ... Switch B IPv6 enabled 5 Connect Node 1 Port 4 to Switch A IPv6 enabled 17 1GbE RJ 45 port 2 not used 6 Connect Node 1 Port 2 to Switch A IPv6 enabled 18 1GbE RJ 45 port 3 not used during initial configuration available for customer network 7 Connect Node 1 Port 3 to Switch B IPv6 enabled 19 1GbE RJ 45 port 4 not used during initial configuration available for customer network 8 Connect Node 1 Por...

Page 29: ... Switch B IPv6 enabled 3 Interconnect switch links 13 1GbE RJ 45 port 2 not used 4 10 GbE Switch B IPv6 enabled 14 1GbE RJ 45 port 3 not used during initial configuration available for customer network 5 Connect Node 1 Port 2 to Switch A IPv6 enabled 15 1GbE RJ 45 port 4 not used during initial configuration available for customer network 6 Connect Node 1 Port 1 to Switch B IPv6 enabled 16 Node 2 ...

Page 30: ...nabled 19 Node 2 6 Connect Node 1 Port 6 to Switch A IPv6 enabled 20 Connect Node 2 Port 2 to Switch A IPv6 enabled 7 Connect Node 1 Port 5 to Switch B IPv6 enabled 21 Connect Node 2 Port 1 to Switch B IPv6 enabled 8 Connect Node 1 Port 3 to Switch B IPv6 enabled 22 1 GbE RJ 45 port 2 not used during initial configuration available for customer network 9 Node 1 23 1 GbE RJ 45 port 3 not used durin...

Page 31: ...ion to a laptop or workstation for setup 26 Connect Node 2 iLO port to 1 GbE Switch 13 1 GbE RJ 45 port 3 not used during initial configuration available for customer network 27 Connect Node 1 iLO port to 1 GbE Switch 14 1 GbE RJ 45 port 4 not used during initial configuration available for customer network ...

Page 32: ...d configurations HC380 General virtualization or VDI solutions are supported on a flat untagged network or a network with tagged VLANs to segment iSCSI and vMotion traffic The ESXi management network must always be an untagged pvid network You may put the ESXi vMotion and storage networks on the same subnet but Hewlett Packard Enterprise recommends separate subnets or VLANs to isolate and manage t...

Page 33: ...he system does not automatically power on you can use the following alternate methods Use a virtual power button selection through iLO Press and release the Power On Standby button When the node goes from the standby mode to the full power mode the node power LED changes from amber to green For more information about iLO see the Hewlett Packard Enterprise website http www hpe com info ilo docs Con...

Page 34: ...ect 5 In the Windows Security dialog box enter the credentials o User name administrator o Password HyperConv 234 Testing network connectivity Before continuing to configure the HC380 you can test your network setup to ensure that IPv6 is enabled on your network between your HC380 nodes To ensure IPv6 is configured properly perform the following test 1 Optional Test the IPv6 connectivity to the iL...

Page 35: ...d buy html 2 On the vSphere host extract the GPU mode change utility from NVIDIA gpumodeswitch 2016 04 zip 3 Copy the NVIDIA GpuModeSwitch 1OEM 600 0 0 2494585 x86_64 vib to the root of the vSphere host 4 Run the following command to put the HC 380 node into Maintenance mode esxcli system maintenanceMode set e true t 0 5 Run the following command to install the GPU mode change utility esxcli softw...

Page 36: ...anceMode set e false t 0 8 Run the following command to verify that NVIDIA GRID Tesla M60 graphics adapters are present and installed nvidia smi Configuring the HC380 using OneView InstantOn Guidelines for using OneView InstantOn OneView InstantOn is the automated deployment tool that guides you through the steps to configure your HC380 appliance Following successful completion of this configurati...

Page 37: ...icense Agreements and then click Next Completing the vCenter screen On the vCenter screen select the instance of OneView for VMware vCenter that you will use Select Local if the system will use a local included copy of vCenter Select Remote if the system will connect to vCenter currently running on another server For more information about a Remote vCenter installation see Appendix F Remote vCente...

Page 38: ...Center verification in the Access section is marked successful 3 After the Access and Management VM ESXi Connectivity sections report green status you can apply a license for the remote instance of OneView for VMware vCenter if it is not already licensed If it is already licensed skip this field 4 In the Cluster field specify the datacenter and cluster on OneView for VMware vCenter that will be us...

Page 39: ...selected 2 Select the systems you want to install 3 Click Next to continue to the IP assignments screen Completing the IP Assignments screen 1 On the IP Assignments screen enter the appropriate network settings using the information collected in the preinstallation worksheets on page 14 You can provide only the starting IP address in the range and OneView InstantOn automatically assigns the remain...

Page 40: ...ials You use these credentials to access the StoreVirtual Centralized Management Console when you apply the StoreVirtual licenses Credential requirements o User name Must contain 3 30 characters Must begin with a letter a z A Z May contain ASCII letters numbers asterisks underscores _ or hyphens Cannot contain the equal sign o Password Must contain 5 40 characters May contain most ASCII characters...

Page 41: ...page 14 to complete the fields of the Settings screen 1 In the General Settings section enter the following information o preferred storage system name o storage network domain name server address o network time protocol server address 2 In the Mail Settings section enter the following information o storage network mail server and port o sender email o recipient email 3 If you are deploying a 2 no...

Page 42: ...nager that can be configured in the StoreVirtual CMC as a post deployment step For more information see Appendix G Management group quorum consideration on page 109 4 Click Next to continue to the Review Configuration screen Completing the Review Configuration Screen 1 On the Review Configuration screen ensure the information that you entered is correct ...

Page 43: ...o view help documentation and complete the installation with fully licensed VSAs you must have internet access VMware software The VMware vSphere license that ships with each HC380 node is a trial license that is valid for 60 days from the date on which the node ships from the factory Apply a purchased license before the trial license expires or restrictions will occur To apply your license for ea...

Page 44: ...e StoreVirtual VSA MAC addresses under the Feature Key heading on the Next Steps screen to obtain license keys a Copy the MAC address by right clicking the screen on top of the value that you want to copy and selecting copy from the context menu b Paste the information into a text editor c Copy and paste the information from the text editor into the Hewlett Packard Enterprise licensing portal 3 Un...

Page 45: ...t the end user license agreement 2 Specify the network addresses to be used by HC380 Management UI a Enter an unused IP address into the IP address field b Enter the subnet mask value into the Subnet mask field c Enter the gateway value into the Gateway field 3 Provide the vCenter administrator username and password 4 Click Submit You may have to wait several minutes up to 60 minutes or longer dep...

Page 46: ...encil icon for the Identity section 4 Provide the Embedded OneView IPv4 address for the OneView configuration This address was collected in the preinstallation worksheets on page 14 5 Verify and update as needed the values in the other fields then click OK 6 Click the pencil icon for the vCenter section 7 Type the vCenter IP address and click Connect This address was configured by OneView InstantO...

Page 47: ...k the plus sign next to each directory group to associate groups in the directory with the HC380 user roles User roles on page 47 NOTE Verify connectivity between the HC380 and your AD server For AD Certificate Services HC380 uses the default port 636 to connect to the AD server using SSL If the directory server is added as a user in the registered groups do not prefix the domain name before the u...

Page 48: ...LAN is not plumbed through the top of rack switches then during the installation process it is likely communication with vCenter or ESXi hosts will be lost and the installation process will fail The MySQL JDBC driver has been downloaded and accessible from the management VM Each ESXi server has SSH enabled Limitations Only local vCenter running at the HC380 Management VM is supported for CloudSyst...

Page 49: ... the preinstallation worksheet for CloudSystem CloudSystem on page 18 Additional post deployment options are available to upgrade to CloudSystem 9 01 and 9 02 and change CloudSystem passwords The installer has been designed so that it can be launched multiple times if an error situation causes the CloudSystem installer to fail and that situation is subsequently resolved re running the tool will th...

Page 50: ...tem 9 01 Installation desktop icon or by executing the file C Program Files HPE HPECS9Setup CloudSystem9 exe Completing the Introduction screen 1 On the Introduction screen review the content and accept the vSphere PowerCLI End User License Agreement 2 Click Next to proceed to the Installation Options screen Completing the Installation Options screen 1 On the Installation Options screen specify wh...

Page 51: ...VLAN IDs for each of the five CloudSystem networks These values can be between 1 and 4095 The Data Center Management Network VLAN coincides with your management network VLANs for the Storage trunk must represent unused VLANs in your environment Select any non used ID to represent these networks The CloudSystem installation process requires valid VLAN values and we did not want to pick arbitrary VL...

Page 52: ...and the corresponding networking subnet range in CIDR format You can also specify the external networking VLAN identifier and the corresponding CIDR networking value for the external VLAN See HPE Helion CloudSystem 9 0 Network Planning Guide for more details on provider and tenant networks This guide is found on the Hewlett Packard Enterprise website http www hpe com info CloudSystem docs ...

Page 53: ...he Data Center Management DCM and Consumer Access Network CAN networks The values for the DCM network should be on the same subnet as the networking addresses supplied in the OneView InstantOn tool for the ESXi Network Components in the IP Assignments Completing the IP Assignments screen on page 39 screen The block storage network values are not used by the HC380 solution though they are required ...

Page 54: ...ick Next to proceed to the Credentials screen Completing the Credentials screen 1 On the Credentials screen provide the vCenter administrator and VSA administrator credentials 2 Click Next to proceed to the Appliance Hostname screen ...

Page 55: ...pecify the hostnames and IP addresses of these appliance VMs The DCM network and CAN network values must be outside the range specified for the required IP addresses or specified for the DCM network in the OneView InstantOn tool 2 Click Next to proceed to the Review Configuration screen Completing the Review Configuration screen 1 In the Review Configuration screen review all selected values and v...

Page 56: ...k on the installation process A CloudSystem Enterprise installation can take about 2 hours to complete Details of the installation process are shown in the Details window Completing the Next Steps screen The Next Steps screen notifies you of the completion status of the installation and provides a list of items that can be completed while additional processing occurs ...

Page 57: ... screen you must disable SSH on each ESXi server before using the product Datastores The initial configuration setup and process only utilize a portion of the total available storage To utilize the remaining storage in your HC380 you must create datastores Creating datastores 1 Open a browser and navigate to the vSphere Web Client The login window appears 2 Enter your user name and password for th...

Page 58: ...ster 7 Select the specific cluster for which you want to create a datastore The Summary tab for the selected cluster appears 8 Select the Manage tab and then select HP Management The Actions menu appears on the right side of the window The vSphere Web Client may not always refresh quickly If you are not seeing what is expected click the Refresh icon in the top menu bar or the disk refresh icon on ...

Page 59: ... number of datastores you want to create b Select NETWORK_RAID_10 in the RAID level drop down box 12 Click Next The storage window appears 13 Enter a unique name for the new datastore and then click Next 14 On the Validation screen verify that the information entered is correct If so click Next If not click Back and return to the applicable screen to edit it 15 On the Ready to complete window clic...

Page 60: ...s the Customize System View Logs menu 4 Type the username and password 5 Access the Troubleshooting Mode Options menu 6 Disable SSH 7 Press Esc to exit the Troubleshooting Mode Options menu 8 Press Esc to close the Customize System View Logs menu ...

Page 61: ...f the upgrade by accessing the log file http DCM_UA1_IP_address 8086 update logs cs update install status log Tenant and Provider Networking Tenant 1 In the CloudSystem Operations Console a Point the browser to the URL of the Operations Console The default IP is specified on the Appliance Hostnames panel in the installation and deployment utility b Login as admin user using the default password un...

Page 62: ...rk b Fill out the content similar to that shown below Flat network type and external physical network c Click Create Network d Create the external subnet i Click on the hyperlink name of the newly created external network to open the network detail ii Click Create Subnet iii Provide the External network subnet name network address CIDR and Gateway IP iv On the Subnet Detail either enable or disabl...

Page 63: ...de is found on the Hewlett Packard Enterprise website http www hpe com info CloudSystem docs The monitoring dashboard may be disabled until the JDBC driver has been downloaded and installed after all of the CloudSystem 9 0 appliance VMs have been brought up Create router 1 Launch the Horizon console 2 Select Project Network Routers and then Create Router 3 Provide a name for the router and click C...

Page 64: ...else on the system including running Windows Update and configuring proxies Do not run HP OneView InstantOn while performing an HPE LeftHand OS upgrade Tool tips and error information are available when you hover in a text box on a screen in HP OneView InstantOn The information might take a few seconds to display The HP OneView InstantOn version shown in the figures in this document may be differe...

Page 65: ... 14 If you are expanding your system by adding one node or multiple nodes you need only enter the starting IP address OneView InstantOn automatically assigns the remaining contiguous IP addresses NOTE If you manually configured a VLAN ID for the ESXi management network you must remove it while completing the system expansion You can add it again when the expansion is complete IP addresses for the ...

Page 66: ...formation that you entered is correct If you need to make changes go back using the links in the left navigation pane When you proceed click Deploy Be aware that if you are deploying multiple systems the time to complete deployment increases IMPORTANT Do not close OneView InstantOn during the deployment process If the deployment does not complete see Troubleshooting on page 73 ...

Page 67: ... you receive a confirmation dialog to let you know that the cluster has been successfully expanded 10 Before you use the storage of the expansion node or system refresh the HPE Storage data cache The refresh ensures that OneView for VMware vCenter has information about the storage before you use it a Open the vCenter web client b Select the cluster that was created during system deployment c Selec...

Page 68: ...ompleted by hovering over the Refresh icon to display the last time the HPE Storage data was updated If prompted to refresh date select No NOTE If you need the licensing links again restart OneView InstantOn and the Next Steps screen automatically opens ...

Page 69: ...e new node on the virtual distributed switch of vCenter 5 Compute only Activate the compute host cluster Pre expansion preparation 1 Prepare the IP address netmask gateway and VLAN s of the new node for ESXmgmt vMotion HostStorage2 and HostStorage3 networks The values should be on the same range and values as the existing nodes 2 Open up the port for vmnic0 of the new node in the Top of Rack switc...

Page 70: ...back to the CMC and add the server 9 Right click on Servers and select New Server 10 In the New Server dialog perform the following steps a Use the ESXmgmt IP of the new node for the Name and CHAP Name b Keep the two iSCSI security checkboxes enabled default c For the CHAP passwords ensure that Target and Initiator are 12 characters long and are unique 11 Present the volume s to the newly added se...

Page 71: ...r 1 Use the following steps to configure the new Compute node to the virtual distributed switches a Using the vSphere Client go to Inventory Networking b Right click on CS9_Compute_DVS and click Add Host i Select the new node ii Select physical adapters vmnic6 and vmnic7 iii Set the destination port group of vmk3 to dvESXcomp iv Click Next on the Virtual Machine Networking v Click Finish c Right c...

Page 72: ...g hosts In this scenario the new host needs to join the existing cluster 1 All deployed instances need to be terminated or migrated first 2 From the CloudSystem Ops Console deactivate the compute cluster 3 Activate the same compute cluster with the new host included 4 Re deploy the terminated instances or migrate them back to the newly activate compute cluster Scenario 2 The new host is on a diffe...

Page 73: ...hat displays You can choose to install a self signed certificate or a certificate signed by a trusted authority HC380 nodes are not discovered Symptom OneView InstantOn is not able to discover the HC380 nodes Cause IPv6 may not be enabled for the 1Gb or 10Gb switches Action Enable IPv6 for the 1Gb or 10Gb switches For more information see IPv6 enablement at switch level on page 8 OneView InstantOn...

Page 74: ...stantOn might appear to hang at various times Action No action is required Do not cancel or stop the deployment The system configuration is continuing although the indicator might not update The countdown timer will resume shortly Invalid username and password error appears when you specify a local vCenter Symptom When you select a local vCenter the default credentials for VMware vCenter are autom...

Page 75: ...and the Storage Administrator Portal vSphere HA errors Perform the following steps to overcome any issues that are occurring with the vSphere cluster High Availability configuration 1 Using the management VM launch vSphere Client and login to the cluster using the following credentials o Hostname localhost o User administrator vsphere local o Password HyperConv 234 You may see some alarms against ...

Page 76: ...tem on page 18 2 Make sure that the DCM VLAN is enabled in the TOR switches 3 Execute the following steps on the OneView InstantOn management VM a If not already done configure a laptop or workstation to access the management VM Configuring a laptop or workstation to access the system on page 33 b Migrate the management VM to node 1 if it is not already there This migration should have been perfor...

Page 77: ...re this step can complete b Move the host to maintenance mode c Migrate the host to the new CS9Compute cluster d Move the host out of maintenance mode e Power on VSA VM 4 Enable HA on CS9Compute if there is more than one node 5 Enable DRS on CS9Compute node Both the management and compute clusters must have DRS enabled If the compute cluster no longer satisfies the minimum requirements for HA it i...

Page 78: ...ted with two uplinks on vmnic8 or vmnic9 No portgroups are created on the Comp CloudData Trunk at this time Action Migrate ESXmgmt on vSwitch0 to CS9_Mgmt_DVS using the following steps 1 Create CS9_Mgmt_DVS w dvESXMgmt portgroup VLAN DCM 2 Navigate to Inventory Networking right click on CS9_Mgmt_DVS and select Manage Hosts 3 Pick all hosts in the management cluster for a two node solution there is...

Page 79: ...s enterprise cs ovsvapp Storage is not available for OVA images Symptom When you attempt to upload OVA images storage is not available Action 1 On the ESXi server that is the management VM browse to the datastore1 datastore 2 Locate the cloud folder and download the Enterprise and Foundation zip files to a temporary location on the management appliance 3 Unzip the Enterprise and Foundation zip fil...

Page 80: ...uld not register vCenter with CloudSystem Symptom The installation process could not register vCenter with CloudSystem Cause The installer is trying to register vCenter with the CloudSystem to allow for compute nodes to be activated Action Perform one or both of the following actions Verify that vCenter is accessible Use the following steps to register vCenter with CloudSystem a Launch the CloudSy...

Page 81: ... Trunk d Select the Queue for Activation button e Select Complete Activations f Click Confirm Activations An ovsvapp compute_host VM instance is created for each compute host This step can take several minutes and will depend on the number of compute nodes If the activation fails use the following troubleshooting options Sometimes the activation has completed but may show a RED status Try refreshi...

Page 82: ...not add Subnets to Networks Symptom Could not add subnets to networks Explanation The installer is attempting to create a subnet for a given VLAN from the CIDR specified in the user interface Potential causes could be that the VLAN does not exist or the CIDR overlaps with another network Action For more information see Tenant and provider networking on page 61 Could not create router Symptom Could...

Page 83: ...powers off the VSA VM on the management node If the VSA volumes are pending activity the VM cannot be powered off until the VSA storage reaches a stable state Action For more information see Trouble migrating host to management cluster VM name did not power off error msg Symptom VSA VM could not be powered off on the management node Explanation Before creating the CS9 Management cluster and moving...

Page 84: ... the VSA VM on each respective host If the utility is not able to locate it if the name does not match the SVVSA pattern for instance the system cannot shut it down and allow the respective host to enter maintenance mode prior to migrating the host to the new cluster Action Ensure that the utility can locate the VSA VM on each respective host Deploy CloudSystem 1 Ensure that the management applian...

Page 85: ... 3 HC380 Node 3 FlexibleLOM1 HPE 5900AF 48XG 4QS FP 2 3 HC380 Node 3 FlexibleLOM2 HPE 5900AF 48XG 4QS FP 1 51 HPE 5900AF 48XG 4QS FP 2 51 IRF Link HPE 5900AF 48XG 4QS FP 1 52 HPE 5900AF 48XG 4QS FP 2 52 IRF Link In addition to the 10GbE connectivity needs the HPE Integrated Lights Out connection on each DL also needs to be connected and configured on the same management network as the 10GbE Ports ...

Page 86: ...ation initial setup will be done over the serial port This section shows how to connect to the serial port This task requires a part number 5185 8627 RJ45 DB9 console cable to connect the serial port and a serial terminal or serial terminal emulator Laptop for example with an available serial port DB9 connector 1 Connect a serial terminal or laptop or server running a terminal emulator to the seri...

Page 87: ...llowing steps 1 Configure the switch On initial boot and connection to the serial or console port of the switch the Comware setup should automatically start and attempt to enter Automatic configuration Automatic configuration attempt 1 Interface used M GigabitEthernet0 0 0 Enable DHCP client on M GigabitEthernet0 0 0 Automatic configuration is running press CTRL_C or CTRL_D to break 2 Press ctrl a...

Page 88: ...D may result in configuration change or loss Continue Y N Y HPE save The current configuration will be written to the device Are you sure Y N y Please input the file name cfg flash startup cfg To leave the existing filename unchanged press the enter key Validating file Please wait Saved the current configuration to mainboard device successfully HPE quit HP reboot Start to check configuration with ...

Page 89: ...e identical IRF fabrics handle collisions and recover from faults in the unlikely event of an IRF split or failure For more information see HPE 5920 5900 Switch Series IRF Configuration Guide Configuration of MAD is not covered in this document Configure the VLANs To create the necessary VLANs complete the following step on both switches From system view run the following commands vlan mgmt_net_vl...

Page 90: ...ervice unicast server mgmt_net_ntp1 priority clock protocol ntp save Add individual port descriptions for troubleshooting To add individual port descriptions for troubleshooting activity and verification from system view run the following commands interface Ten GigabitEthernet 1 0 1 description HC380 node1 FLEXLom 1 quit interface Ten GigabitEthernet 1 0 2 description HC380 node2 FLEXLom 1 quit in...

Page 91: ...n_net_1_vlan quit Cisco Nexus networking This section describes how to configure a 3 node HC380 appliance with a pair of Cisco Nexus 5672UP switches Network cabling Use the following table as a guide to configure the network cabling The table provides an example of the 10GbE networking connectivity to Cisco Nexus 5672UP switches Connectivity between the switches is provided by an upstream device t...

Page 92: ...ple the same steps can be leveraged for a 1GbE based HC380 solution using any Cisco Nexus OS 7 1GbE based device taking into account the additional 1GbE connections that are required For more information about the connectivity requirements see Configuring the network switches on page 32 The example below assumes you already have a 1GbE infrastructure where your iLO from each HC380 node are connect...

Page 93: ...with Out of band mgmt0 management configuration yes no y Enter Mgmt0 IPv4 address net_switch1_mgmt_ip Mgmt0 IPv4 netmask mgmt_net_netmask Configure the default gateway yes no y Enter IPv4 address of the default gateway mgmt_net_gw Enable the telnet service yes no n Enter Enable the ssh service yes no y Enter Type of ssh key you would like to generate dsa rsa rsa Number of rsa key bits 768 2048 204...

Page 94: ... IPv4 address mgmt_net_ntp1 Configure default interface layer L3 L2 L2 Enter Configure default switchport interface state shut noshut noshut shut Enter basic FC configurations yes no n Enter Would you like to edit the configuration yes no n Enter Review the configuration summary before enabling the configuration Use this configuration and save it yes no y Enter Configure global values Complete thi...

Page 95: ... verification complete the following steps in configure Terminal mode for each switch Cisco Nexus 56128p Switch 1 From configure terminal run the following commands interface Ethernet 1 1 description HC380 node1 FLEXLom 1 exit interface Ethernet 1 2 description HC380 node2 FLEXLom 1 exit interface Ethernet 1 3 description HC380 node3 FLEXLom 1 exit copy running config startup config Cisco Nexus 56...

Page 96: ... VM Test IPv6 connectivity to the iLO of each HC380 node In order to test IPv6 connectivity to the iLO of each HC380 node perform the following from the HC380 management VM 1 Open a web browser to the iLO of the first HC380 node and log in Use either a username and password combination you previously set up on the iLO or the Administrator user with the password on the Toe Tag on the HC380 node 2 O...

Page 97: ...h have the iLO connections a IPv6 is enabled by default on a Comware based device however it can be disabled using ACLs b If the rest of the network is another switch vendor they could also have IPv6 disabled To help eliminate a Comware based ToR being used by the HC380 as the source of blocking you can try the following if you have access to the network switch i Log into the Comware based switch ...

Page 98: ...ou previously set up on the iLO or the Administrator user with the password on the Toe Tag on the HC380 node 2 Once logged in open a remote console to the system Accept any security warnings that appear 3 Press Alt F1 at the same time and log into the esxcli command interface with the username root and password HyperConv 234 4 Execute the following command and record the entry for vmk3 root node1 ...

Page 99: ...s To help eliminate a Comware based switch being used by the HC380 as the source of blocking you can try the following if you have access to the network switch i Log into the Comware based switch and enter system view Execute the following command to enable IPv6 on your management vlan interface HPE interface Vlan interface mgmt_net_vlan HPE Vlan interface ipv6 address auto link local HPE Vlan int...

Page 100: ...nto the infrastructure More information can be located in HP 5920 5900 Layer 2 LAN Switching Configuration Guide or Cisco Nexus 5600 Series NX OS Interfaces Configuration Guide Release 7 x Configuration worksheet The configuration worksheet contains a list of values that are required to complete this deployment guide Before beginning deployment of a HC380 ensure the configuration worksheet is comp...

Page 101: ...Appendix A Network switch configuration 101 Description Variable Value Network Switch IRF or VPC Domain ID net_switch_domain_id ...

Page 102: ...Appendix B CloudSystem 9 0 Management Host Networking 102 Appendix B CloudSystem 9 0 Management Host Networking ...

Page 103: ...Appendix C CloudSystem 9 0 Compute Host Networking 103 Appendix C CloudSystem 9 0 Compute Host Networking ...

Page 104: ...sole to access can sometimes become confusing Refer to this chart for clarification and default credentials Console name Console image CS9 Operations Console admin unset IP Management Appliance DCM VIP HPE Helion OpenStack Horizon Console admin unset IP Cloud Controller Appliance DCM VIP Management Appliance cloudadmin cloudadmi n IP CloudSystem Appliance DCM VIP ...

Page 105: ...05 Console name Console image MarketPlace Portal consumer cloud IP Enterprise Appliance CAN VIP CSA Management Console admin cloud IP Enterprise Appliance CAN VIP Operations Orchestration administrator unset IP Enterprise Appliance CAN VIP ...

Page 106: ...w HPE Helion CloudSystem 9 0 Network Planning Guide available on the Hewlett Packard Enterprise website http www hpe com info CloudSystem docs before deploying CloudSystem The VLANs need to be unique and between 1 and 4095 Note that the CloudSystem installation utility does not perform any modifications to TOR switches and assumes the configuration has already been completed The following figure s...

Page 107: ...o centrally manage multiple remote sites or deployments while reducing vCenter licensing costs There are a couple of deployment options for the remote vCenter setup One option is a Windows server on which OneView for VMware vCenter is installed that is on the same 1 GbE or 10 GbE network as the HC380 system as shown below Item Description 1 Windows server running VMware vCenter Server and OneView ...

Page 108: ...pendix F Remote vCenter setup 108 Item Description 1 Windows server running OneView for VMware vCenter 2 vCenter Server Appliance vCSA 3 1 GbE or 10 GbE network 4 HC380 cluster with built in Management VM ...

Page 109: ... in a 2 node system For more information see Working with managers and quorum in HPE StoreVirtual Storage User Guide found on the Hewlett Packard Enterprise website http www hpe com storage docs storevirtual When you expand a 2 node cluster with Quorum Witness to 3 nodes the Quorum Witness is no longer required The following table shows how quorum is configured by OneView InstantOn during deployme...

Page 110: ...rprise Appliance VIP2 3 172 28 0 45 172 28 0 46 172 28 0 47 255 255 240 0 410 W X Y n 110 W X Y n 111 W X Y n 112 W X Y n 113 W X Y n 114 W X Y n 115 W X Y n 116 W X Y n 117 W X Y n 118 W X Y n 119 W X Y n 120 W X Y n 121 W X Y n 122 W X Y n 123 W X Y n 124 W X Y n 125 Node 1 iLO serial number Node 2 iLO serial number Node 3 iLO serial number Node 4 iLO serial number Node 5 iLO serial number Node ...

Page 111: ... CloudSystem Mgmt Compute VMs2 25 W X Y n 44 W X Y n 46 DCM Management Appliance VIP2 DCM Cloud Controller VIP2 DCM Enterprise Appliance VIP2 3 W X Y n 110 W X Y n 111 W X Y n 112 W X Y n 113 W X Y n 114 W X Y n 115 W X Y n 116 W X Y n 117 W X Y n 118 W X Y n 119 W X Y n 120 W X Y n 121 W X Y n 122 W X Y n 123 W X Y n 124 W X Y n 125 Node 1 iLO SN Node 2 iLO SN Node 3 iLO SN Node 4 iLO SN Node 5 i...

Page 112: ...nt Example IP Example CIDR Example VLAN ID vSphere vMotion Node 1 Node 16 IP addresses 16 172 28 20 1 172 28 20 16 255 255 255 0 111 Must be contiguous Customer worksheet The following table can be used by the customer to identify the IP addresses needed for the vSphere vMotion network Addresses Purpose Count Customer IP Customer CIDR Customer VLAN ID vSphere vMotion Node 1 Node 16 IP addresses 16...

Page 113: ... Count Example IP Example CIDR Example VLAN ID Storage Node 1 Node 16 IP addresses 50 172 28 30 1 172 28 30 50 255 255 255 0 112 Must be contiguous Customer worksheet The following table can be used by the customer to identify the IP addresses needed for the storage network Addresses Purpose Count Customer IP Customer CIDR Customer VLAN ID Storage Node 1 Node 16 IP addresses 50 Must be contiguous ...

Page 114: ...11 1 255 255 255 0 751 Provider Network 3 1 192 168 11 2 255 255 255 0 752 Provider Network 4 1 192 168 11 3 255 255 255 0 753 Tenant Network 1 1 192 168 14 0 255 255 255 0 801 Tenant Network 2 1 192 168 14 1 255 255 255 0 802 Tenant Network 3 1 192 168 14 2 255 255 255 0 803 Tenant Network 4 1 192 168 14 3 255 255 255 0 804 External Network 1 192 68 12 0 255 255 255 0 850 Customer worksheet The f...

Page 115: ...Appendix H IP addresses for sample cluster 115 Purpose Count Customer IP Customer CIDR Customer VLAN ID External Network 1 ...

Page 116: ...ng Warranties Regulatory information Safety and regulatory compliance For important safety environmental and regulatory information see Safety and Compliance Information for Server Storage Power Networking and Rack Products available at the Hewlett Packard Enterprise website http www hpe com support Safety Compliance EnterpriseProducts Belarus Kazakhstan Russia marking Manufacturer and Local Repre...

Page 117: ...clude YWW where Y indicates the year counting from within each new decade with 2000 as the starting point for example 238 2 for 2002 and 38 for the week of September 9 In addition 2010 is indicated by 0 2011 by 1 2012 by 2 2013 by 3 and so forth YYWW where YY indicates the year using a base year of 2000 for example 0238 02 for 2002 and 38 for the week of September 9 Turkey RoHS material content de...

Page 118: ...er supply specifications for the server nodes see HPE ProLiant DL380 Gen9 Server User Guide found at the Hewlett Packard Enterprise website http www hpe com support DL380Gen9 docs For environmental mechanical and power supply specification for the server rack see the server rack documentation ...

Page 119: ...cumentation to identify the recommended software update method To download product updates go to either of the following o Hewlett Packard Enterprise Support Center Get connected with updates page http www hpe com support e updates o Software Depot website http www hpe com support softwaredepot To view and update your entitlements and to link your contracts and warranties with your profile go to t...

Page 120: ...gnosis and automatic secure submission of hardware event notifications to Hewlett Packard Enterprise which will initiate a fast and accurate resolution based on your product s service level Hewlett Packard Enterprise strongly recommends that you register your device for remote support For more information and device support details go to the Insight Remote Support website http www hpe com info ins...

Page 121: ... CLM cloud management network DCM data center management DNS domain name system DRS Distributed Resource Scheduler HA high availability HDD hard disk drive or hard drive iLO Integrated Lights Out IRF Intelligent Resilient Framework LDAP Lightweight Directory Access Protocol LOM LAN on Motherboard NTP network time protocol ...

Page 122: ...22 SSD solid state device SSO single sign on TMRA recommended ambient operating temperature ToR top of rack VDI virtual desktop infrastructure VLAN virtual local area network VM Virtual Machine VSA VMware vSphere Storage Appliance ...

Page 123: ...tion send any errors suggestions or comments to Documentation Feedback mailto docsfeedback hpe com When submitting your feedback include the document title part number edition and publication date located on the front cover of the document For online help content include the product name product version help edition and publication date located on the legal notices page ...

Page 124: ...roblems 73 disposal battery 116 documentation feedback 123 E ESXi management network examples and worksheet 110 ESXi management network IP addresses 9 EuroAsian Economic Commission 116 European Union notice 116 expansion CloudSystem 69 expansion using OneView InstantOn 64 F Federal Communications Commission FCC notice 116 flat network 8 G Group Administration 47 H HC380 Management UI configuring 4...

Page 125: ...orksheet 113 storage network IP addresses 11 supported servers 73 supported targets 73 supported versions 7 T Taiwan battery recycling notice 116 technical support 119 temperature requirements 24 tenant and provider networking 61 TMRA recommended ambient operating temperature 24 troubleshooting 73 troubleshooting CloudSystem 76 troubleshooting firmware upgrade utility 73 U Ukraine notice 117 unint...

Reviews: