background image

vlan <<vm_production_net_1_vlan>>

name VM-Production-VLAN1
quit

vlan <<fcoe_san_a_vlan>>

name FCoE-SAN-A-VLAN
description FCOE SAN A (VSAN <<net_fcoe_vsan_a_id>>)
quit

vlan <<fcoe_san_b_vlan>>

name FCoE-SAN-B-VLAN
description FCOE SAN B (VSAN <<net_fcoe_vsan_b_id>>)
quit

save

Convert Interfaces to Use FC Protocol

Convert the needed ports to serve as Fibre Channel (FC) ports.

Procedure

From system-view, run the following command:

interface range Ten-GigabitEthernet 1/2/1 to Ten-GigabitEthernet 1/2/6
Ten-GigabitEthernet 2/2/1 to Ten-GigabitEthernet 2/2/6

port-type fc

Add Individual Port Descriptions for Troubleshooting

Add individual port descriptions for troubleshooting activity and verification. The following examples use a
single Nimble Storage array with dual controllers.

Procedure

From system-view, run the following commands:

interface FortyGigE 1/1/1

description <<enclosure_1_name>>-VC1:Q1
quit

interface FortyGigE 1/1/2

description <<enclosure_1_name>>-VC1:Q2
quit

interface FortyGigE 2/1/1

description <<enclosure_1_name>>-VC2:Q1
quit

interface FortyGigE 2/1/2

description <<enclosure_1_name>>-VC2:Q2
quit

interface FortyGigE 1/1/7

description Switch1-IRF-Switch2-IRF-2/1/7
quit

interface FortyGigE 1/1/8

31

Copyright

©

2017 by Nimble Storage, Inc. All rights reserved.

Documentation Feedback

Convert Interfaces to Use FC Protocol

Summary of Contents for Converged Architecture 700

Page 1: ...HPE Converged Architecture 700 with Nimble Storage Deployment Guide ...

Page 2: ...work Cabling 16 Power Cabling 18 Preparing to Install and Configure the HPE Converged Architecture 700 with Nimble Storage 21 The Configuration Worksheet 21 Fully Qualified Domain Names Versus IP Addresses 21 HPE Resources for Automation Efforts 21 Connecting to the Components in the Solution 22 HPE iLO 22 HPE Onboard Administrator 22 Network Switches 22 VMware Host Client 23 VMware vSphere Client...

Page 3: ...figuring iLO 38 Install iLO Advanced Licenses 38 Configure iLO 38 Configuring the c7000 Enclosures 40 Assign IP Addresses to the c7000 Enclosures from the Insight Display 40 Configure Enclosures with the OA Wizard 41 Configure Enclosure Bay IP Addressing 43 Create Admin User for All iLOs 44 Repeat c7000 Configuration Procedures for Each Enclosure in the Solution 44 Configuring the Server and Insta...

Page 4: ...g and Configuring the Nimble Storage Array 59 Initializing and Configuring the Nimble Storage Array 59 Initialize the Array with NWT 59 Configure the Nimble Array 60 Update NimbleOS 60 Configure Nimble Storage to Communicate with VMware vCenter 60 Configuring the FCoE SAN and Presenting the Storage Arrays to the Management Host 62 Zoning the Nimble Storage to the Management Servers 62 Create and C...

Page 5: ... Load the VMware ESXi Image 82 Load VMware VIBs 82 Configure the ICsp Media Server 83 Configure the HPE ICsp OneView Integration 83 Configure OS Deployment Settings 83 Adding a New Build Plan for Enhanced HPE OneView for VMware vCenter Builds 83 Installing and Configuring the HPE OneView for VMware vCenter Software 85 Deploy the HPE OneView for VMware vCenter VM 86 Perform the Initial Configuratio...

Page 6: ...w Cluster 105 Appendix C Factory Resetting a Blade to Prepare for a New OV4VC Build or After a Failed Deployment on a Blade 106 Remove Server Entry from ICsp 106 Remove Profile from OneView 107 Reset the Blade Through Intelligent Provisioning 107 Additional Resources 109 About the Authors 110 David Fogaren 110 Julian Cates 110 Version History 111 Copyright 2017 by Nimble Storage Inc All rights res...

Page 7: ...age logo InfoSight SmartStack CASL NimbleConnect Timeless Storage Data Velocity Delivered Unified Flash Fabric and other names are registered trademarks or trademarks of Nimble Storage in the United States and or other jurisdictions Other trade names trademarks and service marks are the property of their respective owners InfoSight is a registered trademark in Japan of Intage Inc of Japan Usage of...

Page 8: ...ng to meet these criteria so that customers can purchase and deploy the solution with the confidence and knowledge that stringent design and testing have been performed by HPE Solution Overview The HPE Converged Architecture 700 with Nimble Storage can be thought of as a solution template whose components have been prevalidated together The template indicates which families of hardware and softwar...

Page 9: ...to provide a highly available scalable and high performing virtualization platform from one vendor HPE These components are configured according to HPE best practices providing a prescriptively defined foundation onto which IT workloads can be deployed Terms and Abbreviations The following terms and abbreviations appear frequently in this deployment guide You can use the definitions in this list a...

Page 10: ...p media server and that runs the HPE OneView for vCenter plugin software This VM can also be the primary management system for the solution managing the VMware vSphere hosts and the Nimble Storage arrays multi active detection MAD A mechanism that manages switches during an IRF failure MAD detects other switches in the IRF stack that come online as masters and keeps online only the switch with the...

Page 11: ...ment Appliance Build the management VM Configure the storage arrays Deploy the Nimble Storage arrays Configure the converged SAN network Configure the Nimble Storage vCenter integration Deploy the Nimble Storage datastores to the management hosts Configure the HPE management software Deploy HPE OneView Deploy HPE ICsp Deploy the HPE OneView for VMware vCenter plugin Configure the compute servers B...

Page 12: ...h Nimble Storage solution was thoroughly tested to validate the design and the interoperability of the components The precise software and firmware versions that were tested in the lab are presented in the sections that follow 12 Copyright 2017 by Nimble Storage Inc All rights reserved Documentation Feedback Validated Software and Firmware Levels ...

Page 13: ... FlexFabric 10Gb 2P 556FLR SFP Adapter Emulex 11 1 183 62 HPE FlexFabric 20Gb 2P 650FLB Adapter Emulex Note Components marked with an asterisk are not included in the SPP For these components you must build a custom firmware bundle For instructions on how to create the bundle see Create a Custom SSP in the HPE OneView 3 0 User Guide Nimble Storage Software The following table lists the Nimble Stor...

Page 14: ... 2 1 HPE OneView for VMware vCenter 2012 R2 Standard Edition Windows Server Windows management VMs HPE Customized VMware Image HPE publishes a separate VMware recipe specific to HPE ProLiant hardware to ensure compatibility of driver and firmware releases with the VMware ESXi hypervisor The recipe details the HPE customized VMware image and the components necessary for a successful deployment of E...

Page 15: ...ee HPE BladeSystem c7000 Enclosures on the HPE Support Site HPE ProLiant BL460c Gen9 Servers For site requirements installation instructions and other general reference materials see HPE ProLiant BL460c Gen9 Servers on the HPE Support Site HPE ProLiant WS460c Gen9 Graphics Server Blade For site requirements installation instructions and other general reference materials see HPE ProLiant WS460c Gen...

Page 16: ...ng diagram shows the SAN connections for the HPE Converged Architecture 700 with Nimble Storage solution Figure 2 Cabling overview SAN connections 16 Copyright 2017 by Nimble Storage Inc All rights reserved Documentation Feedback Cabling for Networking Storage and Power ...

Page 17: ...F 5940 4Slot 1 10 PCI 1 2 HPE ProLiant DL360 Gen9 2 2 2 2 HPE FF 5940 4Slot 2 11 FC5 Nimble Storage controller A 1 2 13 HPE FF 5940 4Slot 1 12 FC6 Nimble Storage controller A 2 2 13 HPE FF 5940 4Slot 2 13 FC9 Nimble Storage controller A 1 2 14 HPE FF 5940 4Slot 1 14 FC10 Nimble Storage controller A 2 2 14 HPE FF 5940 4Slot 2 15 FC5 Nimble Storage controller B 1 2 15 HPE FF 5940 4Slot 1 16 FC6 Nimb...

Page 18: ... for management Power Cabling The following diagram shows the power connections for the HPE Converged Architecture 700 with Nimble Storage solution 18 Copyright 2017 by Nimble Storage Inc All rights reserved Documentation Feedback Power Cabling ...

Page 19: ...re 4 Power cabling overview Detailed information for each power connection is provided in the following table 19 Copyright 2017 by Nimble Storage Inc All rights reserved Documentation Feedback Power Cabling ...

Page 20: ...1 Nimble Storage array controller A 10 L2 1 Side B PDU 2 PS 1 Nimble Storage array controller B 11 L2 9 Side A PDU 1 PS 2 HPE ProLiant DL360 Gen9 1 12 L2 9 Side B PDU 1 PS 1 HPE ProLiant DL360 Gen9 1 13 L1 7 Side A PDU 1 PS 2 HPE ProLiant DL360 Gen9 2 14 L1 7 Side B PDU 1 PS 1 HPE ProLiant DL360 Gen9 2 15 L1 8 Side B PDU 1 PS 1 HPE BladeSystem c7000 enclosure 16 L2 8 Side B PDU 2 PS 2 HPE BladeSys...

Page 21: ...the component instead Although you can use just IP addresses HPE recommends that you use DNS names whenever possible The solution requires a valid DNS server with host name entries for every component even if you use only IP addresses HPE Resources for Automation Efforts This deployment guide covers the manual steps that are required to build a verified configuration of the HPE Converged Architect...

Page 22: ...onsole click the NET link or the Java link on the Overview page HPE Onboard Administrator Perform the steps in this procedure to log in to the active HPE Onboard Administrator of an enclosure Procedure 1 Using a web browser navigate to https enclosure_1_oa_1_ip 2 Accept any security warnings to continue to the website 3 Log in with the user name admin and the password enclosure_1_password 4 Altern...

Page 23: ... to vCenter Procedure 1 Download the client a Using a web browser navigate to http vsphereclient vmware com vsphereclient 5 1 1 2 5 0 8 VMware viclient all 6 0 0 5112508 exe b Download and install the vSphere Client for Windows You will later use the vSphere Web Client for administration tasks but the thick client installed in this step is used to ease installation c After you download and install...

Page 24: ... the new browser window or tab that opens VMware VM Console vSphere Client for Windows Perform the steps in this procedure to open a VM console from the vSphere Client for Windows application Procedure 1 Log in to the vSphere Client for Windows 2 From the Home page click VMs and Templates 3 In the left pane expand the data tree to display the VM for which you want to open the console 4 Right click...

Page 25: ...rminal emulator that supports SSH connections and connect to nimble_fqdn 2 Log in with the user name admin and the password nimble_adm_pwd Nimble Storage Administrator Console Perform the steps in this procedure to log in to the Nimble Storage array Administrator Console Procedure 1 Using a web browser navigate to https nimble_fqdn 2 Accept any security warnings to continue to the website 3 Log in...

Page 26: ...h the Comware setup should automatically start and attempt to enter automatic configuration Note When instructions call for network configuration in system view context if you are at the HPE prompt issue the system view command to get to the HPE prompt Startup configuration file does not exist Started automatic configuration press CTRL_C or CTRL_D to break Automatic configuration attempt 1 Not rea...

Page 27: ... return to User View with Ctrl Z 4 Change the IRF member ID and reboot the switch HPE irf member 1 renumber 2 Renumbering the member ID may result in configuration change or loss Continue Y N y HPE save The current configuration will be written to the device Are you sure Y N y Please input the file name cfg flash startup cfg To leave the existing filename unchanged press the enter key Validating f...

Page 28: ...e Access to the Switch HPE recommends implementing a multi active detection MAD mechanism which is useful for these purposes To detect the presence of multiple identical IRF fabrics To handle collisions To recover from faults in the unlikely event of an IRF split or failure For more information see the HPE FlexFabric 5940 IRF Configuration Guide This guide explains how to use the management links ...

Page 29: ...alue is an arbitrary number but it must be unique from other IRF domains Procedure 1 From system view run the following commands irf domain net_switch_domain_id irf member 1 priority 32 irf member 2 priority 30 irf mac address persistent always Convert the Chassis Working Mode To configure the interfaces and the switch to use FC or FCoE you must convert the system working mode Before running the c...

Page 30: ...e VLANs Needed To create the necessary VLANs perform this procedure on both switches Procedure 1 From system view run the following commands vlan mgmt_net_vlan name MGMT VLAN quit vlan deployment_net_vlan name Native Deployment VLAN quit vlan mgmt_vmotion_net_vlan name MGMT vMotion VLAN quit vlan mgmt_ft_net_vlan name MGMT FT VLAN quit vlan compute_vmotion_net_vlan name Compute vMotion VLAN quit v...

Page 31: ...Individual Port Descriptions for Troubleshooting Add individual port descriptions for troubleshooting activity and verification The following examples use a single Nimble Storage array with dual controllers Procedure 1 From system view run the following commands interface FortyGigE 1 1 1 description enclosure_1_name VC1 Q1 quit interface FortyGigE 1 1 2 description enclosure_1_name VC1 Q2 quit int...

Page 32: ...gabitEthernet 1 2 1 description mgmt_server_1_hostname LOM1 quit interface Ten GigabitEthernet 1 2 2 description mgmt_server_2_hostname LOM1 quit interface Ten GigabitEthernet 2 2 1 description mgmt_server_1_hostname LOM2 quit interface Ten GigabitEthernet 2 2 2 description mgmt_server_2_hostname LOM2 quit save Configure Global FCoE Parameters Configuring the Fibre Channel over Ethernet FCoE mode ...

Page 33: ...s step traffic classifier DCBX operator or if match acl 4000 quit 4 Create a traffic behavior named DCBX and configure it to mark packets with an 802 1 p priority of 3 traffic behavior DCBX remark dot1p 3 quit 5 Create a QoS policy that associates the traffic classifier created in step 3 with the traffic behavior created in step 4 and specify that this classifier behavior mode is associated with D...

Page 34: ...o storage traffic for assured forwarding af1 Set the rest of the WRR values to strict priority because they are not being used Run the following commands in system view while still on the interface range from step 1 of this procedure qos wrr be group 1 byte count 5 qos wrr af1 group 1 byte count 5 qos wrr af2 group sp qos wrr af3 group sp qos wrr af4 group sp qos wrr ef group sp qos wrr cs6 group ...

Page 35: ...HPE FlexFabric 5940 4Slot switch A with the VSAN for FCoE SAN A interface range Fc 1 2 1 to Fc 1 2 12 port access vsan net_fcoe_vsan_a_id 2 Associate the FC interfaces on HPE FlexFabric 5940 4Slot switch B with the VSAN for FCoE SAN B interface range Fc 2 2 1 to Fc 2 2 12 port access vsan net_fcoe_vsan_b_id Configure SNMPv3 SNMPv3 must be configured properly on the switches to enable HPE OneView t...

Page 36: ...up 111 quit interface range FortyGigE 2 1 1 to FortyGigE 2 1 3 port link aggregation group 112 quit interface range name enclosure_1_name port link type trunk undo port trunk permit vlan 1 port trunk pvid vlan deployment_net_vlan port trunk permit vlan deployment_net_vlan mgmt_net_vlan compute_vmotion_net_vlan compute_ft_net_vlan vm_production_net_1_vlan quit 2 Add the appropriate FCoE VLAN to the...

Page 37: ...an quit save Note The bridge aggregations created in this procedure do not become fully operational until the management and compute servers are deployed with VMware vSphere as described in this guide Uplink into the Existing Network Infrastructure Depending on the available network infrastructure several methods and features can be used to uplink the HPE Converged Architecture 700 with Nimble Sto...

Page 38: ...LO Advanced Licenses If the iLO Advanced licenses were not installed in the factory locate the HPE OneView license keys from the paper documentation for the server Each DL360 includes an HPE OneView license Figure 5 Example of HPE OneView key with iLO The information highlighted in yellow is the HPE part number that identifies whether this is a key for the DL platform In this example E5Y43A is the...

Page 39: ...s Enter Enter mgmt_net_netmask and press Enter h Select Gateway IP Address and press Enter Enter mgmt_net_gw and press Enter i Press F10 to save the configuration j Enter Y to save and exit k Press Enter on the iLO Needs to Reset pop up window l Wait 30 seconds for the iLO to reset and then try to reconnect to the iLO and open the remote console m Press Enter on the iLO is Resetting pop up window ...

Page 40: ...irm the password by retyping mgmt_server_ilo_password and press Enter l Press Enter on the iLO Needs to Reset pop up window m Press Enter on the iLO is Resetting pop up window n Press Enter when you see the Changes Saved pop up window o Press ESC to go to the iLO 4 Configuration Utility menu again to go to the Systems Configuration menu and again at the System Utilities menu Press Enter to exit RB...

Page 41: ...gure each enclosure through the web UI Procedure 1 Log in and configure Onboard Administrator OA a Connect to the primary HPE Onboard Administrator for the first enclosure b If a security warning appears choose the option Continue to this website not recommended to proceed c Log in to the OA as the administrator with the Admin user ID and the password from the Pull tag on the OA module d On the Fi...

Page 42: ...P address information a On the Onboard Administrator Network Settings page click Next b For each OA in the enclosure ensure that Use static IP settings for each active Onboard Administrator is selected and the appropriate information is entered OA1 is used in this example DNS Host Name enclosure_1_oa_1_hostname IP Address enclosure_1_oa_1_ip Subnet Mask mgmt_net_netmask Gateway mgmt_net_gw DNS Ser...

Page 43: ...P addresses Procedure 1 From the left side of the UI select Enclosure Information Enclosure Bay IP Addressing IPv4 2 On the Device tab for bay 1 enter the IP address subnet mask gateway domain and DNS servers in the appropriate fields of the configuration worksheet 3 Choose the appropriate option for populating the EBIPA information in the rest of the blades If the IP information is contiguous for...

Page 44: ...leges on each blade in the enclosure Procedure 1 Using a terminal emulation program open an SSH session to the active Onboard Administrator 2 In the SSH window enter the identifying information for the enclosure IP Address enclosure_1_oa_1_ip Username admin Password enclosure_1_password 3 Run the following command to create an admin user on each blade iLO in the enclosure replacing blade_ilo_admin...

Page 45: ... Remote Console by selecting either NET or Java from the Information Overview window 3 If prompted click Run to allow the remote console to open 4 With the server in the powered off state power on the server by selecting Power Switch Momentary Press Enter Intelligent Provisioning and Configure the Smart Array Procedure 1 Press F10 when appropriate to enter Intelligent Provisioning 2 When the splas...

Page 46: ... DNS mgmt_net_dns1 8 Click the Continue icon in the lower right pane 9 Confirm the information presented and click Continue 10 Intelligent Provisioning installs ESXi on the management server This process takes several minutes and causes the system to reboot 11 When the ESXi installation is finished a pop up message states that the server must be rebooted Press Enter to reboot the server 12 The ser...

Page 47: ...t a native untagged VLAN select VLAN optional and press Enter 8 Enter mgmt_net_vlan and press Enter 9 Select Custom DNS Suffixes 10 Enter mgmt_net_domain_name and press Enter 11 Press Esc to exit the Configure Management Network submenu 12 Press Y to confirm the changes and return to the main menu Configure the vSwitch Failover Policy You must configure a policy to specify how the vSwitch will han...

Page 48: ...nt workstation Log in to VMware ESXi Hosts with the VMware vSphere Client for Windows Log in to each ESXi host with the vSphere Client for Windows Procedure 1 Open the downloaded VMware vSphere Client for Windows and connect to the first management server 2 Open another instance of the VMware vSphere Client for Windows and connect to the second management server Set Up VMkernel Ports and Virtual S...

Page 49: ...et_vlan in the VLAN ID Optional field c Select the Use This Port Group for vMotion checkbox d Click Next to continue with vMotion VMkernel creation e Enter the vMotion IP address mgmt_server_1_vmotion_ip and subnet mask mgmt_vmotion_net_netmask for the host f Click Next and Finish to finalize the creation of the vMotion VMkernel interface 8 Select the VMkernel vMotion configuration and click Edit ...

Page 50: ...Center Management Appliance These procedures provide detailed instructions for installing the VMware vCenter Management Appliance in an HPE Converged Architecture 700 with Nimble Storage environment Prepare for the VMware vCenter Server Appliance Installer Procedure 1 From the vSphere download page on the VMware website download the VMware vCenter Server Appliance ISO file and save it to the insta...

Page 51: ...complete click Continue to proceed to stage 2 of the deployment process 13 Click Next 14 Configure the appliance and then click Next Time Synchronization Mode Synchronize time with NTP servers NTP Servers mgmt_net_ntp1 15 Configure SSO and then click Next a Select Create a new SSO domain b Specify the SSO settings SSO Domain Name mgmt_net_domain_name SSO User Name administrator SSO Password vcente...

Page 52: ...nsure about the size select Medium 10 For the datastore select mgmt_server_1_hostname localdatastore and click Next 11 Configure the network settings and then click Next Network Management IP Version IPv4 IP Assignment static System Name vcenter_fqdn IP Address vcenter_mgmt_ip Subnet Mask mgmt_net_netmask Default Gateway mgmt_net_gw DNS Servers mgmt_net_dns1 12 Review the settings and click Finish...

Page 53: ...ng up the EVC mode see Enhanced vMotion Compatibility EVC Processor Support and How to Enable EVC in vCenter Server Virtual SAN Do not select this checkbox Add Hosts to Management Cluster Procedure 1 Double click vcenter_dc_name in the left pane 2 Click Clusters in the left pane 3 Right click vcenter_mgmt_cluster_name in the bottom left pane and click Add Host a Type the first management server s ...

Page 54: ...ete the following procedures Deploy the base Windows VM Install the VMware tools Enable the Desktop Experience role Configure the second hard drive Set the hostname Set the IP addresses Disable the firewall Enable remote desktop access Configure NTP Run updates and software installations Configure the IIS and ICsp media server Deploy Base Windows VM Procedure 1 From the Home page of the vSphere We...

Page 55: ... 17 Press Enter set the password and log in to the server 18 Click OK again when prompted Install VMware Tools Procedure 1 Navigate back to the vCenter Web Client tab 2 Right click mgmt_vm_name and select All vCenter Actions Guest OS Install VMware Tools 3 Click Mount 4 Navigate back to the VM Console 5 Click Run setup64 exe 6 Click Next to begin the VMware tools installation wizard 7 Click Next t...

Page 56: ...erver Manager and click Local Server 2 Click the link to the right of Computer name in Server Manager 3 Click Change 4 Enter the value of mgmt_vm_hostname 5 Click More 6 Enter the value of mgmt_net_domain_name and click OK 7 Close the window and click Restart Later Set IP Addresses Procedure 1 Right click the Windows icon and click Network Connections 2 Identify which Ethernet adapter on the VM is...

Page 57: ...nable Remote Desktop Access Procedure 1 Open Server Manager and click Local Server 2 Click the link to the right of Remote Desktop in Server Manager 3 Select Allow remote connections to this computer accept any warnings and click OK Configure NTP Procedure 1 Right click the clock in the taskbar at the bottom right corner of the Windows desktop and click Adjust date time 2 Change the time zone and ...

Page 58: ...Verify that Role based or feature based installation is selected and click Next 4 Verify that the local server is selected and click Next 5 Select Web Server IIS 6 Click Add Features to add required features for Web Server IIS 7 Click Next 8 Select NET Framework 3 5 Features and click Next in the Select Features window 9 Click Next in the Web Server Role IIS window 10 Click Next to accept the defa...

Page 59: ...ve to the management VM mgmt_vm_fqdn 2 From the Start Menu select Run the Nimble Setup Manager 3 On the Welcome page find the array that is associated with this solution and click its radio button Click Next 4 If you do not see your array ensure it is connected properly to the 1 GbE switches in VLAN mgmt_net_vlan as an access port and that the firewall is disabled on the management VM 5 Click OK o...

Page 60: ... to the version outlined in Validated Software and Firmware Levels on page 12 It might be necessary to repeat this section several times to update the firmware to the appropriate level if version stepping is required Procedure 1 Log in to the Nimble array and select Administration Software from the top ribbon bar 2 Select Download to check for new versions of the NimbleOS If you do not see the nee...

Page 61: ...e Username administrator mgmt_net_domain_name Password vcenter_administrator_password 4 Select Web Client and VASA Provider 5 Click Save 61 Copyright 2017 by Nimble Storage Inc All rights reserved Documentation Feedback Configure Nimble Storage to Communicate with VMware vCenter ...

Page 62: ...ange of 1 to 1024 The vFC IDs in the example code are the ones that were used in this verified configuration 3 Create the vFC for the first management server s LOM 2 port and associate it with FCoE VSAN B interface vfc 712 description mgmt_server_1_hostname LOM2 port trunk vsan net_fcoe_vsan_b_id bind interface Ten GigabitEthernet 2 2 17 quit 4 Repeat this procedure for the other management server...

Page 63: ...online yes 8G 56 c9 ce 90 7c 99 ae 00 56 c9 ce 90 7c 99 ae 08 3 Back at the switch enter system view and run the vsan net_fcoe_vsan_a_id command system viewvsan net_fcoe_vsan_a_id 4 Using the output from the Nimble Storage array as your guide create an alias for the first Nimble Storage array port logged in to the fabric the items in the preceding switch output example that begin with system view ...

Page 64: ...e_vsan_b_id 5 Create the zone for vsan b zone name mgmt_server_1_hostname LOM2 to nimble_system_name member zone alias mgmt_server_1_hostname LOM2 member zone alias nimble_system_name CA fc6 member zone alias nimble_system_name CA fc10 member zone alias nimble_system_name CB fc6 member zone alias nimble_system_name CB fc10 quit 6 Repeat these steps to create zones for the second management server ...

Page 65: ...ure 1 Using a web browser connect to the VMware vSphere Web Client and log in 2 From the Home tab select Hosts and Clusters 3 Right click vcenter_dc_name and choose Nimble Storage Actions Create Datastore a Select nimble_group_name and click Next b On the General tab complete the following information and then click Next Datastore Name vcenter_mgmt_cluster_name Vol0 Description vcenter_mgmt_cluste...

Page 66: ...Management Hosts to Shared Storage The next task is to move the vcenter_vm_name vcenter_psc_vm_name and mgmt_vm_name to the Nimble Storage array Procedure 1 Using a web browser log in to the VMware vSphere Web Client 2 From the Home tab click Hosts and Clusters 3 Expand vcenter_dc_name vcenter_mgmt_cluster_name in the left pane 4 Right click mgmt_vm_name and click Migrate 5 Select Change storage o...

Page 67: ... page of the vSphere Web Client choose vCenter Host and Clusters 2 Right click vcenter_mgmt_cluster_name and choose Deploy OVF Template 3 Browse to the location of the HPE OneView OVA file select the file and open it 4 Walk through the steps to create a VM a Name the VM as oneview_vm_name b Select Thick Provision Eager Zeroed for the disk format c Place the VM in the Mgmt_Vol0 datastore d Ensure t...

Page 68: ...on to the HPE OneView server d When prompted click Continue and then click Agree and Update in the EULA to install the update 3 After the installation the appliance may reboot Complete the HPE OneView Configuration from the Web UI Procedure 1 Log in to the HPE OneView Web Administration Portal 2 From the top left corner of the UI choose HP OneView Settings 3 If Appendix A Configuration Worksheet o...

Page 69: ... managed server but it imposes no restrictions on the number of VMs that can be associated with a license For this solution you should have received multiple HPE OneView license keys HPE OneView automatically applies these licenses to the servers after you add the licenses to the license pool Example of an HPE OneView license key with iLO QCTG XXXX H9PY KHXZ V7B5 HWWB Y9JL XXXX B89H MZVU DXAU 2CSM...

Page 70: ... could conflict However it is acceptable to have management and deployment on the same network In this case the network that you use for deployment has to be a native untagged VLAN to the blade for proper PXE support Procedure 1 From the top left corner of the HPE OneView UI choose HP OneView Networks 2 Click Create network 3 Use the information in the following table to create Ethernet networks F...

Page 71: ...l networks are not required click Cancel in the Create Network window Create Network Sets Procedure 1 From the top left corner of the HPE OneView UI choose HP OneView Network Sets 2 Click Create network set to create the Mgmt_Set_A network set a Name Mgmt_Set_A b Preferred Bandwidth 1 Gb s c Maximum Bandwidth 20 Gb s d Click Add networks and add the following networks to this network set Tip You c...

Page 72: ...twork set a Name VM_Traffic_Set_A b Preferred Bandwidth 9 Gb s c Maximum Bandwidth 20 Gb s d Click Add networks and add the following networks to this network set VM_Traffic_A Any additional VM traffic networks that you have created for side A 7 Click Create to create the VM_Traffic_Set_B network set a Name VM_Traffic_Set_B b Preferred Bandwidth 9 Gb s c Maximum Bandwidth 20 Gb s d Click Add netwo...

Page 73: ... network e Click Add uplink ports and add the following ports HP VC FlexFabric 20 40 F8 Module 1 Q1 1 HP VC FlexFabric 20 40 F8 Module 1 Q2 1 HP VC FlexFabric 20 40 F8 Module 1 Q3 1 e Click Create to create the Solution_SUS_B uplink set a Name Solution_SUS_B b Type Ethernet c Click Add networks and add the following networks to this uplink set Deployment_B FT_B Mgmt_B SAN_B VM_Traffic_B vMotion_B ...

Page 74: ...which you are creating the profile does not have any VMs on it At this point in the configuration of the solution only the first management server mgmt_server_1_hostname should have VMs but double check to be sure Before you apply a profile to a management server you must migrate all VMs in that server to another management server The procedures in this section focus on the second management serve...

Page 75: ...ver Template 3 From the top right side choose Actions Create server profile and enter the following information Name mgmt_server_2_hostname Description mgmt_server_2_hostname server profile Server Hardware mgmt_server_2_ilo_hostname 4 Click Create The firmware baseline is applied and the server should reboot several times After the profile is completely applied the server shuts down 5 Power on the...

Page 76: ...e following table to create the connections Table 10 HPE recommended BL460c server profile connections Bootable Port Requested Bandwidth Gb Network Type Name Not bootable FlexibleLOM 1 1 a 1 Mgmt_Set_A Ethernet Mgmt_A Not bootable FlexibleLOM 1 2 a 1 Mgmt_Set_B Ethernet Mgmt_B Not bootable FlexibleLOM 1 1 b 8 SAN_A Fibre Channel SAN_A Not bootable FlexibleLOM 1 2 b 8 SAN_B Fibre Channel SAN_B Not ...

Page 77: ...lly imported into HPE OneView If an HPE ProLiant BL660c Gen9 server has two LOMs and additional NIC or CNA mezz cards the connection for the Mgmt_A and the Mgmt_B management networks should be on LOM2 The HPE OneView for vCenter plugin does not support the use of Mgmt_A on multiple NICs because it causes deployment failures Create the Server Profile Template for the HPE ProLiant BL660c Gen9 Server...

Page 78: ...et vMo tion_FT_B_LOM2 Not bootable FlexibleLOM 2 1 d 9 VM_Traffic_Set_A Ethernet VM_Traf fic_A_LOM2 Not bootable FlexibleLOM 2 2 d 9 VM_Traffic_Set_B Ethernet VM_Traf fic_B_LOM2 c Select the Manage local storage and the Manage integrated controller checkboxes If a warning appears click Close to acknowledge it d Make the following selections a Select the Re initialize internal storage checkbox If a...

Page 79: ...e HPE iPDUs or configuring the Rack and Datacenter views for a more holistic display of the solution For more information see the HPE OneView Deployment and Management Guide Consult Additional Resources on page 109 for links to the HPE OneView documentation Deploying and Configuring HPE ICsp You must deploy and configure the HPE Insight Control server provisioning ICsp VM HPE ICsp is used to deplo...

Page 80: ...word admin 5 Set the new password to icsp_administrator_password and click OK 6 In the Appliance Network dialog box enter the following information Appliance settings Host Name icsp_fqdn IPv4 IP Address icsp_mgmt_ip IPv4 Subnet mask mgmt_net_netmask IPv4 Gateway address mgmt_net_gw Preferred DNS Server mgmt_net_dns1 Deployment settings if using separate networks for management and deployment Selec...

Page 81: ...er setup utility link b Click Save when prompted to download the utility and save it to the desktop You will need the utility for the next configuration tasks Configure the Media Server and Load the HPE Service Pack for ProLiant To perform this procedure locate the HPE SPP that is listed in Validated Software and Firmware Levels on page 12 Procedure 1 Mount the SPP ISO file on the management VM ei...

Page 82: ...ck Run 4 Click Continue The Browse for Folder window opens 5 Select Media E and then select ICsp 6 Click OK 7 Clear the Select All checkbox and select ESXi 6 5 8 Click Install 9 Keep the Windows File Share Name option as deployment 10 Click Install 11 Click Install but do not specify the distribution location You will manually specify the location in a later procedure 12 Click Close and then click...

Page 83: ...r Password oneview_readuser_password Description Solution OneView Appliance 4 Click Add and accept the certificate when prompted If the HPE OneView appliance is successfully added HPE ICsp displays the message Appliance access is authorized Configure OS Deployment Settings Procedure 1 From the top left corner of the HPE ICsp UI choose HP Insight Control Server Provisioning Settings 2 Hover the cur...

Page 84: ...s awk F print 1 esxcli network vswitch standard uplink remove uplink name vmnic0 vswitch name vSwitch0 This ensures we still have a vmk that uses DHCP so it can communicate to ICsp OV4VC Will remove this for us later esxcli network vswitch standard portgroup add p vmkDeployment v vSwitch0 esxcli network ip interface add i vmk9 p vmkDeployment mac address mgmt_mac_address esxcli network ip interfac...

Page 85: ... For the build plan to be available in the HPE OneView for VMware vCenter plugin the name must contain ESX case insensitive 5 Click OK 6 From the list of OS build plans on the left side select HPE Grow Cluster ESXi 6 5 Scripted Install 7 Hover your cursor over Custom Attributes and click Edit 8 Click Create custom attribute and enter the following information Name NTP_Server Value mgmt_net_ntp1 9 ...

Page 86: ...S Servers mgmt_net_dns1 7 Select the Power on after deployment checkbox and click Finish Perform the Initial Configuration of the HPE OneView for vCenter Plugin After the OneView for VMware vCenter VM is imported into vCenter and is powered on you must register the vCenter instance in the configuration Procedure 1 Log out and close any open VMware vSphere Web Client and vSphere Client for Windows ...

Page 87: ...ny security warnings to continue Configure Server Module Credentials Procedure 1 From the HPE OneView for vCenter Getting Started page in the left pane choose HPE Management Server Module Credentials 2 Click the Credentials for Platform Infrastructure Integration tab 3 Enter the following global device credentials for ESXi iLO and Onboard Administrator ESXi User name root and password compute_serv...

Page 88: ...ost Hostname IP Address mgmt_server_1_ip Username root Password mgmt_server_root_password d Click Save and then click OK after the credentials are successfully saved e Repeat these steps for each management server 6 Click the Credentials for HPE Management Software Integration tab 7 In the HPE Insight Control Server Provisioning Credential pane add the credentials for HPE ICsp Hostname icsp_fqdn U...

Page 89: ...rate Do not change the common name this name should be ov4vc_fqdn 4 Click Copy to copy the certificate 5 Keep the certificate in the clipboard You will paste the certificate when uploading it to Onboard Administrator Upload the Self Signed Certificate to the Onboard Administrator of Each Enclosure Procedure 1 Log in to the active Onboard Administrator of the first enclosure 89 Copyright 2017 by Ni...

Page 90: ... screen is displayed Set Host Network Configuration Preferences For the OneView for VMware vCenter plugin to be able to call the vSwitches by their custom names during the grow cluster phase you must set these vSwitch names Procedure 1 In the VMware vSphere Web Client navigate to Home HP Management Administration HP Management Host Network Configuration Preferences 2 Click the Network Preferences ...

Page 91: ... SAN Note Depending on the number of servers and the planned end cluster layout multiple clusters can be created 3 Right click vcenter_prod_cluster_1_name and select HP Management Actions HP Grow Cluster a After the Grow Cluster Work Flow Selection window appears select the bottom workflow and click Next b In the Grow Cluster Step 1 window make the following selections a For OS Build Plan select H...

Page 92: ... Installation Configure Compute Server for OneView Configuring the compute server for OneView is optional although HPE recommends making the OneView Server Profile list more user friendly for the end user Procedure 1 Open a web browser and connect to the HPE OneView Web Administration Portal 2 From the top left corner select HP OneView Server Profiles 3 For this example locate blade 1 from enclosu...

Page 93: ...t VMkernel Adapters within the Networking section 9 Select the vmkvMotion VMkernel adapter and click the edit pencil icon a On the NIC settings tab set the MTU to 9000 b On the IPv4 settings tab click Use static IPv4 settings c Enter the following values IPv4 Address enclosure_1_blade_vmotion_bay_1_ip Subnet Mask compute_vmotion_net_netmask d Click OK 10 Select the vmkFT VMkernel adapter and click...

Page 94: ...MC IP address enclosure_1_ebipa_bay1_ip BMC MAC address mac_address 5 Repeat this procedure for all of the other compute blades Post Installation Configuring Compute Server for Storage After the servers are configured in each of the clusters you can connect the servers to the Nimble Storage array and provision datastores to them Gather the WWN of the Compute Server from OneView This procedure is n...

Page 95: ... of 1 to 1024 The vFC IDs shown in the example code are the ones used in the verified configuration interface vfc 1 description enclosure_1_blade_bay_1_hostname LOM1 port trunk vsan net_fcoe_vsan_a_id bind interface Bridge Aggregation 111 mac san_a_mac_address quit 4 Create the vFC for the LOM 2 port of the first management server and associate it with FCoE VSAN B interface vfc 201 description enc...

Page 96: ...te cluster also selects all of the hosts that are part of the cluster 7 Click Next 8 Enter the datastore size leaving all other options at the default values 9 Click Next 10 Select Create New Volume Collection and provide a name for the volume collection 11 Click Next 12 From the Schedule Template dropdown menu select an appropriate template or create a custom schedule that meets your snapshot ret...

Page 97: ...t_vlan Deployment network VLAN deployment_net_netmask Deployment network netmask mgmt_vmotion_net_vlan Management vMotion network VLAN mgmt_vmotion_net_netmask Management vMotion network net mask mgmt_ft_net_vlan Management FT network VLAN mgmt_ft_net_netmask Management FT network netmask compute_vmotion_net_vlan Compute vMotion network VLAN compute_vmotion_net_netmask Compute vMotion network netm...

Page 98: ...rver 1 IP address mgmt_server_2_ip Management server 2 IP address mgmt_server_1_ft_ip Management server 1 FT IP address mgmt_server_2_ft_ip Management server 2 FT IP address mgmt_server_1_vmotion_ip Management server 1 vMotion IP address mgmt_server_2_vmotion_ip Management server 2 vMotion IP address mgmt_server_root_password Management server root password Nimble Storage System Value Variable Des...

Page 99: ...vices Controller root password vcenter_sso_password vCenter SSO password vcenter_sso_site_name vCenter SSO site name vcenter_dc_name vCenter data center name vcenter_mgmt_cluster_name vCenter management cluster name vcenter_prod_cluster_1_name vCenter production cluster 1 name Management VM Value Variable Description mgmt_vm_name Management VM name mgmt_vm_hostname Management VM host name mgmt_vm_...

Page 100: ...umber count oneview_readuser_password HPE OneView readUser password HPE OneView for vCenter OV4VC Plugin Value Variable Description ov4vc_vm_name HPE OV4VC VM name ov4vc_hostname HPE OV4VC host name ov4vc_fqdn HPE OV4VC FQDN ov4vc_admin_password HPE OV4VC admin password ov4vc_mgmt_ip HPE OV4VC mgmt network IP ad dress HPE ICsp Value Variable Description icsp_vm_name HPE ICsp name icsp_hostname HPE...

Page 101: ...re 1 EBIPA bay 2 IP address enclosure_1_ebipa_bay3_ip HPE c7000 enclosure 1 EBIPA bay 3 IP address enclosure_1_ebipa_bay4_ip HPE c7000 enclosure 1 EBIPA bay 4 IP address enclosure_1_ebipa_bay5_ip HPE c7000 enclosure 1 EBIPA bay 5 IP address enclosure_1_ebipa_bay6_ip HPE c7000 enclosure 1 EBIPA bay 6 IP address enclosure_1_ebipa_bay7_ip HPE c7000 enclosure 1 EBIPA bay 7 IP address enclosure_1_ebipa...

Page 102: ...Enclosure 1 blade bay 4 IP address enclosure_1_blade_bay_5_ip Enclosure 1 blade bay 5 IP address enclosure_1_blade_bay_6_ip Enclosure 1 blade bay 6 IP address enclosure_1_blade_bay_7_ip Enclosure 1 blade bay 7 IP address enclosure_1_blade_bay_8_ip Enclosure 1 blade bay 8 IP address enclosure_1_blade_bay_9_ip Enclosure 1 blade bay 9 IP address enclosure_1_blade_bay_10_ip Enclosure 1 blade bay 10 IP...

Page 103: ...bay_13_host name Enclosure 1 blade bay 13 host name enclosure_1_blade_bay_14_host name Enclosure 1 blade bay 14 host name enclosure_1_blade_bay_15_host name Enclosure 1 blade bay 15 host name enclosure_1_blade_bay_16_host name Enclosure 1 blade bay 16 host name enclosure_1_blade_vmo tion_bay_1_ip Enclosure 1 blade vMotion bay 1 IP address enclosure_1_blade_vmo tion_bay_2_ip Enclosure 1 blade vMoti...

Page 104: ...nclosure_1_blade_ft_bay_1_ip Enclosure 1 blade FT bay 1 IP ad dress enclosure_1_blade_ft_bay_2_ip Enclosure 1 blade FT bay 2 IP ad dress enclosure_1_blade_ft_bay_3_ip Enclosure 1 blade FT bay 3 IP ad dress enclosure_1_blade_ft_bay_4_ip Enclosure 1 blade FT bay 4 IP ad dress enclosure_1_blade_ft_bay_5_ip Enclosure 1 blade FT bay 5 IP ad dress enclosure_1_blade_ft_bay_6_ip Enclosure 1 blade FT bay 6...

Page 105: ...place and customize this section install firstdisk overwritevmfs reboot after installation reboot Set the network to DHCP on the network adapater network bootproto dhcp Command for server based licensing To use Set the Custom Attribute for Productkey_ESXi65 and uncomment the below 2 lines firstboot vim cmd vimsvc license set Productkey_ESXi65 OV4VC custom values firstboot This will configure the M...

Page 106: ... volumes hostname s localdatastore nimble ncm for esx6 5 4 1 0 650005 zip post install script DO NOT MODIFY THE CODE BELOW IT WILL RESULT IN BUILD PLAN FAILURE post interpreter python ignorefailure true import time stampFile file finished stamp mode w stampFile write time asctime Appendix C Factory Resetting a Blade to Prepare for a New OV4VC Build or After a Failed Deployment on a Blade If a prob...

Page 107: ...select Actions Power off in the upper right corner 6 To remove the server profile select Actions Delete in the upper right corner Reset the Blade Through Intelligent Provisioning The final tasks are to clear the configuration on the HPE Smart Array controller and to reset the BIOS back to the factory defaults Provisioning 1 Connect and log in to the HPE iLO of the server you are resetting 2 Select...

Page 108: ...es 11 When the server attempts to PXE boot the process is complete and you can shut down the server by selecting Power Switch Momentary Press from the top left corner of the Remote Console 108 Copyright 2017 by Nimble Storage Inc All rights reserved Documentation Feedback Reset the Blade Through Intelligent Provisioning ...

Page 109: ...r ProLiant download Service Pack for ProLiant documentation HPE Software Nimble Storage Software Note You will need a valid Nimble Storage InfoSight account with the proper rights to download any software HPE OneView Software HPE OneView Documentation HPE OneView Partner Integrations HPE OneView for vCenter Documentation HPE VMware OEM Software Delivery Repository VMware Software VMware vCenter Se...

Page 110: ... their most critical applications Julian Cates Principal Technical Marketing Engineer Nimble Storage a Hewlett Packard Enterprise company Julian Cates is a Principal Technical Marketing Engineer with the Nimble Storage Technical Marketing team For the most recent 12 years of his 20 year IT career he has focused on building and implementing storage solutions that customers rely on to run their most...

Page 111: ...Version History Description Release Date Version Initial release June 2017 1 0 111 Copyright 2017 by Nimble Storage Inc All rights reserved Documentation Feedback Version History ...

Reviews: