manualshive.com logo in svg

NetApp HCI, Manual

Share
Download
NetApp HCI Manual Download Page 32

Source

Destination

Port

Description

Management node

Baseboard management
controller (BMC)

443

Hardware monitoring and
inventory connection
(Redfish and IPMI
commands)

Management node

23.32.54.122

,

216.240.21.15

443

Element software
upgrades

Management node

Witness Node

9442

Per-node configuration
API service

Management node

vCenter Server

9443

vCenter Plug-in
registration. The port can
be closed after registration
is complete.

SNMP server

Storage cluster MVIP

161 UDP

SNMP polling

SNMP server

Storage node MIP

161 UDP

SNMP polling

Storage node MIP

DNS servers

53 TCP/UDP

DNS lookup

Storage node MIP

Management node

80

Element software
upgrades

Storage node MIP

Management node

443

Element software
upgrades

Storage node MIP

S3/Swift endpoint

80

(Optional) HTTP
communication to S3/Swift
endpoint for backup and
recovery

Storage node MIP

NTP server

123 UDP

NTP

Storage node MIP

Management node

162 UDP

(Optional) SNMP traps

Storage node MIP

SNMP server

162 UDP

(Optional) SNMP traps

Storage node MIP

LDAP server

389 TCP/UDP

(Optional) LDAP lookup

Storage node MIP

Remote storage cluster
MVIP

443

Remote replication cluster
pairing communication

Storage node MIP

Remote storage node MIP 443

Remote replication cluster
pairing communication

Storage node MIP

S3/Swift endpoint

443

(Optional) HTTPS
communication to S3/Swift
endpoint for backup and
recovery

Storage node MIP

Management node

10514 TCP/UDP, 514
TCP/UDP

Syslog forwarding

Storage node MIP

Syslog server

10514 TCP/UDP, 514
TCP/UDP

Syslog forwarding

Storage node MIP

LDAPS server

636 TCP/UDP

LDAPS lookup

Summary of Contents for HCI

Page 1: ...CI configuration and management documentation HCI NetApp March 06 2021 This PDF was generated from https docs netapp com us en hci docs index html on March 06 2021 Always check docs netapp com for the...

Page 2: ...itch requirements 30 Network cable requirements 31 IP address requirements 32 Network configuration 33 DNS and timekeeping requirements 41 Environmental requirements 42 Protection domains 42 Witness N...

Page 3: ...Plug in 252 Expand your NetApp HCI system 254 Expansion overview 254 Expand NetApp HCI storage resources 254 Expand NetApp HCI compute resources 256 Expand NetApp HCI storage and compute resources at...

Page 4: ...45 Replace power supply units 347 Replace SN2010 SN2100 and SN2700 switches 349 Replace storage node in a two node cluster 357 Legal notices 358 Copyright 358 Trademarks 358 Patents 358 Privacy policy...

Page 5: ...ontrol interface and manage NetApp HCI resources with NetApp Element Plug in for vCenter Server Discover what s new What s new in NetApp HCI What s new in NetApp Element software What s new in managem...

Page 6: ...Cloud Control enhancements NetApp Hybrid Cloud Control is enhanced for version 1 8P1 Learn more Element 12 2 NetApp HCI 1 8P1 includes Element 12 2 for storage clusters Element 12 2 introduces SolidF...

Page 7: ...o these security improvements the Element API Reference Guide has more information CreateInitiators ModifyInitiators AddAccount ModifyAccount Fully Qualified Domain Name FQDN access to UIs Element 12...

Page 8: ...es for various components of the NetApp HCI and Element storage environment You will be prompted to log in using your NetApp Support Site credentials NetApp HCI NetApp HCI 1 8P1 Release Notes NetApp H...

Page 9: ...ease Notes latest Compute Firmware Bundle 2 27 Release Notes Compute Firmware Bundle 12 2 109 Release Notes Storage firmware Storage firmware Bundle 2 76 Release Notes latest Storage firmware Bundle 2...

Page 10: ...ters It is used to upgrade and provide system services including monitoring and telemetry manage cluster assets and settings run system tests and utilities and enable NetApp Support access for trouble...

Page 11: ...ster settings and utilize system tests and utilities Learn more https management node IP address 9443 Register the vCenter Plug in package in the vSphere Web Client https activeiq solidfire com Monito...

Page 12: ...hin the storage system A local non LDAP cluster administrator account is required to access active nodes in a cluster via the per node UI Account credentials are not required to access a node that is...

Page 13: ...have no effect outside of those volumes Volume accounts are managed within the NetApp Hybrid Cloud Control Volumes table Find more information Manage user accounts Learn about clusters NetApp HCI Reso...

Page 14: ...luster Asynchronous replication is appropriate for the following situations The disaster recovery site is far from the source and the application does not tolerate latencies induced by the network The...

Page 15: ...me clones snapshots are simply replicas of volume metadata so you cannot mount or write to them Creating a volume snapshot also takes only a small amount of system resources and space which makes snap...

Page 16: ...where each node is in a separate chassis these two levels are functionally identical You can manually enable protection domain monitoring using the NetApp Element Configuration extension point in the...

Page 17: ...NetApp Hybrid Cloud Control features are designed to work with multiple storage clusters but authentication and authorization have limitations The limitation around authentication and authorization i...

Page 18: ...Witness Nodes only one can be active in the ensemble The second Witness Node cannot be added to the ensemble because it performs the backup role The cluster stays in degraded state until the offline...

Page 19: ...lement software based storage clusters In addition to upgrades it is used to provide system services including monitoring and telemetry manage cluster assets and settings run system tests and utilitie...

Page 20: ...two and three node storage clusters section here Find more information NetApp HCI Two Node Storage Cluster TR 4823 NetApp Element Plug in for vCenter Server SolidFire and Element Software Documentatio...

Page 21: ...ccess groups Persistent volumes Persistent volumes allow management node configuration data to be stored on a specified storage cluster rather than locally with a VM so that data can be preserved in t...

Page 22: ...llowing limits A maximum of 64 IQNs or WWPNs are allowed in an access group An access group can be made up of a maximum of 2000 volumes An IQN or WWPN can belong to only one access group A single volu...

Page 23: ...ere Standard Switch as the default Optional use of vSphere Distributed Switch requires VMware Enterprise Plus licensing NetApp HCI and ONTAP Select licensing If you were provided a version of ONTAP Se...

Page 24: ...on the storage cluster All drives in storage nodes that are capable of encryption use AES 256 bit encryption at the drive level Each drive has its own encryption key which is created when the drive is...

Page 25: ...hods You can pair multi factor authentication with common SAML 2 0 compatible identity providers IdPs such as Microsoft Active Directory Federation Services ADFS and Shibboleth To configure MFA see En...

Page 26: ...heir Burst IOPS level for a set burst period A volume can burst for up to 60 seconds if the cluster has the capacity to accommodate the burst A volume accrues one second of burst credit up to a maximu...

Page 27: ...ster usage and per node performance QoS performance The QoS performance curve shows the relationship between block size and the percentage of IOPS Block size and bandwidth have a direct impact on the...

Page 28: ...es QoS policies are best for service environments for example with database application or infrastructure servers that rarely reboot and need constant equal access to storage Individual volume QoS is...

Page 29: ...requirements and pre deployment tasks Network port requirements Network and switch requirements Network cable requirements IP address requirements Network configuration DNS and timekeeping requirement...

Page 30: ...l the access attempt succeeds The following abbreviations are used in the table MIP Management IP address a per node address SIP Storage IP address a per node address MVIP Management virtual IP addres...

Page 31: ...gement Control Protocol RMCP port Required for NetApp Hybrid Cloud Control compute firmware upgrades Management node sfsupport solidfire com 22 Reverse SSH tunnel for support access Management node St...

Page 32: ...443 Element software upgrades Storage node MIP S3 Swift endpoint 80 Optional HTTP communication to S3 Swift endpoint for backup and recovery Storage node MIP NTP server 123 UDP NTP Storage node MIP M...

Page 33: ...validation and access to software inventory System administrator PC Storage node MIP 80 NetApp HCI only Landing page of NetApp Deployment Engine System administrator PC Management node 442 HTTPS UI ac...

Page 34: ...e planned cabling configuration you can physically separate these networks using separate switches or logically separate them using VLANs For most deployments however you need to logically separate th...

Page 35: ...nt Find more information NetApp HCI Resources page NetApp Element Plug in for vCenter Server Network cable requirements You can use the following guidelines to ensure that you have enough of the right...

Page 36: ...esses needed per NetApp HCI deployment The NetApp HCI storage network and management network should each use separate contiguous ranges of IP addresses Use the following table to determine how many IP...

Page 37: ...ing networks Network name VLAN ID Management 100 Storage 105 vMotion 107 Virtual machines 200 201 For automatic discovery and configuration of your NetApp HCI nodes in the NetApp Deployment Engine you...

Page 38: ...nodes Option A Two cables using ports D and E Two cables using ports C and D Two cables using ports A and B Option B Six cables using ports A through F Not available Not available Option C Similar to...

Page 39: ...D scheme This configuration uses vSphere Distributed Switches that require VMware vSphere Enterprise Plus licensing NetApp HCI documentation uses letters to refer to network ports on the back panel of...

Page 40: ...s to configure all switch ports used for NetApp HCI nodes These commands are based on a Cisco configuration but might require only small changes to apply to Mellanox switches See your switch documenta...

Page 41: ...rd Switches or vSphere Distributed Switches which require VMware vSphere Enterprise Plus licensing NetApp HCI documentation uses letters to refer to network ports on the back panel of H series nodes H...

Page 42: ...t require inclusion of the native VLAN in the allowed VLAN list See the documentation for your specific switch model and software version Find more information NetApp HCI Resources page NetApp Element...

Page 43: ...locations on the H610S storage node VLAN configuration for H410C H410S and H610S nodes This topology option uses the following VLAN configuration on H410C H410S and H610S nodes Node ports used Network...

Page 44: ...pp HCI nodes These commands are based on a Cisco configuration but might require only minimal changes to apply to Mellanox switches See your switch documentation for the specific commands you need to...

Page 45: ...r a successful deployment Make the following DNS and timeserver preparations before deploying NetApp HCI Create any needed DNS entries for hosts such as individual compute or storage nodes and documen...

Page 46: ...e this feature you should split storage capacity evenly across three or more NetApp H series chassis for optimal storage reliability In this scenario the storage cluster automatically enables protecti...

Page 47: ...edeploy a Witness Node in case it is accidentally removed lost or corrupted You can also use the template to redeploy a Witness Node if you need to replace a failed compute node that was hosting the W...

Page 48: ...yment Engine NDE Manage NetApp HCI using the vCenter Plug in Monitor or upgrade NetApp HCI with the Hybrid Cloud Control Prepare for installation Before you begin the installation complete the NetApp...

Page 49: ...hlights of prerequisites For prerequisites details see Requirements for NetApp HCI deployment overview Bond1G is a logical interface that combines 1GbE network ports on storage nodes and a management...

Page 50: ...s chassis 3 Install the switches 4 Cable the compute node 5 Cable the storage node 6 Connect the power cords 7 Power on the NetApp HCI nodes Complete optional tasks after installing hardware After ins...

Page 51: ...ddress of the primary node via HTTP not HTTPS Example http IP_address 442 nde Deploy NetApp HCI with the NDE UI 1 In the NDE accept the prerequisites check to use Active IQ and accept license agreemen...

Page 52: ...ing vCenter optional 10 Record node serial numbers in the NetApp HCI Installation Discovery Workbook 11 Specify a VLAN ID for the vMotion Network and any network that requires VLAN tagging See the Net...

Page 53: ...ng the vCenter Plug in After you install NetApp HCI you can configure clusters volumes datastores logs access groups initiators and Quality of Service QoS policies by using the NetApp Element Plug in...

Page 54: ...guration Advisor 5 8 1 or later network validation tool NetApp SolidFire Active IQ Documentation Install H series hardware Before you get started with using NetApp HCI you should install the storage a...

Page 55: ...and H410S H610C and H615C The terms node and chassis are used interchangeably in the case of H610C and H615C because node and chassis are not separate components unlike in the case of a 2U four node c...

Page 56: ...H610S The terms node and chassis are used interchangeably in the case of H610C and H615C because node and chassis are not separate components unlike in the case of a 2U four node chassis...

Page 57: ...Prepare for installation In preparation for installation inventory the hardware that was shipped to you and contact NetApp Support if any of the items are missing...

Page 58: ...own Install the rails The hardware order that was shipped to you includes a set of slide rails You will need a screwdriver to complete the rail installation The installation steps vary slightly for ea...

Page 59: ...k 4 Extend the rear section of the rail to the rear post of the rack 5 Align the hooks on the rear of the rail with the appropriate holes on the rear post ensuring that the front and the back of the r...

Page 60: ...H610S install the chassis node directly onto the rails in the rack Starting with NetApp HCI 1 8 you can set up a storage cluster with two or three storage nodes Remove all the packing material and wr...

Page 61: ...ke in the case of the 2U four node chassis Here is an illustration for installing the node chassis in the rack H610S and H615C node chassis In the case of H615C and H610S the terms node and chassis ar...

Page 62: ...tApp HCI installation ensure that the cabling and network configuration of the nodes that you add are identical to the existing installation Ensure that the airflow vents at the rear of the chassis ar...

Page 63: ...cable configuration For ports A and B connect two CAT5e or higher cables in ports A and B for management connectivity For ports C and F connect two SFP28 SFP cables or transceivers for virtual machin...

Page 64: ...s to the two power supply units per chassis and plug them into 240V PDU or power outlet H610C compute node Here is the cabling for the H610C node H610C nodes are deployed only in the two cable configu...

Page 65: ...nect the node to a 1GbE network using an RJ45 connector in the IPMI port Connect both power cables to the node and plug the power cables to a 110 140V power outlet H610S storage node Here is the cabli...

Page 66: ...ure an IPv4 address on the management network Bond1G on one NetApp HCI storage node If you are using DHCP on the management network you can connect to the DHCP acquired IPv4 address of the storage sys...

Page 67: ...ype of node you have you might need to perform additional steps after you install the hardware and configure NetApp HCI H610C node H615C and H610S nodes H610C node Install the GPU drivers in ESXi for...

Page 68: ...ts used for NetApp H series storage nodes 2 Change the bond mode on all storage nodes to LACP in the on node user interface also known as the terminal user interface or TUI before you deploy NetApp HC...

Page 69: ...ring them as part of deployment you do not need to provide switch information About this task Active IQ Config Advisor performs only read only checks to gather information No configuration is modified...

Page 70: ...ver if you are deploying a new vCenter Server with NetApp HCI This section enables Active IQ Config Advisor to ensure that the management network is available for use and also ensures that services su...

Page 71: ...fter you have validated that your environment is ready to support NetApp HCI and resolved any potential issues you need to complete some final tasks before deployment Ensure you have a successful repo...

Page 72: ...trator account on each compute and storage node as soon as you configure the IPMI network port Before you begin You have configured the IPMI IP address for each compute and storage node Steps 1 Open a...

Page 73: ...awer 4 Click Settings 5 Click User Management 6 Select the Administrator user from the list 7 Enable the Change Password check box 8 Enter a new strong password in the Password and Confirm Password fi...

Page 74: ...ment Access the NetApp Deployment Engine in environments without DHCP You have DHCP in your environment Access the NetApp Deployment Engine in environments with DHCP You want to assign all IP addresse...

Page 75: ...e NetApp Deployment Engine user interface Find more information Firmware and driver versions in NetApp HCI and NetApp Element software Access the NetApp Deployment Engine in environments with DHCP In...

Page 76: ...work has special requirements What you ll need You or your network administrator have completed the tasks in the Installation and Setup Instructions document You have physical access to the NetApp HCI...

Page 77: ...e NetApp End User License Agreement b If you accept the terms click I accept at the bottom of the agreement text c Read the VMware End User License Agreement d If you accept the terms click I accept a...

Page 78: ...ation after NetApp HCI deployment Cloud data services functionality on NetApp HCI requires a VDS vSphere standard switches are not supported for cloud data services Find more information Firmware and...

Page 79: ...etApp HCI only recognizes one of the vCenter Server systems Steps 1 Click Join and extend an existing vSphere deployment 2 Enter the domain name or IP address in the vCenter Server Domain Name or IP a...

Page 80: ...rd in the Re enter Password field 4 Click Continue Find more information Firmware and driver versions in NetApp HCI and NetApp Element software To update vCenter and ESXi credentials later see Update...

Page 81: ...es with SED Self encrypting drive and FIPS 140 2 drive encryption capability When deploying or expanding NetApp HCI you can mix nodes with different reported levels of encryption but NetApp HCI only s...

Page 82: ...p HCI resources to the deployment If a node does not meet the requirements for deployment it is not selectable and problems are indicated as errors You can position your cursor over the error in the n...

Page 83: ...lates much of the rest of the information on the network settings page You can then enter final network settings and verify that the network configuration is correct before proceeding You do not need...

Page 84: ...tion for NetApp HCI in the following fields Field Description DNS Server IP Address 1 The IP address of the primary DNS server for NetApp HCI If you specified a DNS server on the vCenter Configuration...

Page 85: ...e of network traffic in each network 6 In the Starting IP column enter the first useable IP address for each network subnet in each network Do not assign VLAN IDs 1 Select No for the Will you assign V...

Page 86: ...re saved on each page d Repeat steps 2 and 3 to make any other necessary changes 4 If you do not want to send cluster statistics and support information to NetApp hosted SolidFire Active IQ servers cl...

Page 87: ...complete some final tasks before your NetApp HCI system is ready for production use such as updating firmware and drivers and making any needed final configuration changes Supported networking changes...

Page 88: ...A vmk1 vmnic5 Port E iSCSI B vmk2 vmnic1 Port D vMotion vmk3 vmnic4 Port C vmnic0 Port F The following is a six interface configuration with VMware vSphere Standard Switching VSS This configuration u...

Page 89: ...vmnic physical interface Management vmk0 vmnic0 Port A vmnic1 Port B iSCSI A vmk1 vmnic0 Port B iSCSI B vmk2 vmnic1 Port A vMotion vmk3 vmnic0 Port A vmnic1 Port B Find more information NetApp Element...

Page 90: ...pp HCI Resources page SolidFire and Element Software Documentation Center Install GPU drivers for GPU enabled compute nodes Compute nodes with NVIDIA graphics processing units GPUs like the H610C need...

Page 91: ...in as root to the ESXi host and install the NVIDIA vGPU Manager in ESXi a Run the following command to log in to the ESXi host as the root user ssh root ESXi_IP_ADDRESS b Run the following command to...

Page 92: ...FQDN If you want to use the FQDN to access web user interfaces such as the Element web UI per node UI or management node UI you must first add a storage cluster setting to identify the FQDN used by t...

Page 93: ...de_IP mnode 2 b Click Authorize or any lock icon and enter the Element cluster user name and password c Enter the client ID as mnode client d Click Authorize to begin a session e Close the window f Cl...

Page 94: ...ample https ManagementNodeIP 2 Log in to NetApp Hybrid Cloud Control by providing the NetApp HCI storage cluster administrator credentials The NetApp Hybrid Cloud Control interface appears If you logg...

Page 95: ...NetApp HCI Resources page...

Page 96: ...vices on the management node use credentials username password to authenticate against VMware vCenter and ESXi If communication between these components fails NetApp Hybrid Cloud Control and vCenter d...

Page 97: ...D as mnode client c Click Authorize to begin a session d Close the window 4 From the REST API UI click GET assets compute_nodes This retrieves the records of compute node assets that are stored in the...

Page 98: ...that the response is HTTP 200 which indicates that the new credentials have been stored in the referenced compute asset record 9 Repeat the previous two steps for additional compute node assets that n...

Page 99: ...ator credentials 2 From the Dashboard click on the top right Options icon and select User Management 3 From the Users page click Configure LDAP 4 Define your LDAP configuration 5 Select the authentica...

Page 100: ...admin group in the LDAP server All the children accounts of that group will inherit those permissions 7 Check the box indicating that I have read and accept the NetApp End User License Agreement 8 Cli...

Page 101: ...letion by selecting Yes Manage volume accounts Volume accounts are managed within the NetApp Hybrid Cloud Control Volumes table These accounts are specific only to the storage cluster on which they we...

Page 102: ...with the account first Deleting or locking an account associated with the management node results in an inaccessible management node Persistent volumes that are associated with management services ar...

Page 103: ...rsion is running NetApp Element software 11 3 or later Management node You have deployed a management node running version 11 3 or later Management services You have updated your management services b...

Page 104: ...the authoritative storage cluster administrator credentials 2 From the Dashboard select the options menu on the top right and select Configure 3 In the Storage Clusters pane select Storage Cluster De...

Page 105: ...redentials You can specify QoS settings for a volume during creation You can manage volumes in NetApp Hybrid Cloud Control in the following ways Create a volume Apply a QoS policy to a volume Edit a v...

Page 106: ...t QoS values Volumes that have a Max or Burst IOPS value greater than 20 000 IOPS might require high queue depth or multiple sessions to achieve this level of IOPS on a single volume 10 Click Create V...

Page 107: ...p Hybrid Cloud Control by providing the NetApp HCI or Element storage cluster administrator credentials 2 From the Dashboard expand the name of your storage cluster on the left navigation menu 3 Selec...

Page 108: ...quential workloads more quickly while still constraining the sustained IOPS for a volume 6 Select Save Clone volumes You can create a clone of a single storage volume or clone a group of volumes to ma...

Page 109: ...you may need to extend partitions or create new partitions in the free space to make use of it d Select an account to associate with the volume clone If an account does not exist click Create New Acc...

Page 110: ...If you selected multiple volumes click the Delete quick filter at the top of the table If you selected a single volume in the Actions column of the Volumes table expand the menu for the volume and sel...

Page 111: ...s groups You can create new volume access groups make changes to the name associated initiators or associated volumes of access groups or delete existing volume access groups using NetApp Hybrid Cloud...

Page 112: ...xpand the options menu for the access group you need to edit 6 In the options menu select Edit 7 Make any needed changes to the name associated initiators or associated volumes 8 Confirm your changes...

Page 113: ...versions Options Create an initiator Add initiators to a volume access group Change an initiator alias Delete initiators Create an initiator You can create iSCSI or Fibre Channel initiators and option...

Page 114: ...the list that might already exist in the installation f Select Create Initiators Add initiators to a volume access group You can add initiators to an volume access group When you add an initiator to a...

Page 115: ...e Dashboard expand the name of your storage cluster on the left navigation menu 3 Select Volumes 4 Select the Initiators tab 5 Delete one or more initiators a Select one or more initiators you want to...

Page 116: ...ultiple clusters or vCenter Servers are used in your environment 7 Enter the minimum IOPS maximum IOPS and burst IOPS values 8 Click Create QoS Policy A system ID is generated for the policy and the p...

Page 117: ...y providing the NetApp HCI or Element storage cluster administrator credentials 2 From the Dashboard expand the menu for your storage cluster 3 Select Storage Volumes 4 Click the Actions menu next to...

Page 118: ...ive Volumes column for a policy to show a filtered list of the volumes assigned to that policy Delete a QoS policy You can delete a QoS policy if it is no longer needed When you delete a QoS policy al...

Page 119: ...asset management Install or recover a management node Install a management node Configure a storage Network Interface Controller NIC Recover a management node Access the management node Access the ma...

Page 120: ...ring a proxy server About this task The Element 12 2 management node is an optional upgrade It is not required for existing deployments Prior to following this procedure you should have an understandi...

Page 121: ...the management network can route to the storage network Do not power on the virtual machine prior to the step indicating to do so later in this procedure b Attach the ISO to the virtual machine and bo...

Page 122: ...server insert the hostname or IP address of the default time server iii Save the configuration file when complete d Force an NTP sync with the newly added server sudo ntpd gq e Restart NTPD sudo serv...

Page 123: ...e same storage cluster that you used during NTP servers configuration storage_username su username The storage cluster administrator username for the cluster specified by the storage_mvip parameter te...

Page 124: ...to port 443 e Optional Use parameter help if you need additional information about each parameter help h Returns information about each parameter Parameters are defined as required or optional based o...

Page 125: ...a controller sub asset d Click Try it out e Enter the parent base asset ID you copied to your clipboard in the asset_id field f Enter the required payload values with type vCenter and vCenter credenti...

Page 126: ...ur environment Configure a storage Network Interface Controller NIC for an untagged network interface Configure a storage Network Interface Controller NIC for a tagged network interface Configure a st...

Page 127: ...ame method SetConfig Configure a storage Network Interface Controller NIC for a tagged network interface Steps 1 Open an SSH or vCenter console 2 Replace the values in the following command template a...

Page 128: ...on Add an asset to the management node NetApp Element Plug in for vCenter Server NetApp HCI Resources Page Recover a management node You can manually recover and redeploy the management node for your...

Page 129: ...com site products all details netapp hci downloads tab a Click Download Latest Release and accept the EULA b Select the management node image you want to download 2 If you downloaded the OVA follow t...

Page 130: ...the buttons press Tab To move from the buttons to the fields press Tab To navigate between fields press the Up or Down arrow keys 2 Configure the management node network eth0 If you need an additional...

Page 131: ...f you deploy the mNode in a hypervisor environment other than VMware for example from the iso image in an Openstack environment refer to the hypervisor documentation for the equivalent commands i Disa...

Page 132: ...The management virtual IP address of the storage cluster Configure the management node with the same storage cluster that you used during NTP servers configuration persistent volume account name The n...

Page 133: ...node contains two UIs a UI for managing REST based services and a per node UI for managing network and cluster settings and operating system tests and utilities For clusters running Element software v...

Page 134: ...ement node REST API UI From the REST API UI you can access a menu of service related APIs that control management services on the management node Steps 1 To access the REST API UI for management servi...

Page 135: ...for SolidFire all flash storage NetApp Element Plug in for vCenter Server NetApp HCI Resources Page Work with the management node UI Management node UI overview With the management node UI https manag...

Page 136: ...sponse from server 405 1 Open the per node management node UI https IP address 442 2 Click the Alert Monitor tab 3 Configure the alert monitoring options Alert monitoring options options Description R...

Page 137: ...Deployment Engine you need to enable telemetry again using the management node REST API to configure the service from this page Send Compute Node Data To AIQ Controls the flow of support and monitori...

Page 138: ...e cluster assets Asset management View or edit existing controller assets Create and manage storage cluster assets Remove an asset from the management node Use the REST API to collect NetApp HCI logs...

Page 139: ...begin a session 4 Close the Available authorizations dialog box If you try to run a command after the token expires a 401 Error UNAUTHORIZED message appears If you see this authorize again Find more i...

Page 140: ...ize or any lock icon and complete the following a Enter the cluster user name and password b Enter the client ID as mnode client c Click Authorize to begin a session d Close the window 3 Click GET ins...

Page 141: ...e management node inventory When you add a new storage cluster asset it is automatically registered with the management node What you ll need You have copied the storage cluster ID and installation ID...

Page 142: ...The user ID used to communicate with the storage cluster the user must have administrator privileges 6 Click Execute The API returns an object containing information about the newly added storage clu...

Page 143: ...user ID used to communicate with the storage cluster the user must have administrator privileges 7 Click Execute Delete a storage cluster asset You can delete a storage cluster asset if the storage c...

Page 144: ...rver updates and then returns the current proxy settings for the management node The proxy settings are used by Active IQ the NetApp HCI monitoring service that is deployed by the NetApp Deployment En...

Page 145: ...d more information NetApp Element Plug in for vCenter Server NetApp HCI Resources Page Verify management node OS and services versions You can verify the version numbers of the management node OS mana...

Page 146: ...rsion information about the management node OS the management services bundle and the management node API mnode api service that are running on the management node a Select GET about b Select Try it o...

Page 147: ...d b Enter the client ID as mnode client if the value is not already populated c Select Authorize to begin a session d Close the window 3 Select GET logs 4 Select Try it out 5 Specify the following par...

Page 148: ...storage nodes 22 SSH login access Management node to storage nodes or from storage nodes to management node By default the capability for remote access is enabled on the management node To disable re...

Page 149: ...ult Disabling SSH does not terminate or disconnect existing SSH client sessions to the management node If you disable SSH and elect to re enable it at a later time you can do so using the same API API...

Page 150: ...node 2 Select Authorize and complete the following a Enter the cluster user name and password b Enter the client ID as mnode client c Select Authorize to begin a session d Close the window 3 From the...

Page 151: ...you need to power off individual VMware ESXi hosts as well as the VMware vCenter Server Appliance in a certain order Steps 1 Log in to the vCenter instance controlling the NetApp HCI system and deter...

Page 152: ...the nodes array includes the node IDs that you recorded in step 2 For example https MVIP json rpc 1 0 method Shutdown nodes 1 2 3 4 option halt 5 Enter the cluster administrator user name and password...

Page 153: ...res NetApp HCI Datastore 01 02 1 Assuming all storage is accessible power on the vCSA and any other required virtual machines as follows a Select the virtual machines in the navigator select all the v...

Page 154: ...and clusters with at least one managed node in H series hardware appear on the Hybrid Cloud Control Dashboard Access the NetApp HCC Dashboard Monitor storage resources Monitor compute resources Monito...

Page 155: ...ne to see your total storage environment You can monitor the number of storage clusters storage nodes and total volumes To see details in the Storage pane click Show Details To see the most recent sto...

Page 156: ...thresholds Hover over the lines to see details You can set the threshold for Warning which defaults to 3 below the Error threshold The Error and Critical thresholds are preset and not configurable by...

Page 157: ...how much IOPS or throughput you can get out of a cluster without surpassing the useful performance of that resource by using the Storage Performance pane Storage performance is the point at which you...

Page 158: ...so monitor for continuously high throughput values which might indicate that you are nearing the maximum useful performance of the resource c Utilization tab Monitor the utilization of IOPS in relatio...

Page 159: ...based on the physical characteristics of the node for example the number of CPUs the CPU speed and the amount of RAM Steps 1 View the Compute Utilization pane Using both the CPU and Memory tabs look f...

Page 160: ...three node clusters Witness Nodes manage quorum within the cluster they are not used for storage Witness Nodes are applicable only to NetApp HCI and not to all flash storage environments For more inf...

Page 161: ...e version for these clusters If the nodes in a cluster have different firmware versions on them you can see Multiple in the Firmware Bundle Version column 5 To view compute inventory information click...

Page 162: ...to edit BMC information Use NetApp Hybrid Cloud Control to edit BMC information You can edit the stored BMC credentials using the NetApp Hybrid Cloud Control Dashboard Steps 1 Open a web browser and b...

Page 163: ...dware tag and BMC information a Open the inventory service REST API UI on the management node https management node IP inventory 1 b Click Authorize and complete the following i Enter the cluster user...

Page 164: ...b Enter the client ID as mnode client if the value is not already populated c Click Authorize to begin a session d Close the window 4 Click PUT nodes hardware_id 5 Click Try it out 6 Enter the node a...

Page 165: ...er NetApp HCI Resources Page Monitor volumes on your storage cluster The SolidFire system provisions storage using volumes Volumes are block devices accessed over the network by iSCSI or Fibre Channel...

Page 166: ...ity column If Warning Error or Critical thresholds are reached the color represents the used capacity status a Warning Yellow b Error Orange c Critical Red 7 From the Volumes view click the tabs to se...

Page 167: ...ur clusters You can access SolidFire Active IQ from the NetApp Hybrid Cloud Control Dashboard Before you begin You must have a NetApp Support account to take advantage of this service You must have au...

Page 168: ...Find more information NetApp SolidFire Active IQ Documentation NetApp Element Plug in for vCenter Server NetApp HCI Resources Page Collect logs for troubleshooting If you have trouble with your NetApp...

Page 169: ...the list of storage or compute nodes and select individual nodes to collect logs from or all nodes in the list 7 Click Collect Logs to start log collection Log collection runs in the background and th...

Page 170: ...to limit log collection to those specific compute nodes Use the GET https management node IP logs 1 bundle option s endpoint to see all possible node IDs you can use mnodeLogs Boolean Set this paramet...

Page 171: ...e the downloadLink attribute contains the full download link including the file name of the log package e Copy the file name at the end of the downloadLink attribute 4 Download the collected log packa...

Page 172: ...for version 1 8 Upgrade your NetApp SolidFire all flash storage system for Element 12 2 vSphere upgrade sequences including Element Plug in for vCenter Server Choose one of the following sequences ba...

Page 173: ...s Upgrading HealthTools is only required if the management node and Element software you are running is 11 1 or earlier HealthTools are not required for performing Element upgrades using NetApp Hybrid...

Page 174: ...vailable in earlier service bundle versions You have ensured that the system time on all nodes is synced and that NTP is correctly configured for the storage cluster and nodes Each node must be config...

Page 175: ...ent node 11 3 or later Beginning with the Element 11 3 management node release the management node design has been changed based on a new modular architecture that provides individual services These m...

Page 176: ...tps lt ManagementNodeIP gt class bare https lt ManagementNodeIP gt a code 2 Log in to NetApp Hybrid Cloud Control by providing the storage cluster administrator credentials 3 Click Upgrade near the to...

Page 177: ...node IP mnode 2 Click Authorize and complete the following a Enter the cluster user name and password b Enter the client ID as mnode client if the value is not already populated c Click Authorize to...

Page 178: ...management node VM Your cluster version is running NetApp Element software 11 3 or later You have downloaded the service bundle update from the NetApp Support Site to a device that can be used in the...

Page 179: ...to the management node You can check the locally installed version of HealthTools by running the sfupdate healthtools v command To use HealthTools with dark sites you need to do these additional step...

Page 180: ...g Element storage to ensure all storage nodes in your cluster are ready for the next Element storage upgrade What you ll need You have updated to the latest management services bundle 2 10 27 or later...

Page 181: ...b If a KB is specified complete the process described in the relevant KB article c After you have resolved cluster issues click Re Run Health Check After the health check completes without errors the...

Page 182: ...REST API UI on the management node https management node IP storage 1 b Click Authorize and complete the following i Enter the cluster user name and password ii Enter the client ID as mnode client if...

Page 183: ...ttom of the response body 4 If the message return indicates that there were problems regarding cluster health do the following a Go to the specific KB article listed for each issue or perform the spec...

Page 184: ...e ready and additional steps are required Your upgrade check fails with an error message that HealthTools is out of date Your upgrade check fails because your management node is on a dark site Steps 1...

Page 185: ...Ds 1 2 3 More information https kb netapp com support s article ka11A0000008ltYQAQ mNodeconnecti vity check_files Test Description Verify options file exists Passed node IDs 1 2 3 check_cores Test Des...

Page 186: ...ode IDs 1 3 More information https kb netapp com support s article ka11A0000008ltTQAQ SolidFire Disk space error check_mnode_connectivity Test Description Verify storage nodes can communicate with man...

Page 187: ...ur management node is on a dark site 1 Review the message and note that the upgrade check fails Sample response sfupgradecheck failed Unable to verify latest available version of healthtools 2 Downloa...

Page 188: ...ce to perform an upgrade check_var_log_disk_space Node Verifies that var log free space meets some percentage free threshold If it does not the check will rotate and purge older logs in order to fall...

Page 189: ...er is ready to be upgraded See Run Element storage health checks prior to upgrading storage Updated BMC for H610S nodes You have upgraded the BMC version for your H610S nodes See the release notes and...

Page 190: ...s that are applicable to your cluster Option Steps Your management node has external connectivity 1 Click the drop down arrow next to the cluster you are upgrading and select from the upgrade versions...

Page 191: ...drop down arrow next to the cluster you are upgrading and select from the upgrade versions available 2 Click Begin Upgrade After the upgrade is complete the UI prompts you to perform phase 2 of the pr...

Page 192: ...r you resolve the error you can return to the page and click Resume When you resume the upgrade the progress bar goes backwards for a few minutes while the system runs the health check and checks the...

Page 193: ...ode client iii Click Authorize to begin a session iv Close the authorization window c From the REST API UI click GET packages remote repository connection d Click Try it out e Click Execute f If code...

Page 194: ...management node IP package repository 1 b Click Authorize and complete the following i Enter the cluster user name and password ii Enter the client ID as mnode client iii Click Authorize to begin a s...

Page 195: ...k Try it out i Paste the installation asset ID into the id field j Click Execute k From the response copy and save the storage cluster ID id of the cluster you intend to upgrade for use in a later ste...

Page 196: ...c 2c963f66abc1 log https localhost 442 storage upgrades 3fa85f64 1111 4562 b3fc 2c963f66abc1 log storageId 114f14a4 1a1a 11e9 9088 6c0b84e200b4 upgradeId 334f14a4 1a1a 11e9 1055 6c0b84e2001b4 packageI...

Page 197: ...te e Do one of the following if there are problems or special requirements during the upgrade Option Steps You need to correct cluster health issues due to failedHealthChecks message in the response b...

Page 198: ...e 2 Reauthenticate if needed and click PUT upgrades upgradeId 3 Click Try it out 4 Enter the upgrade ID from the previous step in upgradeId 5 Enter action acknowledge in the request body action acknow...

Page 199: ...eems stalled contact NetApp Support for assistance Upgrade Element software at connected sites using HealthTools Steps 1 Download the storage upgrade package You need the latest version of HealthTools...

Page 200: ...tfisodium 11 0 0 345 iso 2018 10 01 16 52 15 Newer version of sfinstall available This version 2018 09 01 130 latest version 2018 06 05 901 The latest version of the HealthTools can be downloaded from...

Page 201: ...815 mip 10 117 0 87 nodeID 2 1 of 4 nodes 2019 04 03 13 21 02 Node Upgrade serving image at http 10 117 0 204 rtfi solidfire rtfisodium patch3 11 3 0 14171 filesystem squashfs 2019 04 03 13 25 40 Stag...

Page 202: ...sfully connected to cluster and all nodes You are about to start a new upgrade 10 117 0 161 10 3 0 161 solidfire rtfi sodium 11 0 0 761 iso Nodes 10 117 0 23 nlabp1023 SF3010 10 3 0 161 10 117 0 24 nl...

Page 203: ...tools to update NetApp Element software at a dark site What you ll need 1 For NetApp HCI systems go to the NetApp HCI software download page For SolidFire storage systems go to the Element software d...

Page 204: ...d to pre stage the upgrade in advance If you are upgrading an H610S series node to Element 12 2 and the node is running a version of Element earlier than 11 8 you will need to perform additional upgra...

Page 205: ...single cold boot cycle at the end of the upgrade for each node Phase 2 involves completing steps to perform a complete node shutdown and power disconnect for each H610S node that are described in a r...

Page 206: ...etApp Hybrid Cloud Control UI and API the management node in your environment is running version 11 3 Management services You have updated your management services bundle to the latest version For H61...

Page 207: ...the storage clusters that are part of your installation If a cluster is inaccessible by NetApp Hybrid Cloud Control it will not be displayed on the Upgrades page If you have clusters running Element...

Page 208: ...process It also changes in response to actions you take such as pausing the upgrade or if the upgrade returns an error See Upgrade status changes While the upgrade is in progress you can leave the pag...

Page 209: ...the Upgrade Status column in the UI shows before during and after the upgrade process Upgrade state Description Up to Date The cluster was upgraded to the latest Element version available or the firm...

Page 210: ...uster to be healthy You will need to engage NetApp Support to assist with the failure investigation NetApp Hybrid Cloud Control has a pre set three hour waiting period during which one of the followin...

Page 211: ...ter the client ID as mnode client iii Click Authorize to begin a session iv Close the authorization window c From the REST API UI click GET packages remote repository connection d Click Try it out e C...

Page 212: ...de https management node IP package repository 1 b Click Authorize and complete the following i Enter the cluster user name and password ii Enter the client ID as mnode client iii Click Authorize to b...

Page 213: ...sponse copy the installation asset ID id id abcd01e2 xx00 4ccf 11ee 11f111xx9a0b management errors inventory authoritativeClusterMvip 10 111 111 111 bundleVersion 2 14 19 managementIp 10 111 111 111 v...

Page 214: ...e parameter field g Click Execute to initiate the upgrade The response should indicate state as initializing _links collection https localhost 442 storage upgrades self https localhost 442 storage upg...

Page 215: ...a4 1a1a 11e9 7777 6c0b84e123b2 dateCompleted 2020 04 21T22 10 57 057Z dateCreated 2020 04 21T22 10 57 057Z h Copy the upgrade ID upgradeId that is part of the response 4 Verify the upgrade progress an...

Page 216: ...ody action resume 7 Click Execute You need to pause the upgrade because the maintenance window is closing or for another reason 1 Reauthenticate if needed and click PUT upgrades upgradeId 2 Click Try...

Page 217: ...o version 12 2 from 12 0 If you are upgrading from management node 11 3 11 5 11 7 or 11 8 Upgrade a management node to version 12 2 from 11 3 through 11 8 If you are upgrading from management node 11...

Page 218: ...r on the iSCSI storage network to allow the configuration of persistent volumes Storage nodes are running Element 11 3 or later Steps 1 Configure the management node VM RAM a Power off the management...

Page 219: ...after the upgrade such as Active IQ collector and proxy settings sudo sf rtfi bin sfrtfi_inplace file upgrade casper filesystem squashfs sf_upgrade 1 The management node reboots with a new OS after t...

Page 220: ...href https lt ManagementNodeIP gt class bare https lt ManagementNodeIP gt a code If you are updating your management node to version 12 2 you need management services 2 14 60 or later to proceed You h...

Page 221: ...5 11 7 or 11 8 management node run the following command to upgrade your management node OS version The script retains all necessary configuration files after the upgrade such as Active IQ collector a...

Page 222: ...o 12GB You have configured an additional network adapter if required using the instructions for configuring a storage NIC eth1 in the management node user guide your product Persistent volumes might r...

Page 223: ...opriate for your version Each script retains all necessary configuration files after the upgrade such as Active IQ collector and proxy settings a On an 11 1 11 1 0 73 management node run the following...

Page 224: ...by an existing management node 11 0 or 11 1 with no persistent volumes sudo sf packages mnode upgrade mnode mu mnode user c For multiple storage clusters managed by an existing management node 11 0 o...

Page 225: ...click Hardware Health c The node BIOS manufacturer and model number are listed Copy and save the value for tag for use in a later step 13 Add a vCenter controller asset for HCI monitoring NetApp HCI i...

Page 226: ...ress and browse to the IP address on port 9443 to open the management node UI https mNode 11 1 IP address 9443 6 In vSphere select NetApp Element Configuration mNode Settings In older versions the top...

Page 227: ...he sf hci nma service on the management node There should be no error messages 21 For management node 11 1 only SSH into the management node version 11 1 with root privileges and start the NMA service...

Page 228: ...Element storage If you have followed a different upgrade order see the procedures for in place management node upgrades Before you begin You have updated your management services to 2 10 29 or later...

Page 229: ...ions see the release notes for your version of the plug in What you ll need Admin privileges You have vCenter Administrator role privileges to install a plug in vSphere upgrades You have performed any...

Page 230: ...e during this process to your plug in if you do not log out For vSphere 7 0 you do not need to log out of the web client Steps 1 Enter the IP address for your management node in a browser including th...

Page 231: ...se servers dark sites A custom URL for the plug in ZIP You can click Custom URL to customize the URL if you are using an HTTP or HTTPS server dark site or have modified the ZIP file name or network se...

Page 232: ...g in icons are not visible see Element Plug in for vCenter Server documentation about troubleshooting the plug in 9 Verify the version change in the About tab in the NetApp Element Configuration exten...

Page 233: ...made by the service Use NetApp Hybrid Cloud Control to run compute node health checks prior to upgrading firmware Using NetApp Hybrid Cloud Control HCC you can verify that a compute node is ready for...

Page 234: ...node https management node IP inventory 1 b Click Authorize and complete the following i Enter the cluster user name and password ii Enter the client ID as mnode client if the value is not already pop...

Page 235: ...hineCount 2 2 Run health checks on the compute nodes in the cluster a Open the compute service REST API UI on the management node https management node IP vcenter 1 b Click Authorize and complete the...

Page 236: ...ortion of the resourceLink URL from the POST compute CONTROLLER_ID health checks code 200 response in the task_id parameter field e Click Execute f If the status returned indicates that there were pro...

Page 237: ...s in vCenter Cluster Launch vSphere and resolve and or acknowledge any alerts before proceeding No KB needed to resolve issue Are management services up to date HCI system You must update management s...

Page 238: ...between ESXi host and hardware host No KB needed to resolve issue See this article for more information What is the status of the Witness Nodes in the cluster None of the witness nodes identified are...

Page 239: ...SXi host Node A Witness Node is running locally on this ESXi host When you are ready to upgrade this ESXi host shut down the Witness Node only on this ESXi host and re run the health check One Witness...

Page 240: ...is the default in NetApp HCI installations virtual machines will automatically be migrated to other nodes in the cluster 13 Proceed to the Ready to Complete page in the wizard and click Finish The dr...

Page 241: ...more information BMC credentials Update the credentials NetApp Hybrid Cloud Control uses to connect to the compute node BMC You can do this using either the NetApp Hybrid Cloud Control UI or API Updat...

Page 242: ...on the vSphere cluster is successful For dark site upgrades you can reduce upload time if the upgrade package and the management node are both local Upgrading the NIC BIOS and BMC can take approximat...

Page 243: ...g into the BMC terminates the Hybrid Cloud Control Serial Over LAN SOL session that monitors upgrade process 4 If the health checks at the cluster or node level passed with warnings but without critic...

Page 244: ...es to diagnose and correct any issue For additional insight into compute node firmware upgrade issues using NetApp Hybrid Cloud Control see this KB article Upgrade status changes Here are the differen...

Page 245: ...est firmware version You can use an automation tool of your choice to run the APIs The API workflow documented here uses the REST API UI available on the management node as an example What you ll need...

Page 246: ...e to begin a session iv Close the authorization window c From the REST API UI click GET packages remote repository connection d Click Try it out e Click Execute f If code 200 is returned go to the nex...

Page 247: ...e following i Enter the cluster user name and password ii Enter the client ID as mnode client iii Click Authorize to begin a session iv Close the authorization window c From the REST API UI click POST...

Page 248: ...begin a session iv Close the authorization window c From the REST API UI click GET installations d Click Try it out e Click Execute f From the response copy the installation asset ID id g From the RE...

Page 249: ...ollowing i Enter the cluster user name and password ii Enter the client ID as mnode client iii Click Authorize to begin a session iv Close the authorization window c Click POST nodes hardware_id upgra...

Page 250: ...llowing if there are problems or special requirements during the upgrade Option Steps You need to correct cluster health issues due to failedHealthChecks message in the response body 1 Go to the speci...

Page 251: ...ternative to using the USB thumb drive method described in this procedure you can mount the ISO on the compute node using the Virtual CD DVD option in the Virtual Console in the Baseboard Management C...

Page 252: ...e located on the system or virtual machine VM hosting the web browser Ensure that you have downloaded the ISO before you start the process The recommendation is to have the system or VM and the node o...

Page 253: ...ile and select the ISO file 9 Click Plug In 10 When the connection status shows Device VM Plug in OK click OK 11 Reboot the node by pressing F12 and clicking Restart or clicking Power Control Set Powe...

Page 254: ...atuses are cleared c Power on any of the remaining VMs that were powered off Upgrade firmware on H610C H615C nodes The steps vary depending on whether the node is standalone or part of a cluster The p...

Page 255: ...eboot after you save During the reboot press F11 11 On the screen displayed click Enter Some of the firmware upgrades might cause the console to disconnect and or cause your session on the BMC to disc...

Page 256: ...here components of your NetApp HCI installation there are some additional steps you will need to take for the Element Plug in for vCenter Server Steps 1 For vCSA upgrades clear QoSSIOC settings in the...

Page 257: ...IOC Settings The QoSSIOC Status field displays Not Configured after the process is complete 2 For vCSA and Windows upgrades unregister the plug in from the vCenter Server with which it is associated u...

Page 258: ...ere are compute nodes with different CPU generations in the vSphere cluster When EVC is required for expansion NetApp HCI enables it automatically whenever possible In the following situations you mig...

Page 259: ...1 Open a web browser and browse to the IP address of the management node For example https management node IP address 2 Log in to NetApp Hybrid Cloud Control by providing the NetApp HCI storage cluste...

Page 260: ...cluster are still visible as standby virtual machines in vSphere The newly expanded storage cluster does not use them if you want to reclaim VM resources you can manually remove the Witness Node virt...

Page 261: ...te nodes or click Create New Datacenter to add the compute nodes to a new datacenter If you click Create New Datacenter the Cluster field is automatically populated d If you selected an existing datac...

Page 262: ...ddress Enter a management IP address for the new compute node that is within the management network subnet c vMotion IP Address Enter a vMotion IP address for the new compute node that is within the v...

Page 263: ...performed the following actions with each new node Installed the new node in the NetApp HCI chassis by following the installation instructions Cabled and powered on the new node Ensure that you have...

Page 264: ...ettings of the cluster you have selected for expansion ensure that the vmkernel and vmnic mapping for the management storage and vMotion networks are set to the deployment defaults See supported netwo...

Page 265: ...dress validation completes 15 On the Review page in the Network Settings section new nodes are shown in the bold text To make changes in any section do the following a Click Edit for that section b Af...

Page 266: ...e than four storage nodes This is an optional procedure if you want to free up CPU and memory after you expand your two node cluster to four or more nodes Verify that no cluster faults or errors are r...

Page 267: ...click Delete from Disk 9 Confirm the action in the prompt Find more information NetApp HCI Two Node Storage Cluster TR 4823 NetApp Element Plug in for vCenter Server NetApp HCI Resources page SolidFi...

Page 268: ...ation which was jointly developed by NetApp HCI and Rancher Lifecycle management In a manual Rancher implementation updates for the Rancher server application or the Rancher Kubernetes Engine RKE clus...

Page 269: ...the Rancher management cluster which you can see using NetApp Hybrid Cloud Control vCenter Server or the Rancher user interface The management cluster virtual machines host the Rancher server the Ran...

Page 270: ...Control uses a Rancher node template to make deployment simpler See Rancher documentation about node templates Trident software and persistent storage concepts Trident itself a Kubernetes native appli...

Page 271: ...gement cluster All nodes have the following characteristics vCPU RAM GB Disk GB 2 8 20 Network requirements Ensure that the network that you intend to deploy the Rancher on NetApp HCI management clust...

Page 272: ...pe of network load balancing As a simple solution create a round robin DNS entry for the three static IP addresses reserved for Rancher server These DNS entries should resolve to the Rancher server FQ...

Page 273: ...demo environments Required ports Ensure that the list of ports in the Ports for Rancher Server Nodes on RKE section of the Rancher Nodes section of the official Rancher documentation are open in your...

Page 274: ...e configuration used in the NetApp Deployment Engine which was used to build the NetApp HCI infrastructure After deployment you will receive an email from NetApp providing you with the option to regis...

Page 275: ...A popup window shows a message about getting started with Rancher 2 Click Deploy Rancher The Rancher UI appears...

Page 276: ...ver FQDN To ensure that the Rancher Server remains available during node failures provide a fully qualified domain name FQDN that your DNS server can resolve to any of the IP addresses assigned to the...

Page 277: ...the three virtual machines Once you have finished deployment do not modify the configuration of the Rancher server virtual machine cluster or remove the virtual machines Rancher on NetApp HCI relies...

Page 278: ...HCI compute resources you need to take action in VMware vSphere to ensure that Rancher on NetApp HCI and its managed user clusters are only running on hosts for which you have purchased Rancher Suppo...

Page 279: ...did not already do so during installation or upgrade For instructions on how to enable monitoring see Enable Active IQ and NetApp HCI monitoring Find more information Rancher documentation about archi...

Page 280: ...template If you are not planning to use the node template that NetApp provides and you want to provision on RHEL or CentOS there might be additional requirements If you change your worker node to RHEL...

Page 281: ...ace includes the following components 7 Optional Select Storage for the user cluster to see the storage classes that you can use for your persistent volumes The three storage classes are solidfire gol...

Page 282: ...e user clusters Steps 1 Deploy a user cluster with existing default template 2 Connect the storage network to the user cluster a Open the VMware vSphere web client for the connected vCenter instance b...

Page 283: ...set up user clusters and add applications to those clusters Deploy user clusters After deployment Dev and Ops teams can then deploy their Kubernetes user clusters similar to any Rancher deployment on...

Page 284: ...loud Control by providing the NetApp HCI or Element storage cluster administrator credentials 2 From the Dashboard select the top right Options icon and select Configure The Rancher Server Clusters pa...

Page 285: ...Rancher UI Using the Rancher UI you can see information about Rancher on NetApp HCI management clusters and user clusters In the Rancher UI management clusters are referred to as local clusters 1 Acc...

Page 286: ...and do not upgrade the operating system User clusters cannot be upgraded from NetApp Hybrid Cloud Control What you ll need Admin privileges You have storage cluster administrator permissions to perfor...

Page 287: ...ity updates to take effect A banner appears indicating the component upgrade is successful There could be up to a 15 minute delay before NetApp Hybrid Cloud Control UI shows the updated version number...

Page 288: ...4 Get task status using task ID from upgrade command response curl X GET https mNodeIP k8sdeployer 1 task taskID H accept application json H Authorization Bearer ID REST API UI steps 1 Open the manag...

Page 289: ...ommand and retrieving it from the curl response 2 Get task status using task ID from previous command and copy the latest version number from the response curl X GET https mNodeIP k8sdeployer 1 task t...

Page 290: ...upgraded version number Apply node OS security updates API commands 1 Initiate the check upgrades request curl X GET https mNodeIP k8sdeployer 1 upgrade checkNodeUpdates H accept application json H A...

Page 291: ...the task ID from the previous step d From the task taskID response verify that there is a more recent version number than the one currently applied to your nodes 4 Apply the node OS upgrades For node...

Page 292: ...ult Options Remove Rancher on NetApp HCI using NetApp Hybrid Cloud Control Recommended Remove Rancher on NetApp HCI using the REST API Remove Rancher on NetApp HCI using NetApp Hybrid Cloud Control Yo...

Page 293: ...ot already selected c Enter the client ID as mnode client if the value is not already populated d Do not enter a value for the client secret e Click Authorize to begin a session f Close the window 3 C...

Page 294: ...p Element Plug in for vCenter Server TR 4820 NetApp HCI Networking Quick Planning Guide NetApp Configuration Advisor 5 8 1 or later network validation tool Replace 2U H series chassis If your chassis...

Page 295: ...nsure that the nodes are correctly shut down before you move them After you move all the nodes from the failed chassis you should remove the chassis from the rack and return it to NetApp Install the n...

Page 296: ...you The node powers on automatically when you install it correctly Ensure that you support the node from under when you install it Do not use excessive force while pushing the node into the chassis I...

Page 297: ...D https MVIP json rpc 8 0 MVIP is the MVIP IP address NODEID is the node ID USER is the user name you configured in the NetApp Deployment Engine when you set up NetApp HCI and PASS is the password you...

Page 298: ...e nodes both compute and storage in your NetApp HCI deployment If the answer is yes you can shut down only the storage nodes in the failed chassis Can your VMs and ESXi cluster stay online without the...

Page 299: ...s you want to remove You are now ready to remove the failed chassis Replace the chassis If your rack does not have additional space you should uninstall the failed chassis and replace it with the new...

Page 300: ...eployment 1 In the VMware vSphere Web Client confirm that the compute nodes hosts are listed in the ESXi cluster 2 In the Element plug in for vCenter server confirm that the storage nodes are listed a...

Page 301: ...mption 37A maximum Breaker requirements 40A breaker You have ensured that the materials in your environment adhere to the RoHS specifications You have ensured that the cable requirements are met One U...

Page 302: ...edges of the power supply unit with the opening in the chassis gently push the unit into the chassis using the cam handle until it locks into place and return the cam handle to the upright position 4...

Page 303: ...ore starting this procedure you should have contacted NetApp Support and received a replacement part Support will be involved during the installation of the replacement If you have not done so already...

Page 304: ...I Steps 1 Identify the slot that logged the error as follows a For H615C do the following i Log in to the BMC UI ii Select Logs Reports IPMI Event Log iii In the event log find the memory error and id...

Page 305: ...ooting Options and press Enter e From the Troubleshooting Mode Options menu use the up or down arrow to enable ESXi shell and SSH which are disabled by default f Press the Esc key twice to exit Troubl...

Page 306: ...s Data Width 64 bits 8 ECC bits Size 32 GB Option B 1 Press Alt F1 to enter shell and log in to the node to run the command 3 Contact NetApp Support for help with the next steps NetApp Support require...

Page 307: ...node For a H610C or H615C chassis power down the chassis For H410C nodes in a 2U four node chassis power down only the node with the faulty DIMM 5 Remove the power cables and network cables carefully...

Page 308: ......

Page 309: ...ard and carefully pull the DIMM up Here is a sample image showing the retaining clips 3 Install the replacement DIMM correctly When you insert the DIMM into the slot correctly the two clips lock in pl...

Page 310: ...you will find the other two on the other side of the node 3 Remove both PCI card blanks 4 Remove the GPU and the airflow cover 5 Find the failed DIMM by matching the slot number ID you noted earlier...

Page 311: ...image 2 Remove the GPU if your H615C node has GPU installed and the airflow cover 3 Find the failed DIMM by matching the slot number ID you noted earlier with the numbering on the motherboard Here is...

Page 312: ...p HCI Resources page SolidFire and Element Software Documentation Center Replace drives for storage nodes If a drive is faulty or if the drive wear level falls below a threshold you should replace it...

Page 313: ...the slice drive and ensure that slice syncing is complete before removing the block drives Remove all the block drives from a single node at once Ensure that all block syncing is complete before you m...

Page 314: ...drive you want to remove 5 Select Remove Drives 6 Confirm the action If there is not enough capacity to remove active drives before removing a node an error message appears when you confirm the drive...

Page 315: ...the bezel 3 Press the release button on the failed drive When you press the release button the cam handle on the drive springs open partially and the drive releases from the midplane 4 Open the cam h...

Page 316: ...handle is fully open before you attempt to slide the drive out of the chassis 4 Slide the drive out and place it on a static free level surface 5 Press the release button on the replacement drive bef...

Page 317: ...ct Add 3 Confirm the action Find more information NetApp HCI Resources page SolidFire and Element Software Documentation Center Replace H410C nodes You should replace a compute node in the event of CP...

Page 318: ...NetApp HCI compute and storage nodes in the same chassis and cluster The H410C compute node operates only on high line voltage 200 240 VAC You should ensure that the power requirements are met when yo...

Page 319: ...the node in the chassis by matching the serial number on the sticker at the back of the node with the serial number you noted 4 With the failed node selected select Manage Networking VMkernel adapters...

Page 320: ...ls you had attached to the cables when you disconnected them help guide you If the airflow vents at the rear of the chassis are blocked by cables or labels it can lead to premature component failures...

Page 321: ...ion runs on version 1 6P1 or later What you ll need Ensure that the vSphere instance NetApp HCI is using has vSphere Enterprise Plus licensing if you are expanding a deployment with Virtual Distribute...

Page 322: ...logy page select a network topology to match the new compute nodes you are adding You can only select the two cable option if your compute nodes are using the two cable topology and the existing NetAp...

Page 323: ...detect and resolve problems before production is affected 19 Select Add Nodes You can monitor the progress while NetApp HCI adds and configures the resources 20 Optional Verify that the new compute n...

Page 324: ...ur vCenter version supports before you can add them to your installation You should use the vSphere client to enable EVC for these compute nodes After you enable it refresh the Inventory page and try...

Page 325: ...nfigure VMware ESXi version 6 0 0 as follows a On the remote console or KVM screen select Power Control Set Power Reset This restarts the node b In the Boot Menu window that opens select ESXi Install...

Page 326: ...ay information and press Enter You can reuse the information that you copied before you removed the node The IP address you enter here is the Management Network IP address that you copied earlier g Pr...

Page 327: ...phic that is displayed select Management Network and select the pencil icon to edit the settings viii In the Management Network Edit settings window select Teaming and failover ix Move vmnic3 to Stand...

Page 328: ...checkbox ii Move vmnic0 to Standby adapters by using the arrow icon iii Select OK g With vSwitch1 selected from the Actions drop down menu select Add Networking and enter the following details in the...

Page 329: ...ies change the network label to iSCSI B and select Next vii Under IPv4 settings provide the IPv4 information and select Next The IP address you enter here is the iSCSI B IP address that you copied ear...

Page 330: ...m In the graphic that is displayed select iSCSI A and select the pencil icon to edit the settings as follows i Select Security and make the following selections ii Select Teaming and failover and sele...

Page 331: ...n v Under Adapter Details select Network Port Binding and select vi Select the check boxes for iSCSI B and iSCSI A and click OK A message recommending a rescan of the storage adapter is displayed vii...

Page 332: ...pp Element Management extension point When should you redeploy Witness Nodes You should redeploy Witness Nodes in the following scenarios You replaced a failed compute node that is part of a NetApp HC...

Page 333: ...he down arrow key to navigate to Network and then press Enter for OK ii Navigate to Network config and then press Enter for OK iii Navigate to net0 and then press Enter for OK iv Press Tab till you ge...

Page 334: ...the list of nodes The Witness Node should appear in the pending nodes list e Select the check box for the node you want to add and select Add node When the action is complete the node appears in the l...

Page 335: ...firmware version You can download the latest firmware file from the drop down menu on the NetApp Support Site login required Steps 1 Log in to the baseboard management controller BMC UI 2 Select Maint...

Page 336: ...ode to reboot Log in after the upgrade and select System to verify that the Firmware Revision version matches the version you uploaded Find more information NetApp HCI Resources page SolidFire and Ele...

Page 337: ...ithout causing any service interruption You should obtain the serial number of the failed storage node from the Element UI and match it with the serial number on the sticker at the back of the node In...

Page 338: ...ce the storage node in the chassis You should install the replacement node in the same slot in the chassis from which you remove the faulty node You should use the serial number you noted down from th...

Page 339: ...he storage node to the cluster You should add the storage node back to the cluster The steps vary depending on the version of NetApp HCI you are running What you ll need You have free and unused IPv4...

Page 340: ...name field b In the Management IP Address field enter a management IP address for the new storage node that is within the management network subnet c In the Storage iSCSI IP Address field enter an iSC...

Page 341: ...ode that is within the management network subnet iii In the Storage iSCSI IP Address field enter an iSCSI IP address for the new storage node that is within the iSCSI network subnet b Select Continue...

Page 342: ...mask If you do not know your network administrator can provide this information 3 Enter s to save the settings and then enter y to accept the changes 4 Enter c to navigate to the Cluster tab 5 Use th...

Page 343: ...her antistatic protection You have labeled each cable that is connected to the chassis About this task Alarms in the VMware vSphere Web Client alert you when a host fails You must match the serial num...

Page 344: ...eplace the node After you remove the failed node from the cluster you can remove the failed chassis and install the replacement chassis Ensure that you have antistatic protection before you perform th...

Page 345: ...A graphics processing units GPUs like the H610C node need the NVIDIA software drivers installed in VMware ESXi so that they can take advantage of the increased processing power Steps 1 Open a browser...

Page 346: ...hat all eight GPU drivers are listed in the command output nvidia smi e Run the following command to verify that the NVIDIA vGPU package was installed and loaded correctly vmkload_mod l grep nvidia Th...

Page 347: ...steps a Enter a FQDN or IP address and administrator credentials for the vCenter instance associated with your NetApp HCI installation b Select Continue c Select an existing vSphere datacenter to whic...

Page 348: ...te node that is within the management network subnet c In the vMotion IP Address field enter a vMotion IP address for the compute node that is within the vMotion network subnet d In the iSCSI A IP Add...

Page 349: ...at once For Element software 9 x and earlier add three drives at once allowing them to completely sync before adding the next group of three Remove the slice drive and ensure that slice syncing is co...

Page 350: ...y unscrewing the thumbscrews on the mounting ears You should package and return the failed chassis to NetApp 9 Install the replacement chassis 10 Remove the drives carefully from the failed chassis an...

Page 351: ...a replacement power supply unit You have verified that the second power supply unit is operating You have an electrostatic discharge ESD wristband or you have taken other antistatic precautions About...

Page 352: ...nding on the type of nodes storage or compute you have H610C chassis H615C chassis H610S chassis 2 Unplug the power cord from the power supply unit 3 Lift the cam handle and press the blue latch to sl...

Page 353: ...eries switch non disruptively by following the best practices and steps provided by NetApp What you ll need Ensure that Putty is installed on the laptop and that you capture the output See this video...

Page 354: ...SN2100 switch rear Figure 4 SN2700 switch front and rear About this task You should perform the steps in this procedure in the order below This is to ensure that the downtime is minimal and the repla...

Page 355: ...switch 2 Label all the cables connected to the faulty switch 3 Identify the external file server where the switch configuration files are saved 4 Ensure that you have obtained the following informati...

Page 356: ...2 Enter Configuration mode as shown in the following example switch enable switch configure terminal 3 Find the available configuration files as shown in the following example switch config switch con...

Page 357: ...from the switch to an external server as shown in the following example switch config switch config configuration text file my filename upload scp root my server root tmp my filename 4 Modify the fol...

Page 358: ...ftware version on the switch The version on the faulty switch and the healthy switch should match Steps 1 Connect to your switch remotely using SSH 2 Enter Configuration mode 3 Run the show version co...

Page 359: ...lies to you Option Steps From the BIN configuration file 1 Fetch the BIN configuration file as shown in the following example switch config configuration fetch scp myusername my server path to my file...

Page 360: ...h config configuration text file my filename upload scp root my server root tmp my filename A reboot is not required when you apply the text file Complete the replacement Perform the steps to complete...

Page 361: ...otection About this task Alarms in the VMware vSphere Web Client alert you when a host fails You must match the serial number of the failed host from the VMware vSphere Web Client with the serial numb...

Page 362: ...n be found at https www netapp com us media patents page pdf Privacy policy https www netapp com us legal privacypolicy index aspx Open source Notice files provide information about third party copyri...

Page 363: ...TY WHETHER IN CONTRACT STRICT LIABILITY OR TORT INCLUDING NEGLIGENCE OR OTHERWISE ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE NetApp reserves t...

Reviews:

No comments

Brands by name

Popular brands

Load more brands