HP Cluster Platform Installation Manual Download Page 2

Page: 2 / 74

The information contained herein is subject to change without notice. The only warranties for HP products and services are set forth in the express

warranty statements accompanying such products and services. Nothing herein should be construed as constituting an additional warranty. HP

shall not be liable for technical or editorial errors or omissions contained herein.

Voltaire and GridStack are trademarks of Voltaire Inc.

InfiniBand is a trademark the InfiniBand Trade Association.

AMD, the AMD Arrow logo and combinations thereof, and AMD Opteron are trademarks of Advanced Micro Devices, Inc.

Intel and Xeon are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States and other countries.

Microsoft, Windows, Windows NT, and Windows HPC Server 2008 are U.S. registered trademarks of Microsoft Corporation.

Java is a US trademark of Sun Microsystems, Inc.

Summary of Contents for Cluster Platform

Page 1: ...Microsoft Windows HPC Server 2008 Installation Guide HP Part Number A HPCS08 1B Published June 2009 ...

Page 2: ...cal or editorial errors or omissions contained herein Voltaire and GridStack are trademarks of Voltaire Inc InfiniBand is a trademark the InfiniBand Trade Association AMD the AMD Arrow logo and combinations thereof and AMD Opteron are trademarks of Advanced Micro Devices Inc Intel and Xeon are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States and oth...

Page 3: ...HP Cluster Platform for HPCS 19 3 1 Certificate of Authenticity COA 20 4 Installing HPCS on a Compute Cluster 21 4 1 Cluster Installation Overview 21 4 2 Installation Procedure When HPCS is Preinstalled on HP Cluster Platform and HP Cluster Platform Express 21 4 3 Installing HPCS from CD 30 5 Post Installation Tasks 53 5 1 Altering Regional Settings 53 5 2 Installing the HP Management Agents 53 5 ...

Page 4: ... 9 2 Provisioning Issues 63 9 3 Diagnostics Fail 64 9 4 InfiniBand 64 10 Technical Support 65 10 1 Before You Contact HP 65 10 2 HP Contact Information 65 10 3 HP Customer Support 65 A Promoting the Head Node to Domain Controller 67 Glossary 69 Index 71 4 Table of Contents ...

Page 5: ...List of Figures 2 1 Topology 1 14 2 2 Topology 2 14 2 3 Topology 3 14 2 4 Topology 4 15 2 5 Topology 5 15 2 6 Two Network Topology 15 2 7 Three Network Topology 16 5 ...

Page 6: ...6 ...

Page 7: ...talling HPCS from CD page 30 and omit the section Installation Procedure When HPCS is Preinstalled on HP Cluster Platform and HP Cluster Platform Express page 21 Typographic Conventions This document uses the following typographic conventions or A percent sign represents the C shell system prompt A dollar sign represents the system prompt for the Bourne Korn and POSIX shells A number sign represen...

Page 8: ...rosoft website http www microsoft com windowsserver2008 en us product documentation aspx Microsoft Windows HPC Server 2008 product website http www microsoft com hpc HP s Unified Cluster Portfolio offers comprehensive modular solutions utilizing industry standard servers with a choice of operating environments For more information go to the following URL http h20311 www2 hp com HPC cache 274276 0 ...

Page 9: ...sion HP Encourages Your Comments HP encourages your comments concerning this document HP is committed to providing documentation that meets your needs Send any errors found suggestions for improvement or compliments to http docs hp com en feedback html Include the document title manufacturing part number and any comment error found or suggestion for improvement you have concerning this document Do...

Page 10: ...10 ...

Page 11: ...agement tools 1 2 Benefits and Features HPCS provides enhanced monitoring system health and reporting with built in diagnostic tools to create and manage groups of resources and failover options HPCS has been tested on HP Cluster Platform and Cluster Platform Express which offer the flexibility of a custom solution with the simplicity reliability and value of a preconfigured factory built cluster ...

Page 12: ...12 ...

Page 13: ...orm concept of separate console and administrative networks does not apply where HPCS is employed as the operating environment 2 1 1 Maximum System Limits In this release of HPCS supported HP Cluster Platform configurations are constrained as follows HP Cluster Platform Express is constrained to clusters ranging from 5 to 33 nodes HP Cluster Platform is constrained to clusters ranging from 5 to 51...

Page 14: ...s on a public and private network Figure 2 2 Topology 2 Figure 2 3 shows the head node on a public and private network with the compute nodes on the private network only with a second private network for MPI This topology is referred to as Three Network Topology and is supported by HP Cluster Platform and HP Cluster Platform Express See Figure 2 7 page 16 Figure 2 3 Topology 3 Figure 2 4 shows all...

Page 15: ...same network provides routing for cluster administrative and job management traffic A second network is provided through the site LAN connection Figure 2 6 Two Network Topology The following cluster features are shown in Figure 2 6 1 Site LAN connection 2 LAN network connected to a network interface card NIC installed or embedded in the head node 3 The server designated as the head node control no...

Page 16: ...the site LAN connection Figure 2 7 Three Network Topology The following cluster features are shown in Figure 2 7 1 Site LAN connection 2 LAN network connected to a network interface card NIC installed or embedded in the head node 3 The server designated as the head node control node in HP Cluster Platform terminology 4 NIC dedicated to the LAN network 5 NIC connected to a dedicated Gigabit Etherne...

Page 17: ...s and Firmware Every node that is part of the high speed InfiniBand fabric requires a host channel adapter HCA installed in its PCI bus The HCA is installed in a specific PCI slot on an unshared bus of the appropriate speed ensuring system performance For more information on supported HCA models supported drivers and installation instructions see http www docs hp com en highperfcomp html 2 4 Host ...

Page 18: ...18 ...

Page 19: ...erence the cabling tables to ensure that you understand the port naming syntax In the event of missing or damaged cable labels or if replacing damaged cables use the cabling tables for your model and type of cluster to determine the correct point to point cable routing 2 When cabling the cluster you might see cabling table footnotes that are operating environment specific Follow all cabling instru...

Page 20: ...lowing tasks Upgrade the factory installed operating system using the Microsoft Upgrade program for license validation Reinstall the operating system because of a failure that has permanently disabled it The COA label location varies by server model On rack mounted server models the COA label is located either on the front section of the right panel or on the right front corner of the top panel CA...

Page 21: ...erating system 4 2 Installation Procedure When HPCS is Preinstalled on HP Cluster Platform and HP Cluster Platform Express If HPCS came preinstalled on your servers and you purchased HP Cluster Platform or HP Cluster Platform Express follow these instructions to complete the installation As part of the service provided by HP for HP Cluster Platform and HP Cluster Platform Express configurations mu...

Page 22: ...d If not enable remote desktop After enabling remote desktop select Select Users and add the domain users to allow Remote Desktop Access You might be required to enter Domain Administrator credentials to complete this operation Click OK to close the System Properties window 10 Select Yes when asked to reboot and close the System Properties window to complete the system reboot 11 After the system h...

Page 23: ... Create a new HPC cluster by creating a head node and click Next 17 Select the default Create a new database and click Next 18 Select the default locations for the HPC database files and click Next 4 2 Installation Procedure When HPCS is Preinstalled on HP Cluster Platform and HP Cluster Platform Express 23 ...

Page 24: ...s Updates at a later time If you have your domain setup for new nodes to retrieve and apply updates through utilities such as WSUS or if your node has access to the internet with the ability to apply updates without setting items like a proxy server select Yes Otherwise select No and apply the updates at a later time 20 Click Next 21 In the Installation window click Install This process will take ...

Page 25: ...e cluster preconfigured information appears in the command window Let this complete This process takes an average of 10 to 15 minutes 4 2 Installation Procedure When HPCS is Preinstalled on HP Cluster Platform and HP Cluster Platform Express 25 ...

Page 26: ... corrections For additional information see step 10 in Installing HPCS from CD 25 Select Provide installation credentials These are domain credentials used to join nodes to the domain This is can be the domain administrator account but many domains set up special accounts for this purpose Use the appropriate account Select Yes when it asks to add the account to the Cluster Users Group 26 The remai...

Page 27: ...nstalling HPCS from CD page 30 or refer to the Microsoft HPC Pack 2008 documentation 27 The head node configuration is complete You can now install the compute nodes Select Node Management The cluster compute nodes are preloaded and listed here 4 2 Installation Procedure When HPCS is Preinstalled on HP Cluster Platform and HP Cluster Platform Express 27 ...

Page 28: ... PXE requests that only come from existing compute nodes and click Finish 28 Power on the compute nodes The compute nodes start to provision This might take one to three hours to complete depending on the size of the cluster You can watch the progress by selecting Node Management and highlighting the individual compute node The node information will be at the bottom of the console window To check ...

Page 29: ...de has completed provisioning it displays as offline Right click the node or nodes and select Bring Online 4 2 Installation Procedure When HPCS is Preinstalled on HP Cluster Platform and HP Cluster Platform Express 29 ...

Page 30: ...PCS from CD If HPCS is not preinstalled on your server you must install it from the CDs that came with your server Follow these instructions to complete the installation 1 Verify the hardware is configured appropriately See Chapter 3 page 19 for more information 2 Install your base OS Windows 2008 HPC Edition or Windows 2008 x64 Follow the Windows Operating System installation instructions to comp...

Page 31: ...ing domain promote the head node to a domain controller For information on promoting your server to a domain controller see Appendix A page 67 5 Install HPC 2008 a Run setup exe b Accept terms and select Create a new HPC cluster by creating a head node 4 3 Installing HPCS from CD 31 ...

Page 32: ...Update Service WSUS setup for your active directory or your servers do not need a Proxy server to directly access Microsoft websites you can save some time by having updates installed But if you do not click I don t want to use Microsoft Update 32 Installing HPCS on a Compute Cluster ...

Page 33: ...7 In Install Required Components click Install The installation starts 4 3 Installing HPCS from CD 33 ...

Page 34: ...8 After the cluster is installed start the console by clicking Finish 34 Installing HPCS on a Compute Cluster ...

Page 35: ...Configure your network 10 Select the desired network topology for your cluster For HP Cluster Platform configured hardware select Compute nodes isolated on a private network For clusters with InfiniBand select Compute nodes isolated on private and application networks 4 3 Installing HPCS from CD 35 ...

Page 36: ...s allocated to DHCP make sure you allow for more IP addresses than compute nodes Typical IP settings are as follows Click Next d Select the appropriate network adapter for the application connection This should be your InfiniBand adapter Click Next e You will be asked to provide application network IP configuration parameters You can select your own IP ranges but HP recommends that you accept the ...

Page 37: ...ctions see the documentation at http www docs hp com en highperfcomp html Click Next f Configure your firewall settings Typically you select the defaults Public is firewalled private is not We recommend you do not firewall your private network 4 3 Installing HPCS from CD 37 ...

Page 38: ...lick Next g After making all your network selections review your selections After verifying your selections click Configure This takes several minutes to complete 38 Installing HPCS on a Compute Cluster ...

Page 39: ...Use the appropriate account for your domain Add the user to the cluster user list 12 Configure the node naming scheme Select Configure the naming of new nodes This presents a pattern to use for compute node names as they join the cluster Follow the instructions and name your compute nodes as desired 13 In the To do List select Create a node template Enter a name for the template Click Next a Selec...

Page 40: ...age is found on the Windows HPC 2008 Edition OEM disk Select the first option Create a new operating system image and locate the setup exe on the OEM DVD Include a name for the image 40 Installing HPCS on a Compute Cluster ...

Page 41: ...e OS image If you are using an OEM image with new HP hardware you do not need to enter a key The key is automatically encoded into the image If you are using older hardware or are using a non OEM image you can enter your OS key 4 3 Installing HPCS from CD 41 ...

Page 42: ... HP recommends automatically generated passwords e If you have your WSUS server setup or if your nodes have access to the internet you can select to include Windows updates You can also add additional hot fixes to the installation if you wish 42 Installing HPCS on a Compute Cluster ...

Page 43: ...f Review the settings and create the template Click Create 14 After the template is created all the To do List items have green checks 4 3 Installing HPCS from CD 43 ...

Page 44: ...15 To finish the configuration and start provisioning nodes go to the Configuration tab and select Images 44 Installing HPCS on a Compute Cluster ...

Page 45: ...dded to the image If you see the operating system copy fail while watching the compute node consoles the WinPE image does not contain the correct NIC drivers To find the correct drivers in the PSP a Examine a PSP CD or an unpacked PSP file Review the contents of the bp00XXXX txt file and search for the entry regarding the Multi function driver cp009194 exe HP NC Series Broadcom 1Gb Multifunction D...

Page 46: ... only failure this is a false error The HPC services did not start before the diagnostic tests started to run To clear the error on the diagnostic tab select the head node right click on the error and select Clear Alert 46 Installing HPCS on a Compute Cluster ...

Page 47: ...ts if you wish 18 To start provisioning compute nodes return to the Node Management tab and select Add Nodes Select Deploy compute nodes from bare metal using an operating system image Click Next 4 3 Installing HPCS from CD 47 ...

Page 48: ...s You cannot continue until at least one compute node is PXE booted and starts provisioning Power on at least one of the compute nodes or all of the compute nodes and wait for them to display in the Select New Nodes window 48 Installing HPCS on a Compute Cluster ...

Page 49: ...disk partitions or manually select PXE boot at node startup time 20 Click Deploy You are asked if you want the head node to respond only to PXE requests from existing nodes or respond to all PXE requests Responding to only PXE requests for existing compute nodes is the secure thing to do However if your compute nodes are on a private network you can securely select the second option and nodes can ...

Page 50: ...ess go to the Node Management Console highlight the node you want to monitor and select the Provisioning Log tab at the bottom of the screen This provisioning progress displays and shows any errors 50 Installing HPCS on a Compute Cluster ...

Page 51: ...number of nodes are being provisioned at the same time without multi cast being enabled After the nodes are provisioned you can see all the nodes in the node list Your cluster is ready for use For information on troubleshooting see Chapter 9 page 63 4 3 Installing HPCS from CD 51 ...

Page 52: ...52 ...

Page 53: ...obtain a 64 bit encrypted password certificate to set your password The password certificate can be obtained from an HP Systems Insight Manager Certificate Server For information about how to set and acquire the certificate refer to the HP Insight Management Agents User Guide http h18013 www1 hp com products servers management agents documentation html 1 Click Start and select All Programs Pre ins...

Page 54: ...partition and the operating system is the only drive on the server that is configured during the operating system installation Additional space that is not partitioned is also located on the primary drive This non partitioned space and any additional disk drives on the server must be partitioned and formatted using Disk Administrator before they can be available for use If an array controller has ...

Page 55: ...lation process a message might appear stating that the CPQTEAM DLL file is needed A default path appears in the message box Click OK to accept the path and continue with the installation 5 6 Configuring Network Protocols The TCP IP and SNMP services are automatically installed The HP Management Agents for servers require TCP IP and SNMP services to communicate with HP Systems Insight Manager To di...

Page 56: ...56 ...

Page 57: ...rchase HP MPI for Windows software and licenses Install the software locally on each node in your cluster or use the Run command feature of the Compute Cluster Administrator to remotely install it For more information see the HP MPI website http www hp com go mpi 57 ...

Page 58: ...58 ...

Page 59: ...or your cluster contact your HP sales and service representative or authorized HP reseller CAUTION Never add components to an HP Cluster Platform rack even if available space exists in the rack Your HP Cluster Platform is engineered to prevent thermal problems and to ensure proper power load balancing Adding components or otherwise modifying the rack might result in degraded performance 7 1 Upgrad...

Page 60: ...60 ...

Page 61: ...product to complete product activation either online or by phone directly with Microsoft Please follow activation instructions upon installation of the operating system In addition Microsoft is allowing extension of the 60 day activation period up to 240 days For more information see the Microsoft knowledge base article at http support microsoft com kb 948472 Additionally the Microsoft software in...

Page 62: ...62 ...

Page 63: ... can fail for any number of reasons Watch the provisioning log on the head node to see each node s progress If the node fails to provision check the following items Watch the node console as the node boots The node should PXE boot and get an IP address through DHCP from the head node If neither of these happen check the following The BIOS is selecting the correct NIC to PXE boot This must be the N...

Page 64: ...ight cause a hang on reboot The screen will indicate this error and list the unsigned driver causing the issue Remove the driver from your OS image 9 3 Diagnostics Fail Running diagnostics to check cluster health is a valuable tool Failures can be confusing Some failures to be aware of Initial diagnostics of the head node might fail indicating the management service is not running Many times the t...

Page 65: ...tored If you have purchased a Care Pack service upgrade call 1 800 633 3600 For more information about Care Packs refer to the HP website http www hp com In other locations see the HP worldwide in English webpage http welcome hp com country us en wwcontact html 10 3 HP Customer Support HP customer support offers Software Support Support Plus Software Support and Integrated Hardware and Software Su...

Page 66: ...66 ...

Page 67: ...lect Roles b Select Add Roles and click the Active Directory Domain Services box c Click Next several times accepting the defaults until you can select Install d Click Install 3 After the Active Directory Domain Services role is installed perform a dcpromo a Open a command window Run Cmd b Enter dcpromo c Select the default settings with the following exceptions Select Create a New Forest Enter a ...

Page 68: ...68 ...

Page 69: ...cted through its internal administrative network F Factory integration A method of assembling cluster components into modules and temporarily connecting the modules to form a running testable cluster The cluster is partially disassembled into its modules for shipping Fat tree A network topology used by the interconnect The topology is characterized by a link capacity that is progressively larger c...

Page 70: ... You use the control processor for tasks such as assigning TCP IP addresses loading firmware or running interconnect diagnostics N Network Interface Card NIC Each node has at least two integrated network interface cards NICs One NIC might be dedicated to the server s console These NICs are used for connections to the internal networks Node Level Interconnect NLI In federated clusters an interconne...

Page 71: ...ying hardware 19 feedback 9 G Gigabit Ethernet 13 16 switch 16 glossary 69 H HCA 17 head node 15 16 host channel adapter 17 HP Cluster Platform website 8 HP MPI 57 I iLO 16 in band 13 15 InfiniBand 13 16 host channel adapter 17 management documents 8 single data rate 13 information related 8 installation documentation 19 for preinstalled clusters 21 from CD 30 overview 21 verifying fabric 19 insta...

Page 72: ...dback 9 R reader comments 9 website 9 regional settings 53 related information 8 S SDR 13 servers 13 standalone 59 supported variants 13 shared fabric 16 site LAN 15 standalone servers 59 support 65 supported servers 13 switch 13 16 see also interconnect system interconnect 13 system limits 13 T topology 13 three networks 16 two networks 15 typographic conventions 7 U upgrades 59 upgrading 59 W we...

Page 73: ...73 ...

Page 74: ......

Search results

Summary of Contents for Cluster Platform

Reviews:

Related manuals for Cluster Platform

Brands by name

Popular brands

HP Cluster Platform, Installation Manual

Search results

Summary of Contents for Cluster Platform

Reviews:

Related manuals for Cluster Platform

Brands by name

Popular brands