background image

4. If you are using volume management software, use that software to update the

list of devices on all nodes that are attached to the logical volume that you are
removing.

For instructions about how to update the list of devices, see your Solstice
DiskSuite/Solaris Volume Manager or VERITAS Volume Manager documentation.

5. If you are using volume management software, run the appropriate Solstice

DiskSuite/Solaris Volume Manager or VERITAS Volume Manager commands to
remove the logical volume from any diskset or disk group.

For more information, see your Solstice DiskSuite/Solaris Volume Manager or
VERITAS Volume Manager documentation.

Note –

Volumes that were managed by VERITAS Volume Manager must be

completely removed from VERITAS Volume Manager control before you can delete
them from the Sun Cluster environment. After you delete the volume from any
disk group, use the following commands on both nodes to remove the volume
from VERITAS Volume Manager control.

#

vxdisk offline

Accessname

#

vxdisk rm

Accessname

Accessname

Disk access name

6. If you are using multipathing, unconfigure the volume in Sun StorEdge Traffic

Manager.

#

cfgadm -o force_update -c unconfigure

Logical_Volume

7. Access the storage device and remove the logical volume.

For the procedure about how to remove the volume, see your storage
documentation. For a list of storage documentation, see

“Related Documentation”

on page 6

.

8. Determine the resource groups and device groups that are running on all nodes.

Record this information because you use it in

Step 13

of this procedure to return

resource groups and device groups to these nodes.

#

scstat

9. Move all resource groups and device groups off

Node A

.

#

scswitch -s -h

from-node

10. Shut down and reboot

Node A

.

For the procedure about how to shut down and power off a node, see Chapter 3,
“Shutting Down and Booting a Cluster,” in

Sun Cluster System Administration Guide

for Solaris OS

.

34

Sun Cluster 3.0-3.1 With Sun StorEdge 6120 Array Manual for Solaris OS • January 2006, Revision A

Summary of Contents for StorEdge 6120

Page 1: ...Sun Cluster 3 0 3 1 With Sun StorEdge 6120 Array Manual for Solaris OS Sun Microsystems Inc 4150 Network Circle Santa Clara CA 95054 U S A Part No 817 1701 14 January 2006 Revision A ...

Page 2: ...echnologie incorporée dans le produit qui est décrit dans ce document En particulier et ce sans limitation ces droits de propriété intellectuelle peuvent inclure un ou plusieurs brevets américains ou des applications de brevet en attente aux Etats Unis et dans d autres pays Cette distribution peut comprendre des composants développés par des tierces personnes Certaines composants de ce produit peu...

Page 3: ...Switches or the Storage Array 24 How to Add a Dual Controller Configuration to an Existing Cluster 26 How to Perform Initial Configuration Tasks on the Storage Array 26 How to Connect the Storage Array to FC Switches 27 How to Connect the Node to the FC Switches or the Storage Array 28 Configuring Storage Arrays 31 How to Create a Logical Volume 31 How to Remove a Logical Volume 33 Maintaining Sto...

Page 4: ...Replace a Node to Switch Component in a Cluster Without Multipathing 43 How to Replace a Host Adapter 44 Index 47 4 Sun Cluster 3 0 3 1 With Sun StorEdge 6120 Array Manual for Solaris OS January 2006 Revision A ...

Page 5: ...tel 32 bit family of microprocessor chips and compatible microprocessor chips made by AMD Sun Cluster software runs on two platforms SPARC and x86 The information in this document pertains to both platforms unless otherwise specified in a special chapter section note bulleted item figure table or example Who Should Use This Book This book is for Sun representatives who are performing the initial i...

Page 6: ...ew Information January 2006 Added information about single dual port HBA configurations November 2005 Extended support to x86 based clusters Related Documentation The following books provide conceptual information or procedures to administer hardware and applications If you plan to use this documentation in a hardcopy format ensure that you have these books available for your reference The followi...

Page 7: ...n Cluster Concepts Guide for Solaris OS Overview Sun Cluster Overview for Solaris OS Hardware administration Sun Cluster 3 0 3 1 Hardware Administration Manual for Solaris OS Individual hardware administration guides Software installation Sun Cluster Software Installation Guide for Solaris OS Data service administration Sun Cluster Data Services Planning and Administration Guide for Solaris OS Ind...

Page 8: ...n Your name and email address if available Your company name address and phone number The model number and serial number of your systems The release number of the operating environment for example Solaris 9 The release number of Sun Cluster for example Sun Cluster 3 1 8 05 Use the following commands to gather information about your system for your service provider Command Function prtconf v Displa...

Page 9: ...peface Meaning Example AaBbCc123 The names of commands files and directories and onscreen computer output Edit your login file Use ls a to list all files machine_name you have mail AaBbCc123 What you type contrasted with onscreen computer output machine_name su Password aabbcc123 Placeholder replace with a real name or value The command to remove a file is rm filename AaBbCc123 Book titles new ter...

Page 10: ...e_name Bourne shell and Korn shell Bourne shell and Korn shell for superuser Product Training Sun Microsystems offers training in many Sun technologies through a variety of instructor led courses and self paced courses For information about the training courses that Sun offers and to enroll in a class visit Sun Training at http training sun com 10 Sun Cluster 3 0 3 1 With Sun StorEdge 6120 Array M...

Page 11: ... page 31 Maintaining Storage Arrays on page 35 Installing Storage Arrays This section contains the procedures for installing single controller and dual controller storage array configurations in new and existing Sun Cluster configurations The following table lists these procedures TABLE 1 1 Task Map Installing a Storage Array Task Information Installing arrays in a new cluster using a single contr...

Page 12: ...rray Cabling Configurations You can install your storage array in several different configurations Use the Sun StorEdge 6120 Array Installation Guide to evaluate your needs and determine which configuration is best for your situation The following figures illustrate example configurations Figure 1 1 shows two storage arrays and two have controllers The storage arrays connect to a 2 node cluster th...

Page 13: ...ut a controller connects to the second storage array which has a controller The third storage array without a controller connects to the fourth storage array which has a controller The two storage arrays with controllers connect to a 2 node cluster through two switches Dual controller configurations require software RAID 1 host based mirroring Chapter 1 Installing and Maintaining a Sun StorEdge 61...

Page 14: ...on With Software RAID 1 Figure 1 3 shows two storage arrays and two have controllers The two storage arrays are daisy chained The two storage arrays connect to a 2 node cluster through two switches 14 Sun Cluster 3 0 3 1 With Sun StorEdge 6120 Array Manual for Solaris OS January 2006 Revision A ...

Page 15: ...ws four storage arrays and two have controllers All storage array are daisy chained in the following order alternate master master alternate master and master The two storage arrays with controllers connect to a 2 node cluster through two switches Chapter 1 Installing and Maintaining a Sun StorEdge 6120 Array 15 ...

Page 16: ...LAN Node A Node B Administrative console Switch Switch FIGURE 1 4 Installing a 2x4 Configuration 16 Sun Cluster 3 0 3 1 With Sun StorEdge 6120 Array Manual for Solaris OS January 2006 Revision A ...

Page 17: ...rocedure about how to install FC switches see the documentation that shipped with your FC switch hardware 3 Set up a Reverse Address Resolution Protocol RARP server on the network on which the new storage array is to reside Use the RARP server to set up the following network settings IP address gateway if necessary netmask if necessary hostname For the procedure about how to set up a RARP server s...

Page 18: ...chPro tool to describe your cluster configuration and download the patches For third party firmware patches see the SunSolveSM Online site at http sunsolve ebay sun com 7 Ensure that the cache and mirror settings for each storage array are set to auto For more information see the Sun StorEdge 6020 and 6120 Array System Manual 8 Ensure that the mp_support parameter for each storage array is set to ...

Page 19: ...ks see your Sun Cluster software installation documentation How to Install a Dual Controller Configuration in a New Cluster Use this procedure to install a storage array in a dual controller configuration before you install the Solaris operating environment and Sun Cluster software on your nodes The following procedures contain instructions for other array installation situations How to Install a ...

Page 20: ... functional For the procedure about how to power on the storage arrays see the Sun StorEdge 6120 Array Installation Guide 7 Install any required controller firmware for the storage arrays Access the master controller unit and administer the storage arrays The master controller unit is the storage array that has the interconnect cables attached to the second port of each interconnect card when view...

Page 21: ...ers online see the Sun StorEdge 6020 and 6120 Array System Manual 12 Reset the storage array to update the network settings and system settings that you changed For the procedure about how to reboot or reset a storage array see the Sun StorEdge 6020 and 6120 Array System Manual 13 On all nodes install the Solaris operating system and apply the required Solaris patches for Sun Cluster software and ...

Page 22: ...orEdge 6120 Array Installation Guide 2 Administer the storage array s network settings Network settings include the following settings IP address gateway if necessary netmask if necessary hostname For the procedure about how to set up an IP address gateway netmask and hostname on a storage array see the Sun StorEdge 6020 and 6120 Array System Manual 3 Ensure that the cache and mirror settings for ...

Page 23: ...s that you changed For the procedure about how to reboot or reset a storage array see the Sun StorEdge 6020 and 6120 Array System Manual 7 Confirm that all storage arrays that you upgraded are visible to all nodes luxadm probe How to Connect the Storage Array to FC Switches 1 Install the GBICs or SFPs in the storage array that you plan to add For the procedure about how to install a GBICs or SFPs ...

Page 24: ...upport packages installed If yes proceed to Step 6 If no install the packages The storage array packages are located in the Product directory of the Solaris CD ROM Add any necessary packages 6 Shut down and power off Node N For the procedure about how to shut down and power off a node see your Sun Cluster system administration documentation 7 Install the host adapter in Node N For the procedure ab...

Page 25: ...ur FC switch hardware For the procedure on how to install a GBIC or an SFP see the Sun StorEdge 6120 Array Installation Guide 11 Connect a fiber optic cable between the FC switch and Node N For the procedure about how to install a fiber optic cable see the Sun StorEdge 6120 Array Installation Guide 12 If necessary install the required Solaris patches for storage array support on Node N For a list ...

Page 26: ...ns for other array installation situations How to Install a Single Controller Configuration in a New Cluster on page 17 How to Install a Dual Controller Configuration in a New Cluster on page 19 How to Add a Single Controller Configuration to an Existing Cluster on page 22 This procedure defines Node N as the node with which you begin working How to Perform Initial Configuration Tasks on the Stora...

Page 27: ...ng Access the master controller unit and administer the storage arrays The master controller unit is the storage array that has the interconnect cables attached to the second port of each interconnect card when viewed from the rear of the storage arrays For the required controller firmware for the storage array see the Sun StorEdge 6120 Array Release Notes 7 Reset the storage array to update the n...

Page 28: ...esource groups and device groups off Node N scswitch S h from node 3 Do you need to install host adapters in Node N If no skip to Step 10 If yes proceed to Step 4 4 Is the host adapter that you that are installing the first host adapter on Node N If no skip to Step 6 If yes determine whether the required drivers for the host adapter are already installed on this node For the required packages see ...

Page 29: ... sunsolve ebay sun com 10 If necessary install a GBIC or an SFP in the FC switch or the storage array For the procedure about how to install a GBIC or an SFP see the documentation that shipped with your FC switch hardware For the procedure on how to install a GBIC or an SFP see the Sun StorEdge 6120 Array Installation Guide 11 Connect a fiber optic cable between the FC switch and Node N For the pr...

Page 30: ...switch z D device group name h nodename For more information see your Sun Cluster system administration documentation 19 Perform volume management administration to incorporate the new logical volumes into the cluster For more information see your Solstice DiskSuite Solaris Volume Manager or VERITAS Volume Manager documentation The best way to enable multipathing for a cluster is to install the mu...

Page 31: ... Use this procedure to create a logical volume from unassigned storage capacity Note Sun storage documentation uses the following terms Logical volume Logical device Logical unit number LUN This manual uses logical volume to refer to all such logical constructs This procedure relies on the following prerequisites and assumptions All nodes are booted in cluster mode and attached to the storage devi...

Page 32: ...onfigure Traffic Manager paths see the Sun StorEdge Traffic Manager Installation and Configuration Guide 4 On one node that is connected to the storage device use the format command to label the new logical volume 5 From any node in the cluster update the global device namespace scgdevs Note You might have a volume management daemon such as vold running on your node and have a CD ROM drive connect...

Page 33: ...on the following prerequisites and assumptions All nodes are booted in cluster mode and attached to the storage device The logical volume and the path between the nodes and the storage device are both operational 1 Identify the logical volume that you are removing Refer to your Solstice DiskSuite Solaris Volume Manager or VERITAS Volume Manager documentation for more information 2 Optional Migrate...

Page 34: ...on both nodes to remove the volume from VERITAS Volume Manager control vxdisk offline Accessname vxdisk rm Accessname Accessname Disk access name 6 If you are using multipathing unconfigure the volume in Sun StorEdge Traffic Manager cfgadm o force_update c unconfigure Logical_Volume 7 Access the storage device and remove the logical volume For the procedure about how to remove the volume see your ...

Page 35: ...other LUN operations a device ID might change unexpectedly When you perform a check of the device ID configuration by running the scdidadm c command the following error message appears on your console if the device ID changed unexpectedly device id for nodename dev rdsk cXtYdZsN does not match physical device s id for ddecimalnumber device may have been replaced To fix device IDs that report this ...

Page 36: ...procedures Adding an expansion unit Removing an expansion unit Replacing an expansion unit Adding a disk drive Replacing a failed disk drive Removing a disk drive Replacing an Ethernet cable Replacing a power cable on the storage array Replacing a power and cooling unit PCU Replacing a chassis Replacing a controller Replacing a storage array to switch component in a dual controller configuration A...

Page 37: ...rays you are upgrading 2 Apply the controller disk drive and loop card firmware patches For the list of required patches see the Sun StorEdge 6120 Array Release Notes For the procedure about how to apply firmware patches see the firmware patch README file For the procedure about how to verify the firmware level see the Sun StorEdge 6020 and 6120 Array System Manual 3 Confirm that all storage array...

Page 38: ...o shut down and power off a node see your Sun Cluster system administration documentation 6 Is the storage array that you are removing the last storage array that is connected to Node A If yes disconnect the fiber optic cable between Node A and the FC switch that is connected to this storage array Afterward disconnect the fiber optic cable between the FC switch and this storage array If no proceed...

Page 39: ... to remove the host adapter from Node B If yes power off Node B If no skip to Step 16 14 Remove the host adapter from Node B For the procedure about how to remove host adapters see the documentation that shipped with your nodes 15 Without enabling the node to boot power on Node B For more information see your Sun Cluster system administration documentation 16 Boot Node B into cluster mode For the ...

Page 40: ...moving For more information see your Solstice DiskSuite Solaris Volume Manager or VERITAS Volume Manager documentation 4 Determine the resource groups and device groups that are running on all nodes Record this information because you use this information in Step 19 of this procedure to return resource groups and device groups to these nodes scstat 5 Shut down Node A For the procedure about how to...

Page 41: ...that you are removing the last storage array that is connected to an FC switch that is on Node B If no proceed to Step 14 If yes disconnect the fiber optic cable that connects this FC switch to Node B For the procedure about how to remove a fiber optic cable see the Sun StorEdge 6020 and 6120 Array System Manual 14 Do you want to remove the host adapters from Node B If no skip to Step 17 If yes po...

Page 42: ...er see How to Replace a Host Adapter on page 44 This procedure defines Node A as the node that is connected to the node to switch component that you are replacing This procedure assumes that except for the component you are replacing your cluster is operational Ensure that you are following the appropriate instructions If your cluster uses multipathing see How to Replace a Node to Switch Component...

Page 43: ...e manager error that was caused by the failed data path c Optional If necessary return resource groups and device groups to this node You have completed this procedure 2 Determine the resource groups and device groups that are running on Node A scstat 3 Move all resource groups and device groups to another node scswitch s h from node 4 Replace the node to switch component Refer to your hardware do...

Page 44: ...n Sun Cluster 3 0 3 1 Hardware Administration Manual for Solaris OS Exceptions to this restriction include three node or larger cluster configurations where no storage device has a quorum device configured 1 Determine the resource groups and device groups that are running on Node A Record this information because you use this information in Step 9 of this procedure to return resource groups and de...

Page 45: ... the PatchPro tool for Sun Cluster software go to http www sun com PatchPro click Sun Cluster then choose either Interactive Mode or Expert Mode Follow the instructions in the PatchPro tool to describe your cluster configuration and download the patches For third party firmware patches see the SunSolveSM Online site at http sunsolve ebay sun com 8 Boot Node A into cluster mode For more information...

Page 46: ...46 Sun Cluster 3 0 3 1 With Sun StorEdge 6120 Array Manual for Solaris OS January 2006 Revision A ...

Page 47: ...storage arrays C cables replacing 36 cabling configurations 1x1 configuration 12 1x2 configuration 13 2x2 configuration 14 cabling configurations Continued 2x4 configuration 15 chassis replacing 36 configuring storage arrays 31 35 controllers replacing 36 cooling units replacing 36 creating logical volumes 31 33 D deleting logical volumes See removing logical volumes disk drives adding 36 removing...

Page 48: ...42 power cables replacing 36 power units replacing 36 R RAID 1 configurations 1x1 configuration 12 1x2 configuration 13 removing disk drives 36 dual controller configurations 40 42 expansion units 36 logical volumes 33 35 nodes 36 partner groups 40 42 single controller configurations 37 39 storage arrays 37 39 replacing chassis 36 controllers 36 cooling units 36 disk drives 36 Ethernet cables 36 e...

Page 49: ...ual controller configurations 19 21 installing single controller configurations 17 19 maintaining 35 45 removing 37 39 Sun StorEdge 6120 storage array cabling 12 17 FRUs 36 product documentation 7 switch to storage array components replacing 36 T technical support 8 training 10 U upgrading storage array firmware 37 49 ...

Page 50: ...50 Sun Cluster 3 0 3 1 With Sun StorEdge 6120 Array Manual for Solaris OS January 2006 Revision A ...

Reviews: