Sun Microsystems StorEdge T3+ Installation And Configuration Manual Download Page 20

Page: 20 / 228

Sun StorEdge T3+ Array Installation and Configuration Manual • April 2002

Summary of Contents for StorEdge T3+

Page 1: ...ircle Santa Clara CA 95054 U S A 650 960 1300 Send comments about this document to docfeedback sun com Sun StorEdge T3 Array Installation and Configuration Manual Version 2 1 Controller Firmware Part No 816 4769 10 April 2002 Revision A ...

Page 2: ...ems Inc 4150 Network Circle Santa Clara CA 95054 Etats Unis Tous droits réservés Ce produit ou document est distribué avec des licences qui en restreignent l utilisation la copie la distribution et la décompilation Aucune partie de ce produit ou document ne peut être reproduite sous aucune forme par quelque moyen que ce soit sans l autorisation préalable et écrite de Sun et de ses bailleurs de lic...

Page 3: ...it Interconnect Cards UIC 7 Power and Cooling Unit 9 Array Features 9 Firmware Version 2 1 New Features List 11 Array Architecture 11 2 Supported Configurations 13 Workgroup 14 Enterprise 16 Configuration Guidelines and Restrictions 17 Workgroup Configuration Restrictions 17 Enterprise Configuration Restrictions 17 Configuration Recommendations 18 ...

Page 4: ...ve Tools 23 End User Tools 24 Supported Interfaces 24 Supported Import Interfaces 24 Supported Bootability 25 Supported Multi Platform Software 25 Supported Multi Host Environments 25 Summary of Supported Software 26 4 Configuration Scenarios 27 Direct Host Connection 28 Single Host With One Controller Unit 28 Single Host With Two Controller Units Configured as a Partner Group 29 Host Multi Pathin...

Page 5: ... Groups 46 Switch Host Connection 48 Dual Hosts With Two Switches and Two Controller Units 48 Dual Hosts With Two Switches and Eight Controller Units 50 5 Preparing to Install 53 Preparing for the Installation 54 To Inspect the Array 55 To Edit the Host Files 57 To Install Required Patches 59 Installation Checklist 61 6 Array Installation 63 To Install the Array 64 To Connect the Cables 65 To Powe...

Page 6: ... Version 2 1 Upgrade 97 Upgrading Overview 98 Upgrading Requirements 98 Upgrading Limitations 99 Connecting to the Array 100 To Establish an ftp Session 100 To Establish a Telnet Session 101 To Determine the Firmware Version 103 Upgrading the System Firmware 104 To Install the System Firmware 2 1 Patch 104 To Install the Interconnect Card Firmware 107 To Upgrade the Controller Firmware 109 To Veri...

Page 7: ...ion Rate 122 Using RAID Levels to Configure Redundancy 123 RAID 0 124 RAID 1 124 RAID 5 125 Configuring RAID Levels 125 9 Post Installation Array Settings Configuration 127 Reconfiguring the Array Settings 128 Unit Volume Configurations 128 RAID Levels 129 Cache Modes 129 Disabling and Reconstructing a Drive 131 Monitoring the Array 132 StorEdge Component Manager 132 SNMP Notification 132 syslog E...

Page 8: ...PCI Single Fibre Channel Network Adapter 143 System Requirements 143 Sun StorEdge PCI Dual Fibre Channel Network Adapter 144 System Requirements 144 Compact PCISun StorEdge CompactPCI Dual Fibre Channel Network Adapter 145 System Requirements 145 12 Post Installation Array Cabling 147 Overview of Array Cabling 148 Data Path 148 Administration Path 148 Connecting Arrays 148 Workgroup Configurations...

Page 9: ...ing Components 165 Disk Drives 166 Disk Drive LEDs 166 To Remove and Replace a Disk Drive 167 Power and Cooling Units 170 Power and Cooling Unit LEDs 171 To Remove and Replace a Power and Cooling Unit 171 UPS Battery 173 Battery Maintenance 173 Removing and Replacing the UPS Battery 174 Interconnect Cards 174 Interconnect Card LEDs 174 To Removing and Replacing an Interconnect Card 175 Controller ...

Page 10: ...ay Installation and Configuration Manual April 2002 A Specifications 181 Power Specifications 182 Environmental Specifications 183 Mechanical Specifications 184 Cable Specifications 185 B Illustrated Parts 187 Glossary 193 ...

Page 11: ...E 4 2 Single Host With Two Controller Units Configured as a Partner Group 29 FIGURE 4 3 Failover Configuration 30 FIGURE 4 4 Single Host With Four Controller Units Configured as Two Partner Groups 32 FIGURE 4 5 Single Host With Eight Controller Units Configured as Four Partner Groups 34 FIGURE 4 6 Single Host With Two Hubs and Four Controller Units Configured as Two Partner Groups 37 FIGURE 4 7 Si...

Page 12: ...FIGURE 6 7 Power and Cooling Unit LEDs and Power Button Location 71 FIGURE 6 8 Disk Drive Physical Numbering 82 FIGURE 6 9 Power Switch Locations 95 FIGURE 7 1 Level 3 Firmware Version Check Output for Master Unit 103 FIGURE 7 2 Level 3 Firmware Version Check Output for Master Unit 111 FIGURE 10 1 Sun StorEdge T3 Array Partner Group 136 FIGURE 11 1 Sun Enterprise 6x00 5x00 4x00 3x00 SBus I O Board...

Page 13: ...ive 169 FIGURE 14 5 Power Cords Connected to the Power and Cooling Units 170 FIGURE 14 6 Removing the Power and Cooling Unit 172 FIGURE 14 7 Removing the Interconnect Card 176 FIGURE 14 8 Removing the Controller Card 178 FIGURE B 1 Disk Drive in Canister 188 FIGURE B 2 Sun StorEdge T3 Array Controller Card 189 FIGURE B 3 Interconnect Card 189 FIGURE B 4 Power and Cooling Unit 189 FIGURE B 5 Cables...

Page 14: ...xiv Sun StorEdge T3 Array Installation and Configuration Manual April 2002 ...

Page 15: ... 2 RAID 1 1 0 Data Blocks 124 TABLE 8 3 RAID 5 Data Blocks 125 TABLE 9 1 Examples of Volume Configurations 129 TABLE 9 2 Cache Transition States 130 TABLE 9 3 syslog Error Reporting Levels 133 TABLE 13 1 Disk Drive LED Descriptions 157 TABLE 13 2 Power and Cooling Unit LED Descriptions 158 TABLE 13 3 Interconnect Card LED Descriptions 160 TABLE 13 4 Sun StorEdge T3 Array Controller Card LED Descri...

Page 16: ...xvi Sun StorEdge T3 Array Installation and Configuration Manual April 2002 TABLE A 4 Cable Specifications 185 TABLE B 1 Illustrated Part Numbers 187 ...

Page 17: ... manual can be performed by an experienced system administrator Topics covered here are Before You Read This Book on page xviii Using UNIX Commands on page xviii Typographic Conventions on page xix Shell Prompts on page xix Related Documentation on page xx Accessing Sun Documentation Online on page xxi Sun Welcomes Your Comments on page xxi ...

Page 18: ...e on the Sun documentation web site or from your Sun representative Work with your Sun representative to determine if you require any external hardware or software products for using this device Being prepared with this knowledge and the appropriate tools will simplify the installation Using UNIX Commands This document contains some information on basic UNIX commands and procedures such as booting...

Page 19: ...d with on screen computer output su Password AaBbCc123 Book titles new words or terms words to be emphasized Read Chapter 6 in the User s Guide These are called class options You must be superuser to do this Command line variable replace with a real name or value To delete a file type rm filename Shell Prompt C shell machine_name C shell superuser machine_name Bourne shell and Korn shell Bourne sh...

Page 20: ...et installation Sun StorEdge T3 Array Cabinet Installation Guide 806 7979 Disk drive specifications 18 Gbyte 1 inch 10K rpm Disk Drive Specifications 806 1493 36 Gbyte 10K rpm 1 Inch Disk Drive Specifications 806 6383 73 Gbyte 10K rpm 1 6 Inch Disk Drive Specifications 806 4800 Host Bus Adapters Sun Enterprise 6x00 5x00 4x00 3x00 Systems SBus and Graphics I O Boards Installation Guide 805 2704 Sun...

Page 21: ...Solutions at http www sun com products n solutions hardware docs Network_Storage_Solutions Sun Welcomes Your Comments Sun is interested in improving its documentation and welcomes your comments and suggestions You can email your comments to Sun at docfeedback sun com Please include the part number 8xx xxxx xx of your document in the subject line of your email ...

Page 22: ...xxii Sun StorEdge T3 Array Installation and Configuration Manual April 2002 ...

Page 23: ...ter provides a high level introduction to the Sun StorEdge T3 array Topics in this chapter include Product Description on page 2 Array Components on page 4 Array Features on page 9 Firmware Version 2 1 New Features List on page 11 Array Architecture on page 11 ...

Page 24: ...e unit or as a building block interconnected with other arrays of the same type and configured in various ways to provide a storage solution optimized to the host application The array shown in FIGURE 1 1 can be placed on a table top or rackmounted in a server cabinet or expansion cabinet The array is sometimes called a controller unit which refers to the internal RAID controller on the controller...

Page 25: ...Chapter 1 Overview of the Sun StorEdge T3 Array 3 FIGURE 1 1 Sun StorEdge T3 Array ...

Page 26: ...e available as one field replaceable unit FRU Only a qualified field service representative should replace this FRU Disk Drive Behind the panel at the front of the array are nine Fibre Channel disk drives numbered drive 1 through drive 9 from left to right See FIGURE 1 2 Each drive is in an enclosed canister that is easily installed and removed from the array Drive light emitting diodes LEDs which...

Page 27: ...r and a different design on the internal controller board See FIGURE 1 3 The general features of each array controller card are described in this section FIGURE 1 3 Controller Card Rear View The location of the controller card for both models is shown in FIGURE 1 4 Chapter 14 provides information on how to service the controller card FIGURE 1 4 Sun StorEdge T3 Array Controller Card Front Panel Con...

Page 28: ... Ethernet host interface port RJ 45 This port provides the interface between the controller card and the management host system A shielded Ethernet cable category 5 connects the controller to the site s network hub This interface enables the administration and management of the array via the Sun StorEdge Component Manager software or the command line interface CLI One RJ 45 serial port This serial...

Page 29: ...for interconnecting multiple arrays The interconnect card provides switch and failover capabilities as well as an environmental monitor for the array Each array contains two interconnect cards for redundancy thus providing a total of four interconnect ports FIGURE 1 6 shows the interconnect cards in a Sun StorEdge T3 array FIGURE 1 6 Interconnect Card and Ports Interconnect cards Input Output ...

Page 30: ... circuitry and two connectors for interconnecting multiple arrays It provides loop switch capability and contains an environmental monitor for the array See FIGURE 1 7 For information on how to service the interconnect card see Chapter 14 FIGURE 1 7 Interconnect Cards Rear View Interconnect card 2 Interconnect card 1 ...

Page 31: ... 8 Power and Cooling Units Rear View Array Features The Sun StorEdge T3 array provides high reliability while being simple to administer and maintain The array features a design that supports high availability high performance configuration flexibility and scalability of bandwidth capacity and input output operations per second IOPS TABLE 1 1 provides an example of these key features depicting an ...

Page 32: ... 10 100BASE T Ethernet network port Scalability one to two units one to two controllers 1 314 GB maximum capacity 1 to 2 GB cache 1 or 2 host Fibre Channel interfaces 90 to 190 MB sec bandwidth 7 200 to 14 360 IOPS 100 cache hit reads Reliability redundancy RAID 0 1 1 0 5 Redundant back end data loops Redundant interconnect cards Passive centerplane connector board Redundant power and cooling unit...

Page 33: ...sing to decision support and high performance computing from workgroup environments to data centers The arrays have redundant components for high reliability Components are hot swappable and field replaceable for serviceability Controller units have a cached hardware RAID controller for high performance Expansion units can be added to scale capacity Controllers can be added to expansion units to s...

Page 34: ...inally the unique switched loop architecture provides the flexibility to configure multiple units together for scalability and availability and enables loops to be reconfigured dynamically for diagnosis and recovery in case of loop related failures The following is a summary of the characteristics of the array Modular building blocks of disk storage Switched loop architecture Independent data and ...

Page 35: ... workgroup and enterprise It also describes basic rules and recommendations for configuring the array Topics in this chapter include Workgroup on page 14 Enterprise on page 16 Configuration Guidelines and Restrictions on page 17 Configuration Recommendations on page 18 Sun Cluster Support on page 19 ...

Page 36: ... a high performance high RAS configuration with a single hardware RAID cached controller See FIGURE 2 1 The unit is fully populated with redundant hot swap components and nine disk drives FIGURE 2 1 Workgroup Configuration Application host Ethernet port Ethernet FC AL connection LAN Management host connection ...

Page 37: ...tion provides all the RAS of single controller units plus redundant hardware RAID controllers with mirrored caches and redundant host channels for continuous data availability for host applications Note The Sun StorEdge T3 array configuration supports direct FC AL connections Application host FC AL connection Interconnect cables LAN Ethernet port Ethernet connection Management host Host bus adapte...

Page 38: ...bletop installation The alternate master controller unit is positioned on top of the master controller unit The positioning of the master and alternate master controller units is important for cabling the units together correctly understanding IP address assignments interpreting array command line screen output and determining controller failover and failback conditions In this manual the terms ma...

Page 39: ...n be connected to more than one host only if all of the following conditions exist The partner group can be connected to the hosts through a hub or a switch The configuration is using Sun StorEdge Traffic Manager Software STMS or VERITAS Dynamic Multipathing DMP for multipathing support Cluster configurations are supported using Sun Cluster 3 0 or third party software You cannot use a daisy chain ...

Page 40: ...the same volume configuration block size and cache mode That is all cache parameter settings are common to both units within a partner group The Sun StorEdge SBus FC 100 SOC HBA and the on board SOC interface in Sun Fire systems are supported On Sun Enterprise 6x00 5x00 4x00 3x00 systems a maximum of 64 arrays are supported per cluster On Sun Enterprise 10000 systems a maximum of 256 arrays are su...

Page 41: ...ictions Array controller firmware version 2 0 or later is required on each Sun StorEdge T3 array Sun Cluster 3 0 environments support the Sun StorEdge T3 array Enterprise configurations are supported only in Sun Cluster 3 0 environments Partner groups in a Sun Cluster environment must use Sun StorEdge Traffic Manager software for multipathing support ...

Page 42: ...20 Sun StorEdge T3 Array Installation and Configuration Manual April 2002 ...

Page 43: ...ed Operational Environment on page 22 Supported Multiple Operational Environments on page 22 Supported Clustering Software on page 22 Supported Host Side Drivers on page 23 Supported SAN Switch Support on page 23 Supported Diagnostics and Monitoring Software on page 23 Supported Interfaces on page 24 Supported Import Interfaces on page 24 Supported Bootability on page 25 Supported Multi Platform S...

Page 44: ... With the volume slicing feature enabled the slices can be masked to support multiple operating systems simultaneously Note In the absence of a clustering software managing each slice by a single host will be assumed Supported Multi Pathing Software Veritas Volume Manager 3 2 3 1 1 Solaris Logical Volume Manger 4 2 1 Solaris DiskSuite Sun StorEdge Traffic Manager Software STMS Supported Clustering...

Page 45: ...Edge Traffic Manager Software STMS Supported SAN Switch Support Sun StorEdge 16 port FC AL switch Sun StorEdge FC AL switch Supported Diagnostics and Monitoring Software Administrative Tools Device Manager StorADE 2 0 Network Storage Agent Solaris 2 6 only StorTools Solaris 2 6 only fru stat Ofdg Serial console SunVTS ...

Page 46: ...access HTTP Token based interface for use by Gotham CLI Command line interface Management applications use out of band interfaces with SNMP TCP IP SMTP HTTP protocols Supported Import Interfaces Fibre Channel protocol specified in the ANSI FCP and FCP 2 specifications Device discovery and basic I O operations are compliant with the Fibre Channel standards T3 array is a block storage Device and use...

Page 47: ... the Sun StorEdge T3 array as a bootable device contact your SunService provider for information Supported Multi Platform Software T3 Multi Platform 2 0 Supported Multi Host Environments CSI 2 Reserve Release SCSI III persistent group reservation PGR LUN masking ...

Page 48: ...olume Manager 3 1 1 and later with Dynamic Multipathing DMP Sun Enterprise Server Alternate Pathing AP 2 3 1 Sun StorEdge Component Manager 2 1 and later StorTools 3 3 Diagnostics Sun Cluster 2 2 and 3 0 software see Sun Cluster Support on page 19 Sun StorEdge Data Management Center 3 0 Sun StorEdge Instant Image 2 0 Sun StorEdge Network Data Replicator SNDR 2 0 Solstice Backup 5 5 1 Solstice Disk...

Page 49: ...ations for Sun StorEdge T3 arrays Although many configurations are supported these reference configurations provide the best solution for many installations Topics in this chapter include Direct Host Connection on page 28 Hub Host Connection on page 35 Switch Host Connection on page 48 ...

Page 50: ... 33 Single Host With One Controller Unit FIGURE 4 1 shows one application host connected through an FC AL cable to one array controller unit The Ethernet cable connects the controller to a management host by way of a secure private network and requires an IP address Note This configuration is not recommended for RAS functionality because the controller is a single point of failure In this type of ...

Page 51: ...s configuration is a recommended enterprise configuration for RAS functionality because there is no single point of failure For multi path failover this configuration supports VERITAS DMP by VERITAS Volume Manager and the Sun StorEdge Traffic Manager Software STMS in the Solaris operating environment The following three global parameters must be set on the master controller unit Multi path support...

Page 52: ... controller This path is the failover path When a controller in the master controller unit fails the alternate master controller unit becomes the master When the failed controller is repaired the new controller immediately boots goes online and becomes the alternate master controller unit The former alternate master controller unit remains the master controller unit Note The multipathing software ...

Page 53: ...irements Host based multi pathing software is required for this configuration Note This configuration is a recommended enterprise configuration for RAS functionality because the controller is not a single point of failure The following three parameters must be set on the master controller unit Multi path support software DMP sys mp_support rw STMS sys mp_support mpxio sys cache auto sys mirror aut...

Page 54: ...l 2002 FIGURE 4 4 Single Host With Four Controller Units Configured as Two Partner Groups Application host Management host Ethernet Ethernet port Interconnect cables HBA Secure private LAN FC AL FC AL HBA HBA HBA Master Alternate master controller unit controller unit ...

Page 55: ...d for footprint and I O throughput Note This configuration is a recommended enterprise configuration for RAS functionality because the controller is not a single point of failure The following three parameters must be set on the master controller unit Multi path support software DMP sys mp_support rw STMS sys mp_support mpxio sys cache auto sys mirror auto Note For information on setting these par...

Page 56: ...GURE 4 5 Single Host With Eight Controller Units Configured as Four Partner Groups Application host Management host Ethernet port Secure private LAN Ethernet FC AL FC AL HBA HBA HBA HBA HBA HBA HBA HBA Interconnect cables Master Alternate master controller unit controller unit ...

Page 57: ...two array partner groups The Ethernet connection on the master controller unit is on a secure private network and requires an IP address for the partner group In the event of a failover the alternate master controller unit will use the master controller unit s IP address and MAC address Note This configuration is a recommended enterprise configuration for RAS functionality because the controller i...

Page 58: ...set on the master controller unit Multi path support software DMP sys mp_support rw STMS sys mp_support mpxio sys cache auto sys mirror auto Note For information on setting these parameters refer to the Sun StorEdge T3 Array Administrator s Manual Host based multipathing software is required for this configuration ...

Page 59: ...Host With Two Hubs and Four Controller Units Configured as Two Partner Groups Interconnect cables Application host Ethernet port Management host FC AL FC AL Hub Hub Secure private LAN HBA HBA Ethernet Master Alternate master controller unit controller unit ...

Page 60: ...An array can be connected to any available port on the hub Each array needs to be assigned a unique target address using the port set command These target addresses can be any number between 1 and 125 At the factory the array target addresses are set starting with target address 1 for the bottom array and continuing to the top array Use the port list command to verify that all arrays have a unique...

Page 61: ...ost With Two Hubs Configured and Eight Controller Units as Four Partner Groups Hub Hub Interconnect cables Application host Ethernet port Management host FC AL Secure private LAN HBA HBA Ethernet Master Alternate master controller unit controller unit FC AL ...

Page 62: ... unique values This configuration is not a recommended for RAS functionality because the controller is a single point of failure Note There are no hub port position dependencies when connecting arrays to a hub An array can be connected to any available port on the hub Each array needs to be assigned a unique target address using the port set command These target addresses can be any number between...

Page 63: ...tion Scenarios 41 FIGURE 4 8 Dual Hosts With Two Hubs and Four Controller Units Hub Hub Application host 1 Ethernet port Secure private LAN FC AL HBA HBA HBA HBA Application host 2 Management host Ethernet Controller unit ...

Page 64: ...e a single FC AL loop as with a hub set the array target addresses to unique values This configuration is not a recommended for RAS functionality because the controller is a single point of failure Note There are no hub port position dependencies when connecting arrays to a hub An array can be connected to any available port on the hub Each array needs to be assigned a unique target address using ...

Page 65: ...ion Scenarios 43 FIGURE 4 9 Dual Hosts With Two Hubs and Eight Controller Units Application host 1 Management Host Ethernet port Secure private LAN FC AL Hub Hub HBA HBA HBA HBA Application host 2 Ethernet Controller unit ...

Page 66: ...o any available port on the hub Each array needs to be assigned a unique target address using the port set command These target addresses can be any number between 1 and 125 At the factory the array target addresses are set starting with target address 1 for the bottom array and continuing to the top array Use the port list command to verify that all arrays have a unique target address Refer to th...

Page 67: ...Hubs and Four Controller Units Configured as Two Partner Groups Hub Hub Application host 1 Ethernet port Secure private LAN FC AL FC AL HBA HBA HBA HBA Application host 2 Management host Ethernet Master Alternate master controller unit controller unit Interconnect cables ...

Page 68: ...ner group or a single array to share a single FC AL loop as with a hub array target addresses need to be set to unique values Assign the array target address using the port set command These target addresses can be any number between 1 and 125 At the factory the array target addresses are set starting with target address 1 for the bottom array and continuing to the top array Use the port list comm...

Page 69: ...ubs and Eight Controller Units Configured as Four Partner Groups Application host 1 Management host Ethernet port FC AL FC AL Hub Hub HBA HBA HBA HBA Application host 2 Ethernet Master Alternate master controller unit controller unit Interconnect cables Secure private LAN ...

Page 70: ...sed by any array or data path single point of failure using host based mirroring software such as VERITAS Volume Manager or Solaris Volume Manager When configuring more than a single array to share a single FC AL loop as with a hub set the array target addresses to unique values Each array needs to be assigned a unique target address using the port set command These target addresses can be any num...

Page 71: ...Scenarios 49 FIGURE 4 12 Dual Hosts With Two Switches and Two Controller Units Application host A Application host B Ethernet port Management Host Switch Switch FC AL HBA HBA HBA HBA Ethernet Controller unit Secure private LAN ...

Page 72: ...s VERITAS Volume Manager or Solaris Logical Volume Manager When configuring more than a single array to share a single FC AL loop as with a hub set the array target addresses to unique values Each array needs to be assigned a unique target address using the port set command These target addresses can be any number between 1 and 125 At the factory the array target addresses are set starting with ta...

Page 73: ...cenarios 51 FIGURE 4 13 Dual Hosts With Two Switches and Eight Controller Units Application host 1 Application host 2 Ethernet port Management host Switch Switch FC AL HBA HBA HBA HBA Ethernet Controller unit Secure private LAN ...

Page 74: ...52 Sun StorEdge T3 Array Installation and Configuration Manual April 2002 ...

Page 75: ...eed to take to prepare your system for installing the product Topics in this chapter include Preparing for the Installation on page 54 To Inspect the Array on page 55 To Edit the Host Files on page 57 To Install Required Patches on page 59 Installation Checklist on page 61 ...

Page 76: ...ional hardware and software The array is designed to be easily installed A Phillips screwdriver is required for installing the array into a rack a flat blade screwdriver is helpful for removing and replacing components Note The array configuration requires an Ethernet connection for each controller unit The Sun StorEdge T3 array includes an Ethernet cable category 5 with each array for the 10 100B...

Page 77: ...model Two power cords The cables are illustrated in FIGURE 5 1 FIGURE 5 1 Sun StorEdge T3 Array Cables 2 Inspect the array for evidence of damage If the array is damaged keep all contents and packing materials for the shipping company s agent to inspect 3 Save the packing materials for future use 4 Remove the front panel of the array by pressing in on the side latches and pulling the cover off FIG...

Page 78: ...he pull out tab at the left side of the array next to the first disk drive FIGURE 5 3 This tab contains the array serial number and media access control MAC address Record this information you will need the MAC address for the installation FIGURE 5 3 Serial Number and MAC Address on Pull out Tab Latch Latch Pull out tab ...

Page 79: ...n contact the person who maintains your network Array name This is the user assigned name of the array you are installing Note If you are installing an enterprise configuration partner group you need the MAC address that will be assigned only to the master controller unit also called master unit In a partner group this is the array that is located on the bottom In Step 1 enter the MAC address for ...

Page 80: ...ter appears before the NOTFOUND return statements 4 Determine if the reverse address resolution protocol RARP daemon is running by typing If the RARP daemon is running you must kill the process and restart it for the host to recognize the changes you just made To kill the process type The process ID was provided in the ps eaf grep rarpd command output If the RARP daemon is not running proceed to t...

Page 81: ...hes are available on the SunSolveSM web site http sunsolve sun com To retrieve patches 1 In the SunSolve Online column click on Patches 2 In the Patches column click on PatchPro 3 Click on Storage Products Wait the system might be slow 4 Under Disk Arrays check the box next to StorEdge T3 5 Scroll to the bottom of the page and click Generate Patch List Refer to the patch README file for download i...

Page 82: ...ver PCI Systems only 107292 08 or later ifp PCI driver PCI Systems only 109189 03 or later ifp PCI driver PCI Systems only 109399 03 or later PCI Host Adapter Firmware Fcode 109399 03 or later PCI Host Adapter Firmware Fcode 109399 03 or later PCI Host Adapter Firmware Fcode SBus sf socal Only 105375 26 or later sf socal driver SBus systems only 107469 08 or later sf socal driver SBus systems only...

Page 83: ...array IP address bottom array IP adders Array name Top array name Bottom array name root password for array TFTP IP host address OS patch revision level Veritas DMP release Primary application StarTool release Sun StorEdge Component Manager release Location of firmware files RAID controller firmware file names EPROM firmware file name UID firmware file name Disk drive firmware file name ...

Page 84: ...62 Sun StorEdge T3 Array Installation and Configuration Manual April 2002 ...

Page 85: ...ixed array partner group is not supported Caution For security reasons connect the array to a private network only The following sections describe specific steps of the installation Note Follow these directions in the order provided to ensure a successful installation Topics in this chapter include To Install the Array on page 64 To Connect the Cables on page 65 To Power On and Verify the Hardware...

Page 86: ...y to access components Provide a minimum space of 6 inches 15 cm in front and in back of the array for adequate air flow Keep power and interface cables clear of foot traffic Route cables inside walls under the floor through the ceiling or in protective channels Route interface cables excluding fiber optic cables away from motors and other sources of magnetic or radio frequency interference Make s...

Page 87: ...egin make sure you have all of the required cables and adapters Fiber optic cable one per unit AC power cords two per unit Interconnect cables one pair of cables per partner group Ethernet interface cable 1 per controller unit 10BASE T category 3 interface cable for the array must be purchased separately 10 100BASE T category 5 interface cable for the Sun StorEdge T3 array included with array pack...

Page 88: ...nnect the other end of the fiber optic cable to the FC AL connector on the controller card at the back of the master bottom unit Connect the LC SFF small form factor end of the cable to the FC AL interface FIGURE 6 2 3 Partner group only Repeat Step 1 and Step 2 to connect a second fiber optic cable to the alternate master top unit and to a separate HBA Fiber optic cable Interconnect cable AC powe...

Page 89: ...tor on a Sun StorEdge T3 Array 4 Attach one end of the Ethernet cable to the Ethernet port on the controller card of the master unit FIGURE 6 3 Use a category 5 Ethernet cable FIGURE 6 3 Connecting the Ethernet Cable Fiber optic cable FC AL connector LC SFF connector Ethernet cable Ethernet port ...

Page 90: ...ble Connect this cable to a hub or router on the same network as the master unit 7 Attach the two power cords to the two power and cooling units on the back of the master unit FIGURE 6 4 FIGURE 6 4 Connecting the Power Cords 8 Partner group only Repeat Step 7 to connect the power cords to the alternate master unit Caution Do not power on the units yet If you are connecting a single array unit proc...

Page 91: ...ct the cables to the correct interconnect card connectors exactly as shown in the figure This cable connection determines the master and alternate master relationship Tighten the retaining screws The remaining connectors are reserved for expansion units FIGURE 6 5 Connecting the Interconnect Cables Master controller unit Alternate master controller unit ...

Page 92: ...ing unit features are redundant 2 Verify that AC power is present on each power and cooling unit When AC power is present the AC LED on each power and cooling unit is solid amber and the fans turn at low speed 3 Press the power button on each power and cooling unit on all arrays to power on the units When the arrays are powered on the AC LED and power supply PS LED on the power and cooling units a...

Page 93: ...ng up the LEDs will blink The array boot time might take several minutes after which all LEDs should be solid green indicating the unit is receiving power and there is no drive activity For more information on the LEDs and how to interpret them see Array LEDs on page 156 Note The batteries in the power and cooling units recharge after you power on the unit While the batteries are recharging write ...

Page 94: ...mand with the array name or IP address to connect to the array For example Note The telnet session verifies whether your network connection is good If you cannot connect through the telnet session see the troubleshooting information in the Sun StorEdge T3 Array Administrator s Manual or the Sun StorEdge Component Manager User s Guide to analyze the problem 2 Type root as the login and press Return...

Page 95: ...d The netmask specifies the network mask used to implement IP subnetting 6 Set the host name using the set hostname command 7 Use the set timezone command to set the time zone region For the time zone region see the Sun StorEdge T3 Array Administrator s Manual For example if you are located in the Pacific Standard Time PST time zone the region would be America Los_Angelos as shown 1 passwd OLD pas...

Page 96: ...A reset disconnects the telnet session with the array The array reboots This can take up to several minutes 7 set bootmode tftp bootdelay 3 sn 103676 ip 10 4 31 28 netmask 255 255 255 0 gateway 10 4 31 1 tftphost 10 4 31 83 tftpfile t4ssl bin hostname InUseByAlbert timezone America Los_Angeles vendor 0301 model 501 5710 02 51 revision 0200 logto Apr02 loglevel 3 rarp on mac 00 20 f2 01 94 fc 9 dat...

Page 97: ...ou are running the latest firmware versions on your particular array model and that the array configuration information indicates that the unit is ready for operation You can check the firmware versions and array information in a telnet session with the array Note Verification of level 1 firmware on a Sun StorEdge T3 array is not required at this time Access to level 1 firmware operations is limit...

Page 98: ... array prompt is displayed 3 Type ver to display the header information Here is an example of header information for a Sun StorEdge T3 array In this example the Sun StorEdge T3 array is shown running 2 00 level 3 controller firmware 5 ver T3B Release 2 00 2001 08 02 15 21 29 192 168 209 243 Copyright C 1997 2001 Sun Microsystems Inc All Rights Reserved ...

Page 99: ... 9329 NK040157 u1d9 disk drive SEAGATE ST118202FSUN 9329 LKG79907 u2d1 disk drive SEAGATE ST118202FSUN 9329 LKG90019 u2d2 disk drive SEAGATE ST118202FSUN 9329 LKH18597 u2d3 disk drive SEAGATE ST118202FSUN 9329 LKH15606 u2d4 disk drive SEAGATE ST118202FSUN 9329 LKH16563 u2d5 disk drive SEAGATE ST118202FSUN 9329 LKG88883 u2d6 disk drive SEAGATE ST118202FSUN 9329 LKH61907 u2d7 disk drive SEAGATE ST11...

Page 100: ...wing the instructions in Chapter 7 If you do not need to upgrade firmware proceed to Step 7 7 Type port list to display how the paths are mapped from the host to the volumes An example of port list output for a single controller unit Use the world wide name wwn from the port list output to map the volume to the Solaris environment using the format 1M utility on the data host In the following examp...

Page 101: ... a partner group 9 Type vol mode to display the cache and mirror settings and to determine whether the volume is mounted The default settings for a single controller unit are as follows 9 sys stat Unit State Role Partner 1 ONLINE Master 10 sys stat Unit State Role Partner 1 ONLINE Master 2 2 ONLINE AlterM 1 11 vol mode volume mounted cache mirror v0 yes writebehind off ...

Page 102: ... ready ready 30 v0 u1d2 ready enabled data disk ready ready 30 v0 u1d3 ready enabled data disk ready ready 34 v0 u1d4 ready enabled data disk ready ready 34 v0 u1d5 ready enabled data disk ready ready 32 v0 u1d6 ready enabled data disk ready ready 36 v0 u1d7 ready enabled data disk ready ready 37 v0 u1d8 ready enabled data disk ready ready 41 v0 u1d9 ready enabled standby ready ready 34 v0 LOOP ST...

Page 103: ...unch the software and uninstall the software The Sun StorEdge Component Manager User s Guide describes how to use the GUI to administer Sun StorEdgeT3 Arrays Defining and Mounting Volumes This section includes information on defining and mounting volumes for both a workgroup and enterprise configuration For information on the commands used in this section refer to the Sun StorEdge T3 Array Adminis...

Page 104: ... page 83 If you have an enterprise configuration and want to mount the default volumes skip to To Configure the Enterprise on page 85 Note If you are creating new volumes or changing the volume configuration you must first manually rewrite the label of the previous volume using the autoconfigure option of the format 1M utility Refer to the Sun StorEdge T3 Array Administrator s Manual for more info...

Page 105: ...s messages are listed in the following table If the vol stat output shows the volume as mounted skip to Step 4 If the vol stat output shows the volume as unmounted proceed to Step 2 2 Use the vol mount command to mount the volume 2 vol stat v0 u1d1 u1d2 u1d3 u1d4 u1d5 u1d6 u1d7 u1d8 u1d9 unmounted 0 0 0 0 0 0 0 0 0 TABLE 6 1 Drive Status Messages Value Description 0 Drive is mounted 2 Drive is pre...

Page 106: ...rations 4 Use the luxadm 1M command to recognize the new volume The luxadm 1M command probes for new devices Refer to the luxadm 1M man page for more information on this command a Make sure there is a dev es directory on the host system If not type The dev es directory is necessary for running the luxadm command b On the host system type luxadm insert Note If the luxadm utility is not available yo...

Page 107: ...0 is the name of the volume unmounted is the status of the volume u1d1 u1d9 are the disk drives in the volume 0 is the status of the disk drives in the volume All the disk drives should show a status of 0 Possible status messages are listed in TABLE 6 1 If the vol stat output shows the volume as mounted skip to Step 4 If the vol stat output shows the volume as unmounted proceed to Step 2 2 Use the...

Page 108: ...ives 1 through 9 raid 5 is RAID level 5 5 Type vol stat to check the status of the volumes The status of all drives must be 0 For example 6 Use the vol init command to initialize the volume on the alternate master Depending on system activity at the time of initialization it can take up to an hour to initialize a volume Only one volume can be initialized at a time 3 vol stat v0 u1d1 u1d2 u1d3 u1d4...

Page 109: ...to recognize the new volume The luxadm 1M command probes for new devices Refer to the luxadm 1M man page for more information on this command a Make sure there is a dev es directory on the host system If not type The dev es directory is necessary for running the luxadm command b On the host system type luxadm insert Note If the luxadm utility is not available you must do a reconfiguration reboot b...

Page 110: ...pter 9 The command line procedures for reconfiguring the array are in the Sun StorEdge T3 Array Administrator s Manual Once you have reconfigured the array return to this chapter and proceed to Connecting the Host System on page 89 If you are not changing the default configuration proceed to Connecting the Host System on page 89 format Searching for disks done AVAILABLE DISK SELECTIONS 0 c0t0d0 SU...

Page 111: ... verify the existence of a volume on the array For example In this example device number 2 is the array as identified by the SUN T300 0113 0113 changes label Note If you are creating new volumes or changing the volume configuration you must first manually rewrite the label of the previous volume using the autoconfigure option of the format 1M utility Refer to the Sun StorEdge T3 Array Administrato...

Page 112: ...per Kbyte capacities For example using the array vol command a 4 drive 18 Gbyte RAID 0 volume would report a 71 6 Gbyte capacity within the array This is calculated as follows 139857920 blks 512 bytes blk 1 Gbyte 10003 71 6 Gbytes The format 1M command in the Solaris environment reports a 66 69 Gbyte capacity for the same volume using 1 024 bytes per Kbyte calculated as follows 139857920 blks 512 ...

Page 113: ... of the back end Fibre Channel loops connecting the two units The back end Fibre Channel loops are used to maintain host access to the disks of the unit with the failed controller or any failure in the host data path to that controller This requires the use of a host based alternate pathing mechanism such as the Dynamic Multi Pathing DMP feature of VERITAS Volume Manager Sun Enterprise Alternate P...

Page 114: ...running other alternate pathing software type 3 Use the sys list command to verify that the mirror setting is set to auto Note For data hosts running Solaris operating environments earlier than Solaris 7 11 99 or later run the luxadm insert command so the host can recognize the new paths telnet array name Trying 129 150 47 101 Connected to 129 150 47 101 Escape character is pSOSystem 129 150 47 10...

Page 115: ...athing support is enabled and the host is rebooted from the host side you will see two paths available to the same volume a primary path and an alternate path This means that if you are using the format 1M utility in the Solaris environment you will see two paths for each volume This completes the installation process for an enterprise configuration For information on available array settings and ...

Page 116: ...ocedure will power off the array and all arrays connected to it Note If the array is operating in the Solaris environment and there are volumes mounted unmount the volumes on the data host before powering off the array 1 Ensure that the data path between the host and the array has been quiesced There must not be any I O activity 2 In a telnet session with the array type 3 Press the power button on...

Page 117: ...ver Power on the master unit by pressing the power button on each power and cooling unit At this point all power and cooling unit LEDs on the array and any units connected to it will turn green indicating that power has been restored Note If the green power and cooling unit LEDs on connected units do not light press the power switches on those units Power switches ...

Page 118: ...96 Sun StorEdge T3 Array Installation and Configuration Manual April 2002 ...

Page 119: ...to version 2 1 This chapter contains the following topics Upgrading Overview on page 98 Upgrading Requirements on page 98 Upgrading Limitations on page 99 Connecting to the Array on page 100 To Determine the Firmware Version on page 103 Upgrading the System Firmware on page 104 To Upgrade the Controller Firmware on page 109 To Verify the Upgrade on page 111 ...

Page 120: ...page 103 5 Run the script to automatically install the firmware patches See To Install the System Firmware 2 1 Patch on page 104 6 Upgrade the controller firmware See To Upgrade the Controller Firmware on page 109 7 Check the system functionality See To Verify the Upgrade on page 111 Upgrading Requirements 1 This procedure only works on a T3 array with firmware version 2 0 or 2 0 1 2 The Sun StorE...

Page 121: ...ntroller firmware c Restore the data 2 During the upgrade entire volumes are mapped 1 1 to slices regardless of the amount of data in the volume You will not be able to further slice the volume However if you do decide to further slice the volume s the following steps must be followed a Back up all the data that is on the volume created before the upgrade b Remove any existing slices created durin...

Page 122: ...session 1 Start an ftp session from the management host to the array For example 2 Log in to the array by typing root where password is the root password Note Be sure to set the Binary mode if you are transferring firmware mgmt host 15 ftp 123 123 123 2 Connected to 123 123 123 2 Escape character is 123 123 123 2 pSOSystem NUPPC 2 0 0 G ready Name 123 123 123 2 root Name 123 123 123 2 root root 33...

Page 123: ... can be useful for displaying syslog information You can quickly determine the status of the array unit from the CLI The syslog file of the array file system contains a record of events that have occurred in the unit and can also be examined through the CLI To open a Telnet connection and start a session with the array 1 On the host use the telnet command with the array name or IP address to conne...

Page 124: ...syslog file and interpret it see Connecting to the Array on page 100 For information on how to use the CLI commands see the Sun StorEdge T3 Array Administrator s Manual 1 help ftp telnet arp cat cd cmp cp date echo head help ls mkdir mv ping pwd rm rmdir tail touch boot disable disk enable fru id logger lpc more passwd port proc reset set shutdown sync sys tzset ver vol ep refresh route ...

Page 125: ...An example output of the ver command for the master controller unit is shown in FIGURE 7 1 Check the firmware release version shown on the top line against the explanation shown in TABLE 7 1 In this case 2 00 01 represents firmware version 2 0 1 and an upgrade to version 2 1 is appropriate FIGURE 7 1 Level 3 Firmware Version Check Output for Master Unit p2 1 ver T3B Release 2 00 01 2001 01 04 15 1...

Page 126: ...rocedure This section contains the following topics To Install the System Firmware 2 1 Patch on page 104 To Install the Interconnect Card Firmware on page 107 To Install the System Firmware 2 1 Patch This procedure uses an uploading utility script t3 sh that automatically transfers the contents of this patch to the Sun StorEdge T3 array The script is only for use on a Solaris host system Caution B...

Page 127: ... binaries on the array after the upgrade 4 Access the Solaris host directory that contains the firmware 2 1 patch 5 Use the utility included in the patch t3 sh to download the files to the array by typing Note The t3 sh utility installs all controller and system files but does not overwrite the etc hosts and etc syslog conf files on the target array system as these files are typically customized p...

Page 128: ...rompts Prompt Information Required Please Enter Hostname or IP Address of Target T3 To Be Upgraded Hostname or IP address of the target Sun StorEdge T3 arra system Please Enter Patch Location Pathname Give the path to where the files tar image exists Typically the default current working directory is sufficient Press ENTER to accept the current working directory Please Enter Your Home Directory Pa...

Page 129: ...ory device on the interconnect card The array can be operational during the interconnect card firmware upgrade 1 Check the Interconnect Cards firmware version by typing Contact your Sun service provider to find out the latest Interconnect card firmware version lpc version LOOP A LOOP B Enclosure 1 5 01 Flash 5 01 Flash Enclosure 2 5 01 Flash 5 01 Flash ...

Page 130: ...v1 u1d9 ready enabled data disk ready ready 31 v1 u2d1 ready enabled data disk ready ready 32 v2 u2d2 ready enabled data disk ready ready 31 v2 u2d3 ready enabled data disk ready ready 31 v2 u2d4 ready enabled data disk ready ready 32 v2 u2d5 ready enabled data disk ready ready 31 v2 u2d6 ready enabled data disk ready ready 31 v2 u2d7 ready enabled data disk ready ready 31 v2 u2d8 ready enabled da...

Page 131: ...uration This procedure also requires a Sun StorEdge T3 array system reboot so that all necessary host preparations needed to sustain this procedure should be made before starting 1 Establish a telnet session to the Sun StorEdge T3 array controller as described in To Establish a Telnet Session on page 101 2 Set the boot mode to auto by typing 3 Initiate the download by typing Wait for the system to...

Page 132: ...uring the boot process a controller detects a firmware version on the system disk different from the image loaded in flash the controller will reflash its local level 3 image and reset This can appear as two sequential boot cycles This process is an expected behavior 5 Repeat for each enterprise or workgroup configuration reset y ...

Page 133: ...the master controller unit is shown in FIGURE 7 2 Check the firmware release version shown on the top line against the explanation shown in TABLE 7 3 In this case 2 01 00 represents firmware version 2 1 and indicates that the upgrade was successful FIGURE 7 2 Level 3 Firmware Version Check Output for Master Unit p2 1 ver T3B Release 2 01 00 2002 03 05 13 18 16 10 4 32 211 Copyright C 1997 2001 Sun...

Page 134: ...d cache mirroring is enabled in an enterprise configuration Note For a workgroup configuration cache mirroring and mp_support can be turned off 3 Use the port listmap command to confirm that the volumes assigned to each array are correct vol mode volume mounted cache mirror v0 yes writebehind on v1 yes writebehind on port listmap port targetid addr_type lun volume owner access u1p1 1 hard 0 v0 u1 ...

Page 135: ...abled data disk ready ready 34 v0 u1d9 ready enabled data disk ready ready 36 v0 u2d1 ready enabled data disk ready ready 30 v1 u2d2 ready enabled data disk ready ready 31 v1 u2d3 ready enabled data disk ready ready 34 v1 u2d4 ready enabled data disk ready ready 34 v1 u2d5 ready enabled data disk ready ready 32 v1 u2d6 ready enabled data disk ready ready 37 v1 u2d7 ready enabled data disk ready re...

Page 136: ...318304FSUN A42D 3EL073TH u1d7 disk drive SEAGATE ST318304FSUN A42D 3EL06YQ9 u1d8 disk drive SEAGATE ST318304FSUN A42D 3EL07P62 u1d9 disk drive SEAGATE ST318304FSUN A42D 3EL073F1 u2d1 disk drive SEAGATE ST318304FSUN A42D 3EL06TRE u2d2 disk drive SEAGATE ST318304FSUN A42D 3EL07R81 u2d3 disk drive SEAGATE ST318304FSUN A42D 3EL06X3F u2d4 disk drive SEAGATE ST318304FSUN A42D 3EL07X5M u2d5 disk drive SE...

Page 137: ...using new factory units be sure to install and set up the units as a partner group before you power on and change any parameters or create or change any logical volumes Refer to Chapter 2 for more information Note For more information on changing array global parameters refer to the Sun StorEdge T3 Array Administrator s Manual Topics in this chapter include Configuring Cache on page 116 Configurin...

Page 138: ...nt is nonredundant the caching mode is set to write through Read caching is always performed Auto caching mode provides the best performance while retaining full redundancy protection Auto is the default cache mode for Sun StorEdge T3 array Write behind All write operations are cached An algorithm determines when the data is destaged or moved from cache to disk Write behind cache improves performa...

Page 139: ...Kbytes The default block size is 64 Kbytes A cache segment is the amount of data being read into cache A cache segment is 1 8 of a data block Therefore cache segments can be 2 Kbytes 4 Kbytes or 8 Kbytes Because the default block size is 64 Kbytes the default cache segment size is 8 Kbytes Note The array data block size is independent of I O block size Alignment of the two is not required Data Blo...

Page 140: ...e created a volume To subsequently change the data block size you must first delete the volume s change the data block size and then create a new volume s Caution Unless you back up and restore the data on these volumes it will be lost Mirrored Cache Enabling By enabling mirrored cache you can safeguard cached data if a controller fails Note Mirrored cache is possible only in a redundant enterpris...

Page 141: ...ible from the application host Refer to the Sun StorEdge T3 Array Administrator s Manual for more information on creating logical volumes Guidelines for Configuring Logical Volumes Use the following guidelines when configuring logical volumes The array s native volume management can support a maximum of two volumes per array unit The minimum number of drives is based on the RAID level as follows R...

Page 142: ...e system version 2 Attribute intensive NFS version 3 One LUN per array Data intensive NFS file system version 3 DSS DW HPC Note If you are creating new volumes or changing the volume configuration you must first manually rewrite the label of the previous volume using the autoconfigure option of the format 1M UNIX host command For more information on this procedure refer to the Sun StorEdge T3 Arra...

Page 143: ...it is only usable for the array in which it is configured The hot spare must be configured as drive 9 During a failure for example should drive 7 fail drive 9 is synchronized automatically with the entire LUN to reflect the data on drive 7 After the failed drive 7 is replaced the controller unit will automatically copy the data from drive 9 to the new drive and drive 9 will become a hot spare agai...

Page 144: ...perating with full redundancy protection so no loss of data occurs if another drive in the volume fails After a drive has been replaced the original data is automatically reconstructed on the new drive If no hot spare was used the data is regenerated using the RAID redundancy data in the volume If the failed drive data has been reconstructed onto a hot spare after the reconstruction has completed ...

Page 145: ...ing utility available on the data host s operating system In the Solaris environment use the format utility which can create up to seven distinct partitions per volume Note that in the case of the configuration described above if each partition is equal in size this will result in 18 Gbyte partitions which still may be too large to be used efficiently by legacy applications Use third party softwar...

Page 146: ...her drive is used Because the data is mirrored in a RAID 1 configuration the volume has only half the capacity of the assigned drives For example if you create a four drive RAID 1 volume with 18 Gbyte drives the resulting data capacity is 2 x 18 36 Gbytes TABLE 8 2 shows the data blocks in a RAID 1 1 0 volume with nine drives TABLE 8 1 RAID 0 Data Blocks1 1 Block numbers are written in hexadecimal...

Page 147: ...from right to left in order to eliminate a performance bottleneck Configuring RAID Levels The Sun StorEdge T3 array is preconfigured at the factory with a single LUN RAID level 5 redundancy and no hot spare After a volume has been configured you cannot reconfigure it to change its size RAID level or hot spare configuration You must first delete the volume and create a new one with the configuratio...

Page 148: ...126 Sun StorEdge T3 Array Installation and Configuration Guide April 2002 ...

Page 149: ...ttings Configuration This chapter describes how to reconfigure the default settings of the array as well as how to monitor the array Topics in this chapter include Reconfiguring the Array Settings on page 128 Monitoring the Array on page 132 ...

Page 150: ...n you replace the failed drive data from the hot spare is copied back to the replaced drive and the hot spare returns to a standby status Parity is additional information stored along with the data that enables the controller to rebuild data after a drive failure Only RAID 5 volumes have parity RAID 1 uses mirroring not parity which enables the controller to reconstruct data after a drive failure ...

Page 151: ...used for the following purposes Buffering Data that is being transferred between the host and the drives Read caching Data for future retrieval to reduce disk I O as much as possible Write caching Data that is used to build up stripes of data eliminating the read modify write overhead Write caching improves performance for applications that are writing to disk TABLE 9 1 Examples of Volume Configur...

Page 152: ... caching and no read caching Caution If one of the redundant components fail the cache mode is set to write through In the write through mode mirroring is not used and data is not being cached If you were to view the cache mode at this time using the vol mode command the setting for cache would be displayed as writethrough and the setting for mirror would be displayed as on This means that mirrori...

Page 153: ...structed on the new drive If no hot spare was used the data is regenerated using the RAID redundancy data in the volume If the failed drive data has been reconstructed onto a hot spare After the reconstruction has completed a copy back operation begins during which the hot spare data is copied to the newly replaced drive Interconnect card 2 Disabled Interconnect card 1 2 Disable system down Contro...

Page 154: ... refer to the Sun StorEdge Component Manager User s Guide For information on installing the software refer to the Sun StorEdge Component Manager Installation Guide SNMP Notification SNMP notification directs the software to send remote notification of array events to the administrator s host by using SNMP traps An SNMP trap is a UDP datagram sent to a set of hosts that are identified by their IP a...

Page 155: ... monitoring There are four possible levels of messages You can configure the level of error reporting to receive only certain types of messages such as error and warning messages For more information on configuring remote system logging refer to the Sun StorEdge T3 Array Administrator s Manual TABLE 9 3 syslog Error Reporting Levels Message Level Indication Example Error Critical system event requ...

Page 156: ...134 Sun StorEdge T3 Array Installation and Configuration Manual April 2002 ...

Page 157: ... redundant and larger storage system Note The terms partner group and enterprise configuration refer to the same type of configuration and are used interchangeably in this document Note Partner groups are not supported in Sun Cluster 2 2 configurations Topics in this chapter include Understanding Partner Groups on page 136 How Partner Groups Work on page 137 Creating Partner Groups on page 138 ...

Page 158: ...r group is shown in FIGURE 10 1 FIGURE 10 1 Sun StorEdge T3 Array Partner Group Note The Sun StorEdge T3 array configurations support direct FC AL connections When two units are connected together they form a redundant partner group This group provides controller redundancy Because the controller is a single point of failure in a standalone configuration this redundancy allows an application host ...

Page 159: ...C address from the old master and begins to function as the administrator of the storage system It will also be able to access the drives of the former master controller unit Those drives will still be used to store syslog information system configuration information and bootcode Should it become necessary to reboot the storage system while the master controller unit is inactive the alternate mast...

Page 160: ... Partner Groups Partner groups can be created in two ways From new units From existing standalone units Instructions for installing new array units and connecting them to create partner groups can be found in Chapter 2 To configure existing standalone arrays with data into a partner group you must go through a qualified service provider Contact your Sun Service representative for more information ...

Page 161: ...e Sun Enterprise SBus and Graphics I O Boards on page 140 Sun StorEdge PCI FC 100 Host Bus Adapter on page 141 Sun StorEdge SBus FC 100 Host Bus Adapter on page 142 Sun StorEdge PCI Single Fibre Channel Network Adapter on page 143 Sun StorEdge PCI Dual Fibre Channel Network Adapter on page 144 Compact PCISun StorEdge CompactPCI Dual Fibre Channel Network Adapter on page 145 ...

Page 162: ... and Graphics I O Boards Installation Guide FIGURE 11 1 shows a Sun Enterprise 6x00 5x00 4x00 3x00 SBus I O board FIGURE 11 1 Sun Enterprise 6x00 5x00 4x00 3x00 SBus I O Board System Requirements Your system must meet the following hardware and software requirements Sun Enterprise 6x00 5x00 4x00 3x00 system An available I O board slot OpenBootTM PROM version 3 2 10 or later A release of the Solari...

Page 163: ...e detailed information about this product refer to the Sun StorEdge PCI FC 100 Host Adapter Installation Manual FIGURE 11 2 shows a Sun StorEdge PCI FC 100 host bus adapter FIGURE 11 2 Sun StorEdge PCI FC 100 Host Bus Adapter System Requirements Your system must meet the following hardware and software requirements An available PCI port A release of the Solaris operating environment that supports ...

Page 164: ...g hot pluggable GBICs For more detailed information about this product refer to the Sun StorEdge SBus FC 100 Host Adapter Installation and Service Manual FIGURE 11 3 shows a Sun StorEdge SBus FC 100 host bus adapter FIGURE 11 3 Sun StorEdge SBus FC 100 Host Bus Adapter System Requirements Your system must meet the following hardware and software requirements An available SBus port A release of the...

Page 165: ...this product refer to the Sun StorEdge PCI Single Fibre Channel Network Adapter Installation Guide FIGURE 11 4 shows a Sun StorEdge PCI Single Fibre Channel network adapter FIGURE 11 4 Sun StorEdge PCI Single Fibre Channel Network Adapter System Requirements Your system must meet the following hardware and software requirements An available PCI port A release of the Solaris operating environment t...

Page 166: ...formation about this product refer to the Sun StorEdge PCI Dual Fibre Channel Network Adapter Installation Guide FIGURE 11 6 shows a Sun StorEdge PCI Dual Fibre Channel network adapter FIGURE 11 5 Sun StorEdge PCI Dual Fibre Channel Network Adapter System Requirements Your system must meet the following hardware and software requirements An available PCI slot A release of the Solaris operating env...

Page 167: ...information about this product refer to the Sun StorEdge CompactPCI Dual Fibre Channel Network Adapter Installation Guide FIGURE 11 6 shows a Sun StorEdge CompactPCI Dual Fibre Channel network adapter FIGURE 11 6 Sun StorEdge CompactPCI Dual Fibre Channel Network Adapter System Requirements Your system must meet the following hardware and software requirements An available cPCI port OpenBoot PROM ...

Page 168: ...146 Sun StorEdge T3 Array Installation and Configuration Manual April 2002 ...

Page 169: ... Cabling This chapter describes the array configurations supported by the Sun StorEdge T3 arrays Topics in this chapter include Overview of Array Cabling on page 148 Workgroup Configurations on page 150 Enterprise Configurations on page 151 ...

Page 170: ...where the FC AL from the array is connected to a hub on the same network as the data host Switch connection where the FC AL from the array is connected to a switch on the same network as the data host Administration Path For the administration path each controller unit has an Ethernet connector For each installed controller an Ethernet connection and IP address are required The administration serv...

Page 171: ...istrative console or to the application host These interconnect cards are used solely for ensuring redundancy and failover mechanisms in partner groups FIGURE 12 1 shows a Sun StorEdge T3 array with a controller card and interconnect cards FIGURE 12 1 Sun StorEdge T3 Array Controller Card and Interconnect Cards 10 100BASE T Ethernet port RJ 45 Serial port RJ 45 FC AL data connection port LC SFF Co...

Page 172: ... connections The FC AL connection provides a data path to the application host The Ethernet connection provides a link to the management host The serial port is used solely for diagnostics and service by qualified service personnel only Fiber optic cable lengths between 2 and 500 meters using short wave laser and 50 micron fiber optic cable are supported FIGURE 12 2 Array Workgroup Configuration A...

Page 173: ...l only Fiber optic cable lengths between 2 and 500 meters using short wave laser and 50 micron fiber optic cable are supported This configuration is optimal because it provides full redundancy to the application hosts Failover mechanisms are provided within the arrays but the application host has to provide data path failover mechanisms such as Dynamic Multi Pathing from VERITAS Volume Manager or ...

Page 174: ...152 Sun StorEdge T3 Array Installation and Configuration Manual April 2002 ...

Page 175: ...ormation in this chapter along with the Sun StorEdge T3 Array Administrator s Manual or Sun StorEdge Component Manager User s Guide to determine the service required Topics in this chapter include ofdg Notice on page 154 Analyzing the Problem on page 155 Channel Connection Failures on page 162 FRU Failures on page 162 ...

Page 176: ...rEdge T3 array firmware provides a command line and graphical user interface to a diagnostics tab provided by Sun StorEdge Component Manager 2 2 The ofdg utility is used to perform offline diagnostic testing This tool should be used only by qualified Sun service providers at this time The ofdg utility is limited in its test capabilities and must be run while the system is offline to avoid problems...

Page 177: ...ole In an enterprise configuration where Alternate Pathing failover has been established the failure of a channel path or array controller causes the host to redirect I O from the failed channel to the second FC AL connection Sun StorEdge Component Manager The Sun StorEdge Component Manager communicates with the array unit by means of an Ethernet connection The software must be installed configure...

Page 178: ...see the Sun StorEdge T3 Array Administrator s Manual Array LEDs Each FRU component within the array except for the chassis has a set of LEDs that indicate health and status as shown in the following sections Disk Drive LEDs on page 156 Power and Cooling Unit LEDs on page 157 Interconnect Card LEDs on page 159 Controller Card LEDs on page 160 Even though the LED indicates a FRU failure you should a...

Page 179: ...s and describes each state See FIGURE 13 2 TABLE 13 1 Disk Drive LED Descriptions Drive Activity green Drive Status amber Description Off Off Drive is not installed not recognized Slow blink Off Drive is spinning up or down Solid Off Drive is OK and is idle Flashing Off Drive is OK and is active n a Solid A drive reconstruct or firmware download is in progress n a Slow blink Drive failure has occu...

Page 180: ...r is available Green Off Occurs when array is shut down Power and cooling unit is disabled AC power is available Green Green Normal operating state Power and cooling unit is receiving AC power Power switch is turned on AC power is available Amber Amber Switch is off array will power off after power and cooling unit is disabled Green Amber Indicates one or more of the following Over temperature con...

Page 181: ...of each state See FIGURE 13 3 Green Blinking green Battery on refresh cycle Green Blinking amber Indicates one or more of the following PCU disabled One fan fault Battery hold time low PCU remains enabled Battery out of warranty PCU remains enabled Battery life span failure PCU remains enabled Note Verify a power and cooling unit failure using the CLI or Sun StorEdge Component Manager TABLE 13 2 P...

Page 182: ...t Card LED Descriptions Interconnect Card Status LED green or amber Description Off Interconnect card not installed not recognized Green solid Interconnect card OK Cable OK if present Green slow blink Interconnect card OK Cable bad OK to replace cable Amber solid Interconnect card firmware download in progress Amber slow blink Interconnect card failure OK to replace interconnect card Note Verify a...

Page 183: ...sabled Green The port is enabled and idle Blinking green The port is enabled and active Ethernet Active LED green Off Link invalid Green Link valid and idle Blinking green Link valid and active 10 100 BASE T Active LED green Off Port disabled 10 Mbps rate Green Port enabled and idle 100 Mbps rate Blinking green Port enabled and active Controller Status LED green or amber Off Controller not install...

Page 184: ...must use host based application diagnostics such as the StorTools product for the Solaris operating environment Refer to the documentation of the selected diagnostics tool for information on identifying data channel failures FRU Failures FRU failures are reported by an alarm or message notification from the tool used to monitor the array The failed FRU will most likely display a blinking amber LED...

Page 185: ...s in an array and upgrading software and firmware Caution Any FRU that is removed must be replaced within 30 minutes or the array and all attached arrays will automatically shut down and power off Topics in this chapter include ofdg Notice on page 164 Preparing for Service on page 165 Removing and Replacing Components on page 165 ...

Page 186: ...n StorEdge T3 array firmware provides a command line and graphical user interface to a diagnostics tab provided by Sun StorEdge Component Manager 2 2 The ofdg utility is used to perform offline diagnostic testing This tool should be used only by qualified Sun service providers at this time The ofdg utility is limited in its test capabilities and must be run while the system is offline to avoid pro...

Page 187: ...edges and avoid touching the circuitry Do not slide a FRU over any surface Avoid having plastic vinyl and foam in the work area Limit body movement which builds up static electricity during FRU installation Caution Although the array will remain operational for up to 30 minutes with a FRU removed replace a failed FRU as soon as you have removed it from the array Removing and Replacing Components T...

Page 188: ...or an enterprise configuration must have the same storage capacity and drive speed Note In some cases if disk drives are removed and replaced on a powered down or incompletely booted array the internal system monitoring facilities may not correctly detect the drive replacement Therefore replace disk drives on powered up fully booted arrays only Disk Drive LEDs The top of each disk drive has LEDs t...

Page 189: ...by pressing in on the side latches shown in FIGURE 14 1 and pulling the front panel forward FIGURE 14 1 Removing the Front Panel 3 Locate the disk drive that needs to be replaced Disk drives are numbered from 1 to 9 starting on the left side of the array as shown in FIGURE 14 2 FIGURE 14 2 Disk Drive Numbering Latch Latch Disk 1 Disk 9 ...

Page 190: ...sing the Latch Handle 5 Use the latch handle to slowly pull the disk drive out an inch Wait 30 seconds before pulling the drive out completely giving the disk drive time to spin down 6 Remove the disk drive from the array FIGURE 14 4 Caution Any disk drive that is removed must be replaced within 30 minutes or the array and all attached arrays will automatically shut down and power off ...

Page 191: ...sh it in until it is seated with the centerplane connector 10 Use a coin or small screwdriver to press in and lock the latch handle 11 Replace the front panel Caution You must replace the front panel for the array to meet regulatory emissions requirements 12 Using Sun StorEdge Component Manager or the CLI verify that there are no disk drive errors Refer to the Sun StorEdge Component Manager User s...

Page 192: ...e switches are turned off system primary power does not actually turn off until the controller has performed an orderly shutdown including writing any data cache to disk This process can take up to two minutes Separate power cords are used for the connector on each power and cooling unit to provide redundant cabling The power cords need to be connected to alternate AC power sources for full redund...

Page 193: ...be removed only when a replacement power and cooling unit is available to be inserted Caution Replace only one power and cooling unit at a time to prevent system interruption To replace a power and cooling unit 1 Power off the power and cooling unit by pressing the power switch FIGURE 14 5 Make sure that the AC LED is amber and the PS LED is off 2 Disconnect the power cord from the AC outlet 3 Dis...

Page 194: ...sert the new power and cooling unit 7 Lock the new power and cooling unit by pushing in both latch handles 8 Insert the power cord into the power and cooling unit connector 9 Connect the power cord to the AC outlet Verify that the AC LED on the power and cooling unit is amber indicating that AC power is present 10 Push the power and cooling unit power switch on Verify that both LEDs on the power a...

Page 195: ...s the refresh cycle ensuring that only one battery in an array is refreshed at a time This refresh cycle verifies the health of the battery During the refresh if a problem is detected with the battery future refresh operations are suspended until the problem is fixed If this happens write behind caching is turned off automatically as a safety precaution A refresh cycle does not begin unless both p...

Page 196: ...terface circuitry and two connectors on each card for interconnecting multiple Sun StorEdge T3 arrays The interconnect card also contains the environmental monitor for the array If an interconnect card or cable fails the array continues to function using the remaining interconnect card and cable The interconnect cards in an array are assigned a master and slave status similar to the controller car...

Page 197: ... electricity precautions Caution Replace one interconnect card at a time Follow the procedure as described to ensure that there is no interruption in system operation or loss of data To prevent interruption of system operation during interconnect card replacement make sure that In a workgroup configuration you remove only the failed interconnect card Leave the second interconnect card intact in th...

Page 198: ...es or the array and all attached arrays will automatically shut down and power off 6 Insert the new interconnect card making sure that the card sits on the frame 7 Lock the new interconnect card in place by pushing in on the latch handle 8 Reconnect the interconnect cable to the interconnect card 9 Verify that the LEDs on the interconnect card show that the interconnect card has initialized proper...

Page 199: ...on system activity is interrupted until the controller card is replaced and is back online When a controller card is replaced the array automatically downloads the previous settings to the new controller card The array is fully functional after the new controller card is installed and the controller is online Controller Card LEDs Note The controller card LEDs for a Sun StorEdge T3 array differ fro...

Page 200: ...rray and all attached arrays will automatically shut down and power off FIGURE 14 8 Removing the Controller Card 7 Insert the new controller card 8 Lock the new controller card by pushing in the latch handles 9 Insert the fiber optic cable into the FC AL connector 10 Insert the Ethernet cable into the Ethernet connector 11 Check the controller status LED to determine when the controller is operati...

Page 201: ...ould most likely occur due to an electrical short or a bent or broken pin connector These problems would first appear as a failure of another FRU component such as an interconnect failure or drive failure If replacing the FRU that appears to be failed does not correct the problem then examine the centerplane connector that the FRU connects to for bent or broken pins If nothing is obvious install a...

Page 202: ...180 Sun StorEdge T3 Array Installation and Configuration Manual April 2002 ...

Page 203: ...1 APPENDIX A Specifications Topics in this chapter include Power Specifications on page 182 Environmental Specifications on page 183 Mechanical Specifications on page 184 Cable Specifications on page 185 ...

Page 204: ...d Configuration Manual April 2002 Power Specifications Refer to TABLE A 1 TABLE A 1 Power Specifications Specification Rating Voltage and frequency 100 to 240 VAC 47 to 63 Hz Input current 5A max Input power 450W max Heat load 1540 BTUs hr max ...

Page 205: ... with maximum gradient 10 per hour 5 to 93 noncondensing with maximum gradient 10 per hour Effective altitude from drive specification 1 000 to 10 000 feet 305 to 3 048 meters 1 000 to 40 000 feet 305 to 12 192 meters Shock from drive specification 4 0G for maximum duration of 11 ms half sinewave 10 0G for maximum duration of 11 ms half sinewave Shock can be applied from any axis X Y Z Vibration f...

Page 206: ...r inches in the front and rear for air circulation the airflow direction is from front to rear Refer to TABLE A 3 Note These specifications are for an individual array For specifications on arrays in rack configurations refer to the Sun StorEdge T3 Array Site Preparation Guide TABLE A 3 Physical Specifications Height Width Depth Weight 5 25 inches 17 5 inches 18 5 inches 67 lbs 13 33 cm 44 45 cm 4...

Page 207: ...LC SFF to SC fiber optic cable DB 9 copper LC SFF 82 021 ft 25 m Shielded Ethernet 10 100BASE T category 5 Sun StorEdge T3 array 10BASE T category 3 Sun StorEdge T3 array RJ45 RJ45 328 084 ft 100 m Serial Available only to qualified field service representatives RJ11 Sun StorEdge T3 array RJ45 Sun StorEdge T3 array 82 021 ft 25 m Power 110V Standard n a Power 220V Standard n a Array interconnect c...

Page 208: ...186 Sun StorEdge T3 Array Installation and Configuration Manual April 2002 ...

Page 209: ...ntative Page B 188 Sun StorEdge T3 array controller card F501 5710 Page B 189 Interconnect card F375 0085 Page B 189 Power and cooling unit F300 1454 Page B 189 Interconnect cable 14 in 36 cm 24 in 61 cm F530 2842 F530 2843 Page B 190 Power cord F180 1918 Page B 190 Sun StorEdge T3 array 5m fibre optic cable F537 1033 Page B 190 Sun StorEdge T3 array shielded Ethernet cable category 5 F530 2991 Pa...

Page 210: ...188 Sun StorEdge T3 Array Installation and Configuration Manual April 2002 FIGURE B 1 Disk Drive in Canister ...

Page 211: ...Appendix B Illustrated Parts 189 FIGURE B 2 Sun StorEdge T3 Array Controller Card FIGURE B 3 Interconnect Card FIGURE B 4 Power and Cooling Unit ...

Page 212: ...3 Array Installation and Configuration Manual April 2002 FIGURE B 5 Cables Adapters and Cords Interconnect cable Power cord Fiber optic cable Sun StorEdge T3 array Shielded Ethernet cable category 5 Sun StorEdge T3 array ...

Page 213: ...Appendix B Illustrated Parts 191 FIGURE B 6 Door Assembly Front Panel Front panel ...

Page 214: ...192 Sun StorEdge T3 Array Installation and Configuration Manual April 2002 ...

Page 215: ...he other array controller in a partner group upon failure in the host data path Alternate Pathing requires special software to perform this function auto cache mode The default cache mode for the Sun StorEdge T3 and T3 array In a fully redundant configuration cache is set to write behind mode In a nonredundant configuration cache is set to write through mode Read caching is always performed auto d...

Page 216: ... and T3 arrays D Dynamic Multi Pathing DMP A VERITAS Volume Manager feature that provides an Alternate Pathing mechanism for rerouting data in the event of a controller failover E enterprise configuration One or more partner groups pair of interconnected controller units in a system configuration erasable programmable read only memory EPROM Memory stored on the controller card useful for stable st...

Page 217: ... on an SBus card to convert fiber optic signal to copper gigabyte GB or Gbyte One gigabyte is equal to one billion bytes 1Χ109 graphical user interface GUI A software interface that enables configuration and administration of the Sun StorEdge T3 and T3 array using a graphic application H host bus adapter HBA An adapter that resides on the host hot spare A drive in a RAID 1 or RAID 5 configuration ...

Page 218: ... Sun StorEdge T3 array uses an LC SFF connector for the host FC AL connection light emitting diode LED A device that converts electrical energy into light that is used to display activity logical unit number LUN One or more drives that can be grouped into a unit also called a volume M master controller unit Also called a master unit the main controller unit in a partner group configuration media a...

Page 219: ... a power supply cooling fans and an integrated UPS battery There are two power and cooling units in a Sun StorEdge T3 and T3 array pSOS An operating system built into the Sun StorEdge T3 and T3 array RAID Controller firmware which provides interfaces between the mounted RAID volumes and the database environment Q quiesce To halt all drive activity R read caching Data for future retrieval to reduce...

Page 220: ...stry standard describing a type of connector An LC SFF connector is used for the host FC AL connection to the Sun StorEdge T3 array synchronous dynamic random access memory SDRAM A form of dynamic random access memory DRAM that can run at higher clock speeds than conventional DRAM system area Located on the disk drive label the space that contains configuration data boot firmware and file system i...

Page 221: ...em world wide name WWN A number used to identify array volumes in both the array system and Solaris environment write caching Data used to build up stripes of data eliminating the read modify write overhead Write caching improves performance for applications that are writing to disk ...

Page 222: ...200 Sun StorEdge T3 Array Installation and Configuration Manual April 2002 ...

Page 223: ...s 94 description 2 features 9 FTP connection 100 illustrated parts 187 191 installation 93 LEDs 156 operation 133 overview of 15 telnet connection 101 auto cache mode 116 B battery 173 removing and replacing See power and cooling unit C cabled partner group 70 cabling overview 148 cabling specifications 185 cabling the array 65 cache allocation 118 configuring 116 for improving performance 116 mir...

Page 224: ...Ethernet cable 67 interconnect cables 69 connecting the host system 89 connections Ethernet 6 FC AL 6 serial 6 controller card 5 array controller 6 description 5 illustrated 189 LEDs 160 removing and replacing 177 service 177 controller failover 91 creating soft partitions 90 D data 86 data block size definition 117 data path 148 default configuration 81 changing 88 disabling and reconstructing di...

Page 225: ...eating soft partitions 90 default configuration 88 editing the host files 57 establishing a network connection 72 establishing logical volumes 90 host files 57 hw configuration 70 mounting volumes 81 network connection 72 post instructions 115 power on off 94 preparing 53 54 required patches 59 setting the IP address 57 steps 64 verifying fw 75 verifying the firmware level 76 interconnect cable co...

Page 226: ... 35 37 master unit 57 multipathing software 137 sharing parameter settings 18 using multipathing software 30 performance 10 post installation array cabling 147 array monitoring 132 array settings 127 concept of partner group 136 configuring cache 116 configuring logical volumes 119 global parameters configuration 115 host connection 139 partner group configuration 135 RAID levels 123 power and coo...

Page 227: ... Single Fibre Channel network adapter 143 Sun StorEdge SBus FC 100 HBA 142 Sun StorEdge Traffic Manager configuration recommendations 18 partner group configuration 30 supported software bootability 25 diagnostics and monitoring software 23 host side drives 23 import interface 24 interfaces 23 multi host environments 25 multi platform 25 SAN switch support 23 syslog command 133 system area 12 T te...

Page 228: ...206 Sun StorEdge T3 Array Installation and Configuration Guide April 2002 W workgroup configuration 28 configuration rules 150 write behind cache mode 116 write through cache mode 116 ...

Search results

Summary of Contents for StorEdge T3+

Reviews:

Related manuals for StorEdge T3+

Brands by name

Popular brands

Sun Microsystems StorEdge T3+, Installation And Configuration Manual

Search results

Summary of Contents for StorEdge T3+

Reviews:

Related manuals for StorEdge T3+

Brands by name

Popular brands