manualshive.com logo in svg

HP Surestore Disk Array 12h - And FC60, Advanced User'S Manual, Page: 7 / 466

Share
Download
HP Surestore Disk Array 12h - And FC60 Advanced User'S Manual Download Page 7

      

 7

Con

te

n

ts

1 Product Description

Product Description . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18

Operating System Support . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20
Management Tools  . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20
Features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20
High Availability  . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21
Scalable Storage Capacity  . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21
LED Status Monitoring . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22
EMS Hardware Event Monitoring (HP-UX Only) . . . . . . . . . . . . . . . . . . . . . . . . . 22

Disk Enclosure Components . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23

Operation Features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25
Disk Enclosure SC10 Modules. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 27

Array Controller Enclosure Components  . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34

Front Cover  . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 37
Controller Modules . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 38
Controller Fan Modules . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 40
Power Supply Modules . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 42
Power Supply Fan Module   . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 43
Battery Backup Unit . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 45

 Disk Array High Availability Features  . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 47

RAID Technology  . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 47
Disk Mirroring . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 47
Data Parity . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 48
Data Striping  . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 49
RAID Levels . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 50
RAID Level Comparisons . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 57
Global Hot Spare Disks  . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 61
Primary and Alternate I/O Paths . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 64

Capacity Management Features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 65

LUNs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 65

Summary of Contents for Surestore Disk Array 12h - And FC60

Page 1: ...This manual was downloaded from http www hp com support fc60 HP SureStore E Disk Array FC60 Advanced User s Guide Edition E1200 Printed in U S A hpHH ...

Page 2: ...itten consent of Hewlett Packard The informa tion contained in this document is subject to change without notice Trademark Information Microsoft Windows Windows NT and Windows 2000 are registered trademarks of the Microsoft Corporation Safety Notices To protect against personal injury and product damage do not attempt to lift the product without the assistance of another person or lift device Comp...

Page 3: ...ncepts or operating instructions this font Text to be typed verbatim all commands path names file names and directory names this font Text displayed on the screen Printing History 1st Edition September 1999 2nd Edition October 1999 3rd Edition February 2000 4th Edition July 2000 5th Edition September 2000 6th Edition October 2000 7th Edition December 2000 ...

Page 4: ...ort Mechanism UTM 298 Added information on major event logging available with firmware HP08 307 Added Allocating Space for Disk Array Logs section describing use of environment variable AM60_MAX_LOG_SIZE_MB 308 Added information on Purging Controller Logs 311 Added information for RAID 0 support on HP UX 47 Changed the required minimum number of disk modules per enclosure from 2 to 4 based on powe...

Page 5: ...3 Installation Instruction for moving the disk array Chapter 4 Managing the Disk Array on HP UX Complete instructions for managing your disk array using the available management software Chapter 5 HP UX Diagnostic Tools Information on using STM to gather information about disk array status Chapter 6 Troubleshooting Instructions for isolating and solving common problems that may occur during disk a...

Page 6: ... included in electronic format on the HP Storage Manager 60 CD Download www hp com support fc60 Fibre Channel Mass Storage Adapters Service and User Manual A3636 90002 describes Fibre Channel Mass Storage 9000 It describes installation of the Fibre Channel I O adaptors into K D T and V class systems Download www hp com essd efc A3636A_documentation html Using EMS HA Monitors B5735 90001 contains i...

Page 7: ...n Features 25 Disk Enclosure SC10 Modules 27 Array Controller Enclosure Components 34 Front Cover 37 Controller Modules 38 Controller Fan Modules 40 Power Supply Modules 42 Power Supply Fan Module 43 Battery Backup Unit 45 Disk Array High Availability Features 47 RAID Technology 47 Disk Mirroring 47 Data Parity 48 Data Striping 49 RAID Levels 50 RAID Level Comparisons 57 Global Hot Spare Disks 61 ...

Page 8: ... Configuration 78 Two Disk Enclosure Configurations 80 Three Disk Enclosure Configurations 84 Four Disk Enclosure Configurations 88 Five Disk Enclosure Configurations 92 Six Disk Enclosure Configurations 96 Total Disk Array Capacity 100 For high availability one disk per SCSI channel is used as a global hot spare 101 Topologies for HP UX 102 Basic Topology 103 Single System Distance Topology 110 H...

Page 9: ...0 155 Installing the Disk Enclosures 160 Step 1 Collect Required Tools 160 Step 2 Unpack the Product 160 Step 3 Install Mounting Rails 162 Step 4 Install the Disk Enclosure 162 Step 5 Install Disks and Fillers 166 Moving a Disk Enclosure from One Disk Array to Another 168 Installing the Controller 170 Step 1 Gather Required Tools 170 Step 2 Unpack the Product 170 Step 3 Install Mounting Rails 173 ...

Page 10: ...213 Verifying the Operating System 214 Installing the Disk Array FC60 Software 214 Downgrading the Disk Array Firmware for HP UX 11 11 Hosts 215 Configuring the Disk Array 216 HP UX 216 Windows NT and Windows 2000 220 Using the Disk Array FC60 as a Boot Device HP UX Only 222 Solving Common Installation Problems 223 Adding Disk Enclosures to Increase Capacity 224 General Rules for Adding Disk Enclo...

Page 11: ...ing a RAID Level 247 Global Hot Spares 248 Setting Stripe Segment Size 249 Evaluating Performance Impact 250 Adding Capacity to the Disk Array 254 Adding More Disk Modules 254 Adding Additional Disk Enclosures 256 Replacing Disk Modules with Higher Capacity Modules 256 Upgrading Controller Cache to 512 Mbytes 258 Managing the Disk Array Using SAM 260 Checking Disk Array Status 261 Assigning an Ali...

Page 12: ...sport Mechanism UTM 298 Managing Cache Parameters 299 Performing Disk Array Maintenance 304 Managing Disk Array Logs 307 Upgrading Disk Firmware 313 Managing the Disk Array Using STM 314 Checking Disk Array Status Information 314 Binding a LUN 314 Unbinding a LUN 315 Adding a Global Hot Spare 315 Removing a Global Hot Spare 315 Locating Disk Modules 316 Status Conditions and Sense Code Information...

Page 13: ...ws NT and Windows 2000 Troubleshooting Tools 362 EMS Hardware Event Monitoring HP UX Only 362 Disk Array Installation Troubleshooting Checklist 365 Power Up Troubleshooting 366 Controller Enclosure Troubleshooting 367 Introduction 367 Controller Enclosure LEDs 368 Master Troubleshooting Table 370 SureStore E Disk System SC10 Troubleshooting 376 Disk Enclosure LEDs 376 Losing LUN 0 376 Interpreting...

Page 14: ...ry System Requirements 410 Host Systems 410 Supported Operating Systems 410 Fibre Channel Host Adapters 411 Models and Options 412 A5277A AZ Controller Enclosure Models and Options 412 A5294A AZ Disk Enclosure SC10 Models and Options 414 Disk Array FC60 Upgrade and Add On Products 416 PDU PDRU Products 417 Replaceable Parts 418 A5277A AZ Controller Enclosure Specifications 420 Dimensions 420 Weigh...

Page 15: ...ewlett Packard Software License Terms 431 Regulatory Compliance 434 Safety Certifications 434 EMC Compliance 434 FCC Statements USA Only 435 IEC Statement Worldwide 435 CSA Statement For Canada Only 435 VCCI Statement Japan 436 Harmonics Conformance Japan 436 Class A Warning Statement Taiwan 436 Spécification ATI Classe A France Seulement 437 Product Noise Declaration For Germany Only 437 Geräusch...

Page 16: ...16 ...

Page 17: ...uct Description 17 1 PRODUCT DESCRIPTION Product Description 18 Disk Enclosure Components 23 Array Controller Enclosure Components 34 Disk Array High Availability Features 47 Capacity Management Features 65 ...

Page 18: ... By using Fibre Channel the Disk Array FC60 achieves a high data rate throughput High data throughput is maintained to the disks by using up to six Ultra2 SCSI channels to the disk enclosures one channel for each disk enclosure In addition to increased performance the use of multiple disk enclosures provides scalability simplifying the process of adding storage capacity as needed Up to six disk en...

Page 19: ...Product Description 19 Product Description Figure 1 HP SureStore E Disk Array FC60 Controller with Six Disk Enclosures SureStore E Disk System SC10 Array Controller FC60 ...

Page 20: ...lowing tools are available for managing the disk array on HP UX These tools are included with the disk array Array Manager 60 command line utilities SAM Support Tools Manager STM Windows NT and Windows 2000 The following tools are used to manage the Disk Array FC60 on Windows NT and Windows 2000 This tool is not included with the disk array but must be ordered separately as product A5628A HP Stora...

Page 21: ...me error reporting HP UX only Note The Disk Array FC60 is designed to operate with either one or two controller modules however for data integrity and high availability it is highly recommended that dual controller modules be installed Scalable Storage Capacity The Disk Array FC60 is designed to provide maximum scalability simplifying the process of adding storage capacity as required Storage capa...

Page 22: ... UX 11 0 or 10 20 Hardware monitoring provides a high level of protection against system hardware failure It provides an important tool for implementing a high availability strategy for your system By using EMS Hardware Monitors you can virtually eliminate undetected hardware failures that could interrupt system operation or cause data loss The EMS Hardware Monitor software with the Disk Array FC6...

Page 23: ...hen fully populated with 73 4 Gbyte disks the array provides over 3 Tbytes of storage These values represent maximum storage usable storage space will vary depending on the RAID level used The disk enclosure consists of modular redundant components that are easy to upgrade and maintain See Figure 2 Disks fans power supplies and Bus Control Cards BCCs are replaceable parts that plug into individual...

Page 24: ...24 Disk Enclosure Components Figure 2 Disk Enclosure Components Exploded View Fan Modules BCC Modules Power Supply Modules Front Door Not Shown Chassis and Backplane Disk Modules ...

Page 25: ...LEDs Two system LEDs on the front top right corner of the disk enclosure A in Figure 3 indicate the status of the disk enclosure The left LED indicates when power is on or off and the right LED identifies if a fault has occurred Additional pairs of LEDs above each disk slot D in Figure 3 indicate disk activity and a fault condition The left LED green indicates disk I O activity and the right LED g...

Page 26: ... Figure 3 interrupts power from the power supplies to the disk enclosure components Power to the power supplies is controlled by the power cords and the AC source A system LEDs B power button C disk module D disk module LEDs E door lock F ESD plug G mounting ear H power supply I BCCs J fans K component LEDs ...

Page 27: ...ustrates the 3 5 inch disks in a metal carrier The open carrier design allows ten half height 1 6 inch disks to fit the 19 inch width of a standard rack and meet cooling needs WARNING Touching exposed circuits on the disk module can damage the disk drive inside To avoid damage always handle disks carefully and use ESD precautions The following plastic parts of the disk are safe to touch Bezel hand...

Page 28: ...w profile Rotational speed 10K RPM and 15K RPM 18 Gbyte only Capacity 9 1 Gbyte 18 2 Gbyte 36 4 Gbyte or 73 4 Gbyte A large zero on the capacity label distinguishes a filler from a disk Fillers are required in all unused slots to maintain proper airflow within the enclosure CAUTION Fillers must be installed in unused slots to maintain proper cooling within the disk enclosure A bezel handle B cam l...

Page 29: ...ks in the even numbered slots and BCC B accesses disks in the odd numbered slots Note In full bus mode all ten disks can be accessed through either BCC However internally each BCC still manages five disks This means that if the BCC that is not connected to the SCSI channel fails access to its five disks will be lost Failure of the BCC that is connected to the SCSI channel will render all ten disks...

Page 30: ...tus of the BCC and the bus A rotary switch D used to set the enclosure tray ID which is used by internal controller operations and also by the management tools to identify each enclosure DIP switches set disk enclosure options The only option used by the Disk Array FC60 is the full bus split bus mode Screws F prevent the card from being unintentionally disconnected Cam levers G assist in installin...

Page 31: ...ure 6 an LED B a pull tab C and two locking screws D Figure 6 Fan Internal circuitry senses blower motion and triggers a fault when the speed of either blower falls below a critical level If a fan failure occurs the amber fault LED will go on An alert should also be generated by EMS Hardware Monitoring when a fan failure occurs A internal blowers B LED C pull tab D locking screws ...

Page 32: ...ts the rear DC connector from becoming energized when the power supply is removed from the disk enclosure Figure 7 Power Supply Note Although it is possible to operate the disk enclosure on one power supply it is not recommended Using only one supply creates a single point of failure If the power supply fails the entire enclosure is inaccessible To maintain high availability both power supplies sh...

Page 33: ...pensate for reduced output from the other If one power supply fails the other delivers the entire load Internal circuitry triggers a fault when a power supply fan or other power supply part fails If a power supply failure occurs the amber fault LED will go on An alert should also be generated by EMS Hardware Monitoring when a power supply failure occurs ...

Page 34: ...veral additional internal assemblies See Figure 8 Together these removable modules and internal assemblies make up the field replaceable units FRUs Many modules can be removed and replaced without disrupting disk array operation The following modules are contained in the controller enclosure Controller modules Controller fan module Power supply modules Power supply fan module Battery backup unit ...

Page 35: ...er enclosure Faults detected by the controller module cause the corresponding controller enclosure fault LED to go on Additional LEDs on the individual components identify the failed component See Troubleshooting on page 359 for detailed information on LED operation Controller Fan Power Supply Modules Power Supply Fan Module Controller Module A Controller Module B BBU Front Cover Not Shown Control...

Page 36: ...36 Array Controller Enclosure Components Figure 9 Controller Enclosure Front View ...

Page 37: ... a removable front cover which contains slots for viewing the main operating LEDs The cover also contains grills that aid air circulation The controller modules controller fan and battery backup unit are located behind this cover This cover must be removed to gain access to these modules and also to observe the controller status and BBU LEDs ...

Page 38: ...C60 The controller modules slide into two controller slots A and B and plug directly into the backplane Two handles lock the modules in place Each controller slot has a controller letter that identifies the physical location of the controller in the chassis controller slot A or controller slot B also known as BD1 and BD2 respectively as referenced on the back of the controller enclosure Figure 11 ...

Page 39: ...the heartbeat flashes approximately every two seconds beginning 15 seconds after power on Troubleshooting on page 359 contains additional information on controller LED operation The controller module connects to the host via Fibre Channel and to the disk enclosures via LVD SCSI Each controller must have a unique host fibre ID number assigned using the ID switches on the back of the controller modu...

Page 40: ...ller enclosure is on See Figure 13 Controller Fan Modules The controller fan module is a single removable unit containing dual cooling fans and temperature monitoring logic See Figure 13 It includes five LEDs that indicate overall system status and controller fan status The fans provide cooling by pulling air in through ventilation holes moving it across the controller cards and exhausting it out ...

Page 41: ...Array Controller Enclosure Components 41 Product Description Figure 13 Controller Fan Module ...

Page 42: ...supply modules that slide into two slots in the back of the controller and plug directly into the power interface board See Figure 14 Figure 14 Power Supply Modules Each power supply uses a separate power cord These two power cords are special ferrite bead cords part no 5064 2482 required for FCC compliance Both power cords can plug into a common power source or each cord can plug into a separate ...

Page 43: ...plies are on the system Power Fault LED will be off If either power supply is off or in a fault state the system Power Fault LED goes on When both power supplies are off or not providing power to the enclosure the system power LED on the front of the controller enclosure will be off Power Supply Fan Module Like the controller fan the power supply fan module Figure 15 is a single removable unit tha...

Page 44: ...44 Array Controller Enclosure Components Figure 15 Power Supply Fan Module ...

Page 45: ...closure where it provides backup power to the controller s cache memory during a power outage The BBU will supply power to the controllers for up to five days 120 hrs All data stored in memory will be preserved as long as the BBU supplies power When power to the disk array is restored the cache data will be written to disk Figure 16 Battery Backup Unit CAUTION During a power outage do not remove t...

Page 46: ...experience battery related problems such as a loss of battery power to the controllers or batteries not charging properly the controller enclosure may have some other internal component failure In this case contact your HP service engineer Battery Operation for No Data Loss The BBU protects the write cache data which has not been written to disk for at least 120 hours five days in case of a power ...

Page 47: ...ould not be used in high availability environments Global hot spare disks serve as automatic replacements for failed disks Alternate hardware paths to user data protects against I O path failures Redundant hot swappable hardware components can be replaced without interrupting disk array operation RAID Technology RAID technology contributes to high availability through the use of data redundancy wh...

Page 48: ...nt enclosure Data Parity Data parity is a second technique used to achieve data redundancy If a disk fails or becomes inaccessible the parity data can be combined with data on the remaining disks in the LUN to reconstruct the data on the failed disk Data parity is used for RAID 3 and RAID 5 LUNs To ensure high availability each disk in the LUN should be in a separate enclosure Parity cannot be use...

Page 49: ...m performance under varying sizes of I O transactions Stripe segment size is specified in 512 byte blocks of data Stripe segment size can affect disk array performance The smaller the stripe segment size the more efficient the distribution of data read or written across the stripes in the LUN However if the stripe segment is too small for a single I O operation the operation requires access to two...

Page 50: ...AID 1 RAID 0 1 RAID 3 Windows NT and Windows 2000 only RAID 5 RAID 0 CAUTION RAID 0 does not provide data redundancy It should only be used in situations where high performance is more important than data protection The failure of any disk within a RAID 0 LUN will cause the loss of all data on the LUN RAID 0 should only be used for non critical data that could be lost in the event of a hardware fa...

Page 51: ... the first disk to the second third and fourth then back to the first and so on Figure 18 RAID 0 LUN RAID 1 RAID 1 uses mirroring to achieve data redundancy RAID 1 provides high availability and good performance but at the cost of storage efficiency Because all data is mirrored a RAID 1 LUN has a storage efficiency of 50 A RAID 1 LUN consists of exactly two disks configured as a mirrored pair One ...

Page 52: ...ously the data on the LUN becomes inaccessible Figure 19 shows the distribution of data on a RAID 1 LUN Note that all data on the data disk is replicated on the disk mirror Figure 19 RAID 1 LUN RAID 0 1 RAID 0 1 uses mirroring to achieve data redundancy and disk striping to enhance performance It combines the speed advantage of block striping with the redundancy advantage of mirroring Because all ...

Page 53: ... susceptible to the failure of the second disk of the pair If both disks fail or become inaccessible simultaneously the data on the LUN becomes inaccessible Figure 20 illustrates the distribution of data in a four module RAID 0 1 LUN The disk block addresses in the stripe proceed sequentially from the first pair of mirrored disks disks 1 and 2 to the second pair of mirrored disks disks 3 and 4 the...

Page 54: ...global hot spare is completed the LUN operates in degraded mode The LUN must now use the data and parity on the remaining disks to recreate the content of the failed disk which reduces performance In addition while in degraded mode the LUN is susceptible to the failure of the second disk If a second disk in the LUN fails while in degraded mode parity can no longer be used and all data on the LUN b...

Page 55: ...d parity information on the remaining disks When a failed disk is replaced the disk array automatically rebuilds the contents of the failed disk on the new disk The rebuilt LUN contains an exact replica of the information it would have contained had the disk not failed Until a failed disk is replaced or a rebuild on a global hot spare is completed the LUN operates in degraded mode The LUN must now...

Page 56: ...s which affects the write performance of a RAID 5 LUN For each write the disk array must perform the following steps 1 Read the existing user data from the disks 2 Read the corresponding parity information 3 Write the new user data 4 Calculate and write the new parity information Write caching can significantly improve the write performance of a RAID 5 LUN RAID 5 is good for parallel processing mu...

Page 57: ...indows NT and Windows 2000 only Table 1 RAID Level Comparison Data Redundancy Characteristics RAID Level Disk Striping Mirroring Parity Handle multiple disk failures RAID 0 Yes No No No RAID 0 offers no data redundancy or protection against disk failure RAID 0 should only be used for non critical data The failure of a single disk in a RAID 0 LUN will result in the loss of all data on the LUN RAID ...

Page 58: ...o store parity data As the number of disks in the LUN increases so does the storage efficiency 3 disk LUN 66 4 disk LUN 75 5 disk LUN 80 6 disk LUN 83 Table 3 RAID Level Comparison Relative Performance Compared to an Individual Disk LUN Configuration Relative Read Performance for Large Sequential Access Relative Write Performance for Large Sequential Access RAID 0 The read and write performance of...

Page 59: ...vidual disk RAID 0 1 Simultaneous access to multiple mirrored pairs increases I O performance In general the greater the number of mirrored pairs the greater the increase in performance RAID 3 Provides high read throughput for large sequential I Os Write performance is limited by the need to perform four I O operations per write request Because some I O operations occur simultaneously performance ...

Page 60: ...copied to the RAID 5 group during off peak hours RAID 0 1 RAID 0 1 is a good choice in the following situations Speed of write access is important Write activity is heavy Applications need logging or recordkeeping Daily updates need to be stored to a database residing on a RAID 5 group The database updates on the RAID 1 group can be copied to the RAID 5 group during off peak hours RAID 3 RAID 3 is...

Page 61: ...returned to the global hot spare disk group and is again available as protection against another disk failure If a failed disk is replaced while data is being rebuilt on the global hot spare the rebuild process continues until complete When all data is rebuilt on the global hot spare it is then copied to the replacement disk Global hot spares are an essential component for maintaining data availab...

Page 62: ... When the rebuild finishes the global hot spare is part of the LUN which fulfills the roll of disk 3 4 When disk 3 is replaced the disk array begins copying all the information from the former global hot spare to the replacement disk 5 When copying completes the LUN is restored to its original configuration The former global hot spare is returned to the global hot spare disk group and is available...

Page 63: ...cess on a RAID 5 LUN or Volume Group The information on the hot spare is copied to the replaced disk and the hot spare is again available to protect against another disk failure Data and parity from the remaining disks are used to rebuild the contents of disk 3 on the hot spare disk ...

Page 64: ...n I O is performed to the LUN using the alternate path the disk array switches ownership of the LUN to the controller on the alternate path Once the problem with the primary path is corrected ownership of the LUN should be switched back to the original I O path to maintain proper load balancing The primary path established using LVM defines the owning controller for the LUN This may override the c...

Page 65: ...y of the disk array can be divided into entities called LUNs Individual disks are grouped together to form a LUN Functionally each LUN appears to the host operating system as an individual disk drive Although the LUN appears to the host as an individual disk the use of multiple disks offers advantages of increased data availability and performance Data availability is enhanced by using redundant d...

Page 66: ...om cache RAM thus avoiding the much slower process of accessing a disk for the data A pre fetch capability enables the disk array to anticipate needed data for example on a file transfer and read it from disk into the read cache which helps significantly with sequential read I Os Write I O During a write I O the disk array writes the requested data into write cache Rather than writing the modified...

Page 67: ...his problem never remove both controllers from the disk array simultaneously In the event of an unexpected disk array shutdown or loss of power the BBU provides power to cache memory to maintain the cache for 120 hours 5 days Dynamic Capacity Expansion If slots are available in the disk enclosures you can increase the capacity of the disk array without disrupting operation By simply adding new dis...

Page 68: ...68 Capacity Management Features ...

Page 69: ...y and Array Planning 69 2 TOPOLOGY AND ARRAY PLANNING Overview 70 Array Design Considerations 71 Recommended Disk Array Configurations 77 Topologies for HP UX 102 Topologies for Windows NT and Windows 2000 131 ...

Page 70: ... discusses configuration features of the Disk Array FC60 as it relates to these requirements In addition it provides information on system topologies following the array configuration Note Planning the disk array configuration is typically done before the disk array hardware is received This information is then used during installation of the disk array to create the desired system configuration A...

Page 71: ...ther For example optimizing for maximum performance may increase the cost per megabyte of storeage Array Hardware Configuration Array configuration options that affect high availability performance and storage capacity include Fibre Channel connections disk enclosure bus configuration and internal Ultra2 SCSI channels This information is presented first because it is the basis for some of the arra...

Page 72: ...nd a separate SCSI channel connects to each of the BCCs See Installation on page 143 for more information When using split bus mode the maximum number of disk enclosures is limited to three each disk enclosure uses two channel connections If the storage capacity needs to be increased by adding more disk enclosures the array will need to be reconfigured Reconfiguring the array requires shutting dow...

Page 73: ...dules however for high availability it is highly recommended that two controller modules be installed Performance The maximum aggregate performance that can be sustained by the disk array is approximately 170 megabytes per second using dual Fibre Channel AL connections This performance can be achieved by configuring at least four disk modules per Ultra2 SCSI bus utilizing the six Ultra2 SCSI chann...

Page 74: ...dwidth available to the server Performance can also be measured by the number of I O operations per second a system can perform I Os per second are important in OLTP on line transaction processing applications To maximize I Os per second configure the maximum number of disk modules For the same capacity you may elect to use a larger number of 9 1 Gbyte disk modules instead of a smaller number of h...

Page 75: ...creased by replacing existing smaller capacity disk modules with larger capacity disk modules by adding more disk modules to the disk enclosures or by adding additional disk enclosures The best method for expansion is to install all six disk enclosures at initial installation full bus configuration Then install only the required capacity number of disk modules leaving empty disk slots for future e...

Page 76: ...configured for full bus mode and the additional number of enclosures installed into the rack and required number of full bus enclosures This expansion requires disk enclosures be recabled using full bus enclosures As in all cases of adding disk enclosures to the array the system has to be shut down for the expansion Determine the RAID level and how the LUNs will be created for the expansion If the...

Page 77: ...ability are the single disk enclosure configuration and the two enclosure high capacity configuration These configurations cannot survive the failure of an entire disk enclosure so they should not be used in environments where high availability is critical The configurations list maximum disk capacity and usable disk capacity with ten disk modules installed Configurations based on RAID 1 have less...

Page 78: ...consider selecting a configuration that uses more enclosures operating in full bus mode In addition to simplifying expansion this type of configuration also gives you greater flexibility when creating LUNs Segment size the recommended segment size is 16 Kbyte for RAID 5 and 64 Kbyte for RAID 1 and RAID 0 1 Maximum LUNs A maximum of 30 LUNs can be configured on the disk array One Disk Enclosure Con...

Page 79: ...e disk failure single BCC failure a single channel failure or a single controller failure Expansion requires powering down the disk array removing terminators and or cables from the enclosures and cabling additional disk enclosures Disk Capacity Maximum capacity 730 GBytes Usable capacity 365 GBytes Figure 24 One Disk Enclosure Array Configuration ...

Page 80: ...nfigured for split bus mode two SCSI channels per enclosure LUN Configuration Ten RAID 1 LUNs each comprising two disks 1 1 Each disk in a LUN is in a separate enclosure High Availability Handles a single disk failure BCC failure single channel failure or a single controller failure Expansion requires powering down the disk array removing terminators and or cables from the enclosures and cabling a...

Page 81: ...Recommended Disk Array Configurations 81 Topology and Array Planning Figure 25 Two Disk Enclosure High Availability High Performance Configuration ...

Page 82: ... disks total Disk enclosures configured for split bus mode two SCSI channels per enclosure LUN Configuration Five RAID 5 LUNs each comprising four disks 3 data 1 parity Each disk in a LUN is on a separate SCSI bus High Availability Handles the failure of a single disk single controller or a single channel Does not handle a disk enclosure failure consequently this configuration is NOT recommended f...

Page 83: ...Recommended Disk Array Configurations 83 Topology and Array Planning Figure 26 Two Disk Enclosure Maximum Capacity Configuration ...

Page 84: ...red for split bus mode two SCSI channels per enclosure LUN Configuration 15 RAID 1 LUNs each comprising two disks 1 1 Each disk in a LUN is in a separate enclosure High Availability Handles a single disk failure a single controller a single channel single BCC or a single disk enclosure failure Expansion requires powering down the disk array recabling the array to a full bus configuration rebinding...

Page 85: ...Recommended Disk Array Configurations 85 Topology and Array Planning Figure 27 Three Disk Enclosure High Availability High Performance Configuration ...

Page 86: ...hannels per enclosure LUN Configuration Ten RAID 5 LUNs each comprising three disks 2 data 1 parity Each disk in a LUN is in a separate enclosure High Availability Handles a single disk failure single controller single channel single BCC or a single disk enclosure failure Expansion requires powering down the disk array recabling the array to a full bus configuration rebinding the LUNs and restorin...

Page 87: ...Recommended Disk Array Configurations 87 Topology and Array Planning Figure 28 Three Disk Enclosure Maximum Capacity Configuration ...

Page 88: ...closures configured for full bus mode one SCSI channel per enclosure LUN Configuration Ten RAID 0 1 LUNs each comprising four disks 2 2 Each disk in a LUN is in a separate enclosure High Availability Handles a single disk failure single disk enclosure BCC failure single channel failure or a single controller failure Expansion requires powering down the disk array and adding additional disk enclosu...

Page 89: ...Recommended Disk Array Configurations 89 Topology and Array Planning Figure 29 Four Disk Enclosure High Availability High Performance Configuration ...

Page 90: ... bus mode one SCSI channel per enclosure LUN Configuration Ten RAID 5 LUNs each comprising four disks 3 data 1 parity Each disk in a LUN is in a separate enclosure High Availability Handles a single disk failure single controller single channel single BCC or a single disk enclosure failure Expansion requires powering down the disk array and adding additional disk enclosures and cabling Disk Capaci...

Page 91: ...Recommended Disk Array Configurations 91 Topology and Array Planning Figure 30 Four Disk Enclosure Maximum Capacity Configuration ...

Page 92: ...gured for full bus mode one SCSI channel per enclosure LUN Configuration Ten RAID 0 1 LUNs each comprising four disks 2 2 Five RAID 1 LUNs each comprising two disks 1 1 Each disk in a LUN is in a separate enclosure High Availability Handles a single disk failure BCC failure single channel failure or a single controller failure Expansion requires powering down the disk array and adding an additiona...

Page 93: ...Recommended Disk Array Configurations 93 Topology and Array Planning Figure 31 Five Disk Enclosure High Availability High Performance Configuration ...

Page 94: ...mode one SCSI channel per enclosure LUN Configuration Ten RAID 5 LUNs each comprising five disks 4 data 1 parity Each disk in a LUN is in a separate enclosure High Availability Handles a single disk failure single disk enclosure BCC failure single channel failure or a single controller failure Expansion requires powering down the disk array and adding an additional disk enclosure and cabling Disk ...

Page 95: ...Recommended Disk Array Configurations 95 Topology and Array Planning Figure 32 Five Disk Enclosure Maximum Capacity Configuration ...

Page 96: ...res with ten 73 GByte disks each 60 disks total Disk enclosures configured for full bus mode one SCSI channel per enclosure LUN Configuration Ten RAID 0 1 LUNs each comprising six disks 3 3 Each disk in a LUN is in a separate enclosure High Availability Handles a single disk failure single BCC failure single channel failure or a single controller failure Disk Capacity Maximum capacity 4380 GBytes ...

Page 97: ...Recommended Disk Array Configurations 97 Topology and Array Planning Figure 33 Six Disk Enclosure High Availability High Performance Configuration ...

Page 98: ...sks total Disk enclosures configured for full bus mode one SCSI channel per enclosure LUN Configuration Ten RAID 5 LUNs each comprising six disks 5 data 1 parity Each disk in a LUN is in a separate enclosure High Availability Handles a single disk failure single disk enclosure BCC failure single channel failure or a single controller failure Disk Capacity Maximum capacity 4380 GBytes Usable capaci...

Page 99: ...Recommended Disk Array Configurations 99 Topology and Array Planning Figure 34 Six Disk Enclosure High Maximum Capacity Configuration ...

Page 100: ...optimize performance or capacity Table 6 lists the total capacities available when using fully loaded disk enclosures configured for optimum performance Table 7 lists the same for optimum capacity configurations The capacities listed reflect the maximum capacity of the LUN The actual storage capacity available to the operating system will be slightly less as some capacity is consumed when binding ...

Page 101: ... 6 GB 291 2 GB 584 GB 3 split bus 1 12 2 109 1 GB 218 4 GB 436 8 GB 876 GB 4 full bus 0 1 9 4 2 2 163 8 GB 327 6 GB 655 2 GB 1314 GB 6 full bus 0 1 9 6 3 3 245 7 GB 491 4 GB 982 8 GB 1971 GB Table 7 Capacities for Optimized Capacity Configurations Number of disk enclosures RAID Level No of LUNs Disks per LUN Total Capacity with indicated disks 9 1 GB 18 2 GB 36 2 GB 73 GB 3 split bus 5 8 3 2D 1P 1...

Page 102: ...AL hub or the controller modules in a disk array Two controller modules and two power supply modules are required for high availability topologies Because it is impossible to document all the possible physical layouts the hardware topologies supported by the Disk Array FC60 are grouped into five general categories Basic topology Single system distance topology High availability topology High avail...

Page 103: ...igh availability or One to four single controller module disk arrays for non high availability Maximum 500 m fibre optic cable distance between each host to disk array connection Each implementation of the basic topology uses one Fibre Channel I O adapter Each adapter connects to one controller module over an independent two node Fibre Channel AL For example if one disk array with two controller m...

Page 104: ...n a different host Disk arrays having redundant controller modules protect against single points of hardware failure by providing an alternate hardware path to the host if an controller module Fibre Channel cable host Fibre Channel I O adapter or internal Ultra2 SCSI bus fails Applications can continue to run after the failure of a single disk module This is explained in the Disk Array High Availa...

Page 105: ... of the basic topology implemented on a either a K Class or T Class host with four Fibre Channel I O adapters Two of the Fibre Channel adapters are connected to one dual controller module disk array while the other two Fibre Channel adapters are connected to a second dual controller module disk array Each connection of host adapter and controller module creates a separate Fibre Channel AL ...

Page 106: ...Fibre Channel cable host Fibre Channel I O adapter or internal Ultra2 SCSI bus failure If any of these components fail the disk array becomes unavailable and applications cannot continue to run The disk array remains unavailable until the failed hardware component is replaced Applications can continue to run after the failure of single disk modules within logical disk units LUNs Figure 37 shows th...

Page 107: ...Array Planning controller modules in four disk arrays Each connection between adapter and controller module creates a separate Fibre Channel AL Figure 37 Basic Topology Non High Availability Version Host with Four Fibre Channel I O Adapters ...

Page 108: ...f so LVM switches automatically and transparently to the alternate path The system administrator or service provider hot swaps the controller module Fan module Yes Applications continue to run The system administrator or service provider hot swaps the fan module Power supply modules Yes Applications continue to run when one power supply module fails The system administrator or service provider hot...

Page 109: ... host has two Fibre Channel adapters connected to a dual controller module disk array the array can be accessed through the operational path if primary and alternate paths have been configured in LVM If so LVM switches automatically and transparently to the alternate path The authorized service provider hot swaps the failed cable Table 8 Basic Topology Error Recovery cont d Failing component Conti...

Page 110: ...nnel I O adapters in the single host attach to two ports in the HP Fibre Channel AL Hub providing redundant hardware paths between the host and the HP Fibre Channel AL Hub The controller modules of dual or single controller module disk arrays attach to some or all of the remaining eight HP Fibre Channel AL Hub ports This topology creates a single Fibre Channel AL that resembles a star topology wit...

Page 111: ...y and transparently to the alternate path Likewise if one host adapter fails or if one Fibre Channel cable from the host to the HP Fibre Channel AL Hub or from the HP Fibre Channel AL Hub to one of the dual controller module disk array fails that disk array can still be accessed via the alternate hardware path The HP Fibre Channel AL Hub is a single point of failure in this topology If the HP Fibr...

Page 112: ... the single system distance topology with one host with two Fibre Channel I O adapters and three dual controller module disk arrays In this example two of the HP Fibre Channel AL Hub s ten ports are unused Figure 38 Single System Distance Topology ...

Page 113: ...le Ownership of the failed controller module s LUNs can transfer automatically to the remaining operational controller module if primary and alternate paths have been configured in LVM If so LVM switches automatically and transparently to the alternate path The system administrator or service provider hot swaps the failed controller module Fan module Yes Applications continue to run The system adm...

Page 114: ...der replaces the failed adapter and the system administrator restarts the operating system and applications Fibre Channel cable No on path to failed cable Yes if array has dual controller modules and alternate paths have been configured I O operations fail along the path through the failed cable If the host has two Fibre Channel adapters connected to a dual controller module disk array the array c...

Page 115: ...able distance on each connection between each host and HP Fibre Channel AL Hub and between each HP Fibre Channel AL Hub and disk array for a total Fibre Channel AL cable length not to exceed 5000 m As its name implies the high availability topology supports only dual controller module disk arrays Figure 39 The objective of this topology is to use redundant hardware components to provide high avail...

Page 116: ...gh the other Fibre Channel AL Supported cable lengths for each segment of the Fibre Channel AL include 2 m 16 m 50 m 100 m and 500 m The maximum combined cable lengths for all segments that is the total length of the Fibre Channel AL should not exceed 5000 m because performance can degrade due to propagation delay Because of this it is recommended that the total cable length of the Fibre Channel A...

Page 117: ...Topologies for HP UX 117 Topology and Array Planning Figure 39 High Availability Topology ...

Page 118: ...le fails The system administrator or service provider hot swaps the failed power supply module HP Fibre Channel AL Hub No on path to failed hub Yes on alternate path to other hub I O operations fail along the path to the failed HP Fibre Channel AL Hub I O operations can transfer automatically to the other HP Fibre Channel AL Hub if primary and alternate paths have been configured in LVM If so LVM ...

Page 119: ...has two Fibre Channel adapters connected to a dual controller module disk array the array can be accessed through the operational path if primary and alternate paths have been configured in LVM If so LVM switches automatically and transparently to the alternate path The authorized service provider hot swaps the failed cable Table 10 High Availability Topology Error Recovery cont d Failing componen...

Page 120: ...isk arrays Maximum 500 m fibre optic cable distance on each connection between each host and HP Fibre Channel AL Hub and between each HP Fibre Channel AL Hub and disk array for a total Fibre Channel AL cable length not to exceed 5000 m Like the high availability topology this topology supports high availability by using redundant Fibre Channel ALs If a hardware component Fibre Channel adapter HP F...

Page 121: ...otal cable length of the Fibre Channel AL be as short as possible Fibre optic cables in lengths of 2 m 16 m 50 m and 100 m cables can be ordered from Hewlett Packard see the Reference chapter for part numbers Fibre optic cables longer than 100 m must be custom fabricated for each implementation In this configuration a maximum of nine controller modules can be attached to an HP Fibre Channel AL Hub...

Page 122: ...122 Topologies for HP UX Figure 40 High Availability Distance and Capacity Topology ...

Page 123: ...e fails The system administrator or service provider hot swaps the failed power supply module HP Fibre Channel AL Hub No on path to failed hub Yes on alternate path to other pair of hubs I O operations fail along the path to the failed HP Fibre Channel AL Hub I O operations can transfer automatically to the other pair of cascaded HP Fibre Channel AL Hubs if primary and alternate paths have been co...

Page 124: ...pters connected to a dual controller module disk array the array can be accessed through the operational path if primary and alternate paths have been configured in LVM If so LVM switches automatically and transparently to the alternate path The authorized service provider hot swaps the failed cable Table 11 High Availability Distance and Capacity Topology Error Recovery cont d Failing component C...

Page 125: ...e distance on each connection between each host and HP Fibre Channel AL Hub and between each HP Fibre Channel AL Hub and disk array for a total Fibre Channel AL cable length not to exceed 5000 m This topology is almost identical to the high availability distance and capacity topology The difference is that in the campus topology one half of the host systems HP Fibre Channel AL Hubs and disk arrays...

Page 126: ...126 Topologies for HP UX Figure 41 Campus Topology ...

Page 127: ...em administrator or service provider hot swaps the failed power supply module HP Fibre Channel AL Hub No on path to failed hub Yes on alternate path to other pair of hubs I O operations fail along the path to the failed HP Fibre Channel AL Hub I O operations can transfer automatically to the other pair of cascaded HP Fibre Channel AL Hubs if primary and alternate paths have been configured in LVM ...

Page 128: ...le If the host has two Fibre Channel adapters connected to a dual controller module disk array the array can be accessed through the operational path if primary and alternate paths have been configured in LVM If so LVM switches automatically and transparently to the alternate path The authorized service provider hot swaps the failed cable Failing component Continue after failure What happens and h...

Page 129: ...s connected to it The disk array FC60 can be connected to switches Connecting the array using switches provides for increased performance Two switch topologies are provided in Figure 42 and Figure 43 Note Hubs and switches should not be mixed in these array topologies All devices must be directly connected to a switch Switches require firmware version V 6C2 to support the disk array FC60 Figure 42...

Page 130: ...130 Topologies for HP UX Figure 43 Four Hosts Connected to Cascaded Switches ...

Page 131: ...ows 2000 are illustrated in this section Included are the error handling capabilities of the topologies Note Unsupported Single Hub Topologies on Windows Due to limitations in the RDAC driver included with the HP Storage Manager 60 SM60 software some topologies that use a single hub are not supported The RDAC driver supports only two data paths to the FC60 Disk Array so any topology that provides ...

Page 132: ...ted Single Hub Topology Unsupported Windows Topology Because this topology provides four paths from the host to each disk array it is not supported Any topology that provides more than two paths from a host to the disk array is not supported Path 2 Path 1 Path 3 Path 4 ...

Page 133: ...single point of failure in these configurations are The hub or switch The FC host adapter if there is only a single connection from the host to the hub In a cluster configuration a single host adapter does not represent a single point of failure because data will still be available through the other cluster host The FC cable if there is only a single connection between the host and the hub In a cl...

Page 134: ...134 Topologies for Windows NT and Windows 2000 Figure 45 Four Host Single Hub Single Disk Array Non HA Topology ...

Page 135: ...Topologies for Windows NT and Windows 2000 135 Topology and Array Planning Figure 46 Four Host Cascaded Hubs Dual Disk Array Non HA Topology ...

Page 136: ...136 Topologies for Windows NT and Windows 2000 Figure 47 Four Host Single Switch Dual Disk Array Non HA Topology ...

Page 137: ...eristics The direct connect topology Figure 48 achieves high availability by providing redundant data paths between the host and the disk array but this configuration also provides limited distance and connectivity The use of multiple hubs creates redundant data paths between all hosts and all disk arrays Multiple hubs also provides greater connectivity increasing the number of disk arrays and hos...

Page 138: ...138 Topologies for Windows NT and Windows 2000 Figure 48 Direct Connect Single Host Single Disk Array HA Topology ...

Page 139: ...Topologies for Windows NT and Windows 2000 139 Topology and Array Planning Figure 49 Dual Host Dual Hub Four Disk Array HA Topology ...

Page 140: ...140 Topologies for Windows NT and Windows 2000 Figure 50 Four Host Dual Hub Dual Disk Array HA Topology ...

Page 141: ...Topologies for Windows NT and Windows 2000 141 Topology and Array Planning Figure 51 Four Host Dual Cascaded Hubs Four Disk Array HA Topology ...

Page 142: ...142 Topologies for Windows NT and Windows 2000 ...

Page 143: ...176 Attaching Power Cords 183 Attaching SCSI Cables and Configuring the Disk Enclosure Switches 187 Connecting the Fibre Channel Cables 196 Applying Power to the Disk Array 198 Verifying Disk Array Connection 206 Installing the Disk Array FC60 Software HP UX Only 213 Configuring the Disk Array 216 Using the Disk Array FC60 as a Boot Device HP UX Only 222 Solving Common Installation Problems 223 Ad...

Page 144: ...e Chapter 2 Topology and Array Planning for information on these topics The Disk Array FC60 is designed to be installed in the following HP cabinets Legacy also referred to as original HP cabinets 1 1m 1 6m and 2m System E Rack which includes A490xA J150xA 1 1m 1 6m and 2m Installation consists of the following procedures Preparing the site Installing PDUs Installing disk enclosures Installing the...

Page 145: ... supported on HP UX 11 11 with array firmware release HP03 only Later versions of disk array firmware are not currently supported when running HP UX 11 11 Software requirements The Disk Array FC60 management software must be installed on the host This software is distributed on HP UX Support Plus CD ROM release 9909 or later Table 13 Supported Host Platform Information Supported Host Boot Support ...

Page 146: ...ervice and User Manual part number A3636 90002 A copy of the manual may be viewed or printed by accessing the following web site www hp com essd efc A3636A_documentation html Windows NT and Windows 2000 For information on Windows NT and Windows 2000 host system requirements see the HP Storage Manager 60 User s Guide included with the HP Storage Manager 60 software A5628A C class No A5158A on HP UX...

Page 147: ...qual to the sum of the VA units required to power the Disk Array FC60 and any other peripherals installed in the cabinet For more information about racking configurations see Cabinets and Uninterruptible Power Supplies in the current HP 9000 Servers Configuration Guide The Disk Array FC60 is scalable and may contain from one to six disk enclosures The power requirement varies according to the numb...

Page 148: ...r w 5 Disk Enclosures 34 8A 17 2A 104A 12 Controller w 4 Disk Enclosures 28 3A 14 0A 84A 10 Controller w 3 Disk Enclosures 21 8A 10 8A 64A 8 Controller w 2 Disk Enclosures 15 3A 7 6 44A 6 Controller w 1 Disk Enclosure 8 8 4 4A 24A 4 Table 15 Controller Enclosure Electrical Requirements Measurement Value 110v Value 220v Voltage Range Frequency 100 127V 50 60 Hz 220 240V 50 60 Hz Current Typical Max...

Page 149: ...breaker rating must be adequate for the total current drawn by all devices on all electrical paths that share a circuit breaker Table 16 Disk Enclosure Electrical Requirements Measurement Value Voltage Range Frequency 220 240V 100 127V 50 60Hz Current Typical Maximum Operating 100 120 V 200 240 V Maximum In rush 2 9 3 2A 2 6 3 2A 5 3 6 7A 20A Table 17 Recommended European Circuit Breakers Number o...

Page 150: ...y affect the number of electrical devices that can be installed in a rack For example to install more than four disk enclosures in an HP legacy rack you must upgrade from the older 3 foot and 5 foot PDUs to 19 inch PDUs In addition to rack density consider the following in choosing PDUs Redundant power source To connect redundant power supplies to separate PDUs install redundant PDUs Number of cor...

Page 151: ...Rack height does not allow additional enclosures Table 18 Recommended PDU PDRUs for HP Legacy Racks Number of Components 1 1 meter 21 U Rack 1 6 meter 32 U Rack 2 0 meter 41 U Rack 1 4 Two 3 foot 16 amp PDUs or Two 19 inch 16 amp PDUs Two 5 foot 16 amp PDUs or Two 19 inch 16 amp PDUs 5 8 NA Two 19 inch 30 amp PDRUs 9 10 NA NA Four 19 inch 30 amp PDRUs Table 19 Recommended PDU PDRUs for HP System E...

Page 152: ...must be installed directly behind the disk enclosure to achieve the highest densities in 2 meter racks Hinged brackets allow HP s 30 amp PDRUs HP E7681A and E7682A to swing aside for servicing the disk enclosures see Figure 53 Refer to the documentation supplied with the PDU PDRU for installation instructions Recommended UPS Models The following Hewlett Packard Power Trust models are recommended f...

Page 153: ...Power Distribution Units PDU PDRU 153 Installation Figure 52 PDU Placement in 1 6 Meter Rack PDU 16 Amp or PDRU 30 Amp PDU 16 Amp or PDRU 30 Amp ...

Page 154: ...154 Power Distribution Units PDU PDRU Figure 53 PDRU Placement in 2 0 Meter Rack PDU 16 Amp or PDRU 30 Amp PDU 16 Amp or PDRU 30 Amp ...

Page 155: ...k Array FC60 consists of installing the controller enclosure and up to six disk enclosures Before performing this installation you should have determined the configuration for the array as described in chapter 2 Array Planning and Topology You should also review this section prior to performing the installation The Disk Array FC60 is supported in the System E racks and in the HP legacy original ca...

Page 156: ...es Figure 54 shows EIA rack locations for installation of six disk enclosures and one controller enclosure FC60 in a System E rack Special rails for the System E racks allow installation of enclosures at either full EIA or mid EIA 1 2 EIA position This allows the Component Measure EIA Units Legacy Cabinets 1 EIA Unit 1 75 1 1 Meter Cabinet 21 EIA Units Total Available 1 6 Meter Cabinet 32 EIA Unit...

Page 157: ...eight Figure 55 shows rack locations for installation of six disk enclosures and one controller enclosure positioned on top for legacy racks When disk enclosures are installed in legacy racks an unusable 1 2 EIA space is left at the bottom of the enclosures This space must be filled with a 1 2 EIA unit filler for each enclosure installed ...

Page 158: ...158 Installing the Disk Array FC60 Figure 54 Enclosure EIA Positions for System E Racks ...

Page 159: ...Installing the Disk Array FC60 159 Installation Figure 55 Enclosure EIA Positions for Legacy Cabinets ...

Page 160: ...follow this section Step 1 Collect Required Tools Torx T25 screwdriver Torx T15 screwdriver Small flat blade screwdriver Step 2 Unpack the Product 1 Lift off the overcarton and verify the contents of the box see Table 22 and Figure 56 Table 22 Disk Enclosure SC10 Accessories Figure Label Part part number A Disk Enclosure with power supplies fans and BCC modules B Rail kit A5251A for System E cabin...

Page 161: ...Installing the Disk Enclosures 161 Installation Figure 56 Disk Enclosure Contents ...

Page 162: ...the disk enclosure for lifting a With the chassis still in the box loosen the screw in the handle of each power supply b Pull the cam handle down to disengage the power supply from the backplane and pull each power supply out of the chassis Support the far end of the supply with your free hand as it clears the chassis c Set the power supplies aside to be reinstalled later WARNING Do not attempt to...

Page 163: ...Installing the Disk Enclosures 163 Installation Figure 57 Mounting the Disk Enclosure Rack System E shown A Front Mounting Ears C Rail B Chassis D Rail clamp ...

Page 164: ... a thin flat blade screwdriver to turn the lock Figure 58 Figure 58 Door Lock 4 Ensure that one hole in each mounting ear A in Figure 57 aligns with the sheet metal nuts previously installed on the rack front columns 5 Insert two screws A in Figure 57 through the matching holes in the disk enclosure mounting ears and rack front columns Tighten screws 6 Close the door ...

Page 165: ...stalling the disk enclosure in an HP Rack System E set the clamp D in Figure 57 c Push the clamp tight against the back of the disk enclosure The raised tab of the clamp should overlap the bottom edge of the disk enclosure chassis d Insert and tighten two M5 16mm screws through each clamp and rail Figure 59 Legacy Rack Rail Clamp Installation Disk Enclosure 8 Reinstall power supplies removed in St...

Page 166: ...ts Disks are fragile and ESD sensitive Dropping one end of the disk two inches is enough to cause permanent damage Static electricity can destroy the magnetic properties of recording surfaces Grip disks only by their handles B in Figure 60 and carriers and follow strict ESD procedures Figure 60 Disk Installation A disk enclosure door E disk carrier B disk handle F insertion guide C cam latch G slo...

Page 167: ... CAUTION Do not touch exposed circuit board side of the disk module 4 Remove the disk from the ESD bag grasping the disk by its handle B 5 Using a pencil mark an X on the Slot Location Map label A in Figure 61 located on the top of the disk module This mark identifies the disk slot the disk module should be installed in case it is removed It is important to return a disk to its same location to ma...

Page 168: ...slot must contain either a disk or filler Moving a Disk Enclosure from One Disk Array to Another If you have more than one HP SureStore E Disk Array FC60 it is possible to move a disk enclosure from one array to another to balance capacity The steps involved in moving a disk enclosure are the same for installing a new enclosure The following steps describe moving disk enclosures from one disk arra...

Page 169: ...e the enclosures reverse the steps listed in Installing the Disk Enclosures on page 160 6 Install the disk enclosures in the new rack following the instructions in Installing the Disk Enclosures on page 160 Make sure the disk enclosure is configured properly for the new disk array 7 Bind a LUN with the new disks using the management tool of your choice To use SAM see Binding a LUN on page 267 To u...

Page 170: ...all the Disk Array FC60 controller enclosure into an HP legacy rack or an HP System E Rack Step 1 Gather Required Tools Torx T25 screwdriver Torx T15 screwdriver Small flat blade screwdriver Step 2 Unpack the Product 1 Lift off the overcarton and verify the contents see Table 23 and Figure 62 ...

Page 171: ...1 disk enclosure 4 ea 4 disk enclosures 4 ea 2 disk enclosures 5 ea 5 disk enclosures 6 ea 3 disk enclosures 6 ea 6 disk enclosures F LVD SCSI Terminators of terminators disk enclosures ordered 4 ea 1 disk enclosure 2 ea 4 disk enclosures 2 ea 2 disk enclosures 1 ea 5 disk enclosures 0 ea 3 disk enclosures 0 ea 6 disk enclosures G Fibre Channel cables 2 ea if ordered 2M 1005 0585 16M 1005 0586 H M...

Page 172: ...172 Installing the Controller Figure 62 Controller Enclosure Package Contents ...

Page 173: ...m the Fibre Channel Host ID switch settings and connect the SCSI terminators 1 Remove the front cover by pulling out on the bottom and sliding it downward slightly then pulling it away from the enclosure WARNING Do not attempt to lift the controller enclosure without the help of another person or a lift device It weighs 75 pounds 2 With another person or using a lift lift the enclosure and slide i...

Page 174: ...174 Installing the Controller Figure 63 Mounting the Controller Enclosure ...

Page 175: ...the rail b Insert a screw through the hole in the clamp and the rail and tighten with a Torx T25 screwdriver In HP Rack System E racks a Set the clamp E in Figure 63 inside the rail with the holes in the clamp along the slots in the rail b Push the clamp tight against the back of the disk enclosure The curved tip of the clamp should overlap the bottom edge of the power supply slot c Insert and tig...

Page 176: ...k enclosure Disk Enclosure Tray ID Switch The disk enclosure ID switch sets the Enclosure ID or Tray ID This value is used by FC60 diagnostic software and the controller to identify the disk enclosure for status monitoring operations Each enclosure in the array must be set to a different Enclosure ID To set the ID set the rotary ID switches on the back of both BCC modules to the same number See Fi...

Page 177: ...d and in reverse order from the other Figure 64 Disk Enclosure Configuration Switches Tray ID Tray ID Tray ID Tray ID Tray ID Tray ID Tray ID Tray ID Configuration DIP switch Configuration DIP switch Configuration DIP switch Configuration DIP switch Configuration DIP switch Configuration DIP switch Configuration DIP switch Configuration DIP switch ...

Page 178: ... ten disks inaccessible When switch 1 is set to 0 split bus mode the disk enclosure is split into two separate buses with five disks to each bus In split bus mode each bus is controlled by a separate BCC BCC A the top BCC controls the even drive slots 0 2 4 6 8 and BCC B the bottom BCC controls the odd bus slots 1 3 5 7 9 In split bus mode two SCSI channels are connected to the disk enclosure one ...

Page 179: ...sks for a RAID 0 1 LUN on page 243 for additional disk module addressing information Fibre Channel Host ID Address Setting The controller enclosure has two Fibre Channel connections one for each controller module Each controller module communicates with the host through its Fibre Channel loop connection Internally the two controllers are connected to a common Fibre Channel loop Because they are co...

Page 180: ... address set the switches in the up position for 1 or down for 0 refer to Table 26 for binary switch settings Figure 65 illustrates the loop ID switch set to 42 0101010 Note The factory default Fibre Channel Host ID loop address settings for controller A BD1 is 5 and the default for controller B BD2 is 4 If you must change the default values make sure you select a unique value for each ID The Fibr...

Page 181: ...ors and Fibre Channel Host Loop ID Switches Note Occasionally two or more ports in an arbitrated loop will arbitrate simultaneously Priorities are decided according to the loop IDs The higher the loop ID the higher the priority 0 1 0 1 0 1 0 42 Fibre Channel Host ID Switch ...

Page 182: ...0 1100 010 1101 010 1110 010 1111 011 0000 011 0001 011 0010 011 0011 011 0100 011 0101 011 0110 011 0111 011 1000 011 1001 011 1010 011 1011 011 1100 011 1101 011 1110 011 1111 100 0000 100 0001 100 0010 100 0011 100 0100 100 0101 100 0110 100 0111 100 1000 100 1001 100 1010 100 1011 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 11...

Page 183: ...r enclosure requires special ferrite bead power cords part no 5064 2482 for FCC compliance When connecting power cords connect the power cords from the right side power supplies to the PDUs PDRUs on the right side of the rack and connect the power cords from the left side power supplies to the PDUs PDRUs on the left side of the rack This method ensures that each enclosure power supply is connected...

Page 184: ...h the removal and replacement of serviceable components Also leave a 6 inch service loop to allow for the rotation of PDRUs The letters A B C D E and F in Figure 66 and Figure 67 represent independent PDUs or PDU banks The absence of duplicate letters in individual sorage systems indicates the products are using redundant PDUs The minimum number of duplicate pairs of letters in all sorage systems ...

Page 185: ...Attaching Power Cords 185 Installation Figure 66 Wiring Scheme for 1 6 Meter Rack A A A A AC IN B B B B C C C C AC IN D D D D 30A PDRU 30A PDRU A D A D A C A C B C B C B D B D ...

Page 186: ...er Cords Figure 67 Wiring Scheme for 2 0 Meter Rack A E A F A G B E B F B H C F C G C H D G D H A A A A AC IN B B B B C C C C AC IN D D D D E E E E AC IN F F F F G G G G AC IN H H H H 30A PDRU 30A PDRU 30A PDRU 30A PDRU ...

Page 187: ...d by a number of factors which are described in Chapter 2 Topology and Array Planning When you have determined which configuration you will use refer to Full Bus Cabling and Switch Configuration on page 188 or Split Bus Switch and Cabling Configurations on page 191 A Word About SCSI Terminators Terminators need to be installed on both the disk enclosures and the controller enclosure On the control...

Page 188: ... so on down the rack Install cables along the left side of the disk enclosure connectors as viewed from the back of the rack and install terminators along the right side connectors To configure the disk array for full bus operation 1 Connect one end of a SCSI cable to the controller enclosure SCSI channel 1 connector J12 JVD ARRAY SCSI 1 See Figure 69 2 Connect the other end of the SCSI cable to t...

Page 189: ...et to 1 Segment 1 set to 1 Segment 1 set to 1 Segment 1 set to 1 All other segments set to 0 All other segments set to 0 All other segments set to 0 All other segments set to 0 Tray ID set to unique value Tray ID set to unique value Tray ID set to unique value Tray ID set to unique value for each enclosure for each enclosure for each enclosure for each enclosure Tray ID set to same value Tray ID s...

Page 190: ...190 Attaching SCSI Cables and Configuring the Disk Enclosure Switches Figure 69 Full Bus Cabling SCSI terminator required here ...

Page 191: ... install terminators along the right side connectors To configure the disk array for split bus operation 1 Connect one end of a SCSI cable to the controller enclosure SCSI channel 1 connector J12 JVD ARRAY SCSI 1 see Figure 71 2 Connect the other end of the SCSI cable to the disk enclosure BCC A SCSI connector B 3 Connect a second SCSI cable to the controller enclosure SCSI channel 2 connector J11...

Page 192: ...egments set to 0 All segments set to 0 All segments set to 0 Tray ID set to same value Tray ID set to same value Tray ID set to same value Tray ID set to same value on both BCCs in the enclosure on both BCCs in the enclosure on both BCCs in the enclosure on both BCCs in the enclosure All segments set to 0 All segments set to 0 All segments set to 0 All segments set to 0 Note inverted orientation f...

Page 193: ...Attaching SCSI Cables and Configuring the Disk Enclosure Switches 193 Installation Figure 71 Split Bus Cabling SCSI terminators required on both BCCs ...

Page 194: ...and SCSI ID These values will differ depending on which type of bus configuration is used for the disk enclosures See How are disk modules in the array identified on page 244 for more information Figure 72 is an example of split bus addressing Figure 73 is an example of full bus addressing Figure 72 Split Bus Addressing Example This disk is on channel 3 with an ID of 4 ...

Page 195: ...Attaching SCSI Cables and Configuring the Disk Enclosure Switches 195 Installation Figure 73 Full Bus Addressing Example This disk is on channel 4 with an ID of 12 ...

Page 196: ...Storage Manager 60 CD To connect the Fibre Channel cables to the array complete the following steps Note It is advisable to select Fibre Channel cables that are as close as possible to the proper length for the installation 1 Connect a fibre optic cable to a host or hub Locate the appropriate connector on the adapter card Remove the optical cover and connect the fibre optic cable Refer to the appr...

Page 197: ...nnel Installation 3 Connect the Fibre Channel connectors to the controller MIAs a Remove the optical protectors from the ends of the MIAs and the Fibre Channel cables Figure 74 b Insert the Fibre Channel connectors into the MIAs The fibre optic cable connector is keyed to install only one way ...

Page 198: ...and disk enclosure Note What happens if the disk enclosures are powered up before the controller enclosure When the disk array controller enclosure is powered up it checks for the presence of the disks in the disk enclosures If the disk enclosures have not yet been powered on the controller will not detect the disks This will result in no LUNs appearing because none of the disks are visible to the...

Page 199: ...be on and the Enclosure Fault LED C should be off It is normal for the Enclosure Fault LED amber to go on momentarily when the enclosure is first powered on However if the Enclosure Fault LED remains on it indicates that a fault has been detected Refer to Troubleshooting on page 359 for additional information 4 Power up the controller enclosure using both power switches on the back of the enclosur...

Page 200: ... LED should be on and the remaining LEDs should be off If any fault LED is on an error has been detected Refer to Troubleshooting on page 359 for additional information 6 Close and lock the disk enclosure doors 7 If the host was shutdown to install the array boot the host 8 Perform an ioscan to verify that the host sees the array Power Switches ...

Page 201: ...ctivity Flashing green when disk is being accessed Disk Fault LED Off Power Supply Power Supply On green BCC Module Term Power On green Full Bus Off if split bus On green if single bus BCC Fault Off Bus Active On green bus is available for use Off Isolator chip disabled bus not avail LVD On green bus operating in LVD mode Off bus operating in single ended mode Fan Module Fan On green ...

Page 202: ...the Disk Array Figure 77 Disk Enclosure LEDs A System fault LED B System power LED C Disk activity LED D Disk fault LED E Power On LED F Term Pwr LED G Full Bus LED H BCC Fault LED I Bus Active LED J LVD LED K Fan Fault LED ...

Page 203: ...and pattern of these LEDs depend on how your system is configured Controller Battery Fault B Off Full Charge B On green 1 Fault A Off Full Charge A On green 1 Controller Power Assembly Power 1 On green Power 2 On green Controller Fan Assembly Fan Power On green Fan Fault Off 1 Both Full Charge A and Full Charge B LEDs are ON after batteries are fully charged The LEDs flash while charging is in pro...

Page 204: ...ED B Power Fault LED C Fan Fault LED D Controller Fault LED E Fast Write Cache LED F Controller Power LED G Controller Fault LED H Heartbeat LED I Status LEDs J Fault B LED K Full Charge B LED L Fault A LED M Full Charge A LED N Power 1 LED O Power 2 LED P Fan Power LED Q Fan Fault LED ...

Page 205: ...go off indicating that all data in cache has been written to the disks 3 Power down the controller enclosure 4 Power down the disk enclosures Note If necessary power to all components of the disk array can be shut off simultaneously using a single cabinet power switch or circuit breaker In this situation stop all I O to the disk array and then wait two minutes for all cache data to be written to d...

Page 206: ...can fn An output will be displayed similar to that in Figure 79 The sample ioscan shown in the figure includes entries for both disk array controllers one at loop ID 6 and the other at loop ID 7 loop IDs are determined by the Fibre Channel Host ID switch setting on the back of the controller enclosure The virtual SCSI bus entries for both controllers are also shown Note The State of the each contr...

Page 207: ...MED DEVICE HP A5277A dev dsk c1t0d1 dev rdsk c1t0d1 disk 7 8 8 8 0 7 0 1 0 sdisk CLAIMED DEVICE HP A5277A dev dsk c1t1d0 dev rdsk c1t1d0 disk 8 8 8 8 0 7 0 2 0 sdisk CLAIMED DEVICE HP A5277A dev dsk c1t2d0 dev rdsk c1t2d0 disk 9 8 8 8 0 6 0 3 0 sdisk CLAIMED DEVICE HP A5277A dev dsk c1t3d0 dev rdsk c1t3d0 target 8 8 8 8 0 255 0 6 tgt CLAIMED DEVICE ctl 0 8 8 8 0 255 0 6 0 sctl CLAIMED DEVICE HP A5...

Page 208: ...dentified by two hardware paths Peripheral Device Addressing Peripheral device addressing PDA is used to identify the disk array controller modules A disk array controller module can be identified in the ioscan output as an entry with a driver type of sctl and a description of HP A5277A Figure 80 illustrates the interpretation of the fields in the hardware path when using PDA Figure 80 Peripheral ...

Page 209: ...t addressing VSA is used to address disk array LUNs A disk array LUN can be identified in the ioscan output as an entry with a driver type of sdisk and a description of HP A5277A The LUN number is encoded in the Volume Number segments of the hardware path Figure 81 illustrates the interpretation of the fields in the hardware path when using VSA Figure 81 Volume Set Addressing Hardware Path 8 12 8 ...

Page 210: ...ied by the next to last segment of the hardware path For example in the following ioscan entry the value identifying virtual SCSI bus 1 is shown in bold Figure 79 shows all four virtual SCSI bus entries for a disk array disk 4 8 8 8 0 0 0 1 0 sdisk CLAIMED DEVICE HP A5277A dev dsk c9t1d0 dev rdsk c9t1d0 Why Are There ioscan Entries for LUNs I Didn t Bind By default an ioscan entry is made for LUN ...

Page 211: ...that logical SCSI bus Determining LUN numbers from the hardware path LUN numbers can be determined by using the last three segments of the VSA hardware path which represent the 14 bit volume number The bits of the volume number are encoded as shown in Figure 82 Figure 82 VSA Volume Number Encoding For example if the hardware path is 8 12 8 0 0 0 3 5 the LUN number would be 29 as shown below 000000...

Page 212: ...onnection A quick way to determine the LUN number is to multiply the value of the next to last segment times 8 and add the result to the last segment value Using the above example the LUN number is computed as follows 3 x 8 5 29 ...

Page 213: ...ools and system patches must be installed The software required for the Disk Array FC60 is distributed on the HP UX Support Plus CD ROM 9909 or later System Requirements The following host system requirements must be met to install and use the Array Manager 60 utilities successfully Table 29 System Requirements Hardware platform HP 9000 Series K class D class V class N class T 600 HP UX version HP...

Page 214: ...ray is being installed on a host running HP UX 11 11 it will be necessary to downgrade the controller firmware to HP03 after installing the software Installing the Disk Array FC60 Software The following HP UX patches are required for the HP SureStore E Disk Array FC60 HP UX 10 20 PHCO_22627 and PHSS_22846 HP UX 11 0 PHCO_22628 and PHSS_22847 The required patches can be downloaded from the followin...

Page 215: ... R Downgrading the Disk Array Firmware for HP UX 11 11 Hosts Controller firmware HP08 is not supported on HP UX 11 11 If the disk array is being installed on a host running HP UX 11 11 it will be necessary to downgrade the controller firmware to HP03 after installing the software 1 Identify the version of firmware on the disk array controllers by typing amdload i ArrayID 2 If the controller firmwa...

Page 216: ...termine the ArrayID To display the ArrayID type amdsp i Record the ArrayID its S N for use in performing the remaining steps Step 2 Assign an Alias Name Optional To simplify managing the disk array s an alias name can be assigned to each disk array Once assigned the alias can be used in place of the ArrayID when performing the remaining steps An alias can include upper case characters numbers poun...

Page 217: ... will destroy any data on the disk array To initialize the disk media type amutil syswipe ArrayID Note As the syswipe operation executes watch the activity LEDs on the disk modules Each LED should illuminate briefly starting with the first disk on the first channel and continiung in a orderly sequence through all the disks If the LED on any disk remains on noticeably longer than the others it may ...

Page 218: ...d syntax and parameters refer to the amcfg man page or see Replacing a LUN on page 294 Step 6 Disable WCE On All Disks For optimum data protection WCE Write Cache Enable should be disabled on all disks in the array To disable WCE on all disks type amutil w ArrayID Note To ensure optimum protection against data loss it is recommended that Write Cache Enable be disabled on all disks in the array Dis...

Page 219: ...eated on the disk array To bind a LUN type amcfg L cntrlr LUN d channel ID channel ID r RAIDlevel options ArrayID For example the following command creates LUN 1 as RAID 5 using six disks amcfg L A 1 d 1 1 2 10 3 10 4 1 5 1 6 1 r 5 options ArrayID For more information see Binding a LUN on page 289 To use SAM see Binding a LUN on page 267 Step 9 Add Global Hot Spares Optional Hot spares provide an ...

Page 220: ...ed and that the array is working properly To display disk array status type amdsp a ArrayID See Figure 88 on page 284 for a sample status display output that identifies the important fields and the normal values Windows NT and Windows 2000 Perform the following steps to configure the disk for operation on a Windows NT or Windows 2000 host Refer to the HP Storage Manager 60 User s Guide for detaile...

Page 221: ...Configuring the Disk Array 221 Installation 6 Set up storage partitions if this premium feature is enabled 7 Set the disk array controller clocks ...

Page 222: ...wing procedure ensure that the level of PDC on the server supports booting from a Fibre Channel device To serve as a boot device the Disk Array FC60 must have a suitable LUN created on it If the disk array has a LUN structure on it an available LUN can be used for the boot disk or another LUN can be created This applies to a disk array that has already been in use and when installing a new factory...

Page 223: ...assembled disk arrays have an entire LUN structure created on them If any of the disk enclosures are missing when the disk array is powered on the LUNs will appear but they will all have a size of zero bytes Make sure all disk enclosures are present and powered on before the controller enclosure is powered on Problem The ioscan results shows extra LUNs on the disk array There are several LUN 0 ent...

Page 224: ...all data on the disk array unavailable during the expansion process Backing Up Data All data on the disk array should be backed up to prevent data loss should problems occur during the expansion Maintaining High Availability Adding disk enclosures will typically require that you convert existing disk enclosures from split bus configuration to full bus configuration This may result in more than one...

Page 225: ...w disk modules Careful planning will help ensure that the expansion is performed successfully 1 Identify the original disk array configuration by performing the following tasks a Create a detailed diagram of the existing Disk Array FC60 layout b Attach a label to each Fiber Channel cable attached to the disk array identifying the host interface and disk array controller port it connects c Identify...

Page 226: ... ID of the disk Step 2 Backup All Disk Array Data CAUTION It is critical that you perform this step Protection of user data is essential if a problem occurs during the expansion process 1 Stop all I O activity to the disk array 2 Backup all data on the Disk Array FC60 3 Label and store the backup media in a safe place Step 3 Prepare the Disk Array for Shut Down 1 Determine if any LUNs in the disk ...

Page 227: ...ue with the next step Step 4 Add the New Disk Enclosures CAUTION Use proper Electrostatic Discharge ESD procedures during the expansion procedure ESD discharges can easily damage the HP FC60 Array and drive components Wearing an ESD wrist strap grounded to the component chassis is sufficient for most environments 1 Power down the disk array components in the following order a Switch off power to t...

Page 228: ...ectly terminated SCSI bus can cause data loss 7 Install the SCSI cabling between the controller enclosure and the disk enclosures Use your expanded configuration diagram to determine how to connect the SCSI cabling A single SCSI cable will be used to connect each full bus disk enclosure to the controller enclosure Note To simplify disk array management it is recommended that the SCSI cabling be co...

Page 229: ...or the disk enclosures installed The enclosure connected to channel 1 should be set to 0 The enclosure connected to channel 2 should be set to 1 The enclosure connected to channel 3 should be set to 2 The enclosure connected to channel 4 should be set to 3 The enclosure connected to channel 5 should be set to 4 The enclosure connected to channel 6 should be set to 5 9 Move the necessary disks from...

Page 230: ... complete the discovery process 3 Check for any disk faults If a disk fault occurs remove the disk wait for at least 15 seconds then reinsert the disk The disk array controller should clear the fault on the disk once it has spun up Note If the disk fault will not clear it may be necessary to replace the disk If a new disk does not clear the fault contact HP Support 4 Add any new disks to the disk ...

Page 231: ...applications that depend on a specific path 6 Rescan the disk array from the host using the ioscan fnC disk command The disk array and the paths to each LUN should be displayed This completes the process of expanding the disk array You can now make the capacity provided by the new disks available to the host by binding LUNs ...

Page 232: ...ray is configured with five 6 disk LUNs The original enclosures were operating in split bus mode and have been reconfigured to full bus mode The disks have been moved from their original locations to slots with the corresponding channel ID This strategy achieves the desired result of having each disk in the LUN on a separate channel and also simplifies LUN management Note In the following example ...

Page 233: ...pacity 233 Installation Figure 83 Capacity Expansion Example Disks are moved to the slot that corresponds to their original channel ID High availability is maintained by having no more than one disk per LUN or volume group on each channel ...

Page 234: ...234 Adding Disk Enclosures to Increase Capacity ...

Page 235: ...4 4 4 4 Full bus IDs Full bus IDs Full bus IDs Full bus IDs 0 0 0 0 8 8 8 8 1 1 1 1 9 9 9 9 2 2 2 2 10 10 10 10 3 3 3 3 11 11 11 11 4 4 4 4 12 12 12 12 Split bus IDs Split bus IDs Split bus IDs Split bus IDs 0 0 0 0 0 0 0 0 1 1 1 1 1 1 1 1 2 2 2 2 2 2 2 2 3 3 3 3 3 3 3 3 4 4 4 4 4 4 4 4 Full bus IDs Full bus IDs Full bus IDs Full bus IDs 0 0 0 0 8 8 8 8 1 1 1 1 9 9 9 9 2 2 2 2 10 10 10 10 3 3 3 3 ...

Page 236: ...ll bus IDs Full bus IDs Full bus IDs 0 0 0 0 8 8 8 8 1 1 1 1 9 9 9 9 2 2 2 2 10 10 10 10 3 3 3 3 11 11 11 11 4 4 4 4 12 12 12 12 Split bus IDs Split bus IDs Split bus IDs Split bus IDs 0 0 0 0 0 0 0 0 1 1 1 1 1 1 1 1 2 2 2 2 2 2 2 2 3 3 3 3 3 3 3 3 4 4 4 4 4 4 4 4 Full bus IDs Full bus IDs Full bus IDs Full bus IDs 0 0 0 0 8 8 8 8 1 1 1 1 9 9 9 9 2 2 2 2 10 10 10 10 3 3 3 3 11 11 11 11 4 4 4 4 12 ...

Page 237: ... the Array Manager 60 Software 240 Managing Disk Array Capacity 242 Adding Capacity to the Disk Array 254 Upgrading Controller Cache to 512 Mbytes 258 Managing the Disk Array Using SAM 260 Managing the Disk Array Using Array Manager 60 276 Managing the Disk Array Using STM 314 Status Conditions and Sense Code Information 317 ...

Page 238: ...n Manager or SAM This allows you to manage the disk using the same tool you use to manage your host system Not all tasks can be performed using SAM In general the more common tasks are available from SAM while the more advanced tasks are performed using Array Manager 60 Array Manager 60 Array Manager 60 comprises a set of utilities that provide complete capability for managing the disk array In ad...

Page 239: ...Yes Yes ammgr Yes Assigning an alias to the disk array Yes Yes ammgr No Managing cache memory No Yes ammgr No Managing the rebuild process No Yes amutil No Synchronizing controller date and time No Yes ammgr No Locating disk array components Yes Yes amutil Yes Performing a parity scan No Yes ammgr Yes Displaying disk array serial numbers Yes Yes amdsp No Disabling disk Write Cache Enable WCE No Ye...

Page 240: ...ver if you decide to move the disk array to a different host you will need to install the software on the new host See Installing the Disk Array FC60 Software HP UX Only on page 213 for more information Note Must Array Manager 60 be installed to use SAM Yes The Array Manager 60 software is required to manage the HP SureStore E Disk Array FC60 even when using SAM When using SAM the Array Manager 60...

Page 241: ...isk array using either SAM or Array Manager 60 Because of its importance in managing the disk arrays AM60Srvr is launched automatically when the system is booted Host I Os to the disk array are not dependent on AM60Srvr and are serviced regardless of whether AM60Srvr is running or not Running Array Manager 60 Array Manager 60 runs as a daemon process AM60Srvr and is started automatically when the ...

Page 242: ...creating the LUN structure you need Factors such as capacity RAID level and stripe segment size must be determined for each LUN The LUN configuration you select should be based on system environment and application needs The process of binding LUNs is much like adding new disks to your system Each LUN appears to the host as a single hard disk drive However unlike conventional hard disks the disk a...

Page 243: ...f the larger disks will be used when creating the LUN Consider using more disks for RAID 5LUNs This increases both performance and storage efficiency Because RAID 5 uses only one disk s worth of capacity for parity more disks in the LUN will result in a greater percentage of the disk capacity used for data For example in a 4 disk RAID 5LUN 75 of the capacity is used for data 3 of 4 Adding another ...

Page 244: ... module is connected to There are six channels available 1 6 If the disk enclosure is using full bus configuration all disk modules within the enclosure will be on the same SCSI channel If the disk enclosure is configured for split bus operation disks in the even numbered slots will be on one channel and disks in the odd numbered slots will be on a different channel SCSI ID identifies the ID assig...

Page 245: ... must have a unique enclosure ID number Disk enclosures should be numbered from the top down with the enclosure mounted highest in the rack being 0 The slot number indicates the physical enclosure slot in which the disk module is installed This number is related to but is not the same as the disk SCSI ID Slots are assigned SCSI IDs differently depending on whether the disk enclosure is configured ...

Page 246: ...0 1 2 3 4 8 9 10 11 12 SCSI IDs Disk enclosure ID set to 3 Enclosure connected to channel 2 Full bus configuration Disk Module Addressing Parameters This disk module uses the following address parameters Channel 2 SCSI ID 10 full bus or 2 split bus Enclosure 3 Slot 5 Split bus configuration 0 0 1 1 2 2 3 3 4 4 ...

Page 247: ...ce between I O path loads you can change the ownership of one or more LUNs to solve the problem Note Does the primary path selected using LVM impact LUN ownership Yes The primary I O path established using LVM defines the owning controller for the LUN This may override the controller ownership defined when the LUN was bound For example if controller A was identified as the owning controller when t...

Page 248: ...efficiency can range from 50 for RAID 1 and 0 1 up to 80 for RAID 5 The higher the efficiency the less cost per megabyte for storing your data Global Hot Spares Global hot spares provide additional protection against disk failures The number of global hot spares you use will reflect how much protection you need Each global hot spare you add will provide protection against the failure of a single d...

Page 249: ...r more information see Data Striping on page 49 When creating a LUN the default value used for the stripe segment size is the value currently set for the cache page size 4 Kbytes or 16 Kbytes The default cache page size is 4 Kbytes When setting stripe segment size consider the following Stripe segment size can affect disk array performance The smaller the stripe segment size the more efficient the...

Page 250: ...teristics of each RAID level Setting Stripe segment size Function Sets the number of blocks of data the controller will write to or read from a single disk before switching to the next disk in the LUN Performance Impact Optimum performance is typically achieved when the segment size matches the I O size In this case only one disk is required to service an I O leaving the remaining disk in the LUN ...

Page 251: ...nce by increasing or decreasing the number of write cache hits A hit is an I O that can be serviced from cache rather than accessing the disk media A higher cache threshold value increases the amount of write data that will be stored in cache before flushing to the disk is initiated This increases the possibility that subsequent writes may be serviced from cache rather than accessing the disk redu...

Page 252: ...te cache See Figure 87 Performance Impact A high value for the flush limit increases the amount of data remaining in write cache at the end of the flush This improves the possibility of hits on write cache Because less data is written to the disk during each flush cycle data flushing will occur more often increasing disk activity In most situations this value should be left at the default value of...

Page 253: ...gure 87 Cache Flush Threshold Example Write Data Write Data Write Data 80 80 80 Cache Flush Threshold set to 80 Cache Flush Limit set to 100 Write data exceeds flush threshold Start data flushing Write data below flush threshold Stop data flushing Initial cache settings ...

Page 254: ...to increase capacity is to add more disk modules and create additional LUNs The disks you add will typically be used to bind LUNs so make sure you add enough disk modules to create the desired structure Disk modules can be added to the disk array while it is online without disrupting operation CAUTION Ensure that there is no important data on the disk module you are installing in the disk array An...

Page 255: ...WCE on page 302 for more information Moving Disks from One Disk Array to Another CAUTION Before moving disks from one array to another ensure that there is no important data on the disks All data on the disks will be lost when they are installed in the new disk array If you have more than one HP SureStore E Disk Array FC60 you can move disks from one array to another to balance capacity The disks ...

Page 256: ...r more details Replacing Disk Modules with Higher Capacity Modules If you have no available slots for adding new disk modules you can increase the capacity of the disk array by replacing existing disk modules with higher capacity disk modules This is typically done on a LUN by LUN basis and requires backing up and restoring all data on the LUN To increase capacity by replacing disk modules 1 Ident...

Page 257: ...page 289 To use STM see Binding a LUN on page 314 Note After binding a LUN you must execute the insf e command to install special device files on the LUN This makes the LUN usable by the operating system 7 Mount the file system on the LUN and restore the data to the LUN 8 Disable WCE on the disk modules using the following command amutil w ArrayID See Disabling Disk Module Write Cache Enable WCE o...

Page 258: ...trollers you must determine if this memory is configured as two 128 MB DIMMs or as a single 256 MB DIMM This will influence the number of upgrade kits you must order You can determine the cache configuration by checking the Manufacturing Part Number MFG P N on the product label on the front of the controller 1 Remove the controller enclosure front panel 2 Check the product label on the front of th...

Page 259: ...ection Initial controller configuration Cache Upgrade Kit s Dual controllers each with two 128 MB DIMMs Two A5279A kits Dual controllers each with one 256 MB DIMM One A5279A kit Single controller with two 128 MB DIMMs One A5279A kit Single controller with one 256 MB DIMM One A5279A kit only one of the DIMMs will be used ...

Page 260: ...ny difference which controller I select when managing the disk array When using SAM you must select one of the controllers on the disk array you want to manage Typically you can select either controller to perform an operation and the outcome will be the same An exception is when you are binding a LUN The controller you select will be assigned ownership of the LUN To maintain I O performance you s...

Page 261: ...rtion of the disk array configuration To view disk array status 1 On the main SAM screen double click the Disks and File Systems icon 2 On the Disks and File Systems screen double click the Disk Devices icon The Disk Devices list is displayed There is an entry for each HP FC60 disk array controller and for each LUN on the disk array The LUNs are listed beneath the owning controller Note The center...

Page 262: ...t the Actions menu and the View More Information menu option The Main Status screen is displayed showing the overall status of the disk array 5 Click the appropriate button to view the detailed status for the corresponding disk array component If you need any help in interpreting the status information access the online help ...

Page 263: ...n HP UX General disk array status displayed here Click here Click here Click here Click here for detailed for detailed for detailed for detailed status of status of status of status of indicated indicated indicated indicated component component component component ...

Page 264: ... might be assigned an alias of data_center_1 To assign an alias 1 On the main SAM screen double click the Disks and File Systems icon 2 On the Disks and File Systems screen double click the Disk Devices icon The Disk Devices list is displayed There is an entry for each disk array controller 3 Select a controller for the appropriate disk array from the Disk Devices list Green The component is funct...

Page 265: ...ple disks This is useful if you want to identify the disks that make up a LUN or a failed disk that must be replaced It is advisable to positively identify a failed disk before removing it from the disk array Removing the wrong disk could cause the LUN to become unavailable To locate a disk module 1 On the main SAM screen double click the Disks and File Systems icon 2 On the Disks and File Systems...

Page 266: ...Managing the Disk Array Using SAM 5 Click the Disk Module Status button The Disk Status window is displayed Select the option to flash LEDs All disks within the same group are marked Status of selected disk ...

Page 267: ... the entire disk array 8 Click Start to begin flashing the Fault LEDs 9 Click Stop to stop flashing the Fault LEDs or click OK to close the window and stop the flashing Binding a LUN A number of settings allow you to define the LUN configuration Before binding a LUN make sure you understand what each of the settings does and how it will impact LUN behavior See Configuring LUNs on page 242 for more...

Page 268: ... File Systems screen double click the Disk Devices icon The Disk Devices list is displayed There is an entry for each disk array controller 3 Select a controller for the appropriate disk array from the Disk Devices list 4 Select the Actions menu the Disk Array Maintenance menu option and then Bind LUN The LUN Management screen is displayed ...

Page 269: ...Managing the Disk Array Using SAM 269 Managing the Disk Array on HP UX Order of selected disks displayed here Select unassigned disks for a new LUN ...

Page 270: ...r portion below the MIRROR separator See Selecting Disks for a RAID 0 1 LUN on page 243 for more information 8 Click the Stripe Size button and select the stripe element size You can also enter the stripe size in the field The stripe size must be a multiple of the current cache page size If you enter a value that is not a multiple of the cache page size the value will be rounded up to the nearest ...

Page 271: ...n select Disks and File Systems 2 On the Disks and File Systems screen double click the Disk Devices icon The Disk Devices list is displayed There is an entry for each disk array controller and each LUN on the disk array The LUNs are listed beneath the owning controller 3 From the Disk Devices list select the LUN to be unbound 4 Select the Actions menu the Disk Array Maintenance menu option and th...

Page 272: ...tenance menu option and then Replace The LUN Management screen is displayed 5 Click the RAID Level button and select the desired RAID level for the LUN 6 Select the disks to include in the LUN The disks that were members of the original LUN are marked for inclusion Remove any of these disks or add additional disks as desired 7 Click the Stripe Size button and select the stripe element size You can...

Page 273: ...your disk array always select disks of the largest capacity for your global hot spares This ensures that any disk failure is protected See Global Hot Spare Disks on page 61 for more information on selecting disks for global hot spares If a larger disk is used to replace a smaller disk that has failed the difference in capacity will be unused For example if an 18 Gbyte disk is used as a global hot ...

Page 274: ...274 Managing the Disk Array Using SAM Unassigned disks selected as hot spares ...

Page 275: ...ot spare may make your disk array more vulnerable when a disk failure occurs To remove a global hot spare 1 On the main SAM screen double click the Disks and File Systems icon 2 On the Disks and File Systems screen double click the Disk Devices icon The Disk Devices list is displayed There is an entry for each disk array controller 3 Select a controller for the appropriate disk array from the Disk...

Page 276: ...ge the disk array Table 33 Array Manager 60 Task Summary Task Command Capacity Management Binding a LUN amcfg L cntrlrID LUN d channel ID channel ID r RAIDlevel options ArrayID Unbinding a LUN amcfg D LUN force ArrayID Calculating LUN Capacity amcfg C d channel ID channel ID r RAIDlevel s stripe ArrayID Adding a Global Hot Spare ammgr h channel ID ArrayID Removing a Global Hot Spare ammgr d channe...

Page 277: ...ArrayID Synchronizing the Controller Date and Time ammgr t ArrayID Managing the Universal Transport Mechanism UTM ammgr u U l LUN ArrayID Disk Array Maintenance Locating Disk Modules amutil option ArrayID Checking Rebuild Progress amdsp r ArrayID Changing Rebuild Priority Settings amutil R LUN f Freq a Amt ArrayID Performing a Parity Scan ammgr P LUN Viewing Disk Array Logs amlog s StartTime e End...

Page 278: ...che Page Size Setting the Cache Flush Threshold Setting the Cache Flush Limit Synchronizing the Controller Date and Time Performing a Parity Scan Resetting Battery Age Managing the Universal Transport Mechanism UTM amdsp Identifying Disks Displaying Status Information Listing Disk Array IDs Rescanning for Disk Arrays Checking Rebuild Progress amutil Locating Disk Modules Changing Rebuild Priority ...

Page 279: ...er 60 command type man command_name Substitute one of the Array Manager 60 utility names for command_name For example to access the amdsp man page type man amdsp Quick Help A quick listing of the syntax and available options for a command can be displayed by using the option with the command For example for quick information about the ammgr utility type ammgr Table 35 Syntax Conventions Symbol Mea...

Page 280: ...ormance you should divide the ownership of the LUNs on the disk array between the two controllers Table 36 Command Parameters for Identifying Disk Array Components Command parameter Description ArrayID Identifies the disk array The ArrayID may be either the disk array ID its S N or an alias name assigned to the array Each disk array must have a unique ArrayID The disk array S N and alias can be de...

Page 281: ...one A short meaningful alias should be easier to remember than the disk array ID when using the Array Manager 60 commands 1 Rescan for all disk arrays on the host by typing amdsp R 2 List all the disk arrays by typing amdsp i Each disk array will be listed along with its ID 3 Assign an alias to each disk array by typing ammgr D ArrayAlias ArrayID ArrayAlias is the name you want to assign to the di...

Page 282: ... identifies the type of status information to display Table 37 lists the command options and the status information each displays Table 37 Command Options for Displaying Disk Array Status Option Status Information Displayed none General array information This includes disk capacity usage Sample output is shown in Figure 88 l LUN LUN status Status for all LUNs on the disk array will be displayed un...

Page 283: ... host will not recognize or display UTM LUN 31 If LUN 31 is not displayed install the required patches as described in Installing the Disk Array FC60 Software on page 214 a All status This option displays all the information returned by the preceding options p devicefile Hardware path information Displays hardware path information for the controller corresponding to the specified device file r Reb...

Page 284: ... Ctrl RAID Segment Disks 0 OPTIMAL 16 9 GB A 1 4 1 0 3 0 1 OPTIMAL 16 9 GB B 1 4 2 0 4 0 31 UTM GOOD LUN WCE RCD CME CWOB WCA RCA CMA 0 X X X X X 1 X X X X X Total capacity of LUNs on controller A 84 6 GB Total capacity of LUNs on controller B 50 8 GB Total capacity of all configured LUNs 135 4 GB Cache Status for each LUN all LUNs should have the status values shown LUN Information the status of ...

Page 285: ...Firmware Revision HP01 Total capacity of all installed physical disks 271 4 GB Hot Spare Activity None Vendor ID HP Product ID A5277A Array ID 000A00A0B80673A6 Array alias Array1 Disk Group 060E86000738C6395B Disk Group Type LUN Number of LUNs 1 LUN s 6 Remaining Capacity 0 0 MB RAID Level 1 Segment Size 4 KB Disks 1 3 3 3 Total remaining capacity for LUN disk groups 0 0 MB Disk Information the st...

Page 286: ... 89 days NVSRAM Checksum 0x353181DF Information for Disk System 1 USSA02010592 Controller B SCSI Channel 2 Thumbwheel Setting 0 Controller Status GOOD Vendor ID HP Product ID A5294A Serial Number USSA02010649 Firmware Revision HP04 Information for Disk System 1 USSA02010592 Controller A SCSI Channel 1 Thumbwheel Setting 0 Controller Status GOOD Vendor ID HP Product ID A5294A Serial Number USSA0201...

Page 287: ... Array ID 000A00A0B80673A6 Array alias Array1 Array Controller Subsystem Controller A GOOD Controller B GOOD PS 1 GOOD PS 2 GOOD Fan 1 GOOD Fan 2 GOOD Temp Sensor GOOD Battery GOOD Disk System 1 USSA02010592 BCC Controller B GOOD BCC Controller A GOOD PS 1 GOOD PS 2 GOOD Fan 1 GOOD Fan 2 GOOD Temp Sensor GOOD Disk System 2 USSA02010595 BCC Controller B GOOD BCC Controller A GOOD PS 1 GOOD PS 2 GOO...

Page 288: ... To avoid having to use the array ID when managing the disk array you may want to create an alias You can also export the array ID to a variable and use the variable For example to export the ID for array 000000057D22 to a variable named id type the following export id 000000057D22 You can then use id in place of array id Rescanning for Disk Arrays If the configuration of the disk arrays on your s...

Page 289: ...d settings you intend to use Refer to Calculating LUN Capacity on page 292 for instructions on performing this task Note How long does it take to bind a LUN The time it takes to bind a LUN depends on the size of the LUN you are creating The larger the LUN the longer it takes For example binding a RAID 5 LUN with 18 Gbyte disks can take up to 60 minutes To bind a LUN type amcfg L cntrlrID LUN d cha...

Page 290: ...operating system Table 38 Command Options for Binding a LUN Option Description Default c capacity Specifies the capacity of the LUN Capacity can be specified in megabytes M or gigabytes G by appending the appropriate letter to the capacity value By default the LUN will use the entire capacity available from all the disks It is possible to specify a lower value for LUN capacity but this will result...

Page 291: ... two disks causes the disk array to create a RAID 0 1 LUN amcfg L B 4 d 1 3 1 4 2 3 2 4 r 1 s 4 rack_51 force Allows you to bind a LUN using two or more disks in the same enclosure or on the same channel This option allows you to override the high availability protection designed into the LUN binding process Using this option you can specify more than one disk per enclosure or channel You can also...

Page 292: ...to calculate how much capacity will be available for a given set of configuration values This command does not bind a LUN it simply returns the capacity that would be available if you had bound a LUN using the values provided You can alter the settings to see how LUN capacity is affected until you get the desired results Using this command before you bind a LUN will ensure that you achieve the cor...

Page 293: ...cfg D LUN force ArrayID LUN number assigned to the LUN you want to unbind The force option is required to delete LUN 0 LUN 0 may only be deleted if a UTM LUN has been enabled via NVSRAM setting If UTM is disabled LUN 0 is required for the SCSI command path The UTM LUN itself may not be deleted using this command Command Example The following example unbinds LUN 5 on disk array rack_1 amcfg D 5 rac...

Page 294: ...ership of LUN 3 to controller B on disk array 0000005EBD20 amcfg M 3 c B 0000005EBD20 Replacing a LUN It is possible to replace an existing LUN This operation unbinds the LUN and then rebinds it using the new parameters specified This is useful if you wish to change the settings of an existing LUN such as its size or RAID level using a single command CAUTION All data on a LUN is lost when it is re...

Page 295: ...provide an additional level of protection for the data on your disk array A global hot spare automatically replaces a failed disk restoring data redundancy and performance that may suffer while in degraded mode For maximum protection against disk failure it is recommended that you add one global hot spare per channel For more information on using global hot spares see Global Hot Spares on page 248...

Page 296: ...ing disk 1 1 on disk array 0000005EBD20 ammgr h 1 1 0000005EBD20 Removing a Global Hot Spare If you need to increase the available capacity of your disk array you can do so by removing a global hot spare The global hot spare will be added to the unassigned disk group and can be used to bind a LUN However the loss of the global hot spare may make your disk array more vulnerable when a disk failure ...

Page 297: ... a command To assign an alias to the disk array type ammgr D ArrayAlias ArrayID ArrayAlias is the name you want to assign to the disk array An alias can contain up to 16 of the following characters letters numbers pound sign period and underscore _ All other characters are invalid Command Example The following example assigns an alias of rack_1 to disk array 0000005EBD20 ammgr D rack_1 0000005EBD2...

Page 298: ...opy the data a new LUN and delete LUN 31 before downloading the HP08 firmware One of the primary benefits of using the UTM is Major Event Logging MEL If the UTM is disabled major event logging will not be performed Instead the standard controller logs will be used to gather disk array status Because of the benefits it offers it is recommended that the UTM be enabled Enabling and Changing the UTM L...

Page 299: ... when the UTM is disabled If you want to disable major event logging you can do so by disable the UTM Note It is necessary to disable the UTM LUN before converting from firmware HP08 to ealier versions of firmware To disable use of the UTM type ammgr u ArrayID Note After executing the above command the disk array controllers must be manually reset or power cycled before the new setting will be inv...

Page 300: ...isk array rack_1 ammgr p 16 rack_1 Setting the Cache Flush Threshold The cache flush threshold sets the level at which the disk array begins flushing writing cache content to the disks Cache will be flushed until the cache flush limit value is reached The default value for this setting is 80 The cache flush threshold can be set independently for each controller To set cache flush threshold type am...

Page 301: ...t cache flush threshold The default value for this setting is 100 The cache flush limit can be set independently for each controller To set cache flush limit type ammgr L cntrlrID percent ArrayID percent indicates the percentage of cache memory that remains full when flushing of cache contents stops For example if set to 90 cache memory will be flushed until 90 of the cache amount defined by the c...

Page 302: ...he which is protected by the BBU If power to a disk is interrupted before data in write cache has been copied to the disk media the data will be lost To avoid this situation the WCE feature should be disabled on all disks in the array This ensures that data is written directly to the disk media and not stored in disk cache This procedure for disabling disk WCE should be executed any time a disk mo...

Page 303: ...ay I O performance but increases the possibility of data loss during a power loss If WCE is enabled this procedure for enabling disk WCE should be executed any time a disk module is replaced or a new disk module is added to the array This will ensure that WCE is enabled on all disks in the array To enable WCE on all disks type amutil w on ArrayID WCE will be enabled on all disks visible to the arr...

Page 304: ...d disk before removing it from the disk array Removing the wrong disk could cause the data on the LUN to become unavailable To locate a disk module type amutil option ArrayID option identifies the disk modules you want to identify Table 39 lists valid options Command Example The following example flashes the Fault LED on disk 3 on channel 2 in disk array data_center_1 amutil f 2 3 data_center_1 Ta...

Page 305: ...control whether the rebuild process or host I Os will have greater access to these resources These settings reflect how important the rebuild process is relative to I O activity on the LUN being rebuilt If you select settings that give higher priority to the rebuild process it will complete sooner but at the cost of lower I O performance Lower priority settings give precedence to host I Os which m...

Page 306: ...000005EBD20 Performing a Parity Scan To verify the integrity of the parity data on a LUN you can perform a parity scan This will check each block of data against its parity to ensure that they match Like a rebuild a parity scan competes with host I Os for disk resources and can impact host I O performance The rebuild priority amount setting is used when performing a parity scan A larger amount val...

Page 307: ...in progress you can monitor its progress This will help you determine how much longer the parity scan will take To display parity scan progress type ammgr s LUN ArrayID Halting a Parity Scan You can halt a parity scan currently in progress This may be useful if the parity scan is impacting performance and you want to reschedule it to run when the host is less busy To halt a parity scan type ammgr ...

Page 308: ...g files The log files are stored as individual files in var opt hparray log All log files will be maintained until the specified maximum value is exceeded At that point the oldest log file will be deleted to make room for the new file FIFO The valid range for AM60_MAX_LOG_SIZE_MB is 100 to 4096 100 MB to 4 GB Any value outside of this range is ignored and the default value is used The default valu...

Page 309: ...g record types are valid ctrlr controller log sense This is the default record type if none is specified mel major event log These entries can be filtered using the c option Major event logging is available in firmware versions HP08 and later c limits the major event log entries displayed to only those with critical status Note that using this option will limit the amount of information displayed ...

Page 310: ...r event log for Subsystem 001100A0B8060166 at Wed Nov 29 17 38 27 2000 Sequence Number 14 Time Stamp Wed Nov 29 17 38 19 2000 Event Type Global Hot Spare Not Large Enough 224F Event Category Notification Component Type Disk Enclosure 5 Slot 0 based 3 Event Priority Informational The following is a sample of an Asynchronous Event Log entry Controller log sense for Subsystem 001100A0B8060166 at Mon ...

Page 311: ...eve the contents of the disk array log to the host This may be useful if you suspect a very recent event has not yet been retrieved To flush the contents of the disk array log type amutil l ArrayID A message is displayed indicating that the log file has been flushed The log contents can now be displayed using the amlog command as described above Purging Controller Logs The controller logs are retr...

Page 312: ...size that may cause the var file system to overflow Resetting Battery Age The battery age should be reset to zero when the battery is replaced This ensures an accurate indication of the age of the battery To reset the battery age to zero type ammgr b ArrayID Installing Updated Patches The following HP UX patches are required when upgrading to HP08 firmware The patches must be installed before upgr...

Page 313: ...te The patches are not currently included on the HP UX Support Plus CD ROM They must be downloaded from the indicated web sites Upgrading Disk Firmware The firmware on each disk can be upgraded individually Because different disks require different firmeware files it may be necessary to ...

Page 314: ...r more information on using this tool Checking Disk Array Status Information The STM Information Tool displays disk array status information See Using the STM Information Tool on page 352 for more information on running and using this tool Binding a LUN The STM Expert Tool can be used to bind a LUN See Using the STM Expert Tool on page 355 for more information on running and using this tool STM To...

Page 315: ...e STM Expert Tool on page 355 for more information on running and using this tool Removing a Global Hot Spare The STM Expert Tool can be used to remove a global hot spare See Using the STM Expert Tool on page 355 for more information on running and using this tool STM Tool Action xstm mstm Select Tools Expert Tool Run Select Utilities Unbind LUN STM Tool Action xstm mstm Select Tools Expert Tool R...

Page 316: ...ponents are flashed to aid in identification See Using the STM Expert Tool on page 355 for more information on running and using this tool STM Tool Action xstm mstm Select Tools Expert Tool Run Select Utilities Flash Component Lights Drive or Utilities Flash Component Lights LUN or Utilities Flash Component Lights Disk Enclosure or Utilities Flash Component Lights Array ...

Page 317: ...n Action AM60 OPTIMAL STM OPTIMAL The LUN is operating normally No action is required AM60 OPTIMAL PARITY SCAN IN PROGRESS STM OPTIMAL A parity scan is in progress on the disk array No action is required AM60 OPTIMAL REDUNDANCY RE INITIALIZATION PENDING OR IN PROGRESS STM OPTIMAL A background parity sync operation is in progress on this LUN No action is required The LUN can be used immediately AM6...

Page 318: ...3 OR UNAVAILABLE 83 This state indicates a drive failure during a LUN binding process If a hot spare has been designated the LUN state should transition to Optimal once the LUN binding is complete If no hot spare is in place the LUN state should transition to Degraded Waiting for Repair Action Degraded 1 once the binding is complete AM60 DEAD CREATION IN PROGRESS STM UNAVAILABLE 84 A formatting op...

Page 319: ...M60 FAILED CAUSE UNKNOWN STM FLT 3 The disk has failed due to an unknown condition Replace the disk AM60 REPLACED STM OFF 4 The disk has been replaced The disk will maintain this status until the original data has been rebuilt or copied to the disk No action is required AM60 WRONG DRIVE REMOVED OR REPLACED STM FLT 9 The wrong disk was removed or replaced from a degraded LUN The new disk gets this ...

Page 320: ...ed or been removed Replace or reinstall the disk AM60 CAPACITY LESS THAN MINIMUM STM OFF 38 A disk was replaced by a disk with lower capacity Install disk with the proper capacity The disk is unsupported Install a supported disk AM60 NON SUPPORTED CHANNEL ID STM FLT 49 The command made a request to an unsupported channel and ID Retry the command using the proper channel ID AM60 FORMAT OR RECONSTRU...

Page 321: ...e identified in the table Table 42 Component Status Conditions Status Description AM60 Good STM Optimal The component is operating normally AM60 Non critical STM Fault 3 A component or condition such as temperature or voltage has exceeded warning limits Although immediate action is not required the cause of the non critical status should be investigated and corrected if necessary AM60 Critical STM...

Page 322: ...iators and other targets connected to the bus 0x02 Controller Drive Interface Group comprises the SCSI interface chips on the controller which connect to the drive buses 0x03 Controller Buffer Group comprises the controller logic used to implement the on board data buffer 0x04 Controller Array ASIC Group comprises the ASICs on the controller associated with the array functions 0x05 Controller Othe...

Page 323: ...rive embedded controller drive electronics and Head Disk Assembly its power supply and the SCSI cable that connects it to the controller or supporting sub enclosure environmental electronics The FRU code designates the channel ID in the most significant nibble and the SCSI ID of the drive in the least significant nibble NOTE Channel ID 0 is not used because a failure of drive ID 0 on this channel ...

Page 324: ...r When the Controller Enclosure group is identified FRU Code 0x06 the FRU Code Qualifier is interpreted as follows Component Status Value Status 0 Optimal 1 Warning 2 Failed 3 Missing FRU Code Qualifier 0 x n n n n Status Component ID Byte Bit Field 7 6 5 4 3 2 1 0 Component Status Component ID ...

Page 325: ... ID Value Component 0 Unspecified 1 Device 2 Power Supply 3 Cooling Element 4 Temperature Sensors 6 Audible Alarm 7 Environmental Services Electronics 8 Controller Electronics 9 Nonvolatile Cache B Uninterruptible Power Supply 0x0C 0x13 Reserved 0x14 SCSI Target Port 0x15 SCSI Initiator Port ...

Page 326: ...ure ID field indicates both the channel and enclosure as follows Enclosure 1 Enclosure 2 Channel 1 0x01 0x06 Channel 2 0x02 0x07 Channel 3 0x03 0x08 Channel 4 0x04 0x09 Channel 5 0x05 0x0A 1 When TIE is set to 1 the Disk Enclosure ID field value corresponds to the enclosure tray ID set on the disk enclosure FRU Code Qualifier 0 x n n n n Status Component ID Byte Bit Field 7 6 5 4 3 2 1 0 TIE Disk ...

Page 327: ... logical unit combination 04 01 Logical Unit is in the Process of Becoming Ready The controller is executing its initialization functions on the addressed logical unit This includes drive spinup and validation of the drive logical unit configuration information 04 02 Logical Unit Not Ready Initializing Command Required The controller is configured to wait for a Start Stop Unit com mand before spin...

Page 328: ...action is required by the host Auto reallocation may not have been used but this is the only standard ASC ASCQ that tells the initiator that no further actions are required by the driver 0C 80 Unrecovered Write Error Due to Non Volatile Cache Failure The subsystem Non Volatile cache memory recovery mecha nisms failed after a power cycle or reset This is possibly due to some combination of battery ...

Page 329: ...to Reallocated The controller recovered a read operation to a drive and no fur ther action is required by the host Auto reallocation may not have been used but this is the only standard ASC ASCQ that tells the initiator that no further actions are required by the driver 1A 00 Parameter List Length Error A command was received by the controller that contained a parameter list and the list length in...

Page 330: ...essed logical unit is currently unconfigured An Add LUN operation in the Logical Array Mode Page must be exe cuted to define the logical unit before it is accessible 26 00 Invalid Field in Parameter List The controller received a command with a parameter list that contained an error Typical errors that return this code are unsupported mode pages attempts to change an unchange able mode parameter o...

Page 331: ...01 Mode Parameters Changed The controller received a request from another initiator to change the mode parameters for the addressed logical unit This error notifies the current initiator that the change occurred This error may also be reported in the event that Mode Select parameters changed as a result of a cache synchronization error during the processing of the most recent Mode Select request 2...

Page 332: ...d any out standing 31 01 Format Command Failed A Format Unit command issued to a drive returned an unrecov erable error 32 00 Out of Alternates A Re assign Blocks command to a d rive failed 3F 01 Drive micro code changed 3F 0E Reported LUN s data has changed Previously LUN data reported via a Report LUNs command has changed due to LUN creation deletion or controller hot swap Table 44 SCSI Sense Co...

Page 333: ...re 7 The controller set the drive state to User failed via Mode Select 8 Not used 9 The controller set the drive state to Wrong drive removed replaced A Not used B The controller set the drive state to Drive capacity mini mum C The controller set the drive state to Drive has wrong block size D The controller set the drive state to Failed Controller stor age failure E Drive failed due to reconstruc...

Page 334: ...The FRU codes and qualifi ers indicate the faulty component 3F C8 AC Power Fail The Uninterruptible Power Source has indicated that AC power is no longer present and the UPS has switched to standby power 3F C9 Standby Power Depletion Imminent The UPS has indicated that its standby power source is nearing depletion The host should take actions to stop IO activity to the controller 3F CA Standby Pow...

Page 335: ...ng The cache battery is within the specified number of weeks of failing 3F E0 Logical Unit Failure The controller has placed the logical unit in a dead state User data and or parity can no longer be maintained to ensure avail ability The most likely cause is the failure of a single drive in non redundant configurations or a second drive in a configura tion protected by one drive The data on the lo...

Page 336: ... battery 84 Battery Backed NVSRAM or Clock Failure 91 Diagnostic Self Test failed non data transfer components test 92 Diagnostic SelfTest failed data transfer components test 93 Diagnostic SelfTest failed drive Read Write Buffer data turnaround test 94 Diagnostic Self Test failed drive Inquiry access test 95 Diagnostic Self Test failed drive Read Write data turn around test 96 Diagnostic Self Tes...

Page 337: ... has detected what it believes is a temporary software failure that is likely to be recovered if retried 45 00 Selection Time out on a Destination Bus A drive did not respond to selection within a selection time out period 47 00 SCSI Parity Error The controller detected a parity error on the host SCSI bus or one of the drive SCSI buses 48 00 Initiator Detected Error Message Received The controller...

Page 338: ...0 Disk SMART Event Self Monitoring Analysis and Reporting Technology 80 02 Bad ASC code detected by Error Event Logger 80 03 Error occurred during data transfer from SRM host 84 00 Operation Not Allowed With the Logical Unit in its Current State The requested command or Mode Select operation is not allowed with the logical unit in the state indicated in byte 76 of the sense data Examples would be ...

Page 339: ...bsystem Monitor NVSRAM values configured incorrectly 8A 00 Illegal Command for Drive Access The initiator attempted to pass a command through to a drive that is not allowed The command could have been sent in pass thru mode or by attempting to download drive microcode 8A 01 Illegal Command for the Current RAID Level The controller received a command that cannot be executed on the logical unit due ...

Page 340: ...d 91 03 Illegal Operation for Current Drive State A drive operation was requested through a Mode Select that cannot be executed due to the state of the drive An example would be a Delete Drive when the drive is part of a LUN 91 09 Illegal Operation with Multiple SubLUNs Defined An operation was requested that cannot be executed when multiple SubLUNs are defined on the drive 91 33 Illegal Operation...

Page 341: ...ration For Drive Group State An operation was requested that cannot be executed due to the current state of the Drive Group 91 51 Illegal Reconfiguration Request Legacy Constraint Command could not be completed due to Legacy configuration or definition constraints 91 53 Illegal Reconfiguration Request System Resource Constraint Command could not be completed due to resource limitations of the cont...

Page 342: ...Could Not Be Enabled The controller could not perform write back caching due to a battery failure or discharge Two Minute Warning signal from the UPS or an ICON failure A1 00 Write Back Caching Could Not Be Enabled RDAC Cache Size Mismatch The controller could not perform write back caching due to the cache sizes of the two controllers in the RDAC pair not match ing A4 00 Global Hot Spare Size Ins...

Page 343: ...e Inter controller Communications Have Failed The controller has detected the failure of the communications link between redundant controllers D0 06 Drive IO Time out The controller destination IO timer expired while waiting for a drive command to complete D1 0A Drive Reported Busy Status A drive returned a busy status in response to a command E0 XX Destination Channel Error XX 00 through 07 indic...

Page 344: ...Indicates redundant path is not available to devices ASCQ 21 Indicates destination drive channels are connected to each other Sense byte 26 will contain the Tray ID Sense byte 27 will contain the Channel ID Table 44 SCSI Sense Codes cont d Additional Sense Code Additional Sense Code Qualifier Interpretation ...

Page 345: ...HP UX Diagnostic Tools 345 5 HP UX DIAGNOSTIC TOOLS Overview 346 Support Tools Manager 347 ...

Page 346: ...er is the primary diagnostic tool available for the Disk Array FC60 For diagnosing problems STM provides the capability to gather and display detailed status information about the disk array STM can also be used to perform common management tasks ...

Page 347: ... web site www docs hp com which contains information on using STM including a tutorial to get you started You can also download a copy of the Diagnostic IPR Media User s Guide which contains complete information on using STM STM User Interfaces STM presents three different user three interfaces an X Windows interface xstm a menu based interface mstm and a command based interface cstm Each STM inte...

Page 348: ...60 as two icons labeled A5277A Array See figure Figure 89 Each icon represents one of the disk array controllers which are identified by their hardware paths Click on the icon for the disk array you will be testing Navigation through xstm is done using menus and submenus For more information on navigating in xstm download a copy of the STM Quick Reference Guide from the Systems Hardware Diagnostic...

Page 349: ...screens To navigate from one portion to another portion of the same screen use the Prev and Next keys or alternatively the Cursor Up and Cursor Down keys Navigating the menu bar The following methods are used to navigate the menu bar Position the cursor on the menu bar Use the Tab key or the MenuBar on off function key Move to a particular pulldown menu Use the cursor arrow keys Expand a menu sub ...

Page 350: ...350 Support Tools Manager Figure 90 mstm Interface Main Window ...

Page 351: ... the appropriate device log for more information Failure Log If the results indicate Failure view the device Failure Log for information identifying the likely cause of the failure and recommended action for correcting the problem Test Activity Log If the results are other than Successful or Failure view the Test Activity Log for an explanation of what occurred Table 45 Available Support Tools Too...

Page 352: ...ws 1 At the system prompt Type xstm 2 Click on the desired A5277A Array device icon 3 To run the Information Tool and view the Information log From the menu bar select Tools Select Information Select Run The Information Tool builds and displays the Information log Select Done when done viewing the log 4 To view the Activity log From the menu bar select Tools Select Information Select Activity Log ...

Page 353: ...s Enter 3 To run the Information Tool and display the Information log From the Menubar select Tools Select Information Select Run The Information Tool builds and displays the Information log Select Done when done viewing the log 4 To view the Activity log From the Menubar select Tools Select Information Select Activity Log Select Done when done viewing the log 5 To exit STM From the Menubar select...

Page 354: ... about each disk Much of the information is self explanatory but if you need assistance interpreting any fields a complete online description is available by performing the following steps 1 Run the Information tool on the desired disk array as described in the preceding section 2 Return to the main STM window and select the Tools menu 3 Select Information 4 Select Info The Information Log Descrip...

Page 355: ...form tasks using the Expert Tool the status of each operation is displayed in the main window The Expert Tool window also provides a status of the activities performed on the selected device Running Expert Tool in X Windows 1 At the system prompt Type xstm 2 Click on the A5277A ARRAY device icon 3 To run the Expert tool From the menu bar select Tools Select Expert Select Run 4 Perform the desired ...

Page 356: ...s to get to Menubar Select Tools Select Expert Tool Select Run 4 Perform the desired operation using the Expert Tool menus The Expert Tool menu options are listed in Table 46 5 To exit Expert Tool Select Menubar on or use arrow keys to get to Menubar Select File Select Exit Select Yes Expert Tool Menu Options xstm and mstm When using xstm or mstm all Expert Tool functions are accessed from a serie...

Page 357: ... LUN NA Bind selected disk modules into a LUN with a specified RAID level Unbind LUNs NA Unbind a LUN Replace LUN Zero NA Unbind and rebind LUN 0 Hot Spares Create Create hot spares Delete Delete hot spares Flash Component Lights Drive Flash Fault LED on selected disk LUN Flash Fault LEDs on all disks in the selected LUN Disk Enclosure Flash Fault LEDs on all disks in the selected disk enclosure A...

Page 358: ...358 Support Tools Manager ...

Page 359: ...ng 359 6 TROUBLESHOOTING Introduction 360 Disk Array Installation Troubleshooting Checklist 365 Power Up Troubleshooting 366 Controller Enclosure Troubleshooting 367 SureStore E Disk System SC10 Troubleshooting 376 ...

Page 360: ...ting Some of the FRUs are customer replaceable Other array components can be replaced in the field but only by a trained service representative A complete list of product and part numbers are included in Replaceable Parts on page 418 CAUTION To ensure proper operation disk array controller modules and disk modules should not be removed or replaced when disk array power is off Also disk modules sho...

Page 361: ...ld Replaceable Units Field Replaceable Units Customer Replaceable Unit Hot Swappable Modules Disk Enclosure Disk Modules Yes Yes BCC Bus Controller Card Modules Note disk enclosure should be powered down when replacing the BCC No Power Supply Modules Yes Yes Disk Fan Modules Yes Yes Controller Enclosure Controller Modules No Yes Media Interphase Adapter MIA Yes Yes Battery Backup Module Yes Yes Co...

Page 362: ...r 60 software includes a set of tools for troubleshooting the disk array See the HP Storage Manager 60 NT User s Guide for information on using the HP Storage Manager 60 software EMS Hardware Event Monitoring HP UX Only EMS hardware monitoring is one the most important troubleshooting tools available for the Disk Array FC60 With EMS monitoring you can be alerted to problems as they occur allowing ...

Page 363: ... the event Critical An event that causes host system downtime or other loss of service Host system operation will be affected if the disk system continues to be used without correction of the problem Immediate action is required Serious An event that may cause host system downtime or other loss of service if left uncorrected Host system and hardware operation may be adversely affected The problem ...

Page 364: ...losure 10_12 8 0 255 0 10 0 is 1 Its current value is CRITICAL 5 Event data from monitor Event Time Thu Aug 6 15 18 03 1998 Hostname yourserver rose hp com IP Address 15 43 212 175 Event ID 0x0035ca2b9b00000002 Monitor dm_ses_enclosure Event 101 Event Class I O Severity Critical Enclosure at hardware path 10 12 8 0 255 0 10 0 Hardware failure Associated OS error log entry id s None Description of ...

Page 365: ...hortest possible fibre optic cable lengths between disk arrays and host adaptors Check Disk Array Pre Power Up All modules properly seated in the disk array enclosures Disk modules in their proper slots Check Disk Array Functionality and Configuration Following power up Date and time synchronized with the host No fault indicators on any disk array components All disk modules spun up LUN 0 replaced...

Page 366: ...n the controller batteries if the batteries are fully charged If the batteries are not fully charged the Full Charge LEDs will flash until charging is complete and then remain on The Power LEDs on the controller enclosure Disk enclosure The green Power Supply LEDs Fan LEDs If the power up sequence fails the appropriate amber Fault LED will be on identifying the failing component If the power up te...

Page 367: ...s being supplied to the disk array power supply modules Check the input AC power to the disk array See Applying Power to the Disk Array on page 198 for information on powering up the disk array Controller Enclosure Troubleshooting Introduction This section contains information on identifying problems with the disk array controller enclosure ...

Page 368: ...es for all components within the controller enclosure Figure 92 Controller Enclosure LEDs A Power On LED B Power Fault LED C Fan Fault LED D Controller Fault LED E Fast Write Cache LED F Controller Power LED G Controller Fault LED H Heartbeat LED I Status LEDs J Fault B LED K Full Charge B LED L Fault A LED M Full Charge A LED N Power 1 LED O Power 2 LED P Fan Power LED Q Fan Fault LED ...

Page 369: ...ult Off Heartbeat Blink green Status Green There are 8 status LEDs The number and pattern of these LEDs depend on how your system is configured Controller Battery Fault B Off Full Charge B On green 1 Fault A Off Full Charge A On green 1 Controller Power Assembly Power 1 On green Power 2 On green Controller Fan Assembly Fan Power On green Fan Fault Off 1 Both Full Charge A and Full Charge B LEDs ar...

Page 370: ...s failed Replace the memory modules If the Fault LED remains ON after replacing the memory go to cause D D Controller enclosure midplane failed Replace the midplane If the Fault LED remains ON after replacing the midplane call the factory service center Software issued a controller error message Controller failed Check the Fan Fault LED on the front cover If it is on go to Troubleshooting Controll...

Page 371: ...LED is on replace the failed controller Midplane Power LEDs front and power supply FRUs are ON but all other Power LEDs are off Other FRUs are missing or not installed correctly Check all FRUs in the controller enclosure and make sure they are installed securely If this does not solve the problem go to cause B Defective DC power harness or power interface board Replace the DC power harnesses and t...

Page 372: ...and other devices on the network Make sure they are undamaged particularly fiber optic cables and securely attached D Improper ID settings Make sure that the Fibre host IDs and SCSI disk enclosure IDs are set properly for all devices particularly if you just removed or added a new device to the network E Failed controller enclosure or disk Check the controller enclosure for a controller module fau...

Page 373: ...on Even if the fans in the controller module are operating an obstructed air flow path or a high ambient temperature can cause the temperature within the enclosure to rise Determine what is causing the temperature problem and correct it No LEDs ON Controller fan module is unplugged or has failed 1 Make sure the controller fan module is plugged in correctly Reseat the module if necessary 2 If the P...

Page 374: ...BBU is missing Replace the BBU Power Supply Module No power to the controller module all Power LEDs off Power switches are turned off Turn ON both power switches on the controller enclosure Turn ON the main circuit breakers in the rack if applicable Power cords unplugged Make sure all power cords are plugged in securely Power supply modules overheated or failed Lower the room temperature if it is ...

Page 375: ... Lower the room temperature if it is too high unblock enclosure vents if they are obstructed replace any failed fans in the enclosure or replace the power supply module The LEDs on both power supply modules are ON but all other LEDs are off A Defective DC Power Harness Replace the DC Power Harnesses If this does not resolve the problem go to cause B B Defective Power Interface Board Replace the po...

Page 376: ...perating LED states for all components within the disk enclosure Losing LUN 0 If LUN 0 becomes unavailable because of multiple disk failures Array Manager 60 may not be able to communicate with the disk array If this occurs replace the failed disks as quickly as possible When the disk are replaced it may be necessary to replace LUN 0 recreating it in its original configuration CAUTION If LUN 0 is ...

Page 377: ... System Power Green Power is on Normal operation OFF Power is off System Fault Amber Self test1 Problem2 OFF Normal operation Flashing BCC A B DIP switch settings do not match A System fault LED B System power LED C Disk activity LED D Disk fault LED E Power On LED F Term Pwr LED G Full Bus LED H BCC Fault LED I Bus Active LED J LVD LED K Fan Fault LED ...

Page 378: ...tion Amber Startup1 Fault OFF Power is off Power Supply Green Normal operation Amber Startup1 Fault OFF Power is off Disk Fault OFF Disk is operating normally Amber A fault has occurred with the disk Flashing Used to identify a disk using the software management tools Disk Activity3 Flashing Indicates that the disk is being accessed by the disk array 1 Startup and self tests occur briefly when the...

Page 379: ...re identified in Table 51 Table 51 Status Indications by Component Component Status Disks BCCs Fans Power Supplies Sensors AM60 Good STM Optimal Component is installed and no error conditions are known AM60 Critical STM Fault 2 N A Hardware has failed Voltage temperature exceeds critical limit AM60 Non critical STM Fault 3 N A BCC A and B have different firmware versions N A Voltage temperature ex...

Page 380: ...essed AC breaker is tripped AC power source has failed The PDU PDRU is defective Power switch is defective A faulty component is causing power supplies to turn off Remove all components and reinsert one at a time until the faulty component is isolated System fault LED is on none Power Supply LED off Power supply Not Available The power supply is not plugged in The PDU PDRU or primary power source ...

Page 381: ...perature sensor is faulty Compare temperature reported by peer BCC Major Warning none Non critical Temp is 36º C Temperature sensors are on the BCC and are independent of power supplies Investigate temperature warnings immediately before power supplies sense critical temperature and turn off Temperature is under limit Critical none Critical Temp is 9 5º C Room temperature is too low Temperature se...

Page 382: ...or Warning none Both BCCs Non critical Firmware on BCC A and BCC B are different versions none Not Available Internal bus is faulty Contact HP technical support to replace midplane Table 52 Disk Enclosure Troubleshooting Table cont d Problem Description HW Event Category LED State Status Probable Cause Solution ...

Page 383: ...Removal and Replacement 383 7 REMOVAL AND REPLACEMENT Overview 384 Disk Enclosure Modules 386 Controller Enclosure Modules 396 ...

Page 384: ...es Disk Array Controller Enclosure Battery Backup Module Controller Fan Module Power Supply Modules Power Supply Fan Module All modules other than those listed above must be replaced by a trained service representative Note What is a hot swappable component The term hot swappable identifies a component that can be removed and replaced without disrupting host access to the disk array Host I Os cont...

Page 385: ...nt of hot swappable components Customer repair should be performed only in situations where a representative is not available or system operation may be impacted if repair is not performed immediately The HP SureStore E Disk Array FC60 is fully covered by a warranty from Hewlett Packard Additional support services may have also been purchased for the disk array During the warranty period or if the...

Page 386: ...uitry Do not remove a disk module or filler module until you have a replacement An empty slot will disrupt the cooling airflow within the enclosure and may cause overheating To avoid removing the wrong disk it is recommended that you identify the disk by flashing its amber Fault LED Identifying a disk can be done using the management software tools Removing the wrong disk can cause data to become ...

Page 387: ...moving a Disk Module or Filler Module 1 Unlock and open the disk enclosure door 2 If removing a disk module insert the plug end of your ESD wrist strap in the disk enclosure ESD socket A in Figure 94 3 Release the module by squeezing the latch tab B in Figure 94 and sliding the module part way out of the enclosure CAUTION While the disk is spinning it is vulnerable to damage Wait for the disk to s...

Page 388: ...Disk Module Removal Installing a Disk Module or Filler Module CAUTION Touching the disk circuit board can cause high energy discharge and damage the disk Disksmodulesarefragileandshouldbehandledcarefully A ESD plug in B cam latch C handle ...

Page 389: ... the replacement disk from its ESD bag being careful to grasp the disk by its handle A in Figure 96 2 Pull the cam latch B away from the disk module 3 Mark the slot number that the disk is being installed into on the Slot Location Map on the top of the disk module See Figure 95 This facilitates reinstalling the disk module in the correct slot Figure 95 Disk Slot Identification Label Note Use both ...

Page 390: ... off The green disk Activity LED should blink for a few seconds and then go out If the host begins to access the disk the Activity LED will flash If this behavior does not occur refer to chapter 6 Troubleshooting for information on identifying and solving the problem 7 Unplug the ESD strap and close and lock the disk enclosure door 8 Disable WCE on the new disk module using the following command a...

Page 391: ...Disk Enclosure Modules 391 Removal and Replacement Figure 96 Disk Module Replacement A handle B cam latch C capacity label D LEDs ...

Page 392: ...cooling However if the remaining fan module fails before the defective fan is replaced the disk enclosure must be shut down to prevent heat damage CAUTION Do not remove a disk fan module until you a replacement An empty slot will disrupt the cooling airflow within the enclosure and may cause overheating Removing the Fan Module 1 Loosen the two module locking screws A in Figure 97 2 Slide the fan m...

Page 393: ...dule 1 Slide the replacement fan module into the empty slot C in Figure 97 2 Tighten the locking screws A 3 Check the fan module LED for the following behavior The Fan Fault LED should flash amber and then turn green after a few seconds If the LED does not turn green refer to Troubleshooting on page 359 B A Locking screw B Pull tab ...

Page 394: ... replaced all power will be lost to the disk enclosure CAUTION Do not remove a power supply module until you have a replacement An empty slot will disrupt the cooling airflow within the enclosure and may cause overheating Removing the Power Supply Module 1 Disconnect the power cord to the power supply 2 Loosen the screw B in Figure 98 from the power supply handle A 3 Pull the handle down to diseng...

Page 395: ...inch 8 mm still exposed 2 Swing the handle upward to seat the power supply into the backplane The power supply should be flush with the chassis 3 Tighten the screw B in the power supply handle A 4 Plug the power cord into the power supply and electrical source 5 Check the Power Supply LED It should then turn green If the LED remains off or is amber see chapter 6 Troubleshooting for information on ...

Page 396: ...d in these descriptions The controller modules the controller fan module and the BBU are accessed from the front of the controller enclosure Access to these modules requires that the front cover be removed The power supply modules and the power supply fan module are accessed from the rear of the controller enclosure CAUTION Do not remove a module from the controller enclosure until you are ready t...

Page 397: ...er module the controller fan module or the battery backup unit BBU the front cover must be removed Removing the Front Cover 1 Pull the bottom of the cover out about one inch to release the pins See Figure 99 2 Slide the cover down one inch and pull it away from the controller enclosure Figure 99 Controller Enclosure Front Cover Removal and Replacement 1 2 ...

Page 398: ...closure without adequate ventilation and cooling to the controller modules Operating without proper cooling to the controller modules may damage them You must shut down the controller enclosure to avoid overheating if you anticipate needing more than 15 minutes to replace the fan module Removing the Controller Fan Module 1 Remove the controller enclosure front cover See Front Cover Removal Replace...

Page 399: ...en the screw 2 Check the system LEDs on the controller fan module for the following behavior The green Power LED should be on and the Fan Fault LED should be off If the Fan Fault LED turns on or the Power LED remains off make sure that the controller enclosure fan module is inserted all the way into the chassis and the thumbscrew is tight If the Fan Fault LED remains on it may indicate a problem w...

Page 400: ...he Fast Write Cache LED is off before replacing the BBU Removing the BBU 1 Remove the controller enclosure front cover See Front Cover Removal Replacement on page 397 2 Loosen the four screws two on each side on the BBU See Figure 101 CAUTION The BBU weighs approximately 24 pounds so be prepared to support its weight when you pull it out of the chassis The BBU is not as deep as other modules and d...

Page 401: ...Controller Enclosure Modules 401 Removal and Replacement Figure 101 BBU Removal and Replacement ...

Page 402: ...ate of Installation b Record the expiration date two years from the current date on the line next to Replacement Date 3 Slide the new BBU into the slot and tighten the screws See Figure 101 4 Install the controller enclosure front cover See Front Cover Removal Replacement on page 397 5 Allow the system to run up to 7 hours to properly charge the BBU The Full Charge LEDs will flash while the BBU is...

Page 403: ...adequate ventilation and cooling to the power supplies Operating the power supplies without proper cooling may damage their circuitry You must shut down the controller enclosure to avoid overheating if you take more than 15 minutes to remove the Controller Fan Module and insert the new one Removing the Power Supply Fan Module 1 Gain access to the rear of the disk array controller enclosure 2 Lift ...

Page 404: ... up on the ring latch and push in on the module until it snaps into place 2 Check the module LEDs for the following behavior The green Fan Power LED should be on and the amber Fan Fault LEDs should be off If the Power LED remains off or the Fault LED turns on make sure the power supply fan module is inserted all the way into the chassis and locked in place If the Fault LED remains on the new power...

Page 405: ...e possibility of the remaining supply failing and shutting down the disk array Removing the Power Supply Module 1 Turn off the power switch and unplug the power cord from the failed power supply module See Figure 104 2 Lift up on the pull ring to release the latch See Figure 105 3 Slide the supply out of the enclosure Figure 104 Removing Power from the Controller Enclosure A Power Switch ...

Page 406: ... the slot until it is fully seated and the latch snaps into place 2 Plug in the power cord and turn on the power See Figure 104 3 Check the power supply module LED for the following behavior The Power LED should go on Once the power supply in installed and operating there may be a delay of up to several minutes before the Power Fault LED goes off ...

Page 407: ...he cable from the controller enclosure first then from the failed BCC DO NOT disk connect the SCSI cable from the BCC first or errors may occur when the enclosure is powered on 3 Remove the SCSI cable from the controller enclosure connector 4 Remove the SCSI cable from the BCC 5 Connect the SCSI cable to the BCC connector 6 Connect the other end of the SCSI cable to the controller enclosure SCSI c...

Page 408: ...Initially the disk modules status will be either write failed or no_response Eventually all the disk modules should return to replaced status Once this occurs the disk array will perform a rebuild a result of I O occurring during the period the enclosure was powered off The disk array will operate at reduced performance until the rebuild is completed ...

Page 409: ...TORY Models and Options 412 PDU PDRU Products 417 Replaceable Parts 418 A5277A AZ Controller Enclosure Specifications 420 A5294A AZ Disk Enclosure Specifications 424 Warranty and License Information 428 Regulatory Compliance 434 FCC Statements USA Only 435 ...

Page 410: ... Windows NT 4 0 with Service Pack 4 5 or 6 Table 53 Supported HP UX Host Platform Information Supported Host Boot Support on HP UX 11 x Fibre Channel I O Adapter K class Yes A3404A V class Yes A5158A A3740A L class Yes A5158A A3740A D class Yes A3591B N class Yes A5158A A3740A R class Yes A3591B T class No A3636A C class No A5158A on HP UX 11 x A3740A on HP UX 10 20 A4xx A5xx class Yes A5158A ...

Page 411: ...0001 1063 Mbps short wave non OFC D R class A3591A number A3395 60001 1063 Mbps short wave non OFC T 600 class A3636A number A3329 60107 1063 Mbps short wave non OFC V class A3740A number A3740 60001 1063 Mbps short wave non OFC Windows NT 4 0 and 2000 See the HP Storage Manager 60 User s Guide for a list of supported host adapters ...

Page 412: ...sonnel This model can be ordered with up to six A5294A disk enclosures A5277AZ is a factory racked controller enclosure integrated into the specified rack This model must be ordered with from one to six A5294AZ disk enclosures Both models include the following components except as indicated Rackmount enclosure Two controller modules with 256 Mbytes of cache single controller available Two power su...

Page 413: ...e cache and two Media Interface Adaptors Configured with Windows NT 2000 firmware and Windows NT NVSRAM Includes Storahe 304 Two controller modules with 512 Mbyte cache and two Media Interface Adaptors Configured with HP UX firmware 305 Two controller modules with 512 Mbyte cache and two Media Interface Adaptors Configured with Windows NT firmware Host Connect Cable Options 0Z4 2 meter Fibre Chann...

Page 414: ...ack with the A5227AZ controller This product may only be ordered in conjunction with A5277AZ controller enclosure To order a disk enclosure SC10 without integration into an array order A5272AZ Both models include the following components except as indicated SC10 Rack mount enclosure accommodates 10 1 6 or 1 disk modules Two power supplies Two fan modules Two power cords Two bus controller cards BC...

Page 415: ...e identical Storage Capacity Options 104 4 9 Gbyte 10K rpm disk drives 108 8 9 Gbyte 10K rpm disk drives 110 10 9 Gbyte 10K rpm disk drives 204 4 18 Gbyte 10K rpm disk drives 208 8 18 Gbyte 10K rpm disk drives 210 10 18 Gbyte 10K rpm disk drives 304 4 36 Gbyte 10K rpm disk drives 308 8 36 Gbyte 10K rpm disk drives 310 10 36 Gbyte 10K rpm disk drives 504 4 18 Gbyte 15K rpm disk drives 508 8 18 Gbyt...

Page 416: ...or MIA Must also order Option 002 for 256 Mbytes of cache 002 256 Mbyte cache option for A5278A A5279A Controller cache 512 Mbyte upgrade kit Includes two 256 Mbyte DIMMs A5306A 2 m VHDCI to VHDCI SCSI Cable M M A5307A 5 m VHDCI to VHDCI SCSI Cable M M A5308A 10 m VHDCI to VHDCI SCSI Cable M M A5250A Rail kit for HP legacy cabinets C2785A C2786A C2787A A1896A and A1897A A5251A Rail kit for HP Rack...

Page 417: ... 19 inch 200 240 V 16 Amp 2 C20 inlets 2 C19 outlets switch accessory E7681A 19 inch 200 240 V 30 Amp L6 30P 2 C19 8 C13 outlets switch accessory E7682A 19 inch 200 240 V 30 Amp IEC 309 2 C19 2 C13 outlets switch accessory E4452A 36 inch 220 V 16 Amp L6 20P 6 C 13 outlets E4453A 36 inch 220 V 16 Amp no plug 6 C 13 outlets E5933A 36 inch 110 220 V 16 Amp UPS IEC 320 10 C 13 outlets E4456A B 60 inch...

Page 418: ... NT NVSRAM settings A5635 69002 A5278 60002 128 MB DIMM n a 5065 5201 256 MB DiMM n a A5278 60004 16MB SIMM Module n a A5277 60009 Battery Backup Module A5277 69009 A5277 60003 Controller Fan Module n a 1 Controller modules have operating specific firmware installed and are not interchangeable The HP UX 3 5v controller A5278 60006 can be upgraded to a Windows NT 2000 controller A5635 60002 using t...

Page 419: ...ord n a A5236 60003 Fan n a A5236 60023 Power supply A5236 69023 A5272 67004 Bus Control Card BCC A5272 69004 A5236 60009 Disk filler assembly n a A5276 67001 9 1 Gbyte disk drive module 10K rpm Ultra 2 LVD A5276 69001 A5282 67001 18 2 Gbyte disk drive module 10K rpm Ultra 2 LVD A5282 69001 A5633 67001 18 2 Gbyte disk drive module 15K rpm Ultra 2 LVD A5633 69001 A5595 67001 36 4 Gbyte disk drive m...

Page 420: ...ght Width Depth 6 75 inches 17 1 cm 17 5 inches 44 5 cm 24 inches 61 cm Component Weight of Each lbs Quantity Subtotal lbs Controller modules 6 6 2 13 2 Controller Fan 1 9 1 1 9 Battery 21 4 1 21 4 Power Supply 3 3 2 6 6 Power Supply Fan 1 5 1 1 5 Front Cover 2 1 2 Chassis 31 6 1 31 6 Controller Enclosure Total 78 lbs ...

Page 421: ...gle phase 230 VAC 220 240 VAC 50 to 60 Hz single phase Auto ranging Current Power Consumption Heat Output 615 BTU hr Voltage Typical Operating Current Maximum Operating Current In Rush Current 100 127 VAC 1 5 A 2 3 A 21 7 A 220 240 VAC 0 8 A 1 2 A 42 9 A Incoming Voltage AC RMS Typical Power Consumption 100 127 VAC 180 watts 200 240 VAC 180 watts ...

Page 422: ...iability for the disk array The following specifications were type tested under controlled conditions Hewlett Packard maintains an active program of auditing production products to ensure these specifications remain true when products are again tested under the same conditions The limits of these specifications do not represent the optimum for long trouble free operation and are specifically not r...

Page 423: ...r hour Relative humidity 10 to 90 RH 28º C wet bulb Altitude 4572 m 0 15 000 ft Acoustics Meets or exceeds all known international acoustics specifications for computing environments Battery Back Up Module Disposal The BBU contains batteries that may be harmful to the environment if not disposed of properly Please follow the local state or country regulations regarding the proper disposal of these...

Page 424: ...Dimensions Weight Height Width Depth 5 91 in 15 0 cm 18 9 in 48 0 cm 27 2 in 69 1 cm Component Weight of Each lbs Quantity Subtotal lbs Disk Drive HH 2 8 10 28 Fan 3 3 2 7 Power Supply 10 6 2 22 BCC 4 5 2 9 Midplane Mezzanine 6 1 6 Door 2 1 2 Chassis 35 1 35 Total Approx 110 lbs 50 kg ...

Page 425: ...onsumption DC Power Output Disk 5 V and 12 V from power supply BCC 5 V and 12 V from power supply 3 3 V self generated Fan 12 V from power supply Heat Output 2200 BTU hr Voltage Typical Current Maximum Current 100 127 VAC 4 8 a 6 5 a 220 240 VAC 2 4 a 3 2 a 50 60 Hz single phase power factor corrected Incoming Voltage AC RMS Typical Power Consumption 100 127 VAC 347 watts 200 240 VAC 347 watts ...

Page 426: ... stressful operating environment Operating within the recommended operating range ensures maximum reliability for the disk array The following specifications were type tested under controlled conditions Hewlett Packard maintains an active program of auditing production products to ensure these specifications remain true when products are again tested under the same conditions The limits of these s...

Page 427: ...ting within the recommended operating range a less stressful operating environment ensures maximum reliability The environmental limits in a nonoperating state shipping and storage are wider Temperature 40º C to 70º C 40º F to 158º F Maximum gradient 24º C per hour 43 2º F per hour Relative humidity 15 to 90 noncondensing Altitude 4600 m 15 000 ft Acoustics Sound power 6 4 Bels Sound pressure at o...

Page 428: ...easonable amount of time Customer s alternate remedy will be a refund of the purchase price upon return of the HP SureStore E Disk Array FC60 Replacement Parts Warranty HP replacement parts assume the remaining warranty of the parts they replace Warranty life of a part is not extended by means of replacement Items Not Covered Your HP SureStore E Disk Array FC60 warranty does not cover the followin...

Page 429: ...refund of the purchase price license fee upon return of the product and all copies Removable Media if supplied HP warrants the removable media if supplied upon which this product is recorded to be free from defects in materials and workmanship under normal use for a period of NINETY 90 DAYS from the date of purchase In the event the media proves to be defective during the warranty period Customer ...

Page 430: ...o have serviced your computer equipment Limitation of liability and Remedies In no event will HP or its affiliates subcontractors or suppliers be liable for any of the following 1 Damages for loss of data or software restoration 2 Damages relating to Customer s procurement of substitute products or services i e cost of cover 3 Incidental special or consequential damages including lost profits loss...

Page 431: ...ternal Code LIC The LIC including any updates or replacements any LIC utility software and Supplier s software are collectively referred to as Software HP or its Suppliers own the copyrights in the Software and all copies of the Software HP distributes the Software under license The following Terms and Conditions shall govern the Software and Customer s use of the Software 1 DEFINITIONS a Software...

Page 432: ...ment product becomes operable You must reproduce all copyright notices in the original Software on all copies You may not copy the Software onto any public or distributed network No Disassembly or Decryption You may not disassemble decompile or reverse engineer the Software without HP s prior written consent Where you have other rights under statute you will provide HP with reasonably detailed inf...

Page 433: ...t of Defense on non Department of Defense U S Government contract c Any term of this Agreement which is held to be invalid will be deleted but the remainder of the Agreement will not be affected d Neither party may assign any rights or obligations without prior written consent of the other party e Customer who exports Products assumes responsibility for complying with applicable laws and regulatio...

Page 434: ...Compliance Regulatory Compliance Safety Certifications UL listed CUL certified TUV certified with GS mark Gost Certified CE Mark EMC Compliance US FCC Class A CSA Class A VCC1 Class A BCIQ Class A CE Mark C Tick Mark ...

Page 435: ...io communications Operation of this equipment in a residential area is likely to cause harmful interference in which case the user will be required to correct the interference at his own expense The end user of this product should be aware that any changes or modifications made to this equipment without the approval of the manufacturer could result in the product not meeting the Class A limits in ...

Page 436: ...echnology equipment based on the rules of Voluntary Control Council For Interference by Information Technology Equipment VCCI When used in a residential area radio interference may be caused In this case user may be required to take appropriate Harmonics Conformance Japan Class A Warning Statement Taiwan ...

Page 437: ...ices suivants Comité de Coordination des Télécommunications 20 avenue de Ségur 75700 PARIS Préfecture du département du lieu d exploitation Le formulaire à utiliser est disponible auprès des préfectures La déclaration doit être faite dans les 30 jours suivant la mise en exploitation Le non respect de cette obligation peut être sanctionné par les peines prévues au code des Postes et Télvcommunicati...

Page 438: ...Am fiktiven Arbeitsplatz nach DIN 45635 T 19 Die Daten sind die Ergebnisse von Typprüfungen an Gerätekonfigurationen mit den höchsten Geräuschemissionen 12 Plattenlaufwerke Alle andere Konfigurationen haben geringere Geräuschpegel Für weitere Angaben siehe unter Umgebungsbedingungen ...

Page 439: ...D IEC 801 3 1984 prEN 55024 3 1991 3 V m IEC 801 4 1988 prEN 55024 4 1992 1 kV Power Lines 0 5 kV Data Line IEC 801 5 1992 IEC 61000 4 5 1995 2 kV OC 1 kV SC Common Mode 1 kV Peak Differential Mode IEC 61000 3 2 1997 EN 61000 3 2 1995 Harmonic Current IEC 61000 3 3 1994 EN 61000 3 3 1995 Voltage Fluctuations and Flicker IEC 61000 4 6 1996 EN 61000 4 6 1996 Conducted Immunity GB9254 1988 Supplement...

Page 440: ...440 FCC Statements USA Only ...

Page 441: ...er in the disk array Auto failover allows uninterrupted access to all user data with no downtime The failed controller can be removed then replaced by a new array controller without any downtime loss of data or interruption to the host computer system battery backup unit BBU A hardware component providing up to 5 days 120 Hours of backup power to the disk array should power be lost The BBU power m...

Page 442: ... of temporarily storing data in RAM on the disk array controller to improve performance during an I O By using higher speed RAM whenever possible I Os can be executed faster than accessing the disk cascaded FC AL hubs One FC AL hub connected to another FC AL hub to increase arbitrated loop distances Cascaded hubs allow distances up to 500 meters between hubs or between a hub and a device channel O...

Page 443: ...ebuild the original data if a disk fails or becomes inaccessible Data redundancy is achieved using one of two techniques mirroring or parity data transfer rate Data transfer rate is the speed at which data is transferred between a host computer system and a peripheral degraded mode The operating mode a LUN enters when if a disk fails or becomes inaccessible In degraded mode the LUN must recreate t...

Page 444: ...mblies used in the disk array Each module houses a single disk Up to ten disk modules can be installed in each disk system disk striping A performance enhancing technique in which data is distributed in uniformly sized segments across all the disks in a LUN Striping allows multiple sets of read write heads to simultaneously execute an I O resulting in improved performance RAID 5 LUNs use disk stri...

Page 445: ...ch data in the form of light pulses is transmitted by laser or LED Fibre optic cable is used for high speed transmission over medium to long distances Fibre Channel Logically a bidirectional full duplex point to point serial data channel structured for high performance capability Physically Fibre Channel interconnects devices such as host systems and servers FC hubs and disk arrays through ports c...

Page 446: ...e number of loop connections and the distances between the host system s and disk array s A maximum of ten devices can be connected to each FC AL hub Fibre Channel Protocol for SCSI FCP FCP defines a high level Fibre Channel mapping layer FC 4 using lower level Fibre Channel FC PH services to transmit SCSI command data and status information between a SCSI initiator and a SCSI target across the Fi...

Page 447: ...il a disk failure occurs A global hot spare is a dedicated on line backup disk that cannot be used to store user data during normal disk array operation If any disk in a LUN fails the disk array automatically begins rebuilding the failed disk s content on an available global hot spare When the rebuild process completes the LUN functions normally using the global hot spare as a replacement for the ...

Page 448: ...do not provide data redundancy The disk systems on the disk array are JBOD devices but when connected to the disk array controllers they provide data redundancy through the use of RAID technology link In Fibre Channel two unidirectional fibres transmitting in opposite directions and their associated transmitters and receivers that serve as the communication media between nodes in a topology A link...

Page 449: ...a Loop ID Major Event Log A more detailed logging method implemented on HP08 and later firmware Major event logging requires that the UTM be enabled MIA Media interface adapter a device that allows you to connect fiber optic cable to a copper wire connector mirrored disks A mirrored disk is an exact copy of another disk Mirrored disk are used when implementing the data redundancy technique of mirr...

Page 450: ...addressing technique used by the host to address the disk array controllers Because it is limited to addressing only eight LUNs PDA has been superseded by VSA as the technique for addressing disk array LUNs point to point One of three existing Fibre Channel topologies in which two devices are directly connected by a link with no fabric loop or switching elements present port The hardware entity th...

Page 451: ... but does not provide any data redundancy RAID 0 should only be used for non critcal data storage RAID 1 A RAID level in which the LUN uses a single mirrored pair of disks One disk serves as the data disk and the other serves as the mirror disk RAID 0 1 A RAID configuration in which the LUN uses both mirroring for redundancy and disk striping for performance Half the disks serve as the data disks ...

Page 452: ...ration and management utility SCSI An acronym for Small Computer System Interface SCSI is an industry standard protocol for connecting peripherals and hosts over a bus topology SCSI 2 bus A bus that complies with the SCSI standard The six channel that connect the disk array controller system to the disk systems are SCSI 2 busses Each disk system has two internal SCSI 2 busses that can be configure...

Page 453: ...y configuration management and diagnostics stripe boundary crossing In disk striping if the stripe segment size is too small for a single I O operation the operation requires access to two stripes Called a stripe boundary crossing this event reduces I O performance stripe segment size The amount of information simultaneously read from or written to each disk in a LUN using disk striping The defaul...

Page 454: ...everses the LUN binding process deleting the LUN and returning the disk in the LUN to the unassigned disk group Unbinding destroys all data on the LUN Uninterruptible Power Supply UPS An Uninterruptible Power Supply is a power supply that is capable of maintaining power even if the input ac mains supply loses its source of power Universal Transport Mechanism UTM A special LUN reserved for communic...

Page 455: ...using Array Manager 60 297 assigning using SAM 264 alternate data path 64 alternate LUN path definition 64 AM60Srvr starting 241 AM60Srvr daemon 241 amcfg binding a LUN 289 changing LUN ownership 293 unbinding a LUN 292 amdsp checking rebuild progress 305 listing disk arrays 292 amlog viewing logs 309 ammgr adding hot spare 296 assigning an alias 297 displaying parity scan status 307 halting parit...

Page 456: ...280 listing for all arrays 288 assigning LUN ownership 247 B backplane controller card See BCC module basic topology 102 103 error recovery 108 batteries See battery backup module battery age resetting 312 battery backup module cache protection 46 described 45 life expectancy 46 removal and replacement 400 battery charger See battery backup module BCC module described 29 troubleshooting 380 bindin...

Page 457: ...ribed 43 power supply modules described 42 specifications 420 voltage 421 weight 420 controller enclosure modules described 34 controller fan module described 40 removal and replacement 398 controller memory modules DIMM 40 SIMM 40 controller module described 38 interface connectors 39 LEDs described 39 controller time synchronizing with host 297 cstm described 351 current disk enclosure 425 inrus...

Page 458: ...disk array status checking using Array Manager 60 282 checking using SAM 260 checking using STM 314 disk drives See disk modules disk enclosure acoustics 427 adding 256 current 425 described 23 dimensions 424 heat output 425 hot swappable modules 27 installation 160 moving 168 operating with empty slot 28 operation features 25 options 414 power 425 power input specifications 421 power on switch 19...

Page 459: ...ations See recommended array configurations fan troubleshooting 381 fan module troubleshooting 380 fan module disk enclosure described 31 fault detection 31 removal and replacement 392 fast write cache LED 40 FC AL See Fibre Channel Arbitrated Loop Fibre Channel controller modules 39 host connections 39 hub connection 71 IO adapters and drivers 146 throughput 71 Fibre Channel Arbitrated Loop 102 1...

Page 460: ...pology 115 high availability distance and capacity topology 120 single system distance topology 110 HP UX boot device 222 I I Os per second performance 74 identifying disk modules 244 using Array Manager 60 292 increasing capacity of a LUN 245 of the disk array 254 information log STM 354 Information Tool 352 interpreting information log 354 using menu mode 353 using X windows 352 in rush current ...

Page 461: ...data paths 64 M management software disk array 213 system requirements 213 management tools 20 238 managing disk array capacity 242 managing LUNs using Array Manager 60 289 using SAM 267 using STM 314 menu based interface See mstm MIA installation 197 mirroring described 47 missing LUN 0 376 models and options controller enclosure 412 modules controller enclosure 34 disk enclosure 27 moving a disk...

Page 462: ... controller enclosure described 43 removal and replacement 403 power supply module LEDs 395 power supply module controller enclosure described 42 removal and replacement 405 power supply module disk enclosure described 32 load sharing 32 removal and replacement 394 power switch controller enclosure 200 disk enclosure 199 disk enclosure location 26 power controller enclosure redundancy controller e...

Page 463: ...re 394 SCSI cables 407 removing a global hot spare using Array Manager 60 296 using SAM 275 using STM 315 replacing a LUN using Array Manager 60 294 using SAM 271 replacing disk modules with higher capacity modules 256 rescanning for disk arrays 288 Rittal rack 18 running Array Manager 60 241 S safety compliance 434 SAM 260 adding a global hot spare 273 assigning an alias 264 binding a LUN 267 che...

Page 464: ...ller enclosure normal operation 203 369 status LEDs disk enclosure normal operation 201 steady state current 147 STM adding a global hot spare 315 binding a LUN 314 checking disk array status 314 cstm 351 device logs 351 Expert Tool 355 Firmware Update Tool 357 Information Tool 352 locating disk modules 265 316 managing with 314 mstm 349 removing a global hot spare 315 status indications 379 unbin...

Page 465: ...66 table 380 Windows NT tools 362 U unbinding a LUN using Array Manager 60 293 using SAM 271 using STM 315 universal transport mechanism 298 unsupported topologies Windows 131 upgrade and add on products 416 upgrading controller cache 258 UPS recommended 152 user interfaces for STM 347 UTM 298 V ventilation 403 verifying host to array path 206 viewing logs 309 voltage specifications controller enc...

Page 466: ...466 Index ...

Reviews:

No comments