Compaq DL360 - ProLiant - Photon User Manual Download | Manualshive

Page: 69 / 141

background image

Compaq Smart Array 5i Plus Controller and Battery Backed Write Cache Enabler User Guide

8-1

COMPAQ CONFIDENTIAL

Writer: Amy L. Laffitte File Name: i-ch8 installing the device drivers

Codename: Executor Part Number: 266328-001 Last Saved On: 4/18/02 2:45 PM

8

Installing the Device Drivers

The drivers for the Smart Array 5i Plus Controller are located on the Smart Array
Controller Support Software CD and on the SmartStart and Support Software CD.
Updates are posted to the Compaq website,

www.compaq.com.

Using the Smart Array Controller Support
Software CD

Instructions for installing the drivers from the Smart Array controller Support
Software CD are given in the leaflet provided with the CD. Note that the exact
procedure depends on whether the server is new, or already contains the operating
system and user data.

Using the SmartStart and Support Software CD

If you are setting up a

new

server, the Smart Array Controller drivers are installed

and configured at the same time that you install the operating system. Refer to the
documentation provided with the CD for the operating system installation
instructions.

If you are adding the controller to an

existing system,

you must create Compaq

Support Paq diskettes (CSPs) for the operating system that you use. These diskettes
contain the operating system software, drivers, and support documentation.

«
...
67
68
69
70
71
...
»

Summary of Contents for DL360 - ProLiant - Photon

Page 1: ... Laffitte File Name a frnt Codename Executor Part Number 266328 001 Last Saved On 2 4 02 3 31 PM Compaq Smart Array 5i Plus Controller and Battery Backed Write Cache Enabler User Guide Part Number 266328 001 March 2002 First Edition ...

Page 2: ... S and or other countries All other product names mentioned herein may be trademarks of their respective companies Compaq shall not be liable for technical or editorial errors or omissions contained herein The information in this document is provided as is without warranty of any kind and is subject to change without notice The warranties for Compaq products are set forth in the express limited wa...

Page 3: ...e Important Safety Information vii Symbols on Equipment vii Symbols in Text viii Text Conventions ix Related Documents ix Getting Help x Compaq Technical Support x Compaq Website x Compaq Authorized Reseller x Reader s Comments xi Chapter 1 Features Overview of Controller Features 1 1 Battery Backed Write Cache Enabler 1 2 Memory 1 4 Controller Interface 1 5 SCSI Support 1 5 Drive Array Technology...

Page 4: ...CD 4 2 Creating a System ROMPaq Diskette from the SoftPaq File 4 2 Using the Diskette 4 3 Chapter 5 Updating the Controller Firmware Running Options ROMPaq from the Smart Array Controller Support Software CD 5 2 Running Options ROMPaq from Diskettes 5 3 Creating Diskettes Using the Smart Array Controller Support Software CD 5 3 Creating Diskettes Using the SmartStart and Support Software CD 5 3 Cr...

Page 5: ...ating the Compaq Insight Manager Agents 8 2 Appendix A Regulatory Compliance Notices Regulatory Compliance Identification Numbers A 1 Federal Communications Commission Notice A 1 Class A Equipment A 2 Class B Equipment A 2 Declaration of Conformity for Products Marked with the FCC Logo United States Only A 3 Modifications A 3 Cables A 4 Canadian Notice Avis Canadien A 4 Class A Equipment A 4 Class...

Page 6: ... C 5 RAID 1 0 Drive Mirroring C 6 RAID 5 Distributed Data Guarding C 8 Other Fault Tolerance Options C 11 Appendix D Hard Drive Installation and Replacement General Information About Hard Drive Failure D 1 Recognizing Drive Failure D 2 Compromised Fault Tolerance D 5 Automatic Data Recovery D 6 General Aspects of Drive Replacement D 7 Drive Failure During Rebuild D 8 Moving Drives and Arrays D 9 U...

Page 7: ... the Important Safety Information document provided Symbols on Equipment The following symbols may be placed on equipment to indicate the presence of potentially hazardous conditions WARNING This symbol in conjunction with any of the following symbols indicates the presence of a potential hazard The potential for injury exists if warnings are not observed Consult your documentation for specific de...

Page 8: ...nent If this surface is contacted the potential for injury exists WARNING To reduce the risk of injury from a hot component allow the surface to cool before touching These symbols on power supplies or systems indicate that the equipment is supplied by multiple sources of power WARNING To reduce the risk of injury from electric shock remove all power cords to completely disconnect power from the sy...

Page 9: ...xt Conventions This document uses the following conventions Italic type indicates complete titles of manuals or variables Variables include information that varies in system output in command lines and in command parameters in text Bold type is used for emphasis for onscreen interface components window titles menu names and selections button and icon names and so on and for keyboard keys Monospace...

Page 10: ...rded or monitored Outside North America call the nearest Compaq Technical Support Phone Center Telephone numbers for worldwide Technical Support Centers are listed on the Compaq website www compaq com Be sure to have the following information available before you call Compaq Technical support registration number if applicable Product serial number Product model name and number Applicable error mes...

Page 11: ...te File Name a frnt Codename Executor Part Number 266328 001 Last Saved On 2 4 02 3 31 PM In Canada call 1 800 263 5868 Elsewhere see the Compaq website for locations and telephone numbers Reader s Comments Compaq welcomes your comments on this guide Please send your comments and suggestions by email to ServerDocumentation compaq com ...

Page 12: ...ontroller performance Overview of Controller Features Has dual Wide Ultra3 SCSI channels supporting up to 14 drives Supports the following operating systems Microsoft Windows 2000 Microsoft Windows NT 4 0 Novell Netware 5 X and 6 X Linux Refer to the Compaq website for further information about Linux version support SCO UnixWare 7 XX Supports the Compaq Universal Hot Plug Tape Drive Supports drive...

Page 13: ...rranty and Pre Failure Notification for Compaq drives requires Compaq Insight Manager Easy to use Compaq Array Configuration Utility ACU and browser based Compaq Array Configuration Utility XE ACU XE Option ROM Configuration for Arrays ORCA Utility Redundant ROM Battery Backed Write Cache Enabler A Battery Backed Write Cache Enabler is included with the Smart Array 5i Plus Controller Also called t...

Page 14: ...thout using any tools For detailed instructions refer to the documentation that ships with your server and with the option kit CAUTION When using the battery module observe the following limitations Do not transfer the battery module between different server models Do not add or remove the battery module while array capacity expansion RAID level migration or stripe size migration is in progress Th...

Page 15: ...tion of one or more of the four button cells within the battery module Amber Blinking Open in the circuit between the positive and negative terminals of the battery module Amber Off Battery module status is normal Server is on and is in the first 30 seconds after power up Amber and green On Temporary lock out state data was lost due to cable being detached Server is off and is in data retention mo...

Page 16: ...rt The Smart Array 5i Plus Controller and Battery Backed Write Cache Enabler supports Wide Ultra3 and Wide Ultra2 SCSI devices that use Low Voltage Differential Signaling LVDS on the SCSI bus The Smart Array 5i Plus Controller and Battery Backed Write Cache Enabler does not support Wide SCSI 3 devices that use the Single Ended SE signaling protocol Drive Array Technology Drive array technology dis...

Page 17: ...monitoring Drive parameter tracking monitors more than 15 drive operational parameters and functional tests allowing the array controller to detect drive problems and predict drive failure before it occurs This feature makes possible the Compaq Pre Failure Warranty on Compaq hard drives Parameters that are tracked include read write and seek errors spin up time cable problems and functional tests ...

Page 18: ...ctive failure alert because the degraded drive has not actually failed yet and is still online The online spare is activated only after a drive in the array has failed POST or the Array Diagnostics Utility ADU also reveals imminent drive failure Recovery ROM is a controller redundancy feature that ensures continuous system availability by providing a backup ROM This feature protects against corrup...

Page 19: ...nd contains data The flowcharts in Figure 2 1 and Figure 2 2 summarize the installation procedures for the most common scenarios 1 Install the controller hardware Chapter 3 if it is not pre installed 2 Update the system firmware Chapter 4 3 Update the controller firmware Chapter 5 5 Set the boot controller Chapter 6 4 Configure the system Chapter 6 6 Create at least one logical drive and format it...

Page 20: ...e system firmware Chapter 4 3 Install the controller hardware Chapter 3 5 If using the System Configuration Utility update the system partition Chapter 5 4 Update the controller firmware Chapter 5 6 Install the device driver for your operating system Chapter 8 7 Update Compaq Insight Manager Agents if new versions are available Chapter 8 8 Create and format additional logical drives if desired Cha...

Page 21: ...s These servers are to be serviced by qualified personnel trained to deal with these hazards Do not remove enclosures or attempt to bypass any interlocks that may be provided for the purpose of removing these hazardous conditions Consult the safety information and user documentation provided with your server before attempting the installation To install the Smart Array 5i Plus Controller and Batte...

Page 22: ... allow the internal system components and hot plug hard drives to cool before touching them 7 Remove or open the access panel 8 Install the Smart Array 5i Plus Controller and Battery Backed Write Cache Enabler option Refer to the documentation that ships with your server and with the option kit 9 Restore all data from the backup you performed in step 1 CAUTION Any information that was not backed u...

Page 23: ...e on server options and SCSI drives The System ROMPaq utility has two main sources The SmartStart and Support Software CD that is either shipped with your server or available directly from Compaq The downloadable SoftPaq TM file on the Compaq website If your server has a bootable CD ROM drive you can run System ROMPaq directly from the CD Otherwise you must run System ROMPaq from a diskette create...

Page 24: ...ating a System ROMPaq Diskette from the CD 1 Insert the SmartStart and Support Software CD into the CD ROM drive tray of a server with a bootable CD ROM drive 2 Restart the server 3 On the Compaq System Utilities screen select Create Support Software 4 On the Diskette Builder menu screen scroll through the list and select System ROMPaq Firmware Upgrade Diskette and then click Next 5 Click Create D...

Page 25: ...lace the System ROMPaq diskette in the diskette drive 2 Power up the server 3 When the Welcome screen is displayed press the Enter key 4 When the Select A Device screen is displayed select your server from the list of programmable devices and then press the Enter key The Select An Image screen is displayed showing the following information Device to reprogram your server Current ROM revision date ...

Page 26: ...ation However if you have older Smart Array Controllers or other Compaq options such as drives run Options ROMPaq to make sure that these devices have the latest firmware Compaq recommends that you run the latest Options ROMPaq on all Compaq array controllers whenever new versions of the utility are released The Options ROMPaq utility has two main sources Smart Array Controller Support Software CD...

Page 27: ...es and then press the Enter key 6 The action that you must now take depends on the message on the screen If the screen message reads as follows press the Enter key and then go to step 8 of these instructions The ROM image files found for the device selected are not newer than the current ROM image If the ROM firmware currently on the controller is older than that on the Options ROMPaq diskette the...

Page 28: ...ROMPaq diskettes from one of the CDs or from the appropriate SoftPaq file Creating Diskettes Using the Smart Array Controller Support Software CD 1 Insert the Smart Array Controller Support Software CD into the server CD ROM drive tray 2 Open the OPTRMDSK folder on the CD and execute the QRST5 EXE file 3 Follow the on screen prompts to create the set of Options ROMPaq diskettes 4 To complete the f...

Page 29: ...ick Download and direct the download to the temporary directory that you created 5 Click Save 6 Execute the downloaded SoftPaq file and follow the on screen instructions to create the diskette Up to six diskettes are needed for the Options ROMPaq SoftPaq file 7 To complete the firmware update follow the procedure given in the section Using the Diskettes Using the Diskettes 1 Be sure that the serve...

Page 30: ...mages Compaq Smart Array nnnn Controller y yy In this case press the Enter key and then go to step 7 6 Review the information on the Caution screen and then press the Enter key to reprogram the controller ROM The following message is displayed Reprogramming Firmware Do not interrupt the reprogramming process You will be notified when reprogramming is complete 7 When the reprogramming of the contro...

Page 31: ...lock Sub Allocation feature to allow disk space to be allocated more efficiently Linear memory provides the best system performance in the NetWare environment If you previously used SCU to configure your server this option would have been the default To check that the system is using linear memory run SCU and view the Compaq memory settings Be sure that a linear option is selected under the Base M...

Page 32: ...e the system by using either the ROM Based Setup Utility RBSU or the System Configuration Utility SCU following the procedure given in the server user guide Set the boot controller by using RBSU or the Option ROM Configuration for Arrays ORCA utility described in this chapter Create at least one logical drive by using ORCA or ACU as described in Chapter 7 Using RBSU RBSU is a system configuration ...

Page 33: ...he F9 key when prompted during system startup The ROM Based Setup Utility menu screen is displayed Figure 6 1 RBSU menu screen 3 Configure your system For detailed instructions refer to the Compaq ROM Based Setup Utility User Guide 4 Set the boot controller by selecting Boot Controller Order on the RBSU menu screen and following the on screen prompts 5 When you have finished using the utility pres...

Page 34: ...lts and an ORCA prompt message is displayed for about five seconds If ORCA is not supported the prompt message is not displayed and the system continues with the startup sequence 1 Power up the server and let the system startup sequence begin 2 While the prompt message is on the screen press the F8 key to start ORCA 3 On the Option ROM Configuration for Arrays Main Menu screen select Select Boot C...

Page 35: ...used remotely on systems that are also running Compaq Insight Manager XE NetWare Online Array Configuration CPQONLIN Utility a menu driven utility for NetWare The following limitations apply to all configuration methods For the most efficient use of drive space do not mix drives of different capacity within the same array Each configuration utility treats all physical drives in an array as if they...

Page 36: ...U XE CPQONLIN ORCA Uses a graphical interface 0 0 Available in languages other than English 0 0 Executable at any time 0 Available on CD 0 Uses a wizard to suggest the optimum configuration for an unconfigured controller 0 Describes configuration errors 0 0 Supports these operating systems Windows 2000 0 Windows NT 0 0 NetWare Linux 0 Allows these procedures Creation and deletion of arrays logical...

Page 37: ...about five seconds If ORCA is not supported the prompt message is not displayed and the system continues with the startup sequence While the prompt is displayed press the F8 key to start ORCA The Option ROM Configuration for Arrays Main Menu screen is displayed allowing you to select the boot controller for the system or to create view or delete a logical drive Figure 7 1 ORCA main menu screen To ...

Page 38: ...ing the instructions given in your operating system documentation Using ACU ACU is located on the Smart Array Controller Support Software CD and on the SmartStart and Support Software CD You can run ACU directly from one of these CDs or if the server you are configuring is running the Microsoft Windows NT or Windows 2000 operating system you can download ACU onto your server and run it online When...

Page 39: ...e format the logical drive using the instructions given in your operating system documentation Running ACU from CD This method of running ACU is valid for Windows NT Windows 2000 Linux and Novell NetWare operating systems 1 Insert the CD into the CD ROM drive and restart the server 2 When the CD menu is displayed double click the ACU icon 3 Configure your array see the Typical Manual Configuration...

Page 40: ...act appearance of your screen depends on the controller and hard drives that you use For example the number of ports on the controller and the RAID levels available may be different in your case Main Configuration Screen This ACU Main Configuration screen is the first to be displayed after the configuration wizard has finished or been bypassed Figure 7 2 Example of ACU Main Configuration screen Th...

Page 41: ...information Drive Allows you to delete or change logical drives and to view drive information View Allows you to switch between Physical Configuration View and Logical Configuration View Help Allows you to access online help Controller Selection Box This box provides a drop down list of the controllers installed in the system When you select a controller details of the drives and arrays that are c...

Page 42: ...ny item in the Configuration View window will cause the corresponding hard drive tray LEDs to blink This feature is useful for identifying all physical drives in an array or logical drive all drives on a controller or a specific physical drive Drive View Box Use the radio buttons in this box to display a logical or physical configuration view in the Configuration View window Figure 7 5 Drive View ...

Page 43: ...ick one of these buttons to display the Controller Settings screen or the Create Drive Array screen Array Box The buttons in the Array box are activated when you select an array in the Configuration View window Figure 7 7 Array box Click one of these buttons to display the Modify Drive Array screen the Expand Array screen or the Create Logical Drive screen Logical Drive Box The buttons in the Logi...

Page 44: ...reen the Migrate Logical Drive screen or the Extend Logical Drive screen More Information Button Click More Information in the bottom right of the ACU Main Configuration screen to get a detailed description of the item that is selected in the Configuration View window Secondary Screens Controller Settings Screen To display this screen click Settings in the Controller box Figure 7 6 on the ACU Main...

Page 45: ...to drive failure for a longer time than the High setting The Accelerator Ratio setting determines the amount of memory allocated to the read and write caches Some applications may perform better with a larger write cache others may perform better with a larger read cache If your controller does not have a battery backed array accelerator only read cache will be available the ratio will always be 1...

Page 46: ...ve Array Screen To display this screen click Modify in the Array box on the ACU Main Configuration screen This screen resembles the Create Drive Array screen Figure 7 10 and allows you to change the configuration of your array Expand Array Screen To display this screen click Expand in the Array box on the ACU Main Configuration screen The Expand Array screen resembles the Create Drive Array screen...

Page 47: ... This screen allows you to select the fault tolerance method enable the array accelerator if present and set the stripe size and logical drive size on a new logical drive CAUTION Do not use this screen to modify a pre existing logical drive since this method does not preserve user data Instead to change the RAID level and stripe size on a logical drive that already contains user data click Migrate...

Page 48: ...D 1 or 1 0 8 16 32 64 128 256 128 RAID 5 8 16 32 64 16 Table 7 3 Optimum Stripe Size for a Given Application Type of Server Application Suggested Stripe Size Change Mixed read write Accept the default value Mainly sequential read such as audio video applications Use larger stripe sizes for best performance Mainly write such as image manipulation applications Use smaller stripes for RAID 5 Use larg...

Page 49: ...s For example enabling the maximum boot size on a logical drive in the Windows NT 4 0 operating system allows you to create a bootable partition with a maximum size of 8 GB NOTE Enabling the maximum boot size may decrease performance of the logical drive Modify Logical Drive Screen To display this screen click Modify in the Logical Drive box Figure 7 8 on the ACU Main Configuration screen This scr...

Page 50: ... 13 Migrate RAID Stripe Size screen Extend Logical Drive Screen To display this screen click Extend in the Logical Drive box Figure 7 8 on the ACU Main Configuration screen This screen allows you to increase the capacity of a logical drive while the system is online without disruption of data IMPORTANT Not all operating systems support online capacity extension See the section Extending Logical Dr...

Page 51: ...onfigure the controller settings 2 Assign physical drives of the same size to an array 3 Create one or more logical drives on the array For this example assume that you have four 4 3 GB drives and two 9 1 GB drives connected to your controller You want to make two arrays Array A three 4 3 GB drives with the fourth 4 3 GB drive used as a spare This array is to be configured with RAID 5 fault tolera...

Page 52: ...es have different capacities the excess capacity of the larger drives cannot be used by the array and is wasted For this example select the three drives on Port 1 with SCSI IDs 0 1 and 2 3 Click Assign Drive s to Array Figure 7 19 in the middle of the screen NOTE The probability that an array will experience a drive failure increases with the number of drives in the array Compaq recommends that no...

Page 53: ...ed On 2 8 02 10 39 AM Figure 7 15 Example Array A with Spare 5 Click Done to return to the ACU Main Configuration screen The Logical Configuration View window now looks like Figure 7 16 Figure 7 16 Logical Configuration View of Example Array 6 Select the controller icon and then click Create Array to create Array B 7 Repeat the previous steps to assign both 9 1 GB drives to Array B 8 Click Done to...

Page 54: ...w Figure 7 16 2 Click Create Logical Drive in the Array box 3 On the Create Logical Drive screen Figure 7 11 select RAID 5 4 Click Enable Array Accelerator if it is active 5 Change the stripe size if desired and if possible for your controller model 6 The default values in the Logical Drive Size box will create a single logical drive on the array For this example accept the default values 7 Click ...

Page 55: ...t change and existing data is not changed During capacity expansion ACU automatically redistributes existing logical drives across all of the physical drives in the expanded array If the array being expanded has more than one logical drive data is redistributed one logical drive at a time Newly created logical drives are not available until capacity expansion has finished CAUTION Do not exchange t...

Page 56: ... excess capacity of the larger drives cannot be used by the array and is wasted 3 Assign the new physical drives to an existing array When the expansion process is complete the extra capacity can be used to increase the size of an existing logical drive see the Extending Logical Drive Capacity section or to create a new logical drive For example consider a controller with these two arrays Array A ...

Page 57: ...e of the screen Figure 7 19 Assign Drive to Array button 5 Click Next at the bottom of the screen The screen shown in Figure 7 20 is displayed Figure 7 20 Expansion Wizard Create Logical Drives screen 6 Click Create Logical Drive 7 Set the fault tolerance stripe size array accelerator and size for the second logical drive that you want to create on Array A 8 Click Done to return to the Create Logi...

Page 58: ...rating systems also support offline capacity extension which is carried out by backing up all data reconfiguring the array and restoring the data Before extending logical drives check the operating system documentation for current information or contact your operating system vendor NOTE The extension process takes about 15 minutes per gigabyte A logical drive is unavailable for any other process w...

Page 59: ... For example consider the change from an 11 drive RAID 5 logical volume to a 14 drive RAID 1 0 logical volume If each configuration uses the corresponding default stripe width the block size changes from 16 kbytes per stripe to 128 kbytes per stripe A full stripe in the RAID 5 configuration contains 160 kbytes ten of the drives contain user data one drive contains parity data A full stripe in the ...

Page 60: ...ting that the number of sectors needs to be increased a Delete the old logical volume b Reconfigure the array as a new logical volume with the new fault tolerance method and stripe size that you had selected c Copy the backed up data from step 1 onto the new logical volume 9 To save the new settings click Controller on the menu bar and select Save Configuration Using CPQONLIN The NetWare Online Ar...

Page 61: ...es are configured for the controller the auto configuration wizard screen see Figure 7 21 is displayed If logical drives are present on the controller the manual configuration screen see Figure 7 22 is displayed Press the F1 key for online help at any time on either screen Automatic Configuration Figure 7 21 CPQONLIN auto configuration wizard 1 If the proposed logical configuration shown on the wi...

Page 62: ...the new logical drives available for data storage format the logical drive using the instructions given in your operating system documentation Manual Configuration Figure 7 22 Main manual configuration screen Highlight the controller array or logical drive that you want to configure and then press the Enter key The menu options for that item are shown in the panel on the right hand side of the scr...

Page 63: ... Accept Changes Physical Drives Panel shows spare drives and unassigned hard drives attached to the controller New Array Panel shows physical view of new array Array Options Menu Expand Array Expand Array Assign Drive Accept Changes Physical Drives Panel shows spare drives and unassigned hard drives attached to the controller New Array Panel shows physical view of new array Assign Spare Assign Spa...

Page 64: ... displays three panels Create Array Physical Drives and New Array 3 Select Assign Drive from the Create Array menu and then press the Enter key The highlight automatically moves to the Physical Drives panel 4 Select a drive and then press the Enter key IMPORTANT Do not assign a group of physical drives to the same array unless they are of the same capacity If the drives have different capacities t...

Page 65: ...View panel select the array that needs a spare and then press the Enter key 2 Select Assign Spare from the Array Options menu and then press the Enter key 3 Select the drive that you want as the spare and then press the Enter key 4 Press the Esc key to accept the new configuration and return to the Main Manual Configuration screen Configuring the New Logical Drive 1 In the Logical Configuration Vi...

Page 66: ...ted this setting provides better data protection because the array is vulnerable to additional drive failures for a shorter time NOTE Logical drives can be rebuilt only if they are configured for fault tolerance RAID 1 0 5 or ADG Drive rebuild begins automatically after you have replaced a failed physical drive in the array The accelerator read write ratio determines the amount of memory allocated...

Page 67: ...or migration are queued 1 Back up all data on the logical drive Although array expansion is unlikely to cause data loss observing this precaution provides extra security 2 Verify that the array accelerator batteries if present are fully charged 3 In the Logical Configuration View panel select the array that you want to expand and then press the Enter key 4 Select Expand and then press the Enter ke...

Page 68: ...migrate any other logical drive during this time Instead further requests for expansion or migration will be queued 1 Back up all data on the logical drive Although migration is unlikely to cause data loss observing this precaution provides extra security 2 Verify that the array accelerator batteries if present are fully charged 3 In the Logical Configuration View panel select the logical drive th...

Page 69: ...nstalling the drivers from the Smart Array controller Support Software CD are given in the leaflet provided with the CD Note that the exact procedure depends on whether the server is new or already contains the operating system and user data Using the SmartStart and Support Software CD If you are setting up a new server the Smart Array Controller drivers are installed and configured at the same ti...

Page 70: ...for the operating system that you are using 6 Follow the on screen instructions to create the diskettes Depending on your operating system you will need to use up to six blank diskettes Detailed instructions for installing the device drivers are given in the README files on the CSPs Updating the Compaq Insight Manager Agents If you are installing the controller as additional storage you may now up...

Page 71: ...e or model number of the product Federal Communications Commission Notice Part 15 of the Federal Communications Commission FCC Rules and Regulations has established Radio Frequency RF emission limits to provide an interference free radio frequency spectrum Many electronic devices including computers generate RF energy incidental to their intended function and are therefore covered by these rules T...

Page 72: ...cations Operation of this equipment in a residential area is likely to cause harmful interference in which case the user will be required to correct the interference at personal expense Class B Equipment This equipment has been tested and found to comply with the limits for a Class B digital device pursuant to Part 15 of the FCC Rules These limits are designed to provide reasonable protection agai...

Page 73: ...rference that may cause undesired operation For questions regarding your product contact us by mail or telephone Compaq Computer Corporation P O Box 692000 Mail Stop 530113 Houston Texas 77269 2000 1 800 652 6672 1 800 OK COMPAQ For continuous quality improvement calls may be recorded or monitored For questions regarding this FCC declaration contact us by mail or telephone Compaq Computer Corporat...

Page 74: ... all requirements of the Canadian Interference Causing Equipment Regulations Cet appareil numérique de la classe A respecte toutes les exigences du Règlement sur le matériel brouilleur du Canada Class B Equipment This Class B digital apparatus meets all requirements of the Canadian Interference Causing Equipment Regulations Cet appareil numérique de la classe B respecte toutes les exigences du Règ...

Page 75: ... the CE Marking comply with both the EMC Directive 89 336 EEC and the Low Voltage Directive 73 23 EEC issued by the Commission of the European Community Compliance with these directives implies conformity to the following European Norms the equivalent international standards are in parenthesis EN55022 CISPR 22 Electromagnetic Interference EN55024 IEC61000 4 2 3 4 5 6 8 11 Electromagnetic Immunity ...

Page 76: ...Plus Controller and Battery Backed Write Cache Enabler User Guide COMPAQ CONFIDENTIAL Writer Amy L Laffitte File Name j appa Regulatory Compliance Notices Codename Executor Part Number 266328 001 Last Saved On 4 18 02 2 46 PM Japanese Notice Taiwanese Notice ...

Page 77: ...ustomer operation and maintenance Laser Safety Warnings WARNING To reduce the risk of exposure to hazardous radiation Do not try to open the laser device enclosure There are no user serviceable components inside Do not operate controls make adjustments or perform procedures to the laser device other than those specified herein Allow only Compaq authorized service technicians to repair the laser de...

Page 78: ...ing label or equivalent is located on the surface of the Compaq supplied laser device This label indicates that the product is classified as a CLASS 1 LASER PRODUCT This label appears on a laser device installed in your product Laser Information Table A 1 Laser Information Feature Description Laser type Semiconductor GaAIAs Wave length 780 nm 35 nm Divergence angle 53 5 degrees 0 5 degrees Output ...

Page 79: ...esignated for this product For more information about battery replacement or proper disposal contact your Compaq authorized reseller or your authorized service provider WARNING Your computer contains an internal lithium manganese dioxide vanadium pentoxide or alkaline battery pack There is risk of fire and burns if the battery pack is not properly handled To reduce the risk of personal injury Do n...

Page 80: ... electricity from a finger or other conductor may damage system boards or other static sensitive devices This type of damage may reduce the life expectancy of the device To prevent electrostatic damage observe the following precautions Avoid hand contact by transporting and storing products in static safe containers Keep electrostatic sensitive parts in their containers until they arrive at static...

Page 81: ...r computer chassis Wrist straps are flexible straps with a minimum of 1 megohm 10 percent resistance in the ground cords To provide proper ground wear the strap snug against the skin Use heel straps toe straps or boot straps at standing workstations Wear the straps on both feet when standing on conductive floors or dissipating floor mats Use conductive field service tools Use a portable field serv...

Page 82: ...nd performance of a single physical hard drive is adequate for home users However business users demand higher storage capacities higher data transfer rates and greater protection against data loss when drives fail Merely adding extra physical drives to the system increases the total storage capacity see Figure C 1 However this addition does not affect the efficiency of read write R W operations s...

Page 83: ...e combined into one or more virtual units called logical drives also called logical volumes Then the read write heads of all the constituent physical drives are active simultaneously reducing the total time required for data transfer L1 P1 P2 P3 Figure C 2 Physical drives configured into a logical drive L1 Because the read write heads are active simultaneously the same amount of data is written to...

Page 84: ...y controller which sends the data blocks to the drive write heads in the correct order A natural consequence of the striping process is that each physical drive in a given logical drive will contain the same amount of data If one physical drive has a larger capacity than other physical drives in the same logical drive the extra capacity is wasted because it cannot be used by the logical drive The ...

Page 85: ...array A logical drive can also extend over more than one port on the same controller but it cannot extend over more than one controller Drive failure although rare is potentially catastrophic In Figure C 4 for example failure of any physical drive causes all logical drives in the same array to fail and all data on the drives is lost To protect against data loss due to physical drive failure logica...

Page 86: ...a is being rewritten to the spare the logical drive will still fail When you configure an online spare it is automatically assigned to all logical drives in the same array Additionally you do not need to assign a separate online spare to each array you can configure one hard drive to be the online spare for several arrays as long as the arrays are all on the same controller Fault Tolerance Methods...

Page 87: ...Tolerance Codename Executor Part Number 266328 001 Last Saved On 4 18 02 2 51 PM You cannot use an online spare You can only preserve data by backing it up to external drives RAID 1 0 Drive Mirroring In this configuration data is duplicated onto a second drive P1 P2 B1 B2 B3 B4 B1 B2 B3 B4 Figure C 5 Drive mirroring of P1 onto P2 When the array has more than two physical drives drives are mirrored...

Page 88: ...lled load balancing If a physical drive fails the remaining drive in the mirrored pair can still provide all the necessary data Several drives in the array can fail without incurring data loss as long as no two failed drives belong to the same mirrored pair This fault tolerance method is useful when high performance and data protection are more important than the cost of physical drives NOTE When ...

Page 89: ...g By this method a block of parity data is calculated for each stripe from the data that is in all other blocks within that stripe The blocks of parity data are distributed over every physical drive within the logical drive see Figure C 7 When a physical drive fails data that was on the failed drive can be calculated from the user data on the remaining drives and the parity data This recovered dat...

Page 90: ...es only the storage space equivalent to one physical drive Disadvantages The disadvantages of RAID 5 are that It has a relatively low write performance Loss of data occurs if a second drive fails before data from the first failed drive is rebuilt Table C 1 summarizes the important features of the different kinds of RAID described The decision chart in Table C 2 may help you to determine which opti...

Page 91: ...Read performance High High High Write performance High Medium Low Relative cost Low High Medium Values for usable drive space are calculated with these assumptions All physical drives in the array have the same capacity Online spares are not used No more than 14 physical drives are used for RAID 5 This number is recommended so that the risk of logical drive failure is kept low See Appendix D for f...

Page 92: ...ach logical drive must be in a different array from the others Controller Duplexing uses two identical controllers with independent identical sets of drives containing identical data In the unlikely event of a controller failure the remaining controller and drives will service all requests However the hardware based RAID methods described in this appendix provide a much more robust and controlled ...

Page 93: ... manually Do not terminate the drives Compaq servers and internal cabling provide the required termination of the SCSI bus Do not use drives of different capacity in the same array The excess capacity of larger drives cannot be used by the array and is wasted Do not combine hot pluggable drives with non hot pluggable drives on the same SCSI bus Hard drives that are currently supported by the Smart...

Page 94: ...If more hard drives fail than the fault tolerance method allows fault tolerance is compromised and the logical drive fails In this case all requests from the operating system will be rejected with unrecoverable errors The Compromised Fault Tolerance section discusses possible ways to recover from this situation Recognizing Drive Failure The LEDs on the front of each hard drive are visible through ...

Page 95: ...lace the drive as soon as possible Off on or flashing On Off OK to replace the drive online if the array is configured for fault tolerance and all other drives in the array are online The drive is online and configured as part of an array On Flashing Off Do not remove the drive Removing a drive during this process may terminate the current operation and cause data loss The drive is rebuilding or u...

Page 96: ...place the drive online if the array is configured for fault tolerance and all other drives in the array are online Either 1 the drive is not configured as part of an array 2 the drive is configured as part of an array but a powered on controller is not accessing the drive or 3 the drive is configured as an online spare There are several other ways to recognize that a hard drive has failed The ambe...

Page 97: ...l drives do not need to be replaced However data may still have been lost especially if the system was busy at the time that the problem occurred Procedure to Attempt Recovery When fault tolerance has been compromised inserting replacement drives does not improve the condition of the logical volume Instead if your screen displays unrecoverable disk error messages try the following procedure to rec...

Page 98: ...ical volume remains in a ready to recover condition and the same POST message is displayed whenever the system is restarted When Automatic Data Recovery has finished the Online LED of the replacement drive stops blinking and begins to glow steadily In general approximately 15 minutes is required to rebuild each gigabyte The actual rebuild time depends upon The level of rebuild priority that has be...

Page 99: ... Insight Manager documentation on the Compaq Management CD for details CAUTION Sometimes a drive that has previously been failed by the controller may seem to be operational after the system is power cycled or for a hot pluggable drive after the drive has been removed and reinserted However continued use of such marginal drives may eventually result in data loss Replace the marginal drive as soon ...

Page 100: ...fore replace drives during low activity periods whenever possible In addition be sure that all logical volumes on the same array as the drive being replaced have a current valid backup Drive Failure During Rebuild If another drive in the array fails while fault tolerance is unavailable during rebuild a fatal system error may occur If this happens all data on the array is lost In exceptional cases ...

Page 101: ...en RAID ADG is used two drives can fail simultaneously and be replaced simultaneously without data loss If an online spare has an unlit Online LED it is offline the degraded drive can still be replaced Do not remove a second drive from an array until the first failed or missing drive has been replaced and the rebuild process is complete When the rebuild is complete the Online LED on the front of t...

Page 102: ...t in more than 14 physical drives per channel No more than 32 logical volumes will be configured for a controller No drives are failed or missing The array is in its original configuration with no active spare drives Capacity expansion is not running Controller firmware is the latest version recommended If moving an array all drives in the array must be moved at the same time After verifying that ...

Page 103: ... gigabyte your system is unprotected against drive failure for many hours or even days while the rebuild is in progress To upgrade disk drive capacity 1 Back up all data 2 Replace any drive The data on the new drive is re created from redundant information on the remaining drives CAUTION Do not replace any other drive until data rebuild on this drive is complete 3 When data on the new drive has be...

Page 104: ...d capacity on the enlarged array can now be used to create an additional logical drive with a different fault tolerance setting if necessary Alternatively the unused capacity can be used to increase the size of one of the original logical drives this process is logical drive capacity extension Another method for carrying out logical drive capacity extension is to delete an existing logical drive a...

Page 105: ...his maximum is reached As the number of failed drives increases it becomes increasingly unlikely that a newly failed drive is not mirrored to a previously failed drive The failure of only two physical drives is enough to cause a logical drive to fail if the two drives happen to be mirrored to each other The risk of this occurring decreases as the number of mirrored pairs in the array increases A R...

Page 106: ...pe Probability of Logical Drive Failure Codename Executor Part Number 266328 001 Last Saved On 4 18 02 2 50 PM 1E 13 1E 12 1E 11 1E 10 1E 09 1E 08 1E 07 1E 06 1E 05 0 0001 0 001 0 01 1 5 9 13 17 21 25 29 33 37 41 45 49 53 57 Total number of physical drives in array Relative likelihood of logical drive failure RAID 0 RAID 5 RAID 1 RAID ADG Figure E 1 Probability of logical drive failure ...

Page 107: ...stem halted There is a termination or cabling problem with the system board integrated SCSI controller See the cabling information in this guide 1711 Slot x drive array RAID ADG logical drives present but cache size is less than or equal to 32 MB This configuration is not recommended Migrate the logical drive or drives to RAID 5 or upgrade the array accelerator cache module 1712 Slot x drive array...

Page 108: ...ve failure condition It may fail at some time in the near future Do not replace the drive unless all other drives on the array are online Back up data before replacing drive s 1721 Slot x drive array drive parameter tracking predicts imminent failure The following device s should be replaced when conditions permit a list of devices will be given here Do not replace the drive unless all other drive...

Page 109: ...if the controller is replaced with a model that has a different amount of cache memory 1727 Slot x drive array new logical drive s attachment detected if 32 logical drives this message will be followed by Auto configuration failed too many logical drives The controller has detected an additional array of drives that was attached when the system was powered down The logical drive configuration info...

Page 110: ...ray array controller maximum operating temperature exceeded during previous power up This message appears at the next power up if the controller locks due to excessive temperature Check for proper operation of the server cooling fan 1754 Slot z drive array RAID ADG drive s configured but ADG Enabler Module is detached or defective Please check for detached ADG Enabler Module Array accelerator is t...

Page 111: ...array accelerator should be attached to both controllers The size of array accelerators is different between two controllers in a redundant controller configuration Use array accelerators of the same size on both controllers 1759 Slot x drive array redundant controller error Replace the controller or server system board 1762 Redundant controller operation is not supported in this firmware version ...

Page 112: ...e array accelerator has been removed you must reinstall it for capacity expansion to continue 1765 Slot x drive array Option ROM appears to conflict with an ISA card ISA cards with 16 bit memory cannot be configured in memory range C0000 to DFFFF along with SMART 2 E 8 bit Option ROM due to EISA buffer limitations Please remove or reconfigure your ISA card Remove or reconfigure the conflicting ISA...

Page 113: ...ly followed by additional details Data has been lost while expanding the array therefore the drives have been temporarily disabled Press the F2 key to acknowledge the data loss and re enable the logical drives Restore data from backup If the array accelerator has failed replace the array accelerator board after the capacity expansion process has terminated Never turn off the system and replace the...

Page 114: ...heck storage system power switch and cables Power the system down while checking the ProLiant power and cable connections then power the system back up to retry Power the system down Check the external ProLiant power switch external drives must all be powered up before or at the same time as the main system Check cables If retrying does not help update the ProLiant system firmware or try replacing...

Page 115: ...ansfer failed SCSI port y Interrupt signal inoperative Check SCSI cables Check cooling fan operation by placing hand over the fan Check the internal plenum cooling fan in tower servers or storage systems If the fan is not operating check for obstructions and check all internal connectors Replace the unit side panel if it was removed When the ProLiant Storage System power LED is amber instead of gr...

Page 116: ... installed If this message appears and drive x has not been replaced an intermittent drive failure has occurred This message also appears once immediately following drive replacement before data is restored from backup 1783 Slot x drive array controller failure If this message appears immediately following a ROM installation the ROM is either defective or not installed properly Check that the cont...

Page 117: ...iguration information indicates drive positions beyond the capability of this controller This may be due to drive movement from a controller that supports more drives than the current controller 4 Configuration information indicates drives were configured on a controller with a newer firmware version 1 Turn off the system and check SCSI cable connections to be sure that drives are attached properl...

Page 118: ...usly aborted The following SCSI drive s need Automatic Data Recovery rebuild SCSI port y SCSI ID x Press the F1 key to retry Automatic Data Recovery to drive Press the F2 key to continue without starting Automatic Data Recovery The message normally appears when a drive is replaced in a fault tolerant configuration when the system is powered down In this case press the F1 key to start the Automatic...

Page 119: ...1788 1 Slot x drive array reports incorrect drive replacement The following SCSI drive s should have been replaced SCSI port y SCSI ID x The following SCSI drive s were incorrectly replaced SCSI port y SCSI ID z Press the F1 key to continue drive array will remain disabled Press the F2 key to reset configuration all data will be lost or 2 Faulty power cable connection to the drive or 3 Defective S...

Page 120: ...llowing a cold or warm reset Turn off system and check cable connections If cables are connected replace the drive Press the F1 key to restart the computer with the drive array disabled or If you do not want to replace the drives now press the F2 key 1792 Slot x valid data found in array accelerator Data automatically written to drive array Power was interrupted while the system was in use or the ...

Page 121: ...accelerator will automatically be re enabled and this POST message will go away Replace the array accelerator or array controller if batteries do not recharge within 36 power on hours If the battery pack has failed replace the battery pack 1795 Slot x drive array array accelerator configuration error Data does not correspond to this drive array Array accelerator is temporarily disabled The data st...

Page 122: ... array array accelerator write error occurred Array accelerator is disabled Replace the array accelerator or the Smart Array controller Restore data from backup 1799 Slot x drive array drive s disabled due to array accelerator data loss Press the F1 key to continue with logical drives disabled Press the F2 key to accept data loss and re enable logical drives Data stored on the array accelerator ha...

Page 123: ...e drives and CD ROM drives A Yes The Smart Array 5i Plus Controller and Battery Backed Write Cache Enabler supports Wide Ultra2 SCSI and Wide Ultra SCSI 3 hard drives as well as tape drive formats such as DLT DAT SLR and AIT Q I installed the hard drives in my server Must I now terminate each drive A No If you installed hard drives in a server with a Smart Array 5i Plus Controller and Battery Back...

Page 124: ...must I do if I do not understand the POST error message referring to the Smart Array 5i Plus Controller and Battery Backed Write Cache Enabler A First copy down the POST error message for later reference A list of POST error messages and definitions is available in the maintenance and service guide for your server or at the Compaq website www compaq com At the website locate your software in the S...

Page 125: ... lights light up on some drives when my system is idle A The Smart Array 5i Plus Controller and Battery Backed Write Cache Enabler performs several different background activities on the drives when the controller is otherwise idle For example the Auto Reliability Monitoring task scans fault tolerant volumes for defects and verifies the consistency of parity data The Drive Parameter Tracking task ...

Page 126: ... Utility A diagnostic tool that collects comprehensive information about the array controllers in a system and lists any problems detected ARM Auto Reliability Monitoring Also known as surface analysis A fault management feature whereby hard drives are scanned for bad sectors and data in the faulty sectors is remapped onto good sectors Parity data consistency is also checked for drives in RAID 5 o...

Page 127: ...cked array accelerator installed capacity extension Abbreviated term for logical drive capacity extension The enlargement of a logical drive without disruption of data There must be free space on the array before extension can occur If necessary create free space by deleting a logical drive or by carrying out a capacity expansion Capacity extension can be carried out online with some operating sys...

Page 128: ...erver to halt or corrupt data fault tolerance The ability of a server to recover from hardware problems without interrupting server performance or corrupting data Hardware RAID is most commonly used but there are other types of fault tolerance for example controller duplexing and software based RAID flashing Updating the flash memory on a system Flash memory is non volatile memory that is used to ...

Page 129: ...Test A series of diagnostic tests that run automatically each time the server is started or reset RAID Redundant Array of Independent Disks A form of fault tolerance RAID 0 no fault tolerance uses data striping to distribute data evenly across all physical drives in the array but has no redundant data RAID 1 0 drive mirroring duplicates data from one drive onto a second drive RAID 5 distributed da...

Page 130: ... CD A collection of software for updating system drivers configuring arrays or a system diagnosing problems with arrays or a system and updating firmware for the system or options The latest version of any of these software packages can be obtained by downloading a SoftPaq file from the Compaq website www compaq com SmartStart can also be used to create or update the system partition on your hard ...

Page 131: ... User Guide COMPAQ CONFIDENTIAL Writer Amy L Laffitte File Name q glossary Codename Executor Part Number 266328 001 Last Saved On 2 4 02 4 28 PM Wide Ultra Wide Ultra2 Wide Ultra3 A set of SCSI standards that support maximum signal transfer rates of up to 40 MB s 80 MB s and 160 MB s respectively ...

Page 132: ...ing while online 7 5 screen descriptions 7 6 sources of 7 4 stripe size migration with 7 25 using 7 4 ACU XE Array Configuration Utility XE 1 2 7 1 ADU Array Diagnostic Utility recognizing hard drive failure D 4 using G 2 alerts hard drive failure 1 6 predictive failure D 3 amber LED Battery Backed Write Cache Enabler 1 3 hard drives D 2 ARM Auto Reliability Monitoring 1 6 array adding hard drives...

Page 133: ...LEDs caution 1 3 lifetime of 1 3 limitations caution 1 3 low charge important 1 3 maximum data preservation time 1 2 NiMH 1 2 recharging 1 3 replacement of 1 3 status lights of 1 3 trickle charging 1 4 battery module See Battery Backed Write Cache Enabler block of data defined C 2 Block Sub Allocation 5 6 boot controller setting 6 1 boot partition 7 15 boot size changing 7 15 boot straps using B 2...

Page 134: ...QONLIN 7 31 CPQONLIN NetWare Online Array Configuration Utility Accelerator Ratio setting 7 32 comparison of with other configuration utilities 7 2 configuring controller settings 7 31 Expand Priority level 7 32 installation of 7 26 limitations of 7 2 manual configuration with 7 28 menu options in 7 29 RAID level migration with 7 34 Rebuild Priority level 7 32 stripe size migration with 7 34 wizar...

Page 135: ...rmation D 1 immediate possible cause D 7 POST notification of D 4 protection against C 4 recognizing D 2 replacing drive D 7 upon replacement possible cause D 7 failure logical drive cause of D 2 probability of E 1 recovery from D 6 fast charging Battery Backed Write Cache Enabler 1 4 fault management features automatic data recovery D 6 hard drive failure alerts 1 6 fault tolerance See also RAID ...

Page 136: ...hazardous conditions symbols on equipment vii hazardous energy circuits symbol viii heel straps using B 2 help additional sources x Compaq authorized resellers telephone numbers xii Compaq website xi technical support telephone numbers x hot spare defined C 5 hot surface symbol viii warning viii 3 2 hot plug drives replacing D 7 using D 1 I Important Safety Information document vii installation pr...

Page 137: ...CU 7 11 allocation to cache in CPQONLIN 7 32 features 1 4 linear 5 6 required amount of for stripe size change 7 25 migration in ACU 7 25 in CPQONLIN 7 34 time required for 7 25 mirroring of drives C 6 mouse compliance statement A 4 multiple logical drives creating 7 14 N NetWare ACU and 7 5 array configuration utility for 7 26 Block Sub Allocation in 5 6 capacity extension in using ACU 7 24 CPQON...

Page 138: ...ence of D 3 online spare in 1 6 pre failure warranty third party hard drives G 2 protecting data alternative methods C 11 RAID methods C 4 R RAID 0 no fault tolerance C 5 RAID 1 0 drive mirroring C 6 RAID 5 distributed data guarding C 8 RAID level migration caution for 7 13 in ACU 7 25 in CPQONLIN 7 34 RAID methods See also fault tolerance comparison with alternative fault tolerance methods C 11 p...

Page 139: ...formation vii screwdriver symbol viii SCSI bus termination D 1 devices compatibility of 1 5 Low Voltage Differential Signaling LVDS 1 5 signaling methods compatibility of 1 5 Single Ended SE 1 5 standards supported 1 5 tape drives support for 1 1 G 1 SCSI ID assigning G 1 SCU System Configuration Utility 5 6 SE Single Ended SCSI support for 1 5 sector repair dynamic 1 6 series number for regulator...

Page 140: ... in text ix on equipment vii system configuration 6 1 System Configuration Utility See SCU system partition creating 5 6 system ROM updating 4 1 System ROMPaq 4 1 creating diskettes 4 2 using G 2 system preventing electrostatic damage to B 1 T tape drives support for 1 1 G 1 technical support x telephone numbers xii symbol viii text conventions ix third party partitioning tools 7 25 time needed fo...

Page 141: ...urces of power viii predictive failure alert D 3 RJ 45 receptacle viii website Compaq x weight symbol viii warning viii Wide Ultra2 SCSI support for 1 1 Wide Ultra3 SCSI support for 1 1 Windows NT capacity extension in 7 24 wizard in ACU 7 4 in CPQONLIN 7 27 wrist straps specifications B 2 using B 2 write cache See also Battery Backed Write Cache Enabler memory allocation to in ACU 7 11 memory all...

Reviews:

No comments

Related manuals for DL360 - ProLiant - Photon

Univerge SV8100

Brand: NEC Pages: 44

Brand: dbx Pages: 8

Brand: VAF instruments Pages: 56

S5120V3-EI Series

Brand: H3C Pages: 54

Brand: Ublox Pages: 116

Brand: Idis Pages: 86

Brand: Paradyne Pages: 2

Brand: JETWAY Pages: 55

Brand: Compro Technology Pages: 2

Brand: Aviosys Pages: 77

Brand: Renesas Pages: 6

PD-9501-10GCO/AC

Brand: Microchip Technology Pages: 41

Brand: Netopia Pages: 138

Brand: XMOS Pages: 8

Brand: Rosewill Pages: 5

StorageWorks TM RAID Array 3000 Pedestal Storage Subsystem

Brand: Compaq Pages: 112

Brand: B&B Electronics Pages: 90

Brand: Actelis Networks Pages: 50

Brands by name

0 1 2 3 4 5 6 7 8 9 A B C D E F G H I J K L M N O P Q R S T U V W X Y Z

Popular brands

Load more brands