background image

Determining What RAID Level to Use

www.3ware.com

33

Through drive coercion, the capacity used for each drive is rounded 
down so that drives from differing manufacturers are more likely to 
be able to be used as spares for each other. The capacity used for 
each drive is rounded down to the nearest GB for drives under 45 
GB (45,000,000,000), and rounded down to the nearest 5 GBytes 
for drives over 45 GB. For example, a 44.3 GB drive will be 
rounded down to 44 GBytes, and a 123 GB drives will be rounded 
down to 120 GBytes.

Summary of Contents for 3WARE 720-0138-00

Page 1: ...3ware SATA RAID Controller Supports the 9000 Series PN 720 0117 00 September 2004 Installation Guide...

Page 2: ...en consent of AMCC 455 West Maude Ave Sunnyvale CA 94085 Trademarks 3ware Escalade and 3DM are all registered trademarks of AMCC The 3ware logo 3BM StorSwitch TwinStor and R5 Fusion are all trademarks...

Page 3: ...ect serial cables to the controller 16 To install the controller in the computer 16 To connect the interface cables to the drives 17 Installing a Serial ATA RAID Controller with Multi lane Internal Co...

Page 4: ...from a Different Device 56 Making Units Managed by a 3ware Controller Available to Windows 63 Finishing Up 64 Driver Installation Under Linux 65 Obtaining 3ware Linux Drivers 66 Be Sure to Use the Co...

Page 5: ...red 100 Installation Overview 100 Installation Instructions 102 Replacing the Battery 107 Appendix B Compliance and Conformity Statements 109 Federal Communications Commission Radio Frequency Interfer...

Page 6: ...iv 3ware 9000 Series Serial ATA RAID Controller Installation Guide...

Page 7: ...to refer to the Knowledgebase available at the 3ware website at http www 3ware com support Conventions Used in This Guide The following conventions are used throughout this guide 3BM refers to the 3w...

Page 8: ...About this Guide vi 3ware 9000 Series Serial ATA RAID Controller Installation Guide...

Page 9: ...l ATA family includes 9500S 4LP 9500S 8 9500S 12 9500S 8MI 9500S 12MI Features of the 3ware 9000 series controllers include Advanced RAID features for greater data protection and management Support fo...

Page 10: ...protected SDRAM user upgradeable Variable stripe size for performance tuning by application Background initialization of redundant array for immediate availability and data redundancy Support for lega...

Page 11: ...BOD drives and restore your data Code set release 9 1 5 and newer supports the Battery Backup Unit BBU which can preserve the contents of the cache memory for up to 72 hours System Requirements 3ware...

Page 12: ...ial ATA controllers Operating System 3ware RAID controllers may be used with Windows 2000 SP3 or newer Windows XP SP1 or newer or Windows Server 2003 Red Hat Linux SuSE Linux Other versions of Linux u...

Page 13: ...cluded 3ware Serial ATA RAID Controller in an ESD protective bag Serial ATA interface cables one per port Cables are not included in 9500S 8MI and 9500S 12MI 3ware installation CD with the following 3...

Page 14: ...About the 3ware RAID Controller 6 3ware 9000 Series Serial ATA RAID Controller Installation Guide...

Page 15: ...les and drives The basic steps are listed here For details see Installing the Hardware on page 9 a Connect the interface cables to the controller card b Turn off power switches and unplug power cords...

Page 16: ...drives to be included and indicate that you want to create a disk array c Select the desired RAID configuration d Set other parameters depending on the type of RAID con figuration e Confirm the array...

Page 17: ...ipment and data Be sure to read this section Installing a Serial ATA RAID Controller and Installing a Serial ATA RAID Controller with Multi lane Internal Connectors provide step by step instructions f...

Page 18: ...o Install the Controller Consider these factors when deciding on the slot in which to insert the controller Cable routing may be easier if you install the 3ware RAID controller next to an open slot Th...

Page 19: ...chassis and drive carrier compatibility list For more information see Additional Details About the LED Status Connectors on page 15 Most chassis have a single drive activity cable that you can connect...

Page 20: ...nsure your own safety and that of your equipment Personal Safety Warning High voltages may be found inside computer equipment Before installing any of the hardware in this package or removing the prot...

Page 21: ...r by its edges or by the black rail and metal bracket at its two ends Do not touch any pin contact lead or component on the 3ware RAID controller Things to Watch Out For Be careful when installing the...

Page 22: ...of ports Controllers with fewer ports may be low profile such as the 9500S 4LP which has only 4 ports LED indicators for individual drives on J7 J8 and J9 Overall LED drive status indicator the last t...

Page 23: ...he even numbered pins are the return or cathode side Warning A common or shared LED ground on a chassis is not supported and can damage the 3ware controller Check with your chassis documentation befor...

Page 24: ...onnectors on the end of the serial controller and the drive are susceptible to damage from excessive bending Be careful not to insert or remove the serial cable connector at an angle 3 Repeat steps 2...

Page 25: ...ntroller directly above the slot until it is fully seated 8 Check that the 3ware RAID controller s metal bracket covers the hole in the case and secure the bracket with the screw that was used to secu...

Page 26: ...nectors on page 15 4 Optional If staggered spinup is desired and supported by your hard drives set the appropriate jumpers on your hard drives to enable staggered spinup Later you will need to enable...

Page 27: ...ype of enclosure you have For use with a backplane that has the InfiniBand 4x connectors SFF 8470 use the InfiniBand 4x cable which has multi lane connectors on each end as shown in Figure 4 LED indic...

Page 28: ...t the multi lane cables Depending on the model of the controller and the number of drives you will be connecting you will connect two or three multi lane cables Each cable supports up to four serial A...

Page 29: ...th the grooves in the slot and all pins make proper contact with the PCI slot pins when pushed into place The 3ware controller is keyed to ensure proper installation into a full sized PCI slot Make su...

Page 30: ...have installed the controller in the computer and attached appropriate cables to the controller and drives complete the following steps to complete the hardware installation Check your Installation an...

Page 31: ...ts follow the steps below For units using JBOD see Migrating Legacy JBOD Units to a 9000 Controller on page 24 Note In order to preserve the data that is on the units attached to the 8000 you will nee...

Page 32: ...Install the 9000 controller in your system while leaving the 8000 controller installed 2 Install the Windows driver For details see Driver Installation Under Windows on page 53 3 Run the conversion u...

Page 33: ...tall the 9000 controller in your system while leaving the 8000 controller installed 2 Install the Windows driver For details see Driver Installation Under Windows on page 53 3 Power down the system di...

Page 34: ...Installing the Hardware 26 3ware 9000 Series Serial ATA RAID Controller Installation Guide...

Page 35: ...guration on page 40 Initializing Units on page 48 Checking the Motherboard Boot Sequence on page 50 Checking the Motherboard Boot Sequence on page 50 If you already know the RAID configuration you wan...

Page 36: ...ays write data to paired drives simultaneously If one drive fails the data is preserved on the paired drive Mirroring provides data protection through redundancy In addition mirroring using a 3ware RA...

Page 37: ...ously The stripe size is configurable in 3ware BIOS Manager 3BM Requires a minimum of two drives When drives are configured in a striped disk array large files are distributed across the multiple disk...

Page 38: ...Disk A single drive that has been configured as a unit through 3ware software 3BM 3DM 2 or CLI Like disks in other RAID configurations single disks contain 3ware Disk Control Block DCB information and...

Page 39: ...u always want the computer to wait for the drive to write all the data to disk before going on to its next task In this case you must disable the write cache Determining What RAID Level to Use The RAI...

Page 40: ...de 2 subunits of 6 3 subunits of 4 or 4 subunits of 3 With 10 drives a RAID 50 will contain 2 subunits of 5 drives each Combination of RAID 0 1 5 10 hot spare or single disks Table 2 Drive Capacity RA...

Page 41: ...facturers are more likely to be able to be used as spares for each other The capacity used for each drive is rounded down to the nearest GB for drives under 45 GB 45 000 000 000 and rounded down to th...

Page 42: ...ing the start up process for your computer To start 3BM 1 Power up or reboot your system 2 While the system is starting watch for a screen similar to Figure 5 Figure 5 3ware BIOS Screen 3 Press Alt 3...

Page 43: ...m 35 A message warns you that changing your disk array configuration may overwrite data on the disks Figure 6 Warning Message When you Start 3BM 4 If you need to backup data before continuing press ES...

Page 44: ...rs and a message asks you to confirm the configuration 2 Type Y 3BM closes and the booting process resumes To exit without saving changes 1 Press Esc If you have made changes that you have not saved y...

Page 45: ...are available to create units and hot spares Exportable Units lists any existing units along with the drives contained in the units Incomplete Drives and Others If you connected drives to the control...

Page 46: ...OR Left and Right Arrow Keys OR Tab and Shift Tab Select or unselect what is currently highlighted A selection may be a drive in a list of drives a button at the bottom of the screen or a field in th...

Page 47: ...re versions BIOS Firmware monitor and slot of the 3ware card Shift F5 Return to the main 3ware BIOS Manager screen from the Advanced Details screen Any key Move a highlighted unit up or down in the li...

Page 48: ...k unit Choose the desired RAID configuration Set other parameters depending on the type of RAID configuration Confirm the unit configuration Save your changes To select the drives and create a disk un...

Page 49: ...ext to Selected Drives 2 After all drives for the unit are selected use the Tab or Right Arrow key to move to the Create Unit button and press Enter The Create Disk Array screen appears see Figure 9 a...

Page 50: ...Configuring Units 42 3ware 9000 Series Serial ATA RAID Controller Installation Guide Figure 9 Create Disk Array Display RAID 0 Example Figure 10 Create Disk Array Display RAID 5 Example...

Page 51: ...enable or disable write cache and set striping size The write cache and striping size parameters depend on the type of RAID level you selected Note You can enable or disable the write cache again late...

Page 52: ...ss such as video access and larger stripe sizes for random access such as a database Figure 12 Stripe Sizes for a RAID 5 For information about the field Continue on Source Error see the 3ware 9000 Ser...

Page 53: ...n For details about hot spares see page 46 3 If you configured more than one unit and you plan to install the operating system on one of them make that unit be the first unit Unit 0 in the list of Exp...

Page 54: ...ecifying a Hot Spare You can designate one of the Available Drives as a hot spare in 3BM If a hot spare is specified and a redundant unit degrades an event notification will be generated The hot spare...

Page 55: ...re 14 Hot Spare Indicated If a hot spare is already enabled you can disable it by following the same process Note In order to replace a failed drive in a degraded unit a hot spare drives must have the...

Page 56: ...rts immediately If you want to begin using the units right away you can halt the zeroing process and initialize them in the background later after the operating system is booted The initialization pro...

Page 57: ...minutes When initializing is done after booting to the OS the process of initializing takes longer than it does if initialization is done by writing zeroes to the array in the BIOS Consequently it wil...

Page 58: ...RAID 10 units data from one half of the array is copied to the other half After the initial verification subsequent verifies to a RAID 1 or 10 unit check for data consistency by comparing the data fro...

Page 59: ...ified as Unit 0 will be treated as the boot disk Installing Drivers and Making the Arrays Available For Use The final steps in setting up your RAID arrays are to load the 3ware drivers and make the ar...

Page 60: ...Configuring Units 52 3ware 9000 Series Serial ATA RAID Controller Installation Guide...

Page 61: ...03 64 bit for AMD Opteron is also supported It is recommended that you upgrade to the latest service pack available A drive or unit managed by the 3ware RAID controller may be configured to be your sy...

Page 62: ...ther drive Floppy diskette to create a driver diskette If you are installing Windows you must create a 3ware driver diskette If Windows is already installed on another device you may install the 3ware...

Page 63: ...ller follow the instructions in this section If Windows is already installed on another drive turn to Installing the Driver on a System that Boots from a Different Device on page 56 To install Windows...

Page 64: ...Windows Server 2003 documentation supplied by Microsoft 7 Turn to page 56 and follow the instructions for Making Units Managed by a 3ware Controller Available to Windows Installing the Driver on a Sy...

Page 65: ...are drivers see Figure 15 Note that you will see screens for the installation of two drivers during this process Figure 15 Found New Hardware Wizard Windows 2000 1 Click the Next button and respond to...

Page 66: ...ilar to Figure 16 indicates that you should restart your computer do so now Some drivers do not require that you restart your computer the text on the screen Completing the Found New Hardware Wizard w...

Page 67: ...ll Hardware Device Drivers 7 When the second Completing the Found New Hardware screen appears click Finish Figure 18 Completing Found New Hardware Wizard After the driver has been installed continue w...

Page 68: ...he 3ware drivers see Figure 19 Note that you will see screens for the installation of two drivers during this process Figure 19 Found New Hardware Wizard Windows XP and 2003 1 Click the Next button an...

Page 69: ...e 20 indicates that you should restart your computer do so now Some drivers do not require that you restart your computer the text on the screen Completing the Found New Hardware Wizard will indicate...

Page 70: ...me to the Found New Hardware Wizard 7 When the second Completing the Found New Hardware screen appears click Finish Figure 22 Completing Found New Hardware Wizard After the driver has been installed c...

Page 71: ...in as the system administrator 2 Use Disk Administrator to partition and format the new arrays or disks a From the Start menu choose Administrative Tools Computer Management b In the Computer Managem...

Page 72: ...You may also want to install 3ware s browser based Disk Management tool 3DM 2 or the 3ware Command Line Interface CLI With 3DM 2 and CLI you can maintain your RAID units while running Windows For mor...

Page 73: ...h as a disk attached to the motherboard The steps you follow to install the driver and make your RAID unit available depend on which version of Linux you are using and whether it will be your boot dev...

Page 74: ...latest compiled and tested driver for RedHat or SuSE Linux from the 3ware web site at http www 3ware com Included in these downloads is the Linux driver source which you can use to compile the latest...

Page 75: ...ver onto an AMD Athlon system however when you boot it will not work Determining the Current Version of your 3ware Driver If you already have a 3ware controller installed and want to check your curren...

Page 76: ...re Driver Firmware Disk Images menu click the button for the driver disk you want to create A confirmation window opens 4 Insert a blank diskette into a drive and click the Yes button to begin creatin...

Page 77: ...ware driver for Red Hat and press Enter The system automatically reports Loading 3w 9xxx driver 3 When prompted select the proper language and keyboard types for your locality 4 If asked for what type...

Page 78: ...open a console window 2 Mount the CD which contains the 3ware driver To mount the CD type mount dev cdrom and press Enter 3 Copy the driver For Redhat workstation on Intel x86 type cp mnt cdrom packag...

Page 79: ...kernel you are using For an SMP kernel multi processor the kernel string will end in smp For example 2 4 18 14smp For an Enterprise kernel the kernel string will end in enterprise For example 2 4 18...

Page 80: ...me and kernel string as described under step 3 5 Add the following line to etc modules conf alias scsi_hostadapter 3w 9xxx 6 Update the modules dep file by issuing the following command Run sbin depmo...

Page 81: ...mount the CD type mount dev cdrom and press Enter 3 Copy the driver For Redhat workstation on Intel x86 type cp mnt cdrom packages drivers linux redhat ws3_x86 intel 3w 9xxx lib modules put kernel st...

Page 82: ...ings depending on the kernel you are using For an SMP kernel multi processor the kernel string will end in smp For example 2 4 18 14smp For an Enterprise kernel the kernel string will end in enterpris...

Page 83: ...t ws3_amd64 3w 9xxx lib modules put kernel string here update 3w 9xxx o If prompted to overwrite type y Use the appropriate module name and kernel string as described under step 3 5 Add the following...

Page 84: ...d to fail For additional information about compiling drivers see the Knowledgebase on the website at www 3ware com 1 Download the 3ware driver source from 3ware s website 2 Copy the driver source into...

Page 85: ...9xxx ent To build Bigmem module type make big f Makefile rh The file created is 3w 9xxx big To build Hugemem module type make hug f Makefile rh The file created is 3w 9xxx hug To build Boot module thi...

Page 86: ...the module as follows For 2 4 kernels copy module to lib modules kernel string kernel drivers scsi 3w 9xxx o 7 If you installed a previous driver when you installed your operating system then perform...

Page 87: ...ed by the 3ware RAID controller you must create a 3ware driver diskette If Linux is already installed on another device you may install the 3ware driver from the 3ware software CD ROM To create a driv...

Page 88: ...h 10 in the procedure below are a workaround for this problem If you do not follow them and instead allow the installation to complete in Step 4 you will have to reinstall the OS from the beginning 1...

Page 89: ...ing on the installation You may see entries like reiserfs ext3 or scsi_mod If present leave them ensuring there is a space between each module name since the system needs them to boot properly Note ab...

Page 90: ...n the last line of the instruction 4 Run sbin depmod a 5 Type mkinitrd 6 If you are using the GRUB boot loader you are finished If you are using the LILO boot loader run LILO to update the boot record...

Page 91: ...opy the config file for the kernel you want to build module for from the appropriate usr src linux arch directory listed below to usr src linux config 6 Make oldconfig 7 Untar the driver source with t...

Page 92: ...etc modprobe conf and add alias scsi_hostadapter 3w 9xxx 13 Load the module modprobe 3w 9xxx To compile a 3ware driver for SuSE Linux 2 6 kernels 1 Download the 3ware 2 6 driver source from the 3ware...

Page 93: ...pe make The 3w 9xxx ko module will be built and output to the driver directory created when you untared the 3w 9xxx tgz file This will take a while since the 2 6 build process exports our module to th...

Page 94: ...Driver Installation Under Linux 86 3ware 9000 Series Serial ATA RAID Controller Installation Guide 12 Edit etc modprobe conf and add alias scsi_hostadapter 3w 9xxx 13 Load the module modprobe 3w 9xxx...

Page 95: ...you can use another device as your boot device such as a disk attached to the motherboard The steps you follow to install the driver and make your RAID unit available depend on whether it will be your...

Page 96: ...cent driver is available please see the 3ware web site Materials Required 3ware driver The driver and the corresponding source files can be found on the 3ware CD ROM at packages drivers freebsd OS ver...

Page 97: ...and reboot For instructions on how to install FreeBSD see the FreeBSD website at http www freebsd org 5 Remove the floppy disk and the CD 6 On reboot escape to the loader menu Note Once again immediat...

Page 98: ...boot time To make the driver part of the kernel 1 Boot with the FreeBSD CD ROM or diskette 2 In the sysinstall menu select Configure Load KLD module Note Immediately after the OS starts booting from t...

Page 99: ...ng directory cd usr src sys i386 conf b Copy the configuration file to a custom file For exam ple if the configuration file is GENERIC type cp GENERIC custom c Edit the custom file and add the lines s...

Page 100: ...EBUG number from 0 to 10 Specifying 0 in the above line prints no debug messages whereas specifying 10 prints a LOT of debug messages 11 Rebuild the kernel and install the new kernel 12 Reboot with th...

Page 101: ...rnel build infrastructure to include the 3ware driver sources a Change to the following directory cd usr src sys i386 conf b Copy the configuration file to a custom file For example if the configurati...

Page 102: ...line to your kernel configuration file custom in the example above options TWA_DEBUG number from 0 to 10 Specifying 0 in the above line prints no debug messages whereas specifying 10 prints a LOT of d...

Page 103: ...IRMWARE 1 7 If you intend to enable printing of debug messages in the driver uncomment the following line in Makefile CFLAGS DTWA_DEBUG number from 0 to 10 Specifying 0 in the above line prints no deb...

Page 104: ...Driver Installation Under FreeBSD 96 3ware 9000 Series Serial ATA RAID Controller Installation Guide...

Page 105: ...ibility information related to 3ware RAID controllers refer to 3ware support page at http www 3ware com support 3ware knowledgebase http www 3ware com KB kb asp 3ware software downloads http www 3ware...

Page 106: ...herboard Compatibility List on the 3ware website at http www 3ware com products compatibility asp to see if you motherboard has been tested by 3ware Q4 Some of the drives do not appear in the Disk Arr...

Page 107: ...the 3ware RAID controller and the Battery Backup Unit are sensitive electronic equipment and can be damaged through electrostatic discharge When installing the BBU on the controller be sure you are gr...

Page 108: ...roller Installation Overview The Battery Backup Unit BBU attaches to the controller at three points as illustrated in Figures 1 through 3 a Slots on the edge of the controller visible after removing t...

Page 109: ...er top view Figure 3 Points of connection on the half height controller top view Note If your 9000 series controller does not have the BBU receptacle contact technical support for assistance b BBU rec...

Page 110: ...he controller memory side down on a flat surface 2 Remove the screws that connect the PCI bracket to the controller and set the bracket aside Figure 4 Removing the screws from the PCI bracket 3 For fu...

Page 111: ...nserted through cable management clips 5 Match the clips on the end of the BBU to the slots on the edge of the controller to create a hinge and rotate the BBU to position it over the card as shown in...

Page 112: ...e controller Match the plastic post on the BBU with the hole on the controller 7 Press down gently until the BBU is seated Figure 8 BBU attached to controller 8 Reconnect the PCI bracket using the phi...

Page 113: ...r connector and power receptacle The controller is now ready to install in your system Figures 10 and 11 show the BBU fully installed on 3ware controllers You can check the status of the battery and r...

Page 114: ...Appendix A Installing the Battery Backup Unit 106 3ware 9000 Series Serial ATA RAID Controller Installation Guide Figure 10 BBU installed on controllers...

Page 115: ...re 9000 Series Serial ATA RAID Controller User Guide Caution There is a risk of explosion if the battery is replaced by an incorrect type To obtain a replacement battery contact AMCC For proper batter...

Page 116: ...lot Figure 11 Power cable from the battery to the BBU 4 Slide the battery out of the plastic 5 Insert the new battery and cable it up 6 If necessary reinstall the 3ware RAID controller close up your s...

Page 117: ...nd if not installed and used in accordance with the instructions may cause harmful interference to radio communications However there is no guarantee that interference will not occur in a particular i...

Page 118: ...WHQL certification for all its products However a product s software drivers are typically submitted for certification at nearly the same time as their release to market Since the certification proces...

Page 119: ...Testing and measurement techniques Section 3 Radiated Radio Frequency Electromagnetic Field Immunity Test EN 61000 4 4 Electromagnetic compatibility EMC Part 4 Testing and measurement techniques Sect...

Page 120: ...ed to be functionally equivalent to new Products or parts replaced under this provision shall become the property of AMCC Battery Backup Unit BBU Hardware 1 Year Hardware Warranty AMCC warrants this p...

Page 121: ...er separately or in combination with other equipment regardless of whether AMCC has been advised of the possibility of such damages AMCC is not liable for and does not cover under warranty any costs a...

Page 122: ...replacement to you at the address of your choosing Upon receipt of the advanced replacement we ask that you immediately ship the defective 3ware RAID Controller to AMCC at 455 West Maude Avenue Sunnyv...

Page 123: ...venient e mail form AMCC also offers toll free 800 945 7273 and 408 523 1145 direct phone support during normal business hours Sales and Ordering Information For sales information send an electronic m...

Page 124: ...Appendix C Warranty Technical Support and Service 116 3ware 9000 Series Serial ATA RAID Controller Installation Guide...

Page 125: ...s 48 RAID concepts and levels 28 units 40 using 3BM 38 D distributed parity 28 drive capacity 32 drive coercion 33 drive installation considerations 11 drive types 4 driver compiling as a loadable mod...

Page 126: ...1 Linux installing driver under 65 M migrating units 23 mirrored array 28 motherboard boot sequence 50 multilane cable with individual SATA connectors 20 multilane cable with multilane connectors on e...

Reviews: