3ware
®
SATA RAID Controller
Supports the 9000 Series
PN 720-0117-01 March 2005
Inst
allation Guide
Page 1: ...3ware SATA RAID Controller Supports the 9000 Series PN 720 0117 01 March 2005 Installation Guide...
Page 2: ...itten consent of AMCC 455 West Maude Ave Sunnyvale CA 94085 Trademarks 3ware Escalade and 3DM are all registered trademarks of AMCC The 3ware logo 3BM StorSwitch TwinStor and R5 Fusion are all tradema...
Page 3: ...nnect serial cables to the controller 16 To install the controller in the computer 17 To connect the interface cables to the drives 18 Installing a Serial ATA RAID Controller with Multi lane Internal...
Page 4: ...Installing the Driver on a System that Boots from a Different Device 56 Making Units Managed by a 3ware Controller Available to Windows 63 Finishing Up 64 Driver Installation Under Linux 65 Obtaining...
Page 5: ...it 99 Tools and equipment required 100 Installation Overview 100 Installation Instructions 102 Replacing the Battery 107 Appendix B Compliance and Conformity Statements 109 Federal Communications Comm...
Page 6: ...iv 3ware 9000 Series Serial ATA RAID Controller Installation Guide...
Page 7: ...to refer to the Knowledgebase available at the 3ware website at http www 3ware com support Conventions Used in This Guide The following conventions are used throughout this guide 3BM refers to the 3w...
Page 8: ...About this Guide vi 3ware 9000 Series Serial ATA RAID Controller Installation Guide...
Page 9: ...t Features The 3ware 9000 Series Serial ATA family includes 9500S 4LP 9500S 8 9500S 12 9500S 8MI and 9500S 12MI Features of the 3ware 9000 series controllers include Advanced RAID features for greater...
Page 10: ...ultiLUN support with auto carving of units greater than 2 terabytes into 2 terabyte volumes RAID Level Migration RLM and Online Capacity Expansion OCE Unit naming and unit serial number support Improv...
Page 11: ...s Operating System 3ware RAID controllers may be used with Windows 2000 Professional Server Advanced Server SP3 or newer Windows XP Professional SP1 or newer Windows Server 2003 Standard Enterprise Wi...
Page 12: ...disk mounting brackets are not included 3ware Serial ATA RAID Controller in an ESD protective bag Serial ATA interface cables one per port Cables are not included in 9500S 8MI and 9500S 12MI 3ware ins...
Page 13: ...les and drives The basic steps are listed here For details see Installing the Hardware on page 7 a Connect the interface cables to the controller card b Turn off power switches and unplug power cords...
Page 14: ...drives to be included and indicate that you want to create a disk array c Select the desired RAID configuration d Set other parameters depending on the type of RAID con figuration e Confirm the array...
Page 15: ...quipment and data Be sure to read this section Installing a Serial ATA RAID Controller and Installing a Serial ATA RAID Controller with Multi lane Internal Connectors provide step by step instructions...
Page 16: ...o Install the Controller Consider these factors when deciding on the slot in which to insert the controller Cable routing may be easier if you install the 3ware RAID controller next to an open slot Th...
Page 17: ...see Additional Details About the LED Status Connectors on page 13 Most chassis have a single drive activity cable that you can connect to the overall activity indicator on the 3ware 9000 controller Fo...
Page 18: ...nsure your own safety and that of your equipment Personal Safety Warning High voltages may be found inside computer equipment Before installing any of the hardware in this package or removing the prot...
Page 19: ...r by its edges or by the black rail and metal bracket at its two ends Do not touch any pin contact lead or component on the 3ware RAID controller Things to Watch Out For Be careful when installing the...
Page 20: ...dicator is different on the two versions as shown in the respective figures If you are not certain which version you have you can use the 3ware CLI to determine the Pchip version tw_cli c0 show pchip...
Page 21: ...ected The even numbered pins are the return or cathode side Table 1 summarizes the LED indicator pin positions for the different controllers LED indicators for individual drives on J7 and J8 Overall L...
Page 22: ...r All all activity indicator k cathode minus is on the top a anode plus is on the bottom 9500S 8 Pchip v1 4 J7 Orientation Horizontal 0 1 2 3 NU Port number NU Not Used J8 Orientation Horizontal 4 5 6...
Page 23: ...Table 1 LED Indicator Pin Positions Controller LED Header Pin Pair Comment LED indicators for individual drives on J7 and J8 Overall LED drive status indicator the last two pins of J9 The anode is the...
Page 24: ...nly be inserted in one direction This helps to ensure proper orientation and installation 2 Align the cable connector with the connector on the controller matching the slotted key and carefully mate t...
Page 25: ...ils about safety precautions see page 10 3 Open the computer case according to the manufacturer s instructions 4 Find the PCI slot you want to use for the serial 3ware RAID controller For a discussion...
Page 26: ...erface cable not connected to the 3ware RAID Controller and plug it into the drive or drive carrier One edge of each interface cable connector is keyed to ensure proper installation 3 Optional Connect...
Page 27: ...ype of enclosure you have For use with a backplane that has the InfiniBand 4x connectors SFF 8470 use the InfiniBand 4x cable which has multi lane connectors on each end as shown in Figure 6 LED indic...
Page 28: ...t the multi lane cables Depending on the model of the controller and the number of drives you will be connecting you will connect two or three multi lane cables Each cable supports up to four serial A...
Page 29: ...th the grooves in the slot and all pins make proper contact with the PCI slot pins when pushed into place The 3ware controller is keyed to ensure proper installation into a full sized PCI slot Make su...
Page 30: ...have installed the controller in the computer and attached appropriate cables to the controller and drives complete the following steps to complete the hardware installation Check your Installation an...
Page 31: ...he steps below For units using JBOD see Moving Units from an 8000 Controller to a 9000 Controller on page 23 Note In order to preserve the data that is on the units attached to the 8000 you will need...
Page 32: ...Install the 9000 controller in your system while leaving the 8000 controller installed 2 Install the Windows driver For details see Driver Installation Under Windows on page 53 3 Run the conversion u...
Page 33: ...l the 9000 controller in your system while leaving the 8000 controller installed 2 Install the Windows driver For details see Driver Installation Under Windows on page 53 3 Power down the system disco...
Page 34: ...Installing the Hardware 26 3ware 9000 Series Serial ATA RAID Controller Installation Guide...
Page 35: ...g topics Understanding RAID Concepts and Levels on page 28 Determining What RAID Level to Use on page 31 Working with the 3ware BIOS Manager 3BM on page 34 Specifying the Unit Configuration on page 40...
Page 36: ...ing the appropriate RAID level for a system Arrays and Units In the storage industry the term array is used to describe two or more disk drives that appear to the operating system as a single unit Whe...
Page 37: ...also useful if you want to add disk drives to configure into a unit without shutting down the system first Configurations Available with the 3ware RAID Controller The following RAID levels and configu...
Page 38: ...e efficiency Requires a minimum of three drives RAID 10 This array is a combination of RAID 1 with RAID 0 Striped and mirrored arrays for fault tolerance and high performance Requires a minimum of fou...
Page 39: ...e Used to store data locally on the drive before it is written to the disk allowing the computer to continue with its next task Enabling write cache results in the most efficient access times for your...
Page 40: ...ombination of RAID 0 RAID 1 hot spare or single disks 6 or more RAID 50 Depending on the number of drives a RAID 50 may contain from 2 to 4 subunits For example with 12 drives possible RAID 50 configu...
Page 41: ...ss of 2 TB If the combined capacity of the drives to be connected to a unit exceeds 2 Terabytes TB you can enable auto carving when you configure your units Auto carving divides the available unit cap...
Page 42: ...ing the start up process for your computer To start 3BM 1 Power up or reboot your system 2 While the system is starting watch for a screen similar to Figure 7 Figure 7 3ware BIOS Screen 3 Press Alt 3...
Page 43: ...m 35 A message warns you that changing your disk array configuration may overwrite data on the disks Figure 8 Warning Message When you Start 3BM 4 If you need to backup data before continuing press ES...
Page 44: ...rs and a message asks you to confirm the configuration 2 Type Y 3BM closes and the booting process resumes To exit without saving changes 1 Press Esc If you have made changes that you have not saved y...
Page 45: ...are available to create units and hot spares Exportable Units lists any existing units along with the drives contained in the units Incomplete Drives and Others If you connected drives to the control...
Page 46: ...OR Left and Right Arrow Keys OR Tab and Shift Tab Select or unselect what is currently highlighted A selection may be a drive in a list of drives a button at the bottom of the screen or a field in th...
Page 47: ...versions BIOS Firmware monitor serial number controller and model number cache memory size slot of the 3ware card and whether or not BBU support is available Shift F5 Return to the main 3ware BIOS Man...
Page 48: ...ed in the step by step example Select the drives to be included and indicate that you want to create a disk unit Choose the desired RAID configuration Set other parameters depending on the type of RAI...
Page 49: ...rives that are part of an existing unit you must first delete the other unit Be cautious in doing this as any existing data on that unit will be overwritten Figure 10 Asterisks Next to Selected Drives...
Page 50: ...Configuring Units 42 3ware 9000 Series Serial ATA RAID Controller Installation Guide Figure 11 Create Disk Array Display RAID 0 Example Figure 12 Create Disk Array Display RAID 5 Example...
Page 51: ...enable or disable write cache and set striping size The write cache and striping size parameters depend on the type of RAID level you selected Note You can enable or disable the write cache again lat...
Page 52: ...ccess such as a database Figure 14 Stripe Sizes for a RAID 5 For information about the field Continue on Source Error see the 3ware 9000 Series Serial ATA RAID Controller User Guide To confirm unit co...
Page 53: ...stall the operating system on one of them make that unit be the first unit Unit 0 in the list of Exportable Units To move a unit up in the list highlight it and press the Page Up key 4 When you are fi...
Page 54: ...Available Drives as a hot spare in 3BM If a hot spare is specified and a redundant unit degrades an event notification will be generated The hot spare will automatically replace the failed drive witho...
Page 55: ...f the following operating systems you will need to enable auto carving in order to make use of the full capacity Windows 2000 Windows XP Linux 2 4 FreeBSD 4 x You must turn on the 2TB Auto Carving pol...
Page 56: ...multiple of 2TB In this release 3BM does not show individual volumes Leaving Individual Drives as JBODs By default if you leave individual drives unconfigured JBODs they will not be available to the...
Page 57: ...lete Information about initialization for each of the different RAID types is described below RAID 0 Units RAID 0 units do not need to be initialized and are immediately available for use with full pe...
Page 58: ...intact when initialization is done in the operating system For RAID 1 and RAID 10 RAID 1 and RAID 10 units are not initialized when they are created and are immediately available for use with full pe...
Page 59: ...t it shows the appropriate boot device After installing the 3ware 9000 controller in your system go into the BIOS for your computer system to check and change the boot order This is necessary because...
Page 60: ...l the unit you have created be your system s boot device If so you will install the driver for the controller as you install the operating system Is the OS already installed on a unit connected to ano...
Page 61: ...atest service pack available A drive or unit managed by the 3ware RAID controller may be configured to be your system s boot device Or you can use another device as your boot device such as a disk att...
Page 62: ...u are installing Windows you must create a 3ware driver diskette If Windows is already installed on another device you may install the 3ware driver from either the 3ware software CD ROM or from a disk...
Page 63: ...r follow the instructions in this section If Windows is already installed on another drive turn to Installing the Driver on a System that Boots from a Different Device on page 56 To install Windows an...
Page 64: ...re specific to 3ware If you need additional instructions refer to the Windows 2000 Windows XP or Windows Server 2003 documentation supplied by Microsoft 8 Turn to page 56 and follow the instructions f...
Page 65: ...you through installing the 3ware drivers see Figure 17 Note that you will see screens for the installation of two drivers during this process Figure 17 Found New Hardware Wizard Windows 2000 1 Click...
Page 66: ...ontroller Installation Guide 4 When the Completing the Found New Hardware Wizard screen appears Figure 18 click Finish Figure 18 Completing Found New Hardware Wizard 5 If the Completing screen similar...
Page 67: ...tall Hardware Device Drivers screen appears Figure 19 click Next and follow the prompts on the screen to install the second driver Figure 19 Install Hardware Device Drivers 7 When the second Completin...
Page 68: ...gnizes it as a Plug and Play device and brings up the Found New Hardware Wizard This wizard guides you in installing the 3ware drivers see Figure 21 Note that you will see screens for the installation...
Page 69: ...appears Figure 22 click Finish Figure 22 Completing Found New Hardware Wizard 5 If the Completing screen similar to Figure 22 indicates that you should restart your computer do so now 6 When the Welc...
Page 70: ...me to the Found New Hardware Wizard 7 When the second Completing the Found New Hardware screen appears click Finish Figure 24 Completing Found New Hardware Wizard After the driver has been installed c...
Page 71: ...in as the system administrator 2 Use Disk Administrator to partition and format the new arrays or disks a From the Start menu choose Administrative Tools Computer Management b In the Computer Managem...
Page 72: ...You may also want to install 3ware s browser based Disk Management tool 3DM 2 or the 3ware Command Line Interface CLI With 3DM 2 and CLI you can maintain your RAID units while running Windows For mor...
Page 73: ...and make your RAID unit available depend on which version of Linux you are using and whether it will be your boot device This chapter provides step by step instructions for the following situations Re...
Page 74: ...an download the latest compiled and tested driver for RedHat or SuSE Linux from the 3ware web site at http www 3ware com Included in these downloads is the Linux driver source which you can use to com...
Page 75: ...your processor Be sure you load the correct driver on your system It is possible to load the wrong driver onto a system however when you boot such systems they will not work For Red Hat AMCC offers th...
Page 76: ...ample cat proc scsi 3w 9xxx 0 If you have a 2 6 kernels with sysfs type the following command cat sys class scsi_host hostid stats where hostid is usually host0 unless other SCSI devices are available...
Page 77: ...sk Images menu click the button for the driver disk you want to create A confirmation window opens 4 Insert a blank diskette into a drive and click the Yes button to begin creating the driver floppy d...
Page 78: ...ette containing the 3ware driver for Red Hat and press Enter The system automatically reports Loading 3w 9xxx driver 3 When prompted select the proper language and keyboard types for your locality 4 I...
Page 79: ...end in enterprise For example 2 4 18 14enterprise For a Bigmem kernel the kernel string will end in bigmem For example 2 4 18 14bigmem For a Hugemem kernel the kernel string will end in hugemem For ex...
Page 80: ...packages drivers linux redhat ws3_u3 x86_intel 3w 9xxx lib modules put kernel string here kernel drivers scsi 3w 9xxx o If prompted to overwrite type y For Redhat workstation on AMD Athlon 32 bit typ...
Page 81: ...mnt cdrom packages drivers linux redhat ws3_us x86_athlon 3w 9xxx lib modules put kernel string here update 3w 9xxx o If prompted to overwrite type y For Redhat workstation on AMD Opteron and EM64T ty...
Page 82: ...bin mkinitrd v f boot initrd 2 4 18 14 img 2 4 18 14 8 If you are using the GRUB boot loader skip to Step 5 If you are using the LILO boot loader run LILO to update the boot record on disk by typing t...
Page 83: ...ation on AMD Opteron and EM64T type cp mnt cdrom packages drivers linux redhat ws3_u3 x86_64 3w 9xxx lib modules put kernel string here kernel drivers scsi 3w 9xxx ko If prompted to overwrite type y N...
Page 84: ...nt cdrom packages drivers linux redhat ws3_u3 x86_64 3w 9xxx lib modules put kernel string here update 3w 9xxx ko If prompted to overwrite type y Note Use the appropriate module name and kernel string...
Page 85: ...to fail The instructions below are for compiling the driver under a 2 4 kernel For information about compiling the driver under a 2 6 kernel see the Knowledgebase on the website at www 3ware com 1 Do...
Page 86: ...nd 3w 9xxx ko for 2 6 kernels To build SMP module type make smp f Makefile rh The file created is 3w 9xxx smp To build Enterprise module type make ent f Makefile rh The file created is 3w 9xxx ent To...
Page 87: ...e ia32e f Makefile rh The file created is 3w 9xxx i32 6 Copy the module as follows For 2 4 kernels copy module to lib modules kernel string kernel drivers scsi 3w 9xxx o 7 If you installed a previous...
Page 88: ...new drive or unit managed by the 3ware RAID controller you must create a 3ware driver diskette If Linux is already installed on another device you may install the 3ware driver from the 3ware software...
Page 89: ...ompted to insert the driver disk 3 Insert the 3ware Linux driver installation diskette 4 Click OK and continue with installation Installing the 3ware Driver on a SuSE Linux System that Boots from a Di...
Page 90: ...uSE 9 1 or earlier after the existing 3w xxx entry add 3w 9xxx to lib modules kernel string modules dep file 4 Mount the CD ROM copy and install the appropriate driver for your system Note The AMD 64...
Page 91: ...rsion that you are running then perform the following steps Note that the steps vary somewhat for 2 4 kernels and 2 6 kernels instructions are provided for each You must have a full Linux kernel sourc...
Page 92: ...tory to driver cd driver 9 To build UP module boot to desired UP kernel type make f Makefile oth The created file is 3w 9xxx o 10 To build SMP module boot to desired SMP kernel type make smp f Makefil...
Page 93: ...usr src linux 5 Change the directory to cd usr src linux 6 Copy the config file for the kernel you want to build module for from the appropriate usr src linux arch directory listed below to usr src l...
Page 94: ...t and output to the driver directory created when you untared the 3w 9xxx tgz file This will take a while since the 2 6 build process exports our module to the kernel module list and then builds all k...
Page 95: ...you can use another device as your boot device such as a disk attached to the motherboard The steps you follow to install the driver and make your RAID unit available depend on whether it will be your...
Page 96: ...cent driver is available please see the 3ware web site Materials Required 3ware driver The driver and the corresponding source files can be found on the 3ware CD ROM at packages drivers freebsd OS ver...
Page 97: ...and reboot For instructions on how to install FreeBSD see the FreeBSD website at http www freebsd org 5 Remove the floppy disk and the CD 6 On reboot escape to the loader menu Note Once again immediat...
Page 98: ...boot time To make the driver part of the kernel 1 Boot with the FreeBSD CD ROM or diskette 2 In the sysinstall menu select Configure Load KLD module Note Immediately after the OS starts booting from t...
Page 99: ...ration file to a custom file For exam ple if the configuration file is GENERIC type cp GENERIC custom c Edit the custom file and add the lines shown below under RAID controllers device twa 3ware Escal...
Page 100: ...options TWA_DEBUG number from 0 to 10 Specifying 0 in the above line prints no debug messages whereas specifying 10 prints a LOT of debug messages 11 Rebuild the kernel and install the new kernel 12...
Page 101: ...e 3ware driver sources a Change to the following directory cd usr src sys i386 conf b Copy the configuration file to a custom file For example if the configuration file is GENERIC type cp GENERIC cust...
Page 102: ...line to sys conf options TWA_DEBUG opt_twa h and the following line to your kernel configuration file custom in the example above options TWA_DEBUG number from 0 to 10 Specifying 0 in the above line...
Page 103: ...e image with the driver TWA_FLASH_FIRMWARE 1 7 If you intend to enable printing of debug messages in the driver uncomment the following line in Makefile CFLAGS DTWA_DEBUG number from 0 to 10 Specifyin...
Page 104: ...Driver Installation Under FreeBSD 96 3ware 9000 Series Serial ATA RAID Controller Installation Guide...
Page 105: ...ibility information related to 3ware RAID controllers refer to 3ware support page at http www 3ware com support 3ware knowledgebase http www 3ware com KB kb asp 3ware software downloads http www 3ware...
Page 106: ...herboard Compatibility List on the 3ware website at http www 3ware com products compatibility asp to see if you motherboard has been tested by 3ware Q4 Some of the drives do not appear in the Disk Arr...
Page 107: ...the 3ware RAID controller and the Battery Backup Unit are sensitive electronic equipment and can be damaged through electrostatic discharge When installing the BBU on the controller be sure you are gr...
Page 108: ...roller Installation Overview The Battery Backup Unit BBU attaches to the controller at three points as illustrated in Figures 1 through 3 a Slots on the edge of the controller visible after removing t...
Page 109: ...er top view Figure 3 Points of connection on the half height controller top view Note If your 9000 series controller does not have the BBU receptacle contact technical support for assistance b BBU rec...
Page 110: ...he controller memory side down on a flat surface 2 Remove the screws that connect the PCI bracket to the controller and set the bracket aside Figure 4 Removing the screws from the PCI bracket 3 For fu...
Page 111: ...nserted through cable management clips 5 Match the clips on the end of the BBU to the slots on the edge of the controller to create a hinge and rotate the BBU to position it over the card as shown in...
Page 112: ...e controller Match the plastic post on the BBU with the hole on the controller 7 Press down gently until the BBU is seated Figure 8 BBU attached to controller 8 Reconnect the PCI bracket using the phi...
Page 113: ...r connector and power receptacle The controller is now ready to install in your system Figures 10 and 11 show the BBU fully installed on 3ware controllers You can check the status of the battery and r...
Page 114: ...Appendix A Installing the Battery Backup Unit 106 3ware 9000 Series Serial ATA RAID Controller Installation Guide Figure 10 BBU installed on controllers...
Page 115: ...re 9000 Series Serial ATA RAID Controller User Guide Caution There is a risk of explosion if the battery is replaced by an incorrect type To obtain a replacement battery contact AMCC For proper batter...
Page 116: ...lot Figure 11 Power cable from the battery to the BBU 4 Slide the battery out of the plastic 5 Insert the new battery and cable it up 6 If necessary reinstall the 3ware RAID controller close up your s...
Page 117: ...nd if not installed and used in accordance with the instructions may cause harmful interference to radio communications However there is no guarantee that interference will not occur in a particular i...
Page 118: ...WHQL certification for all its products However a product s software drivers are typically submitted for certification at nearly the same time as their release to market Since the certification proces...
Page 119: ...Testing and measurement techniques Section 3 Radiated Radio Frequency Electromagnetic Field Immunity Test EN 61000 4 4 Electromagnetic compatibility EMC Part 4 Testing and measurement techniques Sect...
Page 120: ...ed to be functionally equivalent to new Products or parts replaced under this provision shall become the property of AMCC Battery Backup Unit BBU Hardware 1 Year Hardware Warranty AMCC warrants this p...
Page 121: ...er separately or in combination with other equipment regardless of whether AMCC has been advised of the possibility of such damages AMCC is not liable for and does not cover under warranty any costs a...
Page 122: ...ticable thereafter AMCC will ship the advanced replacement to you at the address of your choosing Upon receipt of the advanced replacement we ask that you immediately ship the defective 3ware RAID Con...
Page 123: ...about the product visit our Web site at http www 3ware com support and use our convenient e mail form AMCC also offers toll free 800 945 7273 and 408 523 1145 direct phone support during normal busine...
Page 124: ...Appendix C Warranty Technical Support and Service 116 3ware 9000 Series Serial ATA RAID Controller Installation Guide...
Page 125: ...and levels 28 units 40 using 3BM 38 D distributed parity 29 drive capacity 32 drive coercion 33 drive installation considerations 9 drive types 3 driver compiling as a loadable module for FreeBSD 94 c...
Page 126: ...65 M mirrored array 28 module names for RedHat Linux 71 motherboard boot sequence 51 multilane cable with individual SATA connectors 20 multilane cable with multilane connectors on each end 847 20 P...
