manualshive.com logo in svg

IBM System Storage DS4000, Hardware Manual

The IBM System Storage DS4000 Installation and User Manual is a comprehensive guide designed to assist users in setting up and operating their DS4000 storage system. This essential manual covers all aspects of installation, configuration, usage, and troubleshooting. Download your free copy of the manual from manualshive.com now.

Share
Download
background image

 Index 

539

network   148
technology   127
unconfigured capacity   192

Fibre Channel Hard Disk Drives (FC HDD)   10
Field Replacement Units   40
file system   106, 109, 116, 196, 218, 235, 509, 512
firewall   166, 320
firmware   145, 174, 330
firmware file   348, 494
firmware level   328
FlashCopy   7, 125, 129, 240, 483, 489–491

logical drive   240, 481

flushing level   123, 249, 252
Free Capacity

Base Select   489

free capacity   233, 488

logical drive   192

free space   236, 489

disk drive   236
logical drive   489

Front LEDs   79
FRU   40
Full Disk Encryption (FDE)   123, 125
Full Disk Encryption (FDE) drives   16, 259
Full Disk Encryption Hard Disk Drives (FDE HDD)   10

G

Global Copy   126
Global Mirror   126
graphical user interface (GUI)   144
growth   130

H

hard disk drive firmware   349
hardware   23
hardware initiators   131
HBA firmware   357
HBAnyware   442
HBAs   445, 447
heterogeneous hosts   120
host   117, 119
host agent   144

storage subsystems   146

host attachment   67
Host Bus Adapter (HBA)   116–119, 130, 176, 218, 247, 
443, 446

FC port   117

host computer   138, 144, 151

Event Monitor   151
network connection   144
storage subsystem   144

host connection   129
host group   117, 119, 176, 198, 201, 215, 218, 371, 491

single server   119

host name   146–147, 215, 444–445, 474, 477, 479
host operating system   118, 201, 240

logical drive capacity   240
standard logical drive   241

host port   117, 127, 215, 257, 371, 491

host type   491
world wide name   215

Host SFP LEDs   80
host software   153
host system   116, 144–145, 148, 171, 218, 233, 334
host topology commands   491
host type   119
hot spare   185
hot spare coverage   189
hot spare drive   114, 116, 275
hot_add   152, 218

I

I/O activity   233, 236, 245, 248

full synchronization diverts controller processing re-
sources   245

I/O path   144, 146, 197, 247–248
I/O per second (IOPS)   447
I/O request   120–121, 123, 129, 134, 144, 247
IBM Remote Support Manager (RSM)   285
IBM System Storage Disk Systems family   1, 3
IBM System Storage DS family   2
IBM System Storage DS Remote Support Manager   20
IBM System Storage DS3000 series   2
IBM System Storage DS4000 series   8, 23, 26, 98, 103, 
118, 130

logical drive   125

IBM System Storage DS4000 Storage Manager

software   143

IBM System Storage DS4200 storage subsystem

Battery LED   82
LED   79

IBM System Storage DS4700 Express storage subsystem   
24
IBM System Storage DS4700 storage subsystem   4

chassis   24
RAID controller   26

IBM System Storage DS4800 storage subsystem

battery pack   42
chassis   42
drive-side connections   59
front bezel LEDs   46
interconnect module   42
LED   53
RAID controller LED   47

IBM System Storage DS5000 series   1–3, 6–8, 29
IBM System Storage DS5020 Controller architecture   68
IBM System Storage DS5020 storage subsystem   4, 15, 
17
IBM System Storage DS5100 storage subsystem   5
IBM System Storage DS5300 storage subsystem   5
IBM System Storage DS8000 series   2
IBM System Storage EXP5060   18
Import Array   281, 383
Import Secure Drive Array   278
in-band   144
in-band management   118, 120, 144, 146, 148, 223, 334
InstallAnywhere   333
interconnect module   40
intermixing   4

Summary of Contents for System Storage DS4000

Page 1: ...Sangam Racherla Bruce Allworth Alessio Bagnaresi Chris Bogdanowicz Corne Lottering Pablo Pedrazas Frank Schubert John Sexton Alexander Watson DS4000 and DS5000 hardware planning and configuration Remo...

Page 2: ......

Page 3: ...International Technical Support Organization IBM Midrange System Storage Hardware Guide March 2010 SG24 7676 01...

Page 4: ...ts Use duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp Second Edition March 2010 This edition applies to IBM Midrange System Storage running V7 60 firmware IBM DS Stora...

Page 5: ...TB SATA enhanced disk drive module 17 2 5 IBM System Storage DS5020 storage subsystem and EXP520 17 2 5 1 Highlights 18 2 6 EXP5060 expansion enclosure 18 2 7 iSCSI host interface 19 2 8 8 Gbps FC hos...

Page 6: ...comparison 94 3 7 DS5000 series physical specifications 95 3 8 DS5000 supported operating systems 98 3 9 DS5000 storage subsystem disk enclosures 98 3 9 1 EXP5000 and EXP520 Storage Expansion Unit 99...

Page 7: ...um features 176 4 9 3 Automatic configuration 179 4 9 4 Manual configuration 185 4 9 5 Configuring storage partitioning 201 4 9 6 Configuring mapped drives from Windows 219 4 9 7 Monitoring and alerti...

Page 8: ...6 2 1 Installing the host OS 302 6 2 2 Installing RSM 302 6 2 3 Setting up RSM 302 6 2 4 Configuring SNMP traps in Storage Manager 314 6 2 5 Activating RSM 316 6 2 6 Remote access security 317 6 2 7 M...

Page 9: ...edia Scan 403 7 7 8 Pre read redundancy check 405 7 8 Problem determination 405 7 8 1 Diagnosing drive side problems 406 7 8 2 Diagnosing host side problems 418 7 8 3 Storage Manager communication pro...

Page 10: ...figurations on the DS5000 series 519 Jumbo frames 519 Virtual Local Area Networks 520 Ethernet priority 521 Security 522 Internet Storage Name Service 522 Challenge Handshake Authentication Protocol 5...

Page 11: ...itions of the publication IBM may make improvements and or changes in the product s and or the program s described in this publication at any time without notice Any references in this information to...

Page 12: ...ereof are trademarks of Advanced Micro Devices Inc Emulex HBAnyware SBOD and the Emulex logo are trademarks or registered trademarks of Emulex Corporation Novell SUSE the Novell logo and the N logo ar...

Page 13: ...orage servers and can be used in conjunction with the following IBM Midrange System Storage Redbooks publications IBM Midrange System Storage Implementation and Best Practices Guide SG24 6363 IBM Midr...

Page 14: ...of a Virtual EMEA Team VET providing Level 2 support for DS4000 and DS5000 products in Europe He also maintains a keen interest in performance and configuration issues through participation in the St...

Page 15: ...hes and DS4000 products He has over ten years of experience in planning managing designing implementing analyzing and tuning of SAN environments He has worked at IBM for ten years His areas of experti...

Page 16: ...ts welcome Your comments are important to us We want our books to be as helpful as possible Send us your comments about this book or other IBM Redbooks publications in one of the following ways Use th...

Page 17: ...created or updated on March 16 2010 March 2010 Second Edition This revision reflects the addition deletion or modification of new and changed information described below New information Controller fi...

Page 18: ...xvi IBM Midrange System Storage Hardware Guide...

Page 19: ...rage subsystems and positions them within the overall IBM System Storage Disk Systems DS family The IBM Midrange System Storage storage subsystems include the IBM System Storage DS4000 and IBM System...

Page 20: ...The IBM System Storage DS4000 DS5000 series of disk storage systems that this IBM Redbooks publication addresses is the IBM solution for midrange departmental storage requirements and controlling cha...

Page 21: ...and DS5000 uses Redundant Array of Independent Disks RAID technology RAID technology is used to protect the user data from disk drive failures DS storage subsystems contain Fibre Channel FC interface...

Page 22: ...he storage server enclosure and can attach up to six EXP810 Expansion Units for a total of up to 112 Fibre Channel or SATA disk drives The DS4700 comes in two models Model 72 and Model 70 The Model 72...

Page 23: ...B 16 GB or 32 GB of cache memory and one of the combinations of host interfaces specified in the list above IBM System Storage DS5300 server The DS5300 server has greater scalability than the DS5100 T...

Page 24: ...es and SSD as well An intermix of FC SATA FDE and SSD drives is supported within this expansion enclosure EXP520 Expansion Enclosure This expansion unit is packaged in a 3U rack mountable enclosure su...

Page 25: ...o 8 EXP5060s feature pack must be purchased for the DS5100 DS5300 storage subsystem to enable it to be connected to up to eight EXP5060 storage expansion enclosures 1 4 IBM System Storage DS Storage M...

Page 26: ...pport Storage Manager host based software includes an optional failover driver It is a multipath driver built on MPIO technology Storage Management Initiative Specification Provider SMI S Provider An...

Page 27: ...re available with the same interfaces used by hard disk drives for example SAS SATA and Fibre Channel and they are packaged in the same form factors as hard disk drives 3 5 in 2 5 in and 1 8 in SSDs a...

Page 28: ...ic integrated circuit ASIC that is used to encrypt every bit of data as it is written and also decrypts data as it is being read ASIC requires a security key to allow encryption and decryption to begi...

Page 29: ...50 GB 7 2k rpm SATA II all the models 1000 GB 7 2k rpm SATA II all the models 2000 GB 7 2k rpm SATA II only EXP5000 1 6 iSCSI basics All the DS5000 series models now support iSCSI host connectivity an...

Page 30: ...does mean that the CPUs on the host server have to run the iSCSI stack to perform encapsulation of SCSI commands and data This causes increased CPU and memory processing which can impact performance...

Page 31: ...rbitrated loops were commonly implemented with the use of an FC hub Even though this is physically a star topology logically it will be a loop Alternatively devices can be connected in a daisy chain m...

Page 32: ...of light The core diameter is much smaller than the core of multi mode cable Therefore coupling is much more demanding and tolerances for single mode connectors and splices are very low However singl...

Page 33: ...rp 2010 All rights reserved 15 Chapter 2 New features This chapter provides a brief description about new features that are part of controller firmware version CFW 7 60 and the IBM System Storage DS50...

Page 34: ...vibration But the vast majority of applications cannot justify the extra cost so SSDs have remained a rarity A new storage device type based on non volatile flash memory is now available for enterpris...

Page 35: ...nnel protocol so that the DDM module fits in every EXP810 EXP5000 and EXP520 However the drive requires a certain enclosure service module ESM firmware and controller firmware version CFW to be recogn...

Page 36: ...ccommodates up to 16 disk drives installed within the DS5020 enclosure with attachment support for up to six EXP520 expansion units providing modular and highly scalable storage solutions that range u...

Page 37: ...timal performance iSCSI host interface cards HICs are only an option when initially purchasing the IBM DS5020 iSCSI HICs for the DS53100 and DS5300 are available as field replacable upgrades MES that...

Page 38: ...ide fast response time to alerts Offers detailed information about each alert for error analysis Designed to manage up to 50 DS5000 DS4000 DS3000 storage systems per implementation Sends log and statu...

Page 39: ...has been added to view a subsystem summary The Logical Physical view has been replaced by separate Logical and Physical view tabs and a Support tab has been added to combine all the support activitie...

Page 40: ...22 IBM Midrange System Storage Hardware Guide...

Page 41: ...ut the older DS4000 models see IBM System Storage DS4000 and Storage Manager V10 30 SG24 7010 The chapter also includes a description of additional hardware components that are essential for a complet...

Page 42: ...of the key advantages of the DS4700 Express 4 Gbps technology is that it is backwards compatible with 2 Gbps and even 1 Gbps technologies This means that you can avoid replacing your entire SAN with 4...

Page 43: ...or 4 Gbps host connection speeds Supports Global Hot Spare Host side connections support Fibre Channel switched loop or direct connections Redundant drive side connections designed to avoid any single...

Page 44: ...apability email alerts email alerts Non call Home support Yes Yes Hot swappable disks components Yes Yes Concurrent firmware upgrade RSM for Storage RSM for Storage Call Home support Global Mirror Glo...

Page 45: ...ed loop within the disk enclosure that existed in the previous EXP700 model This feature allows not only better performance in a large configuration resulting from reduced loop latency but also improv...

Page 46: ...es not recommend the intermixing of expansion units in the same redundant drive channel pair IBM recommends connecting all of the EXP710s to a redundant drive channel pair and all of the EXP810s to th...

Page 47: ...ly comes with eight host channels 4 Gbps FC and 8 GB cache for data Model DS5300 comes with eight or sixteen host channels 4 Gbps FC and 8 or 16 GB cache for data and full performance activation Model...

Page 48: ...tal of 448 disks This will allow you to install up to 448 TB of raw capacity with 1 TB SATA disks or 268 TB of raw capacity with FC drives or mixed Supports a maximum of 20 Solid State Drives SSDs wit...

Page 49: ...operations especially for calculating redundancy information for RAID 3 RAID 5 and RAID 6 The parity can be calculated much faster by dedicated hardware than by software which results in good perform...

Page 50: ...Gb s FC Chip Host Interface Card Host Interface Card RJ45 RJ45 DB 9 Ethernet Ethernet Serial Host Card I F Host Card I F Processor Memory Battery Backup DDR SDRAM Data Cache XOR ASIC Internal Control...

Page 51: ...3 Figure 3 7 shows the DS5300 s controller B with the top lid removed Model 5100 may have only one left Host Interface Card and has less data cache memory Figure 3 7 DS5300 controller Host Interface C...

Page 52: ...data movement in and out of the cache memory The controller cache is a significant contributor to the overall performance of the storage array The use of the cache increases controller performance in...

Page 53: ...r an indefinite period of time In this case the controller also has a battery with enough capacity to let it write the full contents of the cache memory to the persistent cache backup devices in case...

Page 54: ...controllers and all ports In this example there is a RAID 5 array group defined on five drives and one volume with the default controller A preferred ownership and a segment size of 256 KB There is a...

Page 55: ...is written to disks of the array 4 Depending on the number of disks the local or second controller s ports are used for writing Encl 1 Encl 2 Encl 3 Encl 4 Encl 5 Encl 6 Encl 7 Encl 8 7 6 5 4 3 2 1 8...

Page 56: ...nd their state will be Empty Clean A cache block that contains data that is consistent with the data on disk is Clean Dirty Write Through Dirty WT A cache block that contains new data that is not cons...

Page 57: ...Yes No No Yes No Read No No Write Through Yes Yes I O Request Controller A Yes Read or Write Is data in cache Read data from Cache cache hit Write caching enabled Set cache block Dirty WT Battery OK...

Page 58: ...swappable and can be interchanged while the system is online allowing DS5000 users to maximize their uptime See the corresponding service guide for specific replacement instructions that take place fo...

Page 59: ...caching without batteries You can find more details about this topic in Chapter 4 IBM System Storage DS planning and configuration on page 103 When the interconnect module is put back in place the DS...

Page 60: ...Figure 3 15 Power distribution The DS5000 storage subsystem battery packs do not use the expiration dates Only replace a battery pack when the LEDs have indicated that they have failed see Interconne...

Page 61: ...hassis controller A is removed Figure 3 16 DS5000 storage subsystem without a chassis Figure 3 17 shows the interconnect module with the removed battery Figure 3 17 Interconnect module with removed ba...

Page 62: ...en fully recharged following any required rest period This controlled discharge followed by a rest period followed by a charge is referred to as a learn cycle Learn cycles occur automatically at sched...

Page 63: ...subsystem host side connections on page 55 You can have a Fibre Channel version which has one or two FC HICs installed per controller Figure 3 18 iSCSI Version which has one or two iSCSI HICs install...

Page 64: ...lights allow the DS5000 to communicate with the user There are four main components with LEDs front bezel panel RAID controllers controller support modules and the interconnect module Front bezel LED...

Page 65: ...25 on page 49 labels each LED see the descriptions of each LED number after Figure 3 25 on page 49 Important The displayed order of the Overall Configuration Needs Attention and Locate Identify LEDs...

Page 66: ...8 Gbps HIC Figure 3 24 on page 49 describes the LEDs for a iSCSI HIC Figure 3 22 4 Gbps HIC faceplate design Figure 3 23 8 Gbps faceplate design Ch 1 Ch 2 Ch 1 Ch 2 Ch 3 Ch 4 Ch 3 Ch 4 2 4 1 2 4 1 2...

Page 67: ...CSI faceplate design Figure 3 25 shows details about the controller LED and its status Figure 3 25 DS5000 storage subsystem RAID controller rear LEDs 100 1000 100 1000 Link activity Link speed on 1Gbp...

Page 68: ...ed Off Normal status On Safe to remove LED 8 amber Needs attention Off Normal status On Controller needs attention controller fault or controller is offline LED 9 green Cache active On Data in cache O...

Page 69: ...problem such as mismatched controller types or it might be non operational due to hardware faults HIC version L1 Label L2 Label Definition 4 Gbps FC Off 1 Gbps Off 2 Gbps When both LEDs for a host or...

Page 70: ...nit L2 Suspend Persistent memory errors Needs Attention condition for offline controller L3 Suspend Persistent hardware errors Needs Attention condition for offline controller L4 Suspend Persistent da...

Page 71: ...LED indicator lights are shown in Figure 3 26 Figure 3 26 Controller support module power supply fan LEDs The LEDs are Power LED green On Power supply and fan unit is providing power Off Power supply...

Page 72: ...tery needs attention amber Off Normal status On Battery failed Power LED green On Storage subsystem is powered on Off Storage subsystem is powered off Overall DS5000 storage subsystem configuration re...

Page 73: ...ervice personnel only Each DS5000 controller holds up to two Host Interface Cards HICs see Figure 3 28 These HICs are currently available 4 Gbps FC HIC four ports per HIC 8 Gbps FC HIC four ports per...

Page 74: ...take advantage of the DS5000 storage subsystem s ability to fail over and distribute the workload among the two controllers For any given host make sure to connect to the same host port number in the...

Page 75: ...29 shows how the DS5000 would be connected into dual redundant fabrics Figure 3 29 SAN connected hosts to DS5000 storage subsystem According to Figure 3 30 host ports in controller B have numbers 1 6...

Page 76: ...rface Card per controller 1 Controller A host card 1 port 1 controller B host card 1 port 1 2 Controller A host card 1 port 3 controller B host card 1 port 3 3 Controller A host card 1 port 2 controll...

Page 77: ...ller The numbering scheme for the drive connections is structured like the host connections Because controller A is upside down the left to right numbering of the drive connection ports is reversed Th...

Page 78: ...ive channel group must run at the same speed There is no blocking between the two adjacent ports at the drive channel group level It is best to spread out the drive side channel pairs among the channe...

Page 79: ...gotiate to the speed of the EXP The DS5000 controller drive port must always be connected to the EXP5000 port labelled 1B Because the left and right EXP5000 ESMs ESMs A and B are inserted in the ESM b...

Page 80: ...mong the eights drive channel pairs as you scale up your DS5000 storage subsystem s storage capacity This allows you to fully utilize the maximum drive side bandwidth For attaching the first four encl...

Page 81: ...he ninth or more enclosures attach them to existing disk loops by daisy chaining them A 256 disk configuration should have two expansion enclosures on each drive side channel pair and uses 16 EXPs in...

Page 82: ...448 drive configuration It requires you to attach seven expansion units EXP5000 to one redundant port channel pair As a result you will have four EXPs connected to one drive port pair and three EXPs...

Page 83: ...s to introduce additional isolation and to separate management and service traffic from one another Because of the extra port it is preferable to have two IP addresses per controller in order to manag...

Page 84: ...from IBM It is designed to deliver high performance advanced functionality high availability and modular and scalable storage capacity The DS5020 disk system is designed to deliver up to a two fold I...

Page 85: ...ller Additionally you may order initially either 2 Dual 8 Gbps Host Interface Cards HIC 2 Dual 1 Gbps ISCSI HIC System cache DS5020 comes with 2 GB cache memory 1 GB per internal RAID controller The 4...

Page 86: ...43 on page 69 share the same PCI E x8 bus to transfer their data to the XOR chip The main FC switch on the controller mainboard processes the FC traffic for the drive channels as well as for the two s...

Page 87: ...nsfers just the SCSI packet through it Figure 3 43 DS5020 iSCSI HIC architecture Because of the similarities between the DS5000 controller models we refer to 3 4 1 DS5100 and DS5300 controller archite...

Page 88: ...te a normal operating status Amber LEDs Needs Attention indicate a possible failure A blue LEDs on a CRU indicates that it is safe to remove the component Figure 3 45 DS5020 power supply and fan unit...

Page 89: ...t card Controllers with 2 GB memory two standard 8 Gbps FC host ports and one optional 2 port 1 GB iSCSI host card The controllers vary only in the size of the cache either 1 or 2 GB and the type of t...

Page 90: ...FPs pre installed Ctrl B Ctrl A FC Host Channels Ch Ch 1 Ch 1 Ch 2 Ch 2 2 8 4 2 8 4 4 2 FC Drive Channels Ch P 1 Ch 2 Ch 1 P 2 Port 1 Port 2 ID Diag Onboard dual port 8 Gbps HIC Onboard 4 Gbps drive c...

Page 91: ...carrier assembly drive tray Install E DDM CRUs in the 16 drive bays on the front of the storage subsystem from the leftmost slot slot 1 to the rightmost slot slot 16 When an E DDM is installed the dr...

Page 92: ...ED lights is not flashing If the E DDM you want to remove is not in a failed or bypass state always use the Storage Manager client program either to place it in a failed state or to place the array th...

Page 93: ...They vary only in host port configurations The base model does not have the optional Host Interface Cards HIC It comes with four 8 Gbps Fibre Channel host ports Attention Never hot swap an E DDM CRU...

Page 94: ...ller B The same configuration applies to the power supply and fan unit It is important to keep this information in mind when connecting the back end ports to hosts and drive side expansion enclosures...

Page 95: ...operating speed of the Fibre Channel port is determined by two factors The speed of the SFP module that is installed The speed of the Fibre Channel connection For example a 4 Gbps SFP that is plugged...

Page 96: ...ibrate the battery charging level The battery unit is hot swappable You can remove the battery unit for servicing and then reinsert it while the DS5020 continues to perform I O operations The battery...

Page 97: ...ctor is a physical switch that must be used to set the enclosure speed The DS5020 Express storage system drive channel operates at only at 4 Gbps Fibre Channel interface speed Front LEDs These are Loc...

Page 98: ...annel speed L2 Table 3 5 FC host SFP status LED definitions Disk Channel SFPs LEDs Table 3 6 FC disk expansion port SFP LED definitions LED 0 LED 1 Port status OFF OFF Link down ON OFF Link rate 2 Gbp...

Page 99: ...Enclosure ID on page 82 for details Off Normal status On Safe to remove Need attention amber Off Normal status On Controller needs attention controller fault or controller is offline Caching active g...

Page 100: ...addition the single digits x1 of the enclosure IDs of all storage expansion enclosures and the DS5020 storage subsystem in the redundant drive channel loop pair must be unique Because the DS5020 has...

Page 101: ...s On Safe to remove Battery charging green On Battery charged and ready Blinking Battery is charging Off Battery is faulted discharged or missing Needs attention or service action required amber Off N...

Page 102: ...oller itself The DS5020 has two 8 Gbps host connections by default They are mounted on the mainboard of the controller Another two host ports per controller can be added when ordering the DS5020 They...

Page 103: ...the same host port number on each controller The host port layout is shown in Figure 3 68 on page 91 Figure 3 62 DS5020 mixed host connection layout 3 5 7 DS5020 storage subsystem drive side connectio...

Page 104: ...rt The DS5020 controller drive port must always be connected to the EXP520 or EXP810 port labelled 1B Because the left ESM A and right ESM B enclosure service modules ESM are inserted in different ori...

Page 105: ...DS5020 depends on how many expansion units you must attach If you attach only one enclosure make sure that you have one connection to each of the controllers thus using one of the two ports on each c...

Page 106: ...Hardware Guide If you attach a second expansion unit connect it by using the second port on the controller controller A port 1 and controller B port 2 as shown in Figure 3 65 Figure 3 65 DS5020 drive...

Page 107: ...ardware 89 Beyond two enclosures up to a maximum of six make sure that you equally distribute the enclosures among the redundant drive channel pairs Figure 3 66 and Figure 3 67 on page 90 Figure 3 66...

Page 108: ...e cabling with six EXPs Drive side cabling example As shown in Figure 3 67 the DS5020 is cabled using all two drive channel pairs assuming that there are six expansion enclosures EXP evenly spread out...

Page 109: ...right ESM of the second EXP 5 Cable the port 1B on the right ESM of the second EXP to the port 1A on the right ESM of the third EXP 6 Cable controller B drive port 1 to the port 1B on the right ESM o...

Page 110: ...t in order to let service personnel to connect using the default IP addresses The default IP addresses for the controllers are shown in the Table 3 7 The default subnet mask for all four Ethernet port...

Page 111: ...storageperformance org results 1 600 MB s 50 000 IOPS 200 000 IOPS 2 GB 4 GB 8 GB s PCI Express x8 4 GB s Intel xScale1 2 GHx 112 FC FDE SATA Four 4 Gb s Four 8 Gb s FC or Eight 8 Gb s FC or Four 8 G...

Page 112: ...e channels Sixteen 4 Gbps Max drives 448 FC SATA Processor Intel Xeon 2 8 GHz Processor memory per controller 2 GB XOR technology Dedicated ZIP ASIC Internal controller bandwidth per controller 4 GB s...

Page 113: ...installed 27 67 kg 61 lbs Fully configured 16 drive modules installed 39 92 kg 88 lbs 3 2 Gbps 1 Gbps on single PCI X buss Across backend drive loops Battery backed 4 8 or 16 GB 224 Eight 4 Gbps FC D...

Page 114: ...Width 482 60 mm 19 00 in Depth 558 80 mm 22 0 in Weight Drive ready without drive modules installed 31 30 kg 69 lbs Fully configured 16 drive modules installed 38 56 kg 85 lbs Operating environment Th...

Page 115: ...rees F at 0 to 914 m 0 3 000 ft 10 to 32 degrees C 50 to 90 degrees F at 914 to 2 133 m 3 000 7 000 ft Relative humidity operating 8 to 80 Relative humidity storage 5 to 80 Electrical power per power...

Page 116: ...V3 Solaris Sun Solaris 9 U8 and 10 U7 all architectures 3 9 DS5000 storage subsystem disk enclosures The EXP5000 is the expansion enclosure available for the DS5000 series except for the DS5020 storag...

Page 117: ...redundant cooling EXP5000s connect to DS5100 and DS5300 controllers through high speed 4 Gbps FC disk expansion ports and have a physical storage capacity of up to 16 TB per enclosure using 1000 GB S...

Page 118: ...city 300 GB formatted capacity is equal to 278 88 GB usable capacity 450 GB formatted capacity is equal to 415 58 GB usable capacity 600 GB formatted capacity is equal to 558 28 GB usable capacity 750...

Page 119: ...t FRUs each containing one power supply and two fans ESMs Two removable environmental services monitors ESMs Figure 3 73 EXP5000 and EXP520 rear view In Figure 3 73 you see the following LEDs and conn...

Page 120: ...pports two ESM CRUs to help provide system redundancy Each ESM connects a separate Fibre Channel loop to one of the two Fibre Channel ports on the disk drives which is designed to provide both loops a...

Page 121: ...ture During the planning process you need to answer numerous questions about your environment What are my host connection requirements What additional hardware do I need What reliability do I require...

Page 122: ...a particular situation and then you can draw your own conclusions RAID 0 For performance but generally not recommended RAID 0 Figure 4 1 is also known as data striping It is well suited for program li...

Page 123: ...sk drive In addition the transaction log performs mostly sequential writes Only rollback operations cause reads from the transaction logs Therefore we can achieve a high rate of performance by isolati...

Page 124: ...centage random write intensive do not perform as well on RAID 5 logical drives because of the way a controller writes data and redundancy data to the drives in a RAID 5 array If there is a low percent...

Page 125: ...also maximum distance separable MDS The calculation of q is complex In the case of the DS5000 storage subsystem this calculation is made by the hardware and thus more performant than the software bas...

Page 126: ...ture Description Definition Distributed parity Disk striping and two independent parity blocks per stripe Can survive the loss of two disks without losing data Benefits Data redundancy high read rates...

Page 127: ...ize this information Table 4 2 RAID levels comparison Summary Based on the respective level RAID offers the following performance results RAID 0 offers high performance but does not provide any data r...

Page 128: ...s book The money saved by economizing on drives can be easily overwhelmed by the business cost of a crucial application going down until it can be restored from backup Naturally no data protection met...

Page 129: ...e array only contains one logical drive Drive types There are three different disk drive types available for the DS Storage Systems Fibre Channel FC disks Encryption capable FDE or not Solid State Dri...

Page 130: ...ys across multiple enclosures rather than in one enclosure so that a failure of a single enclosure does not take a whole array offline By default the automatic configuration is enabled However this is...

Page 131: ...tion would still function in a degraded state as the other drives are not affected by the failure Figure 4 6 Enclosure loss protection In the example shown in Figure 4 7 without enclosure loss protect...

Page 132: ...logical drives and data accessed at any given time depend on which applications and users are active during that time period which is why it is important to monitor the system Enhanced Remote Mirror c...

Page 133: ...and a SATA drive at the largest capacity within the array If a secure capable FDE Fibre Channel and SATA hot spare drive are included all arrays are protected Hot spares locations Distribute the hot...

Page 134: ...hardware unless the use of the DS5000 storage subsystem is dedicated to a single host for example SVC attachment where it is seen as a single host Storage partitioning on the other hand allows the cr...

Page 135: ...CSI it is provided by the Ethernet switch The DS5000 storage subsystem only communicates through the use of this host port s identifiers The storage system is not aware of which host bus adapters are...

Page 136: ...drive must be mapped to the storage partition for the managing host In a security sensitive environment you can also assign the access logical drive to a particular storage partition and ensure host b...

Page 137: ...ge partitioning you should create a table of planned partitions and groups so that you can clearly map out and define your environment Table 4 4 shows an example of a storage partitioning plan This cl...

Page 138: ...choose is 128 KB unless you are creating logical drives under a RAID 3 or choosing the multimedia type for the logical drive in which case a segment size of 256 KB is used The choice of a segment siz...

Page 139: ...t number of times if the block size is too big and you have to use multiple stripes To calculate the best segment size in this environment consider the RAID protection and number of drives participati...

Page 140: ...our layers of paths that is wires connecting adjacent layers of components to each other Starting at the top in this model there are some number of host servers not shown that connect over some number...

Page 141: ...following settings to be configured DS5000 system wide settings Start and stop cache flushing levels this setting will affect all arrays and logical drives created on the system Cache Block size Logic...

Page 142: ...terprise network 4 2 Planning for premium features Premium features are optional features that are activated after being purchased by registering a key using the Storage Manager software When planning...

Page 143: ...r all DS5000 models the base number of disk drives supported can be upgraded up to 448 drives 4 2 4 FlashCopy A FlashCopy logical drive is a point in time image of a logical drive It is the logical eq...

Page 144: ...s writes host I O performance is slower than it is in asynchronous write mode Global Copy Global Copy is an asynchronous write mode All write requests from a host are written to the primary local stor...

Page 145: ...ge for applications that require immediate access to data such as databases and frequently accessed user data Primary storage holds business critical information and data with the highest value and im...

Page 146: ...ct Attach When planning the setup of a Storage Area Network SAN you want the solution to answer your current requirements and fulfill your future needs First the SAN should be able to accommodate a gr...

Page 147: ...items that need to be certified and checked It should include such items that require you to Ensure that the existing versions of firmware and storage management software are up to date Ensure host o...

Page 148: ...er controller is supported so you have to create a zone for the connection between the host bus adapter HBA1 and controller A and a separate zone that contains the other HBA2 to controller B If using...

Page 149: ...for both iSCSI connections and FC connections to the storage system In order to define hosts and partitions in iSCSI remember that you have to plan for iSCSI addresses for the host ports and use the...

Page 150: ...omated discovery management and configuration of iSCSI devices on a TCP IP network iSNS servers offer additional security services through explicitly defined initiator to target mappings and simplifie...

Page 151: ...L Native Cluster Sun Cluster Steeleye Lifekeeper 5 3 6 0 U1 HP MC Service Guard 11 18 00 Symantec VERITAS Cluster VMware Cluster Service 4 4 4 Multipathing IBM offers different multipath drivers that...

Page 152: ...ths Table 4 5 shows the DS5000 storage subsystem interoperability matrix of multipathing drivers Table 4 5 DS5000 storage subsystem interoperability matrix of multipathing drivers Load Balancing Polic...

Page 153: ...fferent data transfer speeds Least queue depth with subset The least queue depth with subset policy is also known as the least I Os or least requests policy This policy routes the next I O request to...

Page 154: ...erability matrix or the readme file for your HBA driver The matrix can be found at http www 01 ibm com systems support storage config ssic index jsp 4 4 6 AIX MPIO With Multiple Path I O MPIO a device...

Page 155: ...ts Manages all of the plug and play interactions Provides I O routing information Identifies conditions requiring a request to be retried failed or failed over Automatically fails over the LUNs to the...

Page 156: ...st part of them A DS5000 storage system can still be used to allocate storage to hosts or use the SVC This is dependant upon various needs and requirements The SVC also offers an alternative to FlashC...

Page 157: ...e path All logical drives on the preferred controller are transferred to the alternate controller This is the configuration setting for Microsoft Windows IBM AIX and Linux when using the RDAC or SDD d...

Page 158: ...mmand manually to balance the LUNs across the controllers Host Server 1 0 1 2 3 1 2 3 A 2 B 3 X Application 0 0 Host Server 1 0 1 2 3 1 2 3 A 2 B 3 X Application 0 0 Application is using LUN 0 Failove...

Page 159: ...UNs that can be assigned to one host and the maximum logical volume size supported by various operating systems Note In AVT mode RDAC automatically redistributes the LUNs to their preferred path after...

Page 160: ...storage partitioning in 4 1 4 Storage partitioning on page 116 Table 4 8 lists the operating system limits as well as the limits of the DS5000 storage subsystem Table 4 8 Maximum number of LUNs per h...

Page 161: ...gical drives and convert from one RAID level to another Storage Manager also allows the user to perform troubleshooting and management tasks such as checking the status of the storage subsystem compon...

Page 162: ...ce handles notification functions e mail and SNMP traps and can monitor storage systems whenever the Enterprise Management window is not open The command line interface SMcli is also packaged with the...

Page 163: ...devices The controller firmware can be thought of as the operating system and application code for the storage subsystem and the NVSRAM can be thought of as the configuration of the application Envir...

Page 164: ...ystems that are attached to the host can be automatically discovered Managing storage systems through the host agent has the following disadvantages The host agent requires a special logical drive cal...

Page 165: ...systems that are supported by the current level of Storage Manager An access logical drive is not needed to communicate with the controllers The maximum number of logical drives that are supported by...

Page 166: ...nstall the TCP IP software on the host and assign an IP address to it This way permits other workstations in the network with the SMclient installed to manage the DS5000 storage subsystem by connectin...

Page 167: ...r configuration and perform other various tasks such as providing proper names to each subsystem configuring alert notification destinations and updating firmware or selecting a particular storage sub...

Page 168: ...igure 4 16 In our illustration we assume out of band management from a machine that only has a TCP IP connection to the DS5000 storage subsystem Figure 4 16 Enterprise Management Device view Note Alth...

Page 169: ...ions available in the Subsystem Management windows later in 4 7 1 Installing Storage Manager in a Windows Server 2008 host on page 153 4 6 3 Event Monitor service The Event Monitor service handles not...

Page 170: ...em hardware FlashCopy work smoothly It is run against a specific drive or mount point and causes the buffers to be flushed to disk mppUtil This utility is used in conjunction with the Linux driver to...

Page 171: ...he following steps 1 Because you are installing new software including new drivers you need to log on with administrator rights 2 Locate and run the installation executable file either in the appropri...

Page 172: ...t Installation Type The installation type you select defines the components that will be installed For example if you select Management Station then the multipath driver and Agent components will not...

Page 173: ...you choose the components as you can see in Figure 4 19 Figure 4 19 InstallAnywhere Select Storage Manager components Besides the usual Storage Manager components you can choose to install Java Acces...

Page 174: ...there are several management machines the Event Monitor should only run on one If you want to use the Event Monitor with SNMP you have to install the Microsoft SNMP service first because the Event Mo...

Page 175: ...t correctly in Windows Server 2008 To verify the correct installation of the SM perform the following steps 1 Look in your Programs folder for a new program entry called IBM DS Storage Manager 10 Clie...

Page 176: ...t software to manage one or more storage systems you can set the Startup Type to Manual Verifying the SMutil installation To verify that you have installed the SMutil correctly on Windows operating sy...

Page 177: ...g the controller microcode Updating the drive and ESM microcode 4 8 1 Physical installation You should have already completed the physical installation of your DS5000 storage subsystem hardware See th...

Page 178: ...and switches if installed must be powered on before the host to ensure proper loop initialization When connecting your DS5000 storage subsystem ports to a SAN switch or directly to a host match whene...

Page 179: ...use by service personnel or for subsystem monitoring hardware that might be available in the future The default IP addresses of the additional Ethernet ports are Controller A 192 168 129 101 Controlle...

Page 180: ...e you are using the Storage Manager software after it is launched the program presents a window to start automatic discovery of the attached devices b Select OK to initiate an automatic discovery If t...

Page 181: ...IP addresses as shown in Figure 4 25 Figure 4 25 Manually adding a storage system c A confirmation message appears and prompts you for additional storage subsystems Click No to finish adding storage...

Page 182: ...o set a password for your storage subsystem as shown in Figure 4 27 Figure 4 27 Password protection e The storage subsystem synchronizes with the management station clock when they become out of synch...

Page 183: ...m but with the default IP addresses We need to change the address to your specific ones In the Subsystem Management window select the Setup tab and then scroll down to select Configure Ethernet Manage...

Page 184: ...ice See Figure 4 24 to be sure of where to connect the LAN cables Figure 4 29 DS5000 Controller Network Configuration change After changing the IP addresses close the Storage Subsystem window and remo...

Page 185: ...tasks that you should implement before the configuring the arrays and data storage When you start the Storage Manager client the Enterprise Management window opens either showing the Device Managemen...

Page 186: ...method as shown in Figure 4 31 Figure 4 31 Add Storage Subsystems setup task The automatic discovery process sends out broadcasts through Fibre Channel if SMagent is installed and started and the IP...

Page 187: ...4 32 Enterprise Management window You can see all detected DS5000 storage subsystems and how they are managed either direct out of band or host agent attached in band or through both connections Ther...

Page 188: ...ame Storage Subsystem option in the Setup view of the Enterprise Management window as shown in Figure 4 33 Figure 4 33 Initial Setup Tasks Name or rename a storage system 2 Type in the name you want t...

Page 189: ...lready set the clocks on the storage subsystems set them now Be sure that your local system is using the correct time and then select Storage Subsystem Set Controller Clock Figure 4 34 Figure 4 34 Set...

Page 190: ...password Configuring alerts This option allows you to set up the alert structure If there are any problems with any of the storage subsystems an e mail or an SNMP notification can be sent The Initial...

Page 191: ...in an incorrect order select Storage Subsystem Change Enclosure Order as shown in Figure 4 36 Figure 4 36 Change the enclosure order Now you can sort the enclosures according to your site setup as sh...

Page 192: ...res or individual enclosures and controllers Figure 4 38 The two options are to always sound an alarm or never sound an alarm The lower part of the window shows the alarms that are already sounding wh...

Page 193: ...the specific version you want apply which is available at the IBM support Web site You can find a detailed procedure in 7 1 5 Updating controller firmware on page 333 Always check the IBM System Stor...

Page 194: ...n This will allow you implement your storage requirements in the best way minimizing any problems with a future desired reconfiguration Keep all the necessary information regarding the different confi...

Page 195: ...the Web site select Activate a Premium Feature read the requirements and then click Continue Complete the fields presented in the window shown in Figure 4 40 by entering the feature activation code r...

Page 196: ...f the premium features in your subsystem Click Enable and as shown in Figure 4 41 select the key file that you received by e mail Figure 4 41 Selecting key file for premium features activation Confirm...

Page 197: ...rd configures all the non configured disk drives in the system with minimal interaction If you need to define space that has not been used in already defined arrays or configure capacity with some spe...

Page 198: ...Subsystem Automatic Configuration OK as shown in Figure 4 43 Figure 4 43 Automatic configuration 2 Read the introduction window It reminds you to quit the wizard and start a manual configuration proce...

Page 199: ...here you only have to select the RAID level to be applied to all unconfigured disks Once you select the RAID level a summary is presented based on the resources available in your configuration Check t...

Page 200: ...rameters shown in Figure 4 45 Figure 4 45 Customized automatic configuration The options for both Fibre Channel or SATA drives are RAID level 0 1 3 5 or 6 or RAID 10 by selecting multiple drives in RA...

Page 201: ...two separate worksheet windows to set your desired configuration You can select the online help for an explanation of each of the parameters For additional information see 4 1 1 DS5000 arrays and RAID...

Page 202: ...the configuration that will be created based on your input and click Finish to proceed You see a confirmation message informing you that depending on the number of drives and volumes it might take som...

Page 203: ...c procedure where the options are limited Now we cover the additional parameters that you can select to better configure the storage for your environment We split the tasks into two sections starting...

Page 204: ...t spares from the Setup view of the your Subsystem management window select Configure Storage Subsystem as shown in Figure 4 49 Figure 4 49 Configuring hot spares Select Configure hot spare drives The...

Page 205: ...automatically create the hot spare coverage using the drives that are available select Automatically assign drives as shown in Figure 4 50 The recommended quantity of spares drives needed for your co...

Page 206: ...ct Hot Spare Coverage or from the top menu select Drive Hot Spare Coverage as shown in Figure 4 52 Figure 4 52 Hot Spare Coverage 2 This opens the Hot Spare Drive Options window as shown in Figure 4 5...

Page 207: ...view opens Click the Show SATA button Figure 4 54 SATA drives protected with hot spare 4 To unassign a hot spare drive and have it available again as a free drive highlight it select Drive Hot Spare C...

Page 208: ...rdware Guide 2 The Hot Spare Drive Options window opens as shown in Figure 4 50 Select View Change current hot spare coverage and click OK This opens the window shown in Figure 4 55 Figure 4 55 View C...

Page 209: ...assign an additional hot spare drive using this interface to solve this issue 3 To resolve this exposure click the Assign option button The Assign Hot Spare window opens as shown in Figure 4 56 4 It...

Page 210: ...orage subsystem Note that the unconfigured capacity for Fibre Channel and SATA disks are grouped separately This procedure illustrates the most common steps to follow in setting up a logical drive fro...

Page 211: ...the drives in the following order Same capacity same speed enclosure redundancy Same capacity mixed speed enclosure redundancy Same capacity mixed speed no enclosure redundancy Mixed capacity same or...

Page 212: ...a logical drive 5 In the Create Logical Drive wizard window click Next to start configuring the logical drive 6 In the Specify Capacity Name dialog window a If you want to define more than one logica...

Page 213: ...tion 195 Figure 4 60 Specifying logical drive capacity Note The recommended settings values for creating volumes Figure 4 60 are dynamic cache read prefetch enabled for all RAID types and the segment...

Page 214: ...and the segment size Table 4 9 shows the defaults predefined for each I O type Table 4 9 Logical drive defaults I O characteristics I O type File system Database Multimedia Segment size 128 K 128 K 25...

Page 215: ...llers and I O paths are online You can distribute your logical drives between both controllers to provide better load balancing between them The default is to alternate the logical drives on the two c...

Page 216: ...dow opens You are prompted about whether you want to create another logical drive Click No if you have finished creating logical drives or want to finish at a later time 10 The Completed window opens...

Page 217: ...s shown in Figure 4 63 Figure 4 63 Logical Drive initialization progress Notice that after creating a logical drive that the disk space is initialized and shows a clock icon to the right of its name T...

Page 218: ...shown in Figure 4 64 Figure 4 64 Logical Physical relationship The current path of the logical drive is represented by the blue dot at the right side of the controller In this case the logical drive...

Page 219: ...age partitioning and LUN masking you ensure that each host or host group only has access to its assigned logical drives You can have up to 256 LUNs assigned to a single storage partition You might hav...

Page 220: ...s Server 2008 We want that host to have access to the logical drives LogDrive1 and LogDrive2 of the storage subsystem This host contains two FC HBAs At some time the host becomes a part of the Windows...

Page 221: ...hosts first and then the host groups Figure 4 68 Selecting Define Host This launches the wizard for defining a new host You have to provide the following information during the process Name of the new...

Page 222: ...clusters sharing logical drives is recommended click Yes to create different hosts groups at a later time 4 In the next window you need the attachment protocol to specify the host interface type FC or...

Page 223: ...t can lose access if there is a problem Click Next after defining all the HBAs 6 The next window requires you to specify the host type This is basically the operating system running on the host It is...

Page 224: ...igure 4 72 In our particular case we selected Windows 2000 Server 2003 Server 2008 Non Clustered Figure 4 72 Define Host Specifying the host type 7 In the next step you are asked whether the host is a...

Page 225: ...anning and configuration 207 8 If the answer is Yes as in our example then you need to specify a host group The host group can be either a new or an existing one as shown in Figure 4 73 Figure 4 73 De...

Page 226: ...nge System Storage Hardware Guide 9 Finally you have the chance to preview the new host definition Figure 4 74 If all the selections are correct click Finish to define the new host Figure 4 74 Define...

Page 227: ...groups Once finished the new host and the host group if it was also defined is placed in the default group It will stay there until you actually create a storage partition by assigning the logical dri...

Page 228: ...leads you through the process and you initiate it by right clicking Default Group and selecting Define Storage Partitioning We show an example in Figure 4 76 Figure 4 76 Define storage partitioning 2...

Page 229: ...77 we selected WindowsLD1 and WindowsLD2 We assigned the LUNs 0 and 1 respectively to these two logical drives Figure 4 77 Storage Partitioning wizard Selecting logical drives LUNs 4 Click Finish when...

Page 230: ...pecify the host type and select Will participate in a cluster and incorporate it into the existing host group where your other host is already defined 2 Change the previous host type from Windows 2008...

Page 231: ...itions you can only map logical drives to partitions up to the maximum number allowed by your specific system and premium feature configuration Check your storage subsystem for the allowed number of p...

Page 232: ...can be created with the Define Host wizard there is usually no need to define the groups from outside the wizard But you still have the option to do so by performing the following steps 1 Right click...

Page 233: ...Move A window opens and prompts you to specify the host group name 4 Because storage partitioning of the DS5000 storage subsystem is based on the world wide names of the host ports the definitions for...

Page 234: ...imilar to Figure 4 83 Figure 4 83 Manage Host Port Identifiers Select this option if you need to review your port configuration assignment add remove and change port settings and whenever you need to...

Page 235: ...storage partition This means the logical drives are already mapped to that host or group If you need to map additional logical drives to the same host or group use the Define Additional Mapping optio...

Page 236: ...enable the use of the storage inside the operating system such as formatting the disks with a file system and mounting them If you attached a Linux system to the DS5000 storage subsystem you need to r...

Page 237: ...ives The verified HBAs show all the mapped LUNs so you can use the Windows Disk Administrator utility to scan for new storage create and format partitions and begin using the new disk space First use...

Page 238: ...eighted paths or one Active and the other in Standby failover Least queue depth as shown in Figure 4 88 Figure 4 88 MPIO load balancing policy For a correct data assignment to your defined logical vol...

Page 239: ...ve as shown in Figure 4 89 Figure 4 89 Matching LUNs between a Windows host and SM Finally use the Windows Disk Management to start using your new mapped DS5000 storage subsystem disks as shown in Fig...

Page 240: ...tricted Rights Use Duplication or disclosure restrict ed by GSA ADP Schedule Contract with IBM Corp IBM Support URL http www ibm com servers storage support disk PHYSICALDRIVE1 Storage Subsystem DS502...

Page 241: ...e SMclient is opened The installed server should be capable of out of band and in band management This ensures proper alerting even if one server is down or a connection type has failed The Enterprise...

Page 242: ...se Management window If you want to monitor only one subsystem then click that particular one and select Edit Configure Alerts You can also select the Setup tab of the Enterprise Management window and...

Page 243: ...mail server and the e mail that will show as the origin of the message as shown in Figure 4 92 You can also complete the contact information if desired Figure 4 92 Configure Alerts Defining the SMTP s...

Page 244: ...ddress box 7 When you have finished adding e mail addresses to notify test your specified SMTP and e mail addresses by clicking the Test button 8 If you have a Network Management Station NMS in your n...

Page 245: ...4 94 Alerts configured for one specific DS5000 storage subsystem Check for the mark besides each representation of the storage subsystem configured for alerts Only the storage subsystems with a Alert...

Page 246: ...es All information is stored in a file that contains a script for the script editor To save the configuration of the subsystem open the Subsystem Management window highlight the subsystem and select S...

Page 247: ...ofile as shown in Figure 4 96 Figure 4 96 Viewing the storage subsystem profile 2 The information is gathered from various components when you request the profile The profile can be saved locally and...

Page 248: ...230 IBM Midrange System Storage Hardware Guide A sample profile window is shown in Figure 4 97 Figure 4 97 Storage Subsystem Profile...

Page 249: ...ct all the internal information of the DS5000 storage subsystem for review by the support organization This includes the storage Subsystems Profile majorEventLog driveDiagnosticData NVSRAM data readLi...

Page 250: ...re Guide Make sure to check that the automatic collection of support data is not disabled select Advanced Troubleshoothing Support Data Support Data Automatic Settings as shown in Figure 4 99 Figure 4...

Page 251: ...It is essential that this process be nondisruptive and not cause any downtime With Storage Manager it is possible to add new disk drives to the storage subsystem and start the expansion procedure whi...

Page 252: ...e type of disks are listed as candidates to add FC SATA Select drives that have a capacity equal to the current drive capacities in the array Note Storage Manager supports RAID 0 and 1 arrays with mor...

Page 253: ...first to consolidate all free space nodes to one free space node for the array Then all new logical drives can use the whole available free space To accomplish this task open the Subsystem Management...

Page 254: ...has an odd number of drives and a migration to RAID 1 is required a disk must be added to the array prior to performing the procedure When changing from RAID 1 to RAID 5 free space in the array can b...

Page 255: ...Storage Manager allows the storage subsystem or previously created arrays to be cleared if required Clearing the storage subsystem completely removes the complete configuration of the storage subsyst...

Page 256: ...at the redundancy group is consistent for the extent of the data specified in the read request If the controller found that the redundancy group data is in a consistent state the read request is retur...

Page 257: ...cy group inconsistencies To enable this feature perform these steps 1 Select the logical drive where the pre read redundancy check is to be enabled 2 Select Logical Drive Change Pre Read redundancy ch...

Page 258: ...sed drives on the array of the standard or FlashCopy repository logical drive Increasing the capacity of a FlashCopy repository logical drive does not increase the capacity of the associated FlashCopy...

Page 259: ...y To increase the logical drive capacity on the SM Logical Physical view highlight the logical drive to be expanded right click it and select Increase Capacity In the Increase Logical Drive Capacity w...

Page 260: ...edure in order to utilize the newly allocated space Extending a basic disk on a Windows platform In the following example we have a Windows 2008 system with a basic disk partition of 1 GB The partitio...

Page 261: ...2008 2 NTFS Partition 25 GB Healthy Volume 5 RAW Partition 136 GB Healthy Volume 6 F SDD_TC 2008 NTFS Partition 15 GB Healthy Volume 7 I SDD_TC 2008 NTFS Partition 15 GB Healthy Volume 8 J Volume1 NTF...

Page 262: ...Initializing a logical drive Reconstructing after a disk failure Copying back from a hot spare drive Changing the segment size of a logical drive Expanding a dynamic logical drive Adding free capacit...

Page 263: ...ities relative to system performance The guidelines in Table 4 10 can help determine how long a synchronization can take and how much various synchronization priorities can affect system performance T...

Page 264: ...logical drive right click it and select Change Modification Priority as shown in Figure 4 109 Figure 4 109 Changing the modification priority 2 Make sure that the correct logical drive is selected an...

Page 265: ...or switch When defining logical drives the system normally alternates ownership between the two controllers as they are defined Situations can occur when all heavily stressed logical drives can reside...

Page 266: ...troller This is considered a routine ownership change and is reported with an informational entry in the event log There can also be a forced failover from the preferred controller to the other contro...

Page 267: ...ite through mode write caching disabled Enable or disable write cache mirroring Figure 4 112 shows the typical values when using the Create Logical Drive Wizard With the Storage Manager cache settings...

Page 268: ...r is fully charged Read ahead is not normally used on the logical drives Read caching Read caching allows read operations from the host to be stored in controller cache memory If a host requests data...

Page 269: ...e operation to complete Therefore a significant gain in application writing performance can be expected It is the responsibility of the cache controller to eventually flush the unwritten cache entries...

Page 270: ...ies older than 20 seconds are flushed automatically Figure 4 114 Storage subsystem cache settings The default is the start flushing level and the stop flushing level is set to 80 This means that the c...

Page 271: ...ble problems caused by bad sectors of the physical disks before they could eventually disrupt normal data reads or writes This process is sometimes known as data scrubbing The media scan runs on all l...

Page 272: ...rity mismatches A media scan does not attempt to resolve any other sort of error occurring during I O operations Important The media scan must be enabled for the entire storage subsystem and enabled o...

Page 273: ...ritical event already logged within the ADT or RDAC context A failover alert delay can be specified that lets you delay the logging of a critical event if the multipath driver transfers logical drives...

Page 274: ...orage subsystem failover alert delay Important The failover alert delay option operates at the storage system level so one setting applies to all logical drives The failover alert delay option is repo...

Page 275: ...rvation of the logical drive is handled by the host application that allows one or more host ports to reserve a logical drive thus preventing other host ports from accessing the same logical drive Unl...

Page 276: ...synchronizes to the newer of the two firmware A failure to successfully transfer the incumbent image from the native to the foreign controller results in the native controller holding the alternate co...

Page 277: ...feature and how to implement it The Disk Security premium feature requires security capable drives A security capable drive encrypts data during writes and decrypts data during reads Each security cap...

Page 278: ...Security on a DS5000 storage subsystem is employed 5 1 1 Encryption method used The FDE drives have encryption hardware and can perform symmetric encryption and decrypting of data at full disk speed w...

Page 279: ...ion Manager using self encrypting FDE drives Data on Drive Data on Drive Data Flow Authorization Flow j 6544IY899 Data Encryption Key Data Encryption Key User Data User Data The quick brown fox jumps...

Page 280: ...tion All of these features are managed by the Storage Manager V10 6 x and higher 5 2 1 DS5000 Disk Encryption Manager The Disk Encryption Manager on the DS5000 system maintains and controls the key li...

Page 281: ...tion See 4 2 Planning for premium features on page 124 for details about this topic 5 2 4 Keys There are two types of keys that are used with Drive Security and FDE drives The encryption key is genera...

Page 282: ...ve Properties window show whether the drive is secure capable and whether it is in Secure Yes or Unsecured No state The example shows that the drive is both capable FDE and enabled Figure 5 3 FDE driv...

Page 283: ...s 5 3 1 FDE and premium feature check There are a number of checks to make prior to key creation First you must check that the premium feature key has been applied to the system To do this task from t...

Page 284: ...onfirm that all the drives in the array are all secure capable The array is already being used and has several logical drives configured and consists of all FDE drives therefore it can be enabled Figu...

Page 285: ...ry We strongly advise that the key be copied and kept in a safe location Tip The best practice is to store the security key file with your key management policies along with the pass phrase It is impo...

Page 286: ...to manage any changes to the FDE drives when they are encryption enabled Security key file created from the process Security key identifier created from the process Password used Figure 5 8 Security...

Page 287: ...ys have been created Disk Security can now be enabled on the array Right click the array and select Secure Drives as shown in Figure 5 9 Figure 5 9 Secure all drives in the array You will then be prom...

Page 288: ...existing key be corrupted or the pass phrase forgotten provided that there are no outstanding Secure Disk communications between the FDE drives and Disk Encryption Manager for example if a disk is in...

Page 289: ...age subsystem The controller negotiates with all of the security enabled FDE drives for the new key The original security key is also stored in the storage subsystem for protection in case something p...

Page 290: ...13 Change Security Key Complete confirmation window 5 4 2 Save security key file This action will save a backup of the security key file and will require the original pass phrase in order to copy it...

Page 291: ...o the security key backup file Figure 5 14 Save Security Key File window 5 4 3 Secure erase Secure erase provides a higher level of data erasure than other traditional methods When you initiate secure...

Page 292: ...apable The drive has security enabled The lock key has not been supplied to the drive Data cannot be read or written from drive Unlocked The drive is security capable The drive has security enabled Th...

Page 293: ...red FDE hot spare drive is used as a spare for a failed drive in the secured RAID array it is security enabled For an array that has FDE drives that are not secured the hot spare drive can be either a...

Page 294: ...um feature should be already enabled as shown in Figure 5 4 on page 265 Verify that the firmware is the same on the target DS5000 as the source DS5000 and is up to date Unlock drives before importing...

Page 295: ...curity with Full Disk Encryption drives 277 Figure 5 17 Preparation checklist When the process has completed the wizard will indicate that the drives can be removed as shown in Figure 5 18 Figure 5 18...

Page 296: ...nce all the disks have been physically moved and are seated correctly in the target DS5000 enclosure the drives can be unlocked and then the array can be imported It is necessary to ensure that all th...

Page 297: ...invalid key details and secure enabled The DS5000 storage subsystem will also indicate that it needs attention due to the locked state of the drives You can see the details about this situation in th...

Page 298: ...anager window select one of the FDE drives that has just been installed it will be marked as offline Right click the drive and select Unlock as shown in Figure 5 23 Figure 5 23 Select the Unlock optio...

Page 299: ...rive unlock completed successfully 5 6 2 Import array The array will be displayed in the Logical tab of the Storage Manager window and is ready to import as shown in Figure 5 26 Figure 5 26 Array read...

Page 300: ...port array shown in Figure 5 27 gives details about the disks that will be imported You need to check that all the disks that are displayed are correct and that none of them are missing Figure 5 27 Im...

Page 301: ...rray are now ready to be mapped to hosts where data can be accessed for read and write operations We recommend that you change the key after a secure array is imported to a DS5000 storage subsystem wh...

Page 302: ...284 IBM Midrange System Storage Hardware Guide...

Page 303: ...rp 2010 All rights reserved 285 Chapter 6 IBM Remote Support Manager for Storage In this chapter we describe how to use IBM Remote Support Manager RSM for Storage with IBM Midrange System Storage stor...

Page 304: ...hould be installed Management of the internal firewall and other configuration changes made by the software might prevent other applications from working There is no guarantee that applications that w...

Page 305: ...erver must be used This is required in order to properly register heartbeat records from the RSM for Storage system in IBM tracking databases RSM for Storage can be run on a dedicated System x server...

Page 306: ...wnership of the host system s first serial port to the virtual client as dev ttyS0 The client must be configured to automatically start when the host reboots RSM for Storage has been tested on both SL...

Page 307: ...in the data center and expedite forwarding of the alerts to an IBM Service center Figure 6 2 DS RSM Model RS2 Additionally the DS RSM Model RS2 is designed to enable IBM to establish communication wit...

Page 308: ...s KVM RHEL is only available on build your own systems 4 4 4 5 4 6 5 0 5 1 5 2 RHEL The DS RSM is preloaded with Novell SLES 10 2 9 3 9 4 10 0 10 1 10 2 SLES RSM for Storage is a collection of softwar...

Page 309: ...t gateway must be accessible from the RSM server without requiring authorization through a firewall If your managed storage subsystems or other SAN devices are on a private management LAN a second Eth...

Page 310: ...the customer must indicate Service Complete for all alerts in the RSM IBM Service can dial to the RSM modem or use an SSH connection to acknowledge and indicate Service Complete for all alerts for the...

Page 311: ...nabled The remote access timeout for localhost is now 35 59 HH MM There are no remote users connected to localhost at this time RSM system type 7985PBF RSM system serial KQDBXV8 RSM system name localh...

Page 312: ...next 12 hours Check the RSM for Storage console for additional information related to this problem Machine type 1818 53A Machine serial 1234567 Machine name ITSO5300 Machine location Dataenter 1 Mach...

Page 313: ...lerts acknowledged 1 alert sent to IBM 0 additional alerts pending Because IBM Service has already been alerted to a problem with this subsystem no additional alerts will be sent to IBM for this subsy...

Page 314: ...local RSM contact country United States Ping check notifications are sent when two ping checks in a row fail Ping checks of the configured SMTP sever and Management Station are performed each half ho...

Page 315: ...ort or remote access through an SSH client can be enabled Remote access by modem The functional requirements for the modem are minimal it is only used for remote access by IBM Service Most Hayes compa...

Page 316: ...address http www ibm com support docview wss uid psg1MIGR 66062 rs 594 6 1 7 RSM management interface The RSM management interface can be accessed through a Web browser pointing to the IP address or h...

Page 317: ...rsm firewall conf are allowed Disabled The firewall is disabled There are no restrictions on access to the networks connected to the RSM Remote Access Disabled Modem answer and remote user login is di...

Page 318: ...face can be changed by the Linux root user using the command rsm passwd admin or rsm passwd lservice We recommend setting a different password for each user ID For the remote user rservice the passwor...

Page 319: ...M Service Figure 6 7 RSM internal firewall 6 2 Installing and setting up RSM In this section we show how to install and configure RSM Before beginning this task go to the RSM support Web page and care...

Page 320: ...rating system installation instructions 6 2 2 Installing RSM The RSM software can be downloaded from http www ibm com storage disk rsm We installed RSM according to the instructions in IBM Remote Stor...

Page 321: ...he RSM administrator This account is named admin and the password was defined during the installation of RSM See Figure 6 9 Figure 6 9 RSM logon window 3 You return to the Main Menu The upper right me...

Page 322: ...System Configuration incomplete 5 Click Contact Information to access the contact list in order to add a new contact Figure 6 12 Figure 6 12 RSM contact list 6 Click Select to add fill out the form a...

Page 323: ...n information 7 The specified contact will be added to the contact list Multiple contacts can be defined that might be assigned with different storage subsystems Click Configuration to return to Syste...

Page 324: ...y Information as shown in Figure 6 11 on page 304 9 Complete the form with the appropriate information and click Update configuration as shown in Figure 6 15 Figure 6 15 RSM company information 10 The...

Page 325: ...Chapter 6 IBM Remote Support Manager for Storage 307 11 Complete the form with the appropriate information and click Update configuration as shown in Figure 6 16 Figure 6 16 RSM connection information...

Page 326: ...re are any drive expansion units attached to the controller If any drive expansion units are detected the configuration status for the subsystem will change to Configuration Incomplete and additional...

Page 327: ...mple data Figure 6 18 RSM storage subsystem information 14 The storage subsystem will be added to the list of configured storage subsystems as shown in Figure 6 19 Up to 50 storage subsystems and SAN...

Page 328: ...IBM Midrange System Storage Hardware Guide 15 When all tasks are completed correctly run the configuration test Click Run Configuration Test as shown in Figure 6 20 Figure 6 20 RSM run configuration t...

Page 329: ...Chapter 6 IBM Remote Support Manager for Storage 311 16 Click Refresh status to see the progress of the test Figure 6 21 Figure 6 21 RSM configuration test...

Page 330: ...uration Test Checking connectivity to Management Station at 9 11 218 110 2009 09 04 18 28 55 UTC Configuration Test Checking connectivity to ITSO5300 2009 09 04 18 28 55 UTC Configuration Test Validat...

Page 331: ...ge subsystem has the status Configuration Incomplete in the System Configuration window Go back to Storage Subsystem configuration and click the storage subsystem you just added Information about disk...

Page 332: ...the RSM server set the RSM server as your SNMP traps destination in the Storage Manager client To configure the DS Storage Manager to send SNMP alerts for each defined storage subsystem in RSM to the...

Page 333: ...d SNMP trap receiver If you have an existing SNMP infrastructure and there is already an SNMP trap destination set you can add the IP address of the RSM server as an additional SNMP trap destination w...

Page 334: ...ctivity log as shown in Figure 6 23 on page 314 and verify that the trap was received The activity log will contain a entry as shown in Example 6 6 Example 6 6 Test alert received 2009 09 04 22 05 08...

Page 335: ...iated attachments and then activate the system When the RSM for Storage system is ready to receive events the System Status will be OK See Figure 6 26 Figure 6 26 RSM main menu Configured 6 2 6 Remote...

Page 336: ...e Access has manually been enabled Normally Remote Access is enabled automatically when an alert is sent to IBM but you can choose to wait for IBM Service to contact you when an alert is received and...

Page 337: ...te access when the service is complete or allow it to time out After the timeout period has elapsed the system is guaranteed to return to a secure state without intervention To configure the timeout v...

Page 338: ...t access to one or more other devices has been enabled The firewall allows access to any storage subsystem that has an active alert and also storage subsystems and other SAN devices that have been pla...

Page 339: ...s shown in Figure 6 28 Figure 6 28 Internal Firewall and Service Access window Placing a device into Service Access mode will create a rule for the internal firewall that will allow connections to tha...

Page 340: ...have a controller shell environment that is accessible using a remote login RLOGIN client IBM Midrange System Storage Storage Manager has an option to disable RLOGIN and we normally recommend disabli...

Page 341: ...r Storage 323 Figure 6 30 RSM storage subsystem with alerts 3 The alert list for the selected storage subsystem Figure 6 31 shows all alerts that were received by RSM Click View to see the details of...

Page 342: ...324 IBM Midrange System Storage Hardware Guide 4 The alert details and an error message are shown in Figure 6 32 Figure 6 32 RSM alert details...

Page 343: ...s the modified status of an alert as shown in Figure 6 31 on page 323 When the problem is solved click Close 6 After the alert is closed it disappears from the alert list 7 The main menu status change...

Page 344: ...326 IBM Midrange System Storage Hardware Guide...

Page 345: ...ystems that can be used with the DS5000 we cover tools to manage your DS5000 logical disks with commands usage and examples We address advanced maintenance topics for the IBM System Storage DS5000 sto...

Page 346: ...your support representative if you plan an update after receiving notification of the availability of a new level or when you want to use a new feature only available with a particular level Use the...

Page 347: ...agnostics 329 3 Click the Enclosures tab to see the ESM current firmware level As shown in Figure 7 2 you have to use the scroll bar to show all of the ESM firmware two per enclosure as shown in Figur...

Page 348: ...d Always review the readme file to make sure that it is the correct version for your product and configuration If the readme contains specific enhancements or fixes specifically for your system then c...

Page 349: ...mware Upgrading large storage configurations can be time consuming Time estimates for upgrading all the associated firmware and software are listed in Table 7 1 Table 7 1 Upgrade times These times wer...

Page 350: ...OS Version RDAC LoP Redhat 4 2 6 18 128 El Yes note a update 7 RHEL4 u7 rdac LINUX 09 03 0B05 0214 LoP Redhat 5 2 6 18 128 EL5 Yes note b update 3 RHEL5 u3 rdac LINUX 09 03 0C05 0214 LoP SLES 9 Servic...

Page 351: ...nager components 2 Install SMruntime 3 Install SMclient 4 Disable and enable the Event Monitor 5 Install SMutil 6 Uninstall the existing IBM DS5000 Management Suite Java 7 Install the IBM FC HBA failo...

Page 352: ...logical drives to the second one and then it reboots and activates new firmware After that it takes ownership of all logical drives and the second controller is rebooted in order to have its new firmw...

Page 353: ...RAM update perform these steps 1 Open the Subsystem Management window for the DS5000 storage subsystem that you want to upgrade To download the firmware select Advanced Maintenance Download Controller...

Page 354: ...2 The Download Firmware window opens showing the current firmware and NVSRAM versions Select the correct firmware and NVSRAM files as shown in Figure 7 6 Check the check box to download the NVSRAM fi...

Page 355: ...ndow shown in Figure 7 7 Figure 7 7 Firmware download confirmation This window instructs you to confirm the firmware and NVSRAM download because the process cannot be cancelled after it begins Confirm...

Page 356: ...ion To activate the new firmware select Advanced Maintenance Activate Controller Firmware as shown in Figure 7 9 Figure 7 9 Subsystem Management window Firmware activation 5 The Activate Firmware wind...

Page 357: ...troller Firmware Upgrade Tool The following information describes how to use the IBM System Storage DS4000 DS5000 Controller Firmware Upgrade Tool to upgrade your DS4800 DS4700 or DS4200 Express contr...

Page 358: ...nagement software is establishing contact with the device Needs Upgrade The storage subsystem is running a level of firmware that is no longer supported by the storage management software Refreshing T...

Page 359: ...aded To download the firmware perform these steps 1 From the Enterprise Management window EMW menu bar select Tools Upgrade Controller Firmware as shown in Figure 7 12 When the Firmware Upgrade window...

Page 360: ...file from a directory on your computer 4 Select the NVSRAM file you want to download by clicking Browse for the Selected NVSRAM file field marked as 2 in Figure 7 14 on page 343 to choose the file fro...

Page 361: ...leases were affected by a code defect that could lead to recursive reboots when a controller is reset during the code upgrade Therefore a check utility was developed to ensure that the DS4000 DS5000 s...

Page 362: ...n An Ethernet connection to both controllers is required Any firewall between the DbFix utility and the DS4000 DS5000 controllers must allow both telnet and FTP traffic to pass Any FTP Server service...

Page 363: ...indicates that a check is not required for code versions outside this range 4 Select System Check System Check A new window opens that shows just the DS4000 DS5000 storage subsystems that need checki...

Page 364: ...rerun after the upgrade 7 If the utility returns a status of Check Failed or any other error contact your local IBM Support Center for further assistance Do not proceed with the firmware update unless...

Page 365: ...failure that prevents the code from synchronizing identify which ESM is the original and which is the replacement to synchronize For EXP5000 EXP520 and EXP810 there is an option to set the enclosure...

Page 366: ...d have the same product ID 4 Enter the firmware file to download in the Select file area by either entering the location and name of the file in the Select file text box or by selecting Browse and get...

Page 367: ...ve firmware download Storage Manager allows you to download hard disk drive firmware to several drives in parallel This way large configurations with multiple expansion enclosures are not affected by...

Page 368: ...dress http www 1 ibm com servers storage support disk Perform these steps to update the firmware of the disk drives 1 To start the hard disk drives firmware update process select Advanced Maintenance...

Page 369: ...Chapter 7 Advanced maintenance troubleshooting and diagnostics 351 2 Start the wizard and a window opens as shown in Figure 7 22 Click Next Figure 7 22 Drive upgrade wizard...

Page 370: ...torage Hardware Guide 3 The window shown in Figure 7 23 opens which shows all the types of drives you have with the current firmware level Click Add to choose the firmware package Figure 7 23 Selectin...

Page 371: ...ns Here you can browse and choose drive firmware packages that you previously downloaded This window shows if a firmware package is compatible in the File Information pane Figure 7 24 shows compatible...

Page 372: ...354 IBM Midrange System Storage Hardware Guide Figure 7 25 Drive firmware Incompatible...

Page 373: ...pter 7 Advanced maintenance troubleshooting and diagnostics 355 5 You can select more drive firmware see Figure 7 26 if you have different drives in enclosures Figure 7 26 Adding drive firmware packag...

Page 374: ...in Figure 7 27 Select the drives you want to upgrade and click Finish Figure 7 27 Selecting drives to upgrade 7 In the window that appears browse to the directory where you downloaded the drive firmw...

Page 375: ...ls to manage the HBAs We describe the following procedures in this section Update Brocade HBA firmware using Brocade Host Connectivity Manager HCM on page 358 For more details about Brocade HCM see 7...

Page 376: ...he HBA s firmware You can obtain the latest version of the firmware at the IBM storage support site at the following address http www 1 ibm com servers storage support disk To update the firmware perf...

Page 377: ...rly installed The firmware or boot code file has been downloaded from the Emulex Web site and extracted to a directory on your local drive You can find the latest version at the IBM storage support si...

Page 378: ...com servers storage support disk To update the HBA firmware using QLogic SANsurfer perform these steps 1 In order to update the BIOS version of the HBA click the Utilities tab and you will be presente...

Page 379: ...e corresponding file for your adapter In Figure 7 33 we show the download for a Qlogic 234x adapter Figure 7 33 Qlogic SANsurfer HBA FC2 133 BIOS update file Once you have selected the file you will b...

Page 380: ...X is the number returned by the lsdev C grep fcs command Self explanatory menus take you through the microcode installation Repeat this process for all the HBAs that need to be updated 7 Verify the a...

Page 381: ...on Collect all Support Data in Storage Manager V10 10 and higher To list the premium features perform the following steps 1 Select Storage Subsystem Premium Features from the Subsystem Management wind...

Page 382: ...LEY HUSKER High Performance Tier No data is available about supported values of this feature Storage Partitioning Enabled by default Yes Default limit 2 Enable Upgrade via key Yes Limit with feature k...

Page 383: ...activation code and make sure that the instructions received are for your machine type and model The feature activation code XX XXXX XXXXX is located at the top of the license activation card 2 From t...

Page 384: ...Storage Hardware Guide 6 Once you have received the key file go to Storage Manager and select Storage Subsystem Premium Features in the Subsystem Management window as shown in Figure 7 35 Figure 7 35...

Page 385: ...um feature The DS storage subsystem validates the supplied code to make sure that it is suitable for the specific serial number and is compatible with the machine type and model It also checks that it...

Page 386: ...3 Saving and loading the configuration Once your DS storage subsystem is configured and running save this configuration in order to be able to restore it in case of problems The saved configuration i...

Page 387: ...tored in a file that contains a script for the script editor To save the configuration of the subsystem open the Subsystem Management window highlight the subsystem and select Storage Subsystem Config...

Page 388: ...eeded The script created can be used to replicate the configuration of the DS storage subsystem You can apply the configuration to the destination subsystem for all the saved elements or any particula...

Page 389: ...ration we use the View Profile option described in 7 3 1 Storage subsystem profile on page 371 7 3 1 Storage subsystem profile The storage subsystem profile is one of the most important items needed f...

Page 390: ...ofile Reading and interpreting the profile is a task usually done by IBM Support There are some common information and failure situations that can be used analyzed and fixed easily by an administrator...

Page 391: ...B SATA 4 Gbps HUA721075KLA330 43W9715 42C0417IBM GK8OAB4A 0 8 Optimal 698 638 GB SATA 4 Gbps HUA721075KLA330 43W9715 42C0417IBM GK8OAB4A 0 9 Optimal 465 762 GB SATA 4 Gbps ST3500641NS 39M4557 39M0181...

Page 392: ...at the array named Data is a RAID 3 built from the disks in slots 1 2 and 3 of enclosure 85 However the drive in 85 1 seems to be failed and is using a hot spare as location 85 4 is sparing for the dr...

Page 393: ...85 3 Optimal 465 762 GB SATA 4 Gbps ST3500630NS 39M4557 42D0002IBM AEH 85 4 Optimal 465 762 GB SATA 4 Gbps ST3500630NS 39M4557 42D0002IBM AEH 85 16 Optimal 68 366 GB Fibre 4 Gbps MAX3073FD F S708 Here...

Page 394: ...nd activating it in the DS5020 storage subsystem When cabling an EXP810 expansion enclosure behind a DS5020 storage subsystem the EXP810 expansion enclosure is cabled in the same manner as an EXP520 e...

Page 395: ...onfiguration and profile files outside of the DS storage subsystem Stop all associated I Os Stop all input and output and un mount or disconnect file systems on the logical drives in the array selecte...

Page 396: ...expansion enclosure that supports 4 GB drives You cannot exceed the maximum supported number of logical drives Make sure that the storage subsystem has the latest applicable controller firmware nonvo...

Page 397: ...hapter 7 Advanced maintenance troubleshooting and diagnostics 379 2 Select Advanced Maintenance Export array from the Subsystem Management window as shown in Figure 7 40 Figure 7 40 Exporting an array...

Page 398: ...d unmount or disconnect the file system for the logical drives contained in an array selected for export Back up data on the logical drives in the array selected for export Locate the array and label...

Page 399: ...s and transport them to the destination system These instructions can be saved to a text file by clicking Save As Figure 7 42 Exporting array Disk removal instructions Note Checking the box beside eac...

Page 400: ...flow The dummy is needed only if the enclosure will remain operational 7 Carefully package each drive and move it to the destination system Proceed with the import process described in the 7 4 5 Impor...

Page 401: ...dow in the Logical view select the array and then select Advanced Maintenance Import array as shown in Figure 7 44 Figure 7 44 Import Array option Note Migrate one array at a time When migrating hard...

Page 402: ...as shown in Figure 7 45 Figure 7 45 Import Array window 3 Click Finish if the configuration to import matches the exported configuration If not stop and go back to the original DS storage subsystem 4...

Page 403: ...gure 7 46 displays the result of the import process Make sure that the operation finished successfully and scroll down the window to see the logical drives imported with the array Make sure that all o...

Page 404: ...a Optimal status as well as the array and the logical drives as they were in the source DS Storage Subsystem See Figure 7 47 Figure 7 47 Finish import operation A last step to perform before using th...

Page 405: ...unctioning storage subsystem to a new controller enclosure only if the firmware in the controllers of the functioning storage subsystem and the new controller enclosure have the same major release ver...

Page 406: ...erform the following steps 1 Migrating from a DS4700 or DS4800 storage subsystem to a DS5100 or DS5300 storage subsystem is supported However you must submit a RPQ with IBM to migrate any EXP810 drive...

Page 407: ...129 101 The default TCP IP address of controller B Ethernet port 1 is 192 168 128 102 and the default TCP IP address of controller B Ethernet port 2 is 192 168 129 102 7 5 3 Preparing the original sto...

Page 408: ...e updated to the latest firmware level To download the latest firmware level go to the following address http www ibm com systems support storage disk 7 5 4 Upgrading the controller firmware To upgrad...

Page 409: ...the controller firmware installed in the original and new subsystems What version of controller firmware is in the original subsystem What 7 xx version of controller firmware is available for the ori...

Page 410: ...off the drive expansion enclosures This is the best practice power off sequence See the documentation that comes with the storage subsystem for details about the power off sequence 3 Label all the ca...

Page 411: ...he DS Storage Manager Client Subsystem Management window to resolve any Needs Attention conditions 6 Update the controller firmware of the new storage subsystem to the latest available version if requ...

Page 412: ...t at the client workstation This will allow you to be more responsive to your storage environment at any time and from any place However using a secure connection is very important If unauthorized use...

Page 413: ...storage subsystem you must have the following hardware settings Windows XP Professional on the client workstation Client workstation must be dual homed One network card for the dedicated DS5000 Manag...

Page 414: ...port learnmore remoteassist intro mspx 7 7 Preventative maintenance and data collection It is essential to regularly monitor the status of the DS4000 or DS5000 storage subsystem in order to identify p...

Page 415: ...agement domain If you do not install the Event Monitor service the Enterprise Management window must remain open If you close the window you will not receive any alert notifications from the managed s...

Page 416: ...monitor a DS4000 or DS5000 storage subsystem could immediately tell when the unit is in a non optimal state Figure 7 51 Storage Manager Subsystem Management window toolbar buttons The Recovery Guru an...

Page 417: ...Status changing to Needs Attention By clicking either the Needs Attention or Recovery Guru button we are presented with the Recovery Guru window Figure 7 52 which shows A summary view listing the fau...

Page 418: ...whenever a critical event is logged There is a Clear All button to delete all the entries in the event log Once a DS4000 or DS5000 storage subsystem is installed in a live environment there is no rea...

Page 419: ...In most cases this provides sufficient detail to help a hardware defect investigation although sometimes switch logs host logs or cabling diagrams might also be required The data gathered in the Coll...

Page 420: ...automatically collecting support data you can manually generate a new collection at any time from the Storage Manager by performing these steps 1 Select Advanced Troubleshooting Support Data Collect...

Page 421: ...editor or SMCli There is an alternate way to manually generate the Collect All Support Data bundle through the script editor or SMCli The command to run is save storageSubsystem supportData file c tem...

Page 422: ...e duration in days of the media scan select a number in the Scan duration days box The media scan duration specifies the number of days over which the media scan can run on the eligible logical drives...

Page 423: ...he DS4000 or DS5000 storage subsystem We will explore some of the included commands that might be relevant to fault finding With any suspected fault it is essential to first rule out the possibility o...

Page 424: ...trollers The earlier models such as the DS4300 storage subsystem and EXP 700 expansion enclosures provide a physical connection between neighboring disks that daisy chains them into a single loop Fibr...

Page 425: ...then the controller will mark the channel as degraded In this state the channel is still available but all I Os are routed via the alternate channel in the redundant channel pair until the problem is...

Page 426: ...ssential to have a clear understanding of the cabling topology By selecting Storage Subsystem View Connections from the Storage Manager Subsystem Management window we are presented with a list of driv...

Page 427: ...Rate 4 Gbps Rate Control Auto Controller A link status Up Controller B link status Up Trunking active No DRIVE COUNTS Total of attached drives 16 Connected to Controller A Attached drives 16 Drive en...

Page 428: ...clues to drive side problems Quite often we see events logged against a faulty disk well before the error threshold is exceeded to mark it as failed If there is a pattern of repeated errors against a...

Page 429: ...ing Interval The elapsed time between when the baseline time was set and when the read link status data was gathered using the Run option ITW The total number of invalid transmission word ITW errors d...

Page 430: ...se of a degraded drive side channel The SOC statistics file can be generated with the following script command save storageSubsystem SOCCounts file c socStatistics csv It is also included within the C...

Page 431: ...Information A large uncompressed text file is generated with a dmp file name suffix This file is also included in the Collect all Support Data bundle Each command appears twice within the Capture Sta...

Page 432: ...ical drives return to an optimal state when reconstruction is complete without any intervention Any arrays and logical drives where the outage resulted in a failed array remain in a failed state after...

Page 433: ...ction or copyback in progress In this case the disk needs to be changed to a Failed state before it can be revived or reconstructed To fail a disk through the Storage Manager Subsystem Management wind...

Page 434: ...what it should be for a given portion of the data If parity errors are detected then it is important to determine the root cause Contact your IBM Support representative for assistance A similar utilit...

Page 435: ...BA 2 032 Repair Logical Drive Parity called on logical drive LUN01 at LBA 2 033 Repair Logical Drive Parity called on logical drive LUN01 at LBA 2 034 Repair Logical Drive Parity called on logical dri...

Page 436: ...n the bad block is lost Recovery Guru notifies the user of a non optimal condition whenever there are any entries in the unreadable sector list This list can be accessed from the Storage Manager Subsy...

Page 437: ...logical drive while the alternate controller will act as a standby in case of failure Whenever a logical drive failover occurs a critical event is logged in MEL and Recovery Guru reports a non optima...

Page 438: ...S Disabled IBM TS SAN VCE Enabled Irix Disabled LNXCLVMWARE Disabled Linux Enabled Linux_DMP Disabled NetWare Failover Enabled Solaris with Veritas DMP Enabled Solaris with or without MPXIO Disabled U...

Page 439: ...llers while other logical drives remain unaffected then the fault is likely to closer to the host itself In this instance we need to focus just on the affected host s and paths to it If storage partit...

Page 440: ...xus PORT Objects ITN ITNID InitiatorPort TargetPort Online x0012 X3655A_port0 FC_TargetPort_Ah_ch11 on x0012 X3655A_port1 FC_TargetPort_Ah_ch12 off Controller B spmShow output I T Nexus PORT Objects I...

Page 441: ...defined devices Any logical drives might remain on the non preferred controller while all available paths to the preferred controller are inaccessible Checking host configuration If logical drives rem...

Page 442: ...aths This can be done from the Storage Manager Subsystem Management window by selecting Advanced Recovery Redistribute Logical Drives Figure 7 65 shows the Redistribute Logical Drives window with a pr...

Page 443: ...the cluster group will periodically fail over and then fail back between cluster nodes until the failed path is restored This behavior is the result of the automatic logical drive failback feature of...

Page 444: ...ting systems provide operating system specific tools to allow reservations to be removed Consult the operating system documentation for details It is possible to view the Logical Drive Reservations an...

Page 445: ...the specific logical drive Controller target ports Shows the port name of the target port Holds Reservation Shows either Yes or No depending on whether the specific host port is the reservation holder...

Page 446: ...e by performing these steps a Select Start Administrative Tools Services The Services window opens b Right click IBM DS Storage Manager Agent c Click Restart The IBM DS Storage Manager Agent stops and...

Page 447: ...button starts flashing All critical events are sent to the SNMP management console or to the e mail recipient that you have configured to receive alert notifications by selecting Edit Configure Alerts...

Page 448: ...truction is in progress on that logical drive A progress bar is displayed when the logical drive is selected Figure 7 67 Storage Manager view after disk failure At this point we have a choice The simp...

Page 449: ...s option in Storage Manager logical view A new window appears showing the failed drive at the top and a list of potential replacement drives beneath as shown in Figure 7 69 This allows us to make the...

Page 450: ...hour before pushing it in fully This reduces the risk of early life failures as the CRU drive is introduced into a controlled data center environment from a delivery vehicle The sudden change in temp...

Page 451: ...while the affected drive is replaced and data restored Perform these steps 1 Stop all I O to the affected logical drives 2 Volume Copy can be used as an alternative to tape backup and restore This fu...

Page 452: ...ssibility of inducing a failure on the PFA disk before the failed disk is replaced 2 If a standby hotspare drive is not available replace the failed disk 3 Monitor the progress of reconstruction on th...

Page 453: ...this time replace the SSD as soon as possible 7 9 4 Managing battery issues On DS5000 storage subsystems the battery unit contains lithium ion battery packs that can maintain power to the RAID contro...

Page 454: ...ion to the Host Configuration Manager HCM for Brocade FC HBAs Brocade offers different software to manage their HBAs A list of software bundles that are downloadable from the Web can be found at the f...

Page 455: ...cade also includes the Brocade BCU which is a command line utility used to configure and manage local HBAs from the console Many of the GUI configuration options are also available through the BCU Run...

Page 456: ...re 7 71 The default user is administrator with the default password of password After a successful login the window shown in Figure 7 72 opens which is the HCM main window Figure 7 71 Agent login wind...

Page 457: ...bottom pane displays a change history of the configuration done by the user By going through the menu items you can perform various actions on the adapter and ports and retrieve much information from...

Page 458: ...he driver internal libraries and firmware You can save this information to the local file system and send it to support personnel for further investigation Use one of the following options to launch t...

Page 459: ...tools Driver A host computer software component that controls the operation of peripheral controllers or HBAs attached to the host computer Drivers manage communication and data transfer between appl...

Page 460: ...ltiple HBAs using Batch Update Set global driver parameters to HBAs Update firmware on the single HBA or multiple HBAs using Batch Update Enable boot code Run diagnostic tests on HBAs Manage out of ba...

Page 461: ...s Performance statistics Central control point in a network environment Diagnostics and utilities Firmware update In this section we provide an overview about how to use the tool with the DS5000 stora...

Page 462: ...m the server that you want to manage as shown in Figure 7 78 Figure 7 78 Qlogic SANsurfer FC HBA Manager view Click Connect to start managing the HBAs on the specified host At this point you are retur...

Page 463: ...t host security and application security Host access defines the authorized user with administrator or root privileges Application access specifies the password for changing settings on the HBAs for f...

Page 464: ...Device List Displays the devices currently available to the host bus adapter Statistics Displays a graph of the performance and errors on the host bus adapters over a period of time Settings Displays...

Page 465: ...I O problems to the storage subsystem and so on This item usually gives the first hint about what path to the storage subsystem controller has a problem Reset The number of LIP resets reported by the...

Page 466: ...t dropped and re connected Invalid CRC The number of cyclic redundancy check CRC errors that were detected by the device Diagnostics You can use the Diagnostics tab Figure 7 84 on page 449 to perform...

Page 467: ...ts and test increments Loopback Test Results Displays the results of a test showing whether the test passed or failed and error counters For a loopback test the test result includes the following info...

Page 468: ...QLogic SANsurfer on page 360 for instructions about updating the HBA firmware Figure 7 85 Qlogic SANsurfer utilities for updating the HBA BIOS and drivers If you are installing your DS5000 for the fi...

Page 469: ...g to the LUN List tab Figure 7 86 Displaying LUNs with SANsurfer In a good configuration you see the same LUN on both HBAs or HBA ports 7 11 4 Windows Server 2008 The drivers used for failover in Wind...

Page 470: ...t Properties to see the version of the driver installed under the Driver tab If running the Storage Manager 10 Failover driver you will find under System devices an entry named IBM DS3000 DS4000 serie...

Page 471: ...g and diagnostics 453 Figure 7 88 Windows Device Manager DSM DS5000 logical drive representation in Windows Server 2008 The DS5000 logical drives mapped to a Windows host are presented in the Windows...

Page 472: ...sk Device that represents each logical drive mapped The physical paths are not represented as was done with RDAC or Windows Server 2003 in the past The best practise to verify the paths is to use the...

Page 473: ...andby Active path on HBA port 4 Standby path on HBA port 5 port number does not refer the hardware port number of the HBA Depending on the SAN iSCSI topology you might have more paths but you usually...

Page 474: ...Device Manager list with the logical drives in the DS5000 Mapping view Right click the multi path disk representation in the Device Manager and select Properties to display the information in the MPIO...

Page 475: ...t click and select Properties The disk properties window opens as shown in Figure 7 92 on page 456 Figure 7 93 Disk Management Using SM utilities to match disks There are two commands provided by the...

Page 476: ...gement select Event Viewer System Now click Action from the drop down menu and select Save Log File as to save the event view log file Application log Proceed as for the system event log but this time...

Page 477: ...y uses the mppUtil utility to discover the RDAC assigned virtual target IDs of the attached subsystems It then updates the RDAC driver configuration file var mpp devicemapping so that the entries will...

Page 478: ...sion 10 00 A5 13 dev sda dev sg0 Storage Subsystem ITSO_5020 Logical Drive TC 2008 1 LUN 0 Logical Drive ID 60080e500017b5bc000047d04aaa2559 Preferred Path Controller A In Use dev sdb dev sg1 Storage...

Page 479: ...ple 7 12 mppUtil g0 good condition root TC 2008 mppUtil g0 Hostname TC 2008 Domainname none Time GMT 10 01 2009 19 25 59 MPP Information DS5000 general information ModuleName ITSO_5020 SingleControlle...

Page 480: ...referredPath A DevState OPTIMAL ReportedPresent Y ReportedMissing N NeedsReservationCheck N TASBitSet Y NotReady N Busy N Quiescent N Controller A Path LUN0 Path information for CTRL A NumLunObjects 2...

Page 481: ...TC 2008 mppUtil g0 Hostname TC 2008 Domainname none Time GMT 10 01 2009 19 27 28 MPP Information ModuleName ITSO_5020 SingleController N VirtualTargetID 0x000 ScanTriggered N ObjectCount 0x000 AVTEna...

Page 482: ...escent N Controller A Path NumLunObjects 2 RoundRobinIndex 0 Path 1 LunPathDevice present DevState OPTIMAL RemoveState 0x0 StartState 0x1 PowerState 0x0 Path 2 LunPathDevice present DevState OPTIMAL R...

Page 483: ...0x0 Verify RDAC installation To verify the installation of RDAC you have many different commands available Chose the right command that displays the output you want You can use one of the following op...

Page 484: ...lerA dr xr xr x 3 root root 0 Oct 24 02 56 controllerB rw r r 1 root root 0 Oct 24 02 56 virtualLun0 proc mpp DS5020 sys1 controllerA total 0 dr xr xr x 2 root root 0 Oct 24 02 56 lpfc_h6c0t2 proc mpp...

Page 485: ...lable in a single file is now scattered across a myriad of files in different parts of the sys file system It is impractical to search through the sys file system for the relevant files when there is...

Page 486: ...enerates a compressed file in the tmp folder root TC 2008 systool c fc_host v Class fc_host Class Device host2 first fc adapter Class Device path sys class fc_host host2 fabric_name 0x100500341e7096 i...

Page 487: ...rent driver variations Check the HBA parameters Since AIX 5L V5 3 there is a command that displays the Fibre Channel HBA information previously you had to use both the lsattr and lscfg commands It als...

Page 488: ...tistics Input Requests 28955 Output Requests 22520 Control Requests 172 Input Bytes 2755219663 The text marked in red in Example 7 16 on page 469 indicates particularly important information that is H...

Page 489: ...group only if the volume group is active lspv l hdisk Lists file systems in disk hdisk Other useful commands Other useful commands are fcstat fcs Provides a complete listing of FC parameters of the HB...

Page 490: ...472 IBM Midrange System Storage Hardware Guide...

Page 491: ...er station s local disk or load a script file from disk The command line interface CLI can also be used to issue individual commands to the scripting engine from the host operating system command line...

Page 492: ...age subsystem or test command syntax and execution It is covered in more detail in 8 2 Script Editor on page 499 Any of these methods provide an efficient way to edit send and execute Storage Manager...

Page 493: ...st the host that is running the SMagent For example SMcli hostname of managing station The n option must be used if more than one host agent managed storage subsystem is connected to the host for exam...

Page 494: ...utputfile p password e S quick SMcli d i s w v S SMcli A DNS network name or IP address1 DNS network name or IP address2 S SMcli X n storage array name w WWID h hostName SMcli m ip address F e mail ad...

Page 495: ...indows The entire command string must be enclosed in double quotes Each command must be terminated with a semicolon UNIX The entire command string must be enclosed in single quotes Each command must b...

Page 496: ...If you set the I terminal to either the profile value or the supportBundle value this information is included with the e mails with the frequency specified by the q terminal These values are valid fr...

Page 497: ...ethod will execute the specified command and return to the operating system command prompt SMcli IP address of one controller IP address of second controller c command w Specifies the storage subsyste...

Page 498: ...ce method is used a script file can also be specified The SMcli command will verify the file location and syntax of the commands Each of the commands will be executed one at a time When the commands a...

Page 499: ...5000 Command Line Interface and Script Commands Programming Guide GC52 1275 8 1 3 Syntax requirements The SMcli command has some specialized syntax requirements but most of them can be simplified by u...

Page 500: ...ation for a list of special script characters Insert three carets before each special script character when used within a literal script command string for example c set storageSubsystem userLabel Fin...

Page 501: ...and Script Commands Programming Guide MIGR 5076792 Storage subsystem commands Table 8 2 lists the storage subsystem commands Table 8 2 Storage subsystem commands Tip While the Script Editor and comma...

Page 502: ...rageSubsystem batteryInstallDate This command resets the age of the batteries in a storage subsystem to zero days reset storageSubsystem RLSBaseline This command resets the Read Link Status RLS baseli...

Page 503: ...pansion drawer in a storage subsystem set storageSubsystem enclosurePositions This command defines the position of all enclosures in the storage subsystem show storageSubsystem autoConfiguration This...

Page 504: ...performs set hostChannel This command defines the loop ID for the host channel show controller For each controller in a storage subsystem this command returns Status online offline Current firmware an...

Page 505: ...and returns Total number of physical disks Type of physical disk Fibre or SATA Basic physical disk information Enclosure and slot location Status Capacity Data transfer rate Product ID Firmware level...

Page 506: ...locate This command locates an enclosure by turning on the indicator lights stop enclosure locate This command turns off the enclosure indicator lights that were turned on by the start enclosure loca...

Page 507: ...hysical disks to be included in the logical drive create logicalDrive drives Manual Drive Select This command creates a new array and logical drive and enables you to specify the physical disks for th...

Page 508: ...ed Media scan with redundancy check status enabled or disabled Pre Read redundancy check enabled or disabled FlashCopy repository logical drives Mirror repository logical drives FlashCopy logical driv...

Page 509: ...d assigns a host to a host group or moves a host to a different host group set hostGroup This command renames a host group set hostPort This command changes the host type for a host port show allHostP...

Page 510: ...This command creates a new Remote Mirror repository logical drive using the parameters defined for a previous Remote Mirror repository logical drive remove remoteMirror This command removes the mirro...

Page 511: ...bout logical drive copy operations The information returned is Copy status Start time stamp Completion time stamp Copy priority Source or target logical drive WWN Target logical drive read only attrib...

Page 512: ...orted drives are present in the storage subsystem In a specific environment change the file names to only those updates that are required for that environment Note that the command for parallel firmwa...

Page 513: ...100 dlp To update the NVSRAM only SMcli 9 11 218 163 9 11 218 164 c download storagesubsystem NVSRAM file C N1742F700R910V03 dlp To update a particular ESM SMcli 9 11 218 163 9 11 218 164 c download t...

Page 514: ...3 GB owner 6 segmentsize 4 error_chk Create_ 1 quit Note we are attaching to a hostgroup this can be changed to host below FCMD IP p PWDD c set logicaldrive 1 logicalunitnumber 7 hostgroup 5 error_ch...

Page 515: ...ion eliminates that need Example 8 9 Windows command line with c option C temp C Program Files IBM_DS client SMcli exe 9 11 218 183 9 11 218 182 p xxxxxxx c set storagesubsystem userlabel Tucson_5020...

Page 516: ...tgroup AIX_ITSO delete logicaldrive AIX_B Performing syntax check Syntax check complete Executing script Script execution complete SMcli completed successfully C temp Example 8 13 UNIX command line wi...

Page 517: ...ogicalDrive WIN 1 mediaScanEnabled false set logicalDrive WIN 1 redundancyCheckEnabled false set logicalDrive WIN 1 modificationPriority high The line beginning with Create is a comment explaining tha...

Page 518: ...Script Editor The Script Editor opens as shown in Figure 8 2 There are two views in the window Script view Provides an area for inputting editing script commands Output view Displays verification or e...

Page 519: ...s not processed by the Script Editor The following command assigns hot spare drives set drives 1 2 1 3 hotspare true Text contained between the characters and For example the comment The following com...

Page 520: ...displayed in the output view reporting the line number of the error and a description of the error If the Script Editor encounters a syntax error no further syntax verification is performed on the sc...

Page 521: ...and reporting a description of the error 8 2 2 Embedding commands in batch files Due to the business demand for higher availability of data the time window allocated to make backups is shrinking Cust...

Page 522: ...504 IBM Midrange System Storage Hardware Guide...

Page 523: ...isks Therefore the basic structure of RAID is an array of disk drives The array is a collection of drives that is configured formatted and managed in a particular way The number of drives in the array...

Page 524: ...time This feature is called Dynamic RAID Migration DRM RAID levels We go through the different RAID levels and explain why we choose a particular setting in a particular situation you can draw your ow...

Page 525: ...ed in parallel for speed or serially for safety Select RAID level 1 for applications with a high percentage of read operations and where cost is not the major concern Figure A 2 RAID 1 Because the dat...

Page 526: ...is a parallel process array mechanism where all drives in the array operate in unison Similar to data striping information written to disk is split into chunks a fixed amount of data and each chunk is...

Page 527: ...do not perform as well on RAID 5 logical drives because of the way a controller writes data and redundancy data to the drives in a RAID 5 array If there is a low percentage of read activity relative...

Page 528: ...nce separable MDS The calculation of q is complex In the case of the DS5000 storage subsystem this calculation is made by the hardware and thus there is more performance than the software based implem...

Page 529: ...nsiderations Requires two sets of parity data for each write operation resulting in a significant decrease in write performance Additional costs because of the extra capacity required by using two par...

Page 530: ...y and two writes Random writes are significantly faster on RAID 10 RAID 10 rebuilds take less time than RAID 5 rebuilds If a real disk fails RAID 10 rebuilds it by copying all the data on the mirrored...

Page 531: ...to another drive IOPS Performance as multiple requests can be fulfilled simultaneously Storage costs are doubled 10 Data is striped across multiple drives and mirrored to the same number of disks IOP...

Page 532: ...of RAID type should take into account the cost of downtime Simple math tells us that RAID 3 and RAID 5 are going to suffer from failures more often than RAID 10 Exactly how often is subject to many va...

Page 533: ...e DS5300 and IBM System Storage DS5100 and included in the IBM System Storage DS5020 Therefore a number of new areas must be factored in when deploying the storage subsystems when you plan to use iSCS...

Page 534: ...servers are called initiators and the storage subsystem iSCSI ports such as those available on the IBM DS5000 storage subsystems are known as targets The targets will listen for connection requests us...

Page 535: ...IP so you still need to assign valid IP addresses along with normal associated IP configuration parameters to all of the appropriate iSCSI initiator and target ports IQNs are used with iSCSI to allow...

Page 536: ...m Before beginning an iSCSI deployment understand and document the network topology that will be used for the SAN A poorly understood or inadequate networking infrastructure will inevitably lead to wh...

Page 537: ...se gigabit Ethernet equipment provides some degree of support for jumbo frames or frames larger than the standard 1500 byte payload limit Enabling jumbo frames has the following effects They can accel...

Page 538: ...HBAs that using jumbo frames led to on occasion degraded performance Figure B 3 Jumbo frames enabled on the iSCSI host port Virtual Local Area Networks Virtual Local Area Networks VLANs are a groupin...

Page 539: ...traffic prioritization where network frames are tagged with one of eight priority levels using a 3 bit value added to the Tag Control Info TCI inside of a standard Ethernet frame where 7 is high and...

Page 540: ...ery management and configuration of iSCSI devices on TCP IP network In a typical iSCSI based storage subsystem without iSNS configured any and all iSCSI session requests to the target may be allowed f...

Page 541: ...ned secret or password The peer then concatenates the random value the ID and the secret to calculate a one way hash using the MD5 hash function This hash value is then sent back to the initiator whic...

Page 542: ...sily seen using the following simplified equation Throughput IOPS x I O size Thus as the size of the inbound I Os decrease and typically become more random in nature as in some applications databases...

Page 543: ...ral other factors when working with a mixed host interface environment due to various limitations on the intermixing of the physical protocols at the controller level and the host level A given host g...

Page 544: ...526 IBM Midrange System Storage Hardware Guide...

Page 545: ...times using SSDs which leads to increased productivity and higher customer satisfaction SSD technology was introduced more than two decades ago Until recently however the high cost per gigabyte and li...

Page 546: ...introduced in storage solutions including the DS5000 series The flash technology is still evolving and we can expect to see a multiple layer cell or MLC in the future MLC is designed to allow a more p...

Page 547: ...design keeps the active operational data in Tier 0 and Tier 1 and uses Tiers 2 and 3 for less active data An example is shown in Figure C 2 The benefits associated with a tiered storage approach are...

Page 548: ...ISSC offering which is a single framework aimed at providing storage optimization through more efficient provisioning better analytics of the storage environment and proper alignment of data to storag...

Page 549: ...Average erase count Spare blocks remaining You can find these two pieces of information in the disk drive properties which you can see in the storage management software by selecting a disk drive on...

Page 550: ...Over the years HDDs have maintained a dramatic rate of improvement in terms of dollar per gigabyte which has enabled data center administrators to keep up with storage capacity demand without greatly...

Page 551: ...mmercial application or database can expect to achieve on a DS5000 storage subsystem The lab environment ensures that the tests performed are identical and a realistic comparison between the different...

Page 552: ...eatly improved performance over HDDs but SSD costs more With such a performance SDD usage can be increasingly justified for use in high performance tiered storage on a DS5000 storage subsystem Also SD...

Page 553: ...stem Storage DS4000 and Storage Manager V10 30 SG24 7010 Implementing an IBM Brocade SAN with 8 Gbps Directors and Switches SG24 6116 Implementing an IBM Cisco SAN SG24 7545 Other publications These p...

Page 554: ...e GC53 1136 Online resources These Web sites are also relevant as further information sources System Storage Interoperation Center SSIC http www 03 ibm com systems support storage config ssic displaye...

Page 555: ...ger HCM 358 C cable 448 cache 105 109 122 508 512 block size 123 249 253 flushing 123 249 252 mirroring 123 249 251 read ahead multiplier 123 249 write through 251 cache block states 38 cache memory 5...

Page 556: ...ve Modules E DDMs 73 Enhanced Remote Mirroring ERM 114 126 127 129 130 Enterprise Management 148 Enterprise Management window 144 148 151 224 371 475 477 478 499 Device Table 499 environmental require...

Page 557: ...EDs 80 host software 153 host system 116 144 145 148 171 218 233 334 host topology commands 491 host type 119 hot spare 185 hot spare coverage 189 hot spare drive 114 116 275 hot_add 152 218 I I O act...

Page 558: ...ical drive to LUN mapping 241 logical unit number LUN 116 198 201 446 485 logical view 117 logical volume 114 loopback 448 lservice 300 lspv 471 lsvg 471 LUN 114 116 119 120 201 LUN number 218 M Major...

Page 559: ...cs 410 read ahead multiplier 123 249 readme file 333 Recovery Guru 347 348 363 399 Redbooks Web site 536 Contact us xiv redundancy check 196 371 media scan 196 redundancy group 238 redundant 3 Redunda...

Page 560: ...ommand returns configuration information 485 commands 483 components 7 different components 144 drive enclosures 348 firmware upgrades 474 health status 498 in band or out of band management 148 indic...

Page 561: ...Index 543 Z zoning 129 130...

Page 562: ...544 IBM Midrange System Storage Hardware Guide...

Page 563: ...spine 0 875 1 498 460 788 pages IBM Midrange System Storage Hardware Guide IBM Midrange System Storage Hardware Guide IBM Midrange System Storage Hardware Guide IBM Midrange System Storage Hardware G...

Page 564: ...IBM Midrange System Storage Hardware Guide IBM Midrange System Storage Hardware Guide...

Page 565: ......

Page 566: ...ch include the IBM System Storage DS4000 and DS5000 families of products This edition covers updates and additional functions available with the IBM System Storage DS Storage Manager Version 10 60 fir...

Reviews:

No comments

Related manuals for System Storage DS4000

M-system AB2 Instruction Manual preview
AB2
Brand: M-system Pages: 3
Sans Digital MOBILERAID MR5S1 Quick Installation Manual preview
MOBILERAID MR5S1
Brand: Sans Digital Pages: 1
Seagate ST12000NM000J Product Manual preview
ST12000NM000J
Brand: Seagate Pages: 57
Seagate Cheetah 15K.7 SAS ST3300557SS Product Manual preview
Cheetah 15K.7 SAS ST3300557SS
Brand: Seagate Pages: 76
Quantum 7000DLT Series Product Manual preview
7000DLT Series
Brand: Quantum Pages: 312
Addonics Technologies AEIDMD4U2 Installation Manual preview
AEIDMD4U2
Brand: Addonics Technologies Pages: 2
Convex CSMD2-B440 User Manual preview
CSMD2-B440
Brand: Convex Pages: 19
Seagate ST3000VN0001 Product Manual preview
ST3000VN0001
Brand: Seagate Pages: 27
IBM Storwize V7000 Problem Determination Manual preview
Storwize V7000
Brand: IBM Pages: 314
oldfields Treco UTASC1015 Manual preview
UTASC1015
Brand: oldfields Treco Pages: 28
QCT QuantaGrid D51PH-1ULH Service Manual preview
QuantaGrid D51PH-1ULH
Brand: QCT Pages: 167
LaCie 5BIG THUNDERBOLT 2 Quick Install Manual preview
5BIG THUNDERBOLT 2
Brand: LaCie Pages: 20
D-Link DNS-312H User Manual preview
DNS-312H
Brand: D-Link Pages: 69
D-Link ShareCenter Pro DNS-1200-05 User Manual preview
ShareCenter Pro DNS-1200-05
Brand: D-Link Pages: 170
Sony MS-EX1G Operating Instructions preview
MS-EX1G
Brand: Sony Pages: 2
Sony USM8GM Operating Instructions preview
USM8GM
Brand: Sony Pages: 2
Sony USM4GR Operating Instructions preview
USM4GR
Brand: Sony Pages: 2
Sony USM4GL Instruction & Operation Manual preview
USM4GL
Brand: Sony Pages: 2

Brands by name

Popular brands

Load more brands