background image

IBM Enterprise Storage Server

Introduction and Planning Guide

2105 Models E10, E20, F10, and F20

GC26-7294-05

IBM

Summary of Contents for Enterprise Storage Server 2105 E10

Page 1: ...IBM Enterprise Storage Server Introduction and Planning Guide 2105 Models E10 E20 F10 and F20 GC26 7294 05 IBM ...

Page 2: ......

Page 3: ...IBM Enterprise Storage Server Introduction and Planning Guide 2105 Models E10 E20 F10 and F20 GC26 7294 05 IBM ...

Page 4: ...back of this document If the form has been removed you may address comments to International Business Machines Corporation RCF Processing Department G26 050 5600 Cottle Road San Jose CA 95193 0001 U S A FAX 1 800 426 6209 You can also send your comments electronically to starpubs us ibm com For additional information on IBM storage products visit the Web site at http www ibm com storage Copyright ...

Page 5: ...edundant array of independent disks implementation 14 Non RAID disk group support 15 Predictive failure analysis 15 Failover protection 15 Sparing 15 Fibre channel support 15 Cache 16 Nonvolatile storage 16 Concurrent maintenance 16 FlashCopy 16 Peer to Peer Remote Copy 17 FlashCopy and PPRC restrictions for open system hosts 18 UNIX Windows NT and Windows 2000 availability features 18 System 390 ...

Page 6: ...vices configuration 45 IBM Subsystem Device Driver 46 Chapter 3 Installation planning 49 Equipment requirements 49 Engineering changes 50 Site requirements for the ESS 50 Service clearance and floor loading requirements for the ESS 55 Planning for installation of the ESSNet 57 Power requirements 58 Input voltages and frequencies 58 Power consumption and environmental information 58 Cooling require...

Page 7: ...d Racks 91 Drawer Placement 91 7133 Model 20 Requirements 91 Model D40 Requirements 92 7133 Model 020 and D40 Requirements for 2105 Installations 93 Notices 95 Trademarks 95 Electronic emission notices 96 Federal Communications Commission FCC statement 96 Industry Canada compliance statement 97 European community compliance statement 97 Japanese Voluntary Control Council for Interference VCCI clas...

Page 8: ...vi ESS Introduction and Planning ...

Page 9: ... to point topology 10 5 Switched fabric topology 11 6 Arbitrated loop topology 12 7 Multipath connections between a host server and ESS LUNs 13 8 Reserved loops 31 9 Cable cutout and door clearance for Models E10 F10 E20 and F20 53 10 Cable cutout and door clearance for Model 100 54 11 ESS Web Copy Services configuration with DNS 74 Copyright IBM Corp 1999 2000 vii ...

Page 10: ...viii ESS Introduction and Planning ...

Page 11: ...1 12 Cable cutout dimensions maximum size 52 13 Clearance and floor loading requirements 55 14 ESS input voltages and frequencies 58 15 Power consumption and environmental information for the ESS 58 16 Operating extremes with the power on 59 17 Recommended operating points with the power on 59 18 Recommended operating ranges with the power on 60 19 Recommended temperatures and humidity with the po...

Page 12: ...x ESS Introduction and Planning ...

Page 13: ...N A caution notice indicates the presence of a hazard that has the potential of causing moderate or minor personal injury 1001 2 Find the number that matches in the IBM Storage Solution Safety Notices book GC26 7229 Product recycling This unit contains recyclable materials Recycle these materials at your local recycling sites Recycle the materials according to local regulations In some areas IBM p...

Page 14: ...xii ESS Introduction and Planning ...

Page 15: ...n the configuration takes over the processes of that cluster controller image A System 390 term for a logical subsystem that you access with an ESCON I O interface One or more controller images exist in each controller Each image appears to be an independent controller but all images share a common set of hardware facilities The ESS can emulate 3990 3 3990 6 or 3990 3 TPF controller images count k...

Page 16: ...ial interface that configures attached units to a communication fabric The ESS supports fibre channel communications for open system hosts through its fibre channel adapters fixed block FB devices An architecture for logical devices that specifies the format of the logical data units on the device The logical data unit is a block All blocks on the device are the same size fixed size the subsystem ...

Page 17: ...nd is spread over 6 P or 7 P drives where P is parity A logical volume can also reside on a non RAID array on one storage device For CKD you can define the logical volume size by the device emulation mode 3390 or 3380 track format For UNIX Microsoft Windows NT and Microsoft Windows 2000 operating systems in the fixed block format the size is 0 5 GB to 224 GB For AS 400 operating systems in the fix...

Page 18: ...erver Introduction and Planning Guide GC26 7294 This guide introduces the product and lists the features you can order It also provides guidelines on planning for the installation and configuration of the ESS v IBM Enterprise Storage Server User s Guide SC26 7295 This guide provides instructions for setting up and operating the ESS and for analyzing problems v IBM Enterprise Storage Server Host Sy...

Page 19: ...3 Locations Service Terminal Codes Power Ordering publications All of the publications that are listed in The ESS product library on page xvi are available on a compact disc that comes with the ESS unless otherwise noted You can also order a hardcopy of each publication For publications on compact disc order IBM Enterprise Storage Server Customer Documents SK2T 8770 All the customer documents list...

Page 20: ...IBM Enterprise Storage Server ESS in your environment v IBM Enterprise Storage Server Performance Monitoring and Management SG24 5656 This book from the IBM International Technical Support Organization provides guidance on the best way to configure monitor and manage your Enterprise Storage Server ESS to ensure optimum performance v IBM System 360 and System 370 I O Interface Channel to Control Un...

Page 21: ...ures and limitations involved in running ESS with Copy Services on a NUMA Q host system It is not available through IBM ordering systems Contact your IBM NUMA Q sales representative to obtain this document Web sites For general information about IBM storage servers see the following Web site v www storage ibm com hardsoft products ess ess htm To view and print the IBM Enterprise Storage Server pub...

Page 22: ...xx ESS Introduction and Planning ...

Page 23: ...ditional interposer v Feature codes for step ahead storage planning v Modification to the ESS weight information v Additional information about the environment for storing an ESS v Modifications to the information about planning for ESS Copy Services v New fields for the Communication Resources work sheet Support Catcher Telephone Number Enable ESS Copy Services commands for IBM System 390 volumes...

Page 24: ...xxii ESS Introduction and Planning ...

Page 25: ...hitecture that is designed to provide high availability and to avoid single points of failure The ESS Models E10 and E20 provide 6 GB of cache The ESS Models F10 and F20 provide 8 GB of cache an optional 16 GB of cache and faster PCI architecture The ESS provides the following features v RAID 5 or non RAID disk groups v Fast SSA drives v Fast reduced instruction set computer RISC processors v A fa...

Page 26: ... is 16 DDMs ESS Models E20 and F20 support a maximum of 128 DDMs With the expansion enclosure Models E20 and F20 support a maximum of 384 DDMs Host systems supported by the ESS The ESS provides heterogeneous data storage that you can share between workloads for open systems hosts The following sections contain information about v Open systems hosts with small computer system interface SCSI adapter...

Page 27: ...ing systems v Personal computer servers with Microsoft Windows 2000 operating systems v Sun with the Solaris operating system v Data General with the DG UX operating system v Personal computer servers with Novell Netware See the following ESS Web site for details about types models adapters and the operating systems that the ESS supports for SCSI attached host systems www storage ibm com hardsoft ...

Page 28: ...t for operating system support and planning information that includes APARs and programming temporary fixes PTFs For additional information about the changes you need to make to System 390 hosts to support ESS functions see DFSMS MVS Version 1 Release 5 Software Support for the IBM Enterprise Storage Server For information about the latest updates to Copy Services components XRC PPRC SnapShot Conc...

Page 29: ...following software on the workstation v Windows NT 4 0 operating system v Browser software Microsoft Internet Explorer and Netscape Navigator that allows access to the ESS Specialist v The ESSNet application for installation and configuration The ESSNet workstations includes an HTML page that provides links to all ESS connected to the ESSNet for Specialist access The ESSNet provides the following ...

Page 30: ... another network connection to the remote ESS through ESSNet hubs for Copy Services support IBM updates ESS Specialist and ESS Copy Services through engineering changes ECs ESS Specialist The ESS includes the ESS Specialist The ESS Specialist is a Web based interface that allows you to configure the ESS From the Web interface you can perform the following tasks v Monitor error logs v View and chan...

Page 31: ...LI commands to invoke Copy Services tasks in an ESS Web Copy Services server The command line functions TSO or API on IBM System 390 hosts initiate and manage Extended Remote Copy XRC Concurrent Copy FlashCopy and PPRC An API has been developed which uses the TSO command line function For more information see OS 390 DFSMSdfp Advanced Services The CLI on the open systems hosts initiates and manages...

Page 32: ...ches to which it is connected The paths panel also shows ESCON connected hosts and channel extenders You can use the paths panel to add or remove copy services paths or to create consistency group relationships for the LSS pairs v Tasks The Tasks panel allows you to manage tasks you have defined You can run remove save group or ungroup tasks The host system command line interface function uses the...

Page 33: ...our service provider can perform service on the ESS by using an IBM mobile service terminal MoST or equivalent Remote services support The ESS service interface also provides remote service support with call home capability for directed maintenance for service personnel You provide an analog telephone line to enable this support The service interface provides an RS232 connection through a modem sw...

Page 34: ...ystems increases from the 25 m 75 ft maximum imposed by SCSI connections up to 500 m 1500 ft The ESS can be up to 11 km 6 8 mi from your host when you connect to it with an IBM SAN fibre channel switch The ESS can also be the same distance from your host when you connect to it with an IBM fibre channel storage hub ESS architecture supports three basic interconnection topologies v Point to point v ...

Page 35: ... loop Fibre channel arbitrated loop FC AL is a ring topology that allows you to interconnect a set of nodes The maximum number of ports you can have for a fibre channel arbitrated loop is 127 See Figure 6 on page 12 The ESS supports FC AL as a private loop It does not support the fabric switching functions in FC AL S008945N 1 2 2 1 3 3 3 Legend 1 is the host system 2 is the ESS 3 is a switch Figur...

Page 36: ... Subsystem Device Driver supports These connections comprise many different components through which data flows during input and output processes Redundancy and the ability to switch between these components provides many different paths for the data to travel In the event of failure in one input output path it automatically switches to another input output path This automatic switching in the eve...

Page 37: ...s adapter on the host server an external SCSI cable a fiber connection cable or a host interface adapter on the ESS In addition multipath load balancing of data flow prevents a single path from becoming overloaded with I O operations The IBM Subsystem Device Driver path recovery algorithms now test Dead paths that are not manually offline every 30 minutes Concurrent download of licensed internal c...

Page 38: ...on page 18 v System 390 hosts See System 390 availability features on page 19 Enhanced data availability for some host systems is also available with the following software The software automatically uses a secondary path from a secondary server if a failure occurs v HACMP for mirroring for RS 6000 host systems v Similar software for other non IBM host systems v System 390 hosts running TPF can us...

Page 39: ...When the ESS detects a DDM failure in a loop it automatically uses a spare DDM to replace the failing DDM The ESS reconstructs the data on the spare DDM by using redundant information from the remaining DDMs in the array If a DDM fails a loop reconfigures itself into two loops Once service personnel have replaced the DDM the loop automatically resumes normal operation as a single loop Neither the ...

Page 40: ...es them to store a second copy of write data This ensures data integrity in the event of a power failure The NVS for cluster 1 is located in cluster 2 cluster 2 NVS is stored in cluster 1 Should a cluster fail the remaining cluster can access the data from the failed cluster Battery backup power protects NVS in each cluster Concurrent maintenance The ESS supports concurrent maintenance Service per...

Page 41: ...tasks such as asynchronous backup See FlashCopy and PPRC restrictions for open system hosts on page 18 for additional information about FlashCopy Peer to Peer Remote Copy The Peer to Peer Remote Copy PPRC feature allows synchronous copying of a physical volume the source on one storage server to another volume the target on a second storage server PPRC ensures write operations on both local and re...

Page 42: ...rent read write access of both volumes the source and target volumes should be on different host systems A copy operation with the source and target volume on the same host system creates a target volume with the same identification as the source volume The host system sees two identical volumes When the copy process creates the same identification for the target volume as for the source volume th...

Page 43: ...undant connections between the host server and disk storage in an ESS These connections comprise many different components through which data flows during input and output processes Redundancy and the ability to switch between these components provides many different paths on which the data travels See IBM Subsystem Device Driver Version 1 Release 1 for more information System 390 availability fea...

Page 44: ...e concurrent with other I O requests The ESS queues requests and then initiates them This allows you to have multiple access to a shared volume logical device without affecting performance Using the Multiple Allegiance feature can improve ESS throughput and performance Parallel Access Volume The Parallel Access Volume PAV feature allows you to access a CKD volume on an ESS in parallel With PAV you...

Page 45: ...28 fibre channel attached hosts per fibre port see Fibre channel host adapters on page 30 for information on loop topology ESCON attachment v 1 16 controller images v 1 256 devices per control unit image Host systems supported v IBM AS 400 v IBM RS 6000 and RS 6000 SP v HP 9000 v Sun v Compaq AlphaServer v Data General v IBM Netfinity and Intel based PCs v IBM NUMA Q v IBM ES 9000 v IBM 3090 v IBM...

Page 46: ...feature requires that you install an ESCON adapter on both the primary ESS and the secondary ESS 3 The ESS does not support PPRC or FlashCopy on the AS 400 Table 3 lists the physical features for the ESS Table 3 IBM Enterprise Storage Server physical features Feature Description Continuous availability designed to virtually eliminate single points of failure or repair See Note 1 v Cluster processo...

Page 47: ...nfiguration a DDMs are either all 9 1 GB all 18 2 GB or all 36 4 GB b DDM capacity assumes a RAID 5 configuration Logical subsystems IBM configures the ESS as logical containers that are known as logical subsystems LSSs The limit is 16 LSSs each for count key data CKD and fixed block FB format Note If you reduce the CKD LSS limit to zero then no Peer to peer copy functions will execute CKD LSS lim...

Page 48: ...24 ESS Introduction and Planning ...

Page 49: ...ct feature code 0983 This feature code ensures that IBM manufactures the ESS in the United States of America Power features This section includes information on requirements and feature codes for v Power outlets v Power supply input voltage v Power cables v Remote power control logic card v Remote support modem and modem switch v Extension cords Power outlets You need to supply the following power...

Page 50: ...r an expansion enclosure IBM includes the correct power cables IBM also provides the power cables for the ESSNet For Models E10 and F10 order the following feature codes 9801 Single Phase 50 60 Hz 50 A United States U S Canada Latin America LA and Asia Pacific AP 9802 Single Phase 50 Hz 50 A Europe Middle East Africa EMEA 9803 Single Phase 50 60 Hz 60 A Japan 9986 Single Phase 50 60 Hz 50 A Chicag...

Page 51: ... a pair of cables for attaching an ESS to the remote support switch This feature also includes two ESSNet Ethernet cables each 17 m 50 ft in length See Power cables for the remote support switch by modem country for information about power cables Power cables for the remote support switch by modem country Select the power cable for the remote support switch for your modem country group 9301 Modem ...

Page 52: ...lic of China Hong Kong Malaysia Singapore Extension cords Each ESS requires an extension cord for use by service personnel These cords are also known as convenience cords Specify one of the following feature codes to order the type of extension cord you require at your site 9401 Extension cord country group C01 Brazil U S Canada 9402 Extension cord country group C02 Aruba Bahamas Barbados Bermuda ...

Page 53: ...uinea Western Samoa 9411 Extension cord country group C11 Bangladesh Burma Pakistan South Africa Sri Lanka 9412 Extension cord country group C12 Antigua Bahrain Brunei Channel Islands Cyprus Fiji Ghana Hong Kong India Iraq Ireland Kuwait Malawi Malaysia Malta Nepal Nigeria Oman Polynesia Qatar Sierra Leone Singapore Tanzania United Arab Emirates Uganda United Kingdom Yemen Zambia Adapter features ...

Page 54: ...S on any loop point to point loop To have IBM install short wave fibre channel adapters on your ESS order FC 3022 IBM P N 54G3384 This feature code includes a 31 m 93 ft 50 µM short wave optics cable These fibre channel adapters incorporate short wave laser transmitters You can order and have IBM install a maximum of 16 fibre channel adapters on the ESS Each adapter has a single host port See your...

Page 55: ...e following memory capacity v Standard 6 GB of cache 3 per cluster v 384 MB 192 MB per cluster of nonvolatile storage NVS The ESS Models F10 and F20 have the following memory capacity v Standard 8 GB of cache 4 per cluster with FC 4002 IBM delivers FC 4002 on the ESS unless you specify the following option 16 GB of cache FC 4004 v 384 MB 192 MB per cluster of nonvolatile storage NVS Physical confi...

Page 56: ... four in the front and four in the rear Note The Model E10 does not support the expansion enclosure Populating the IBM Enterprise Storage Server You can build the maximum configuration for an ESS with the expansion enclosures If you order the expansion enclosure from the factory IBM populates the expansion enclosure with 8 packs in the following order v Models E10 and F10 Cage 1 8 packs 4 3 2 1 Ca...

Page 57: ...cks E20 and F20 High performance configurations The high performance configurations in Table 5 support only arrays with 18 2 GB DDMs Table 5 High performance configurations Feature Code Capacity Description Models 9621 420 GB 4 eight packs E10 F10 E20 and F20 9622 630 GB 6 eight packs E10 F10 E20 and F20 9623 840 GB 8 eight packs E10 F10 E20 and F20 9630 1050 GB 10 eight packs E20 and F20 9624 126...

Page 58: ... and expansion enclosure E20 and F20 9654 8260 GB 36 eight packs and expansion enclosure E20 and F20 9649 9240 GB 40 eight packs and expansion enclosure E20 and F20 9655 10 220 GB 44 eight packs and expansion enclosure E20 and F20 9645 11 200 GB 48 eight packs and expansion enclosure E20 and F20 ESS storage on demand IBM offers a storage on demand feature called step ahead storage With the step ah...

Page 59: ...d configuration features FC 2132 Eight pack with 18 2 GB DDM FC 2133 Eight pack with 36 4 GBDDM Table 7 High performance Configurations with 18 2 GB DDMs Capacity Increments GB Step ahead Capacity Increments GB Total Capacity GB Expansion Enclosure FC 2100 Feature Code Number of Eight Pack Feature Codes 420 210 630 No 9521 4 2122 2 2132 630 210 840 No 9522 6 2122 2 2132 840 210 1050 No 9523 8 2122...

Page 60: ...3 4 2133 9240 980 10 220 Yes 9549 40 2123 4 2133 10 220 980 11 200 Yes 9555 44 2123 4 2133 Feature codes and requirements for attaching 7133 drawers For protection of your assets IBM supports attachment of your existing 7133 drawers to an ESS in a new 2105 Model 100 expansion enclosure Use v FC 1121 to attach the first new Model 100 expansion enclosure v FC 1122 to attach a second new Model 100 ex...

Page 61: ...odel 020 and 7133 Model D40 drawers can be attached to the ESS You cannot attach drawers that have less than 16 DDMs to the ESS All the DDMs must be the same capacity The ESS cannot support mixed DDMs on the same loop Any 7133 drawers you install must meet the 7133 drawer compatibility requirements above You need to migrate or remove all data on 7133 drawers and disband the ranks arrays before ins...

Page 62: ...bles Each ESCON host adapter provides two host connections Order two ESCON cables for each adapter for System 390 hosts You can have your IBM field office order the cable using the OMCABLE transaction in Advanced Administrative Systems AAS Each feature code 3011 gives you one host adapter card Each adapter card requires two ESCON attachment cables either the standard riser rated cable cable group ...

Page 63: ...rol attachment cables You can order remote power control attachment cables for the ESS in quantities from one through eight Table 10 gives the connector IDs Table 10 Remote power control attachment cable connectors Remote Power Control Feature Code Cable Group Number Number of Cables Connector ID 1001 1178 1 through 8 01 03 05 07 09 11 13 15 Language for the operator panel The operator panel langu...

Page 64: ...ccess Volumes v ESS Copy Services IBM service personnel enable these features for you Order the feature code for the capacity that is equal to or greater than the capacity of your ESS Parallel Access Volumes PAV Order the PAV capacity that you need for your System 390 and zSeries hosts by using the following feature codes 1800 Up to 0 5 terabyte TB 1801 Up to 1 TB 1802 Up to 2 TB 1803 Up to 4 TB 1...

Page 65: ...ty you need using the following feature codes 1810 Up to 0 5 TB 1811 Up to 1 TB 1812 Up to 2 TB 1813 Up to 4 TB 1814 Up to 8 TB 1815 Larger than 8 TB Feature codes for peer to peer remote copy Order the capacity you need for your System 390 hosts fibre channel and SCSI attached host systems for both the primary and secondary ESS Use the following feature codes 1820 Up to 0 5 TB 1821 Up to 1 TB 182...

Page 66: ...hen the primary and backup servers should be assigned to ESS clusters that are remote from each other The ESS clusters that are part of a Copy Services CS server group use the TCP IP network to communicate You can configure two ESS Copy Services servers to a group Each ESS Copy Services server group manages four clusters and a maximum of 2048 volumes You have identified the assignment of the TCP I...

Page 67: ...e a Connect the ESS to the ESSNET Network Install DNS recommended b Install and activate the Copy Services LIC features Note LIC features for F10 F20 is capacity limited You can use the capacity for Flash Copy and PPRC that you purchase LIC features should be installed before you configure the machine c For PPRC install ESS ESCON host adapters If you specify the ESCON feature code with your initia...

Page 68: ...he ESS Copy Services server of the mapping of your host system disks to ESS volume serial numbers This task allows you to view the Host system assigned volume with the Web Copy Services interface from the Volume panel Notes a You must first authorize users before they can initiate this script from your host system CLI commands provide security level protection See the IBM Enterprise Storage Server...

Page 69: ...ve v All production applications and data located in a primary site v All secondary data located at a disaster recovery site Shadowing all data that is associated with a server to a backup site reduces the operational management complexity This includes determining what data on a file by file basis the backup site requires to recover the application in the event of a disaster since all data is rep...

Page 70: ...tion IBM recommends that for operational simplicity you attach and address the PPRC primary devices from the primary production server IBM recommends that you also attach and address the PPRC secondary devices from the secondary production server or the recovery server The ESS protects open system PPRC secondary volumes from host access This protection ensures data integrity and data consistency b...

Page 71: ...mation about using this ESS option This book describes how to install and use the IBM Subsystem Device Driver on SCSI and fibre channel attached host systems to enhance availability for the ESS Chapter 2 Planning the physical configuration 47 ...

Page 72: ...48 ESS Introduction and Planning ...

Page 73: ... attachment for AIX and HP UX and installation instructions for the IBM Subsystem Device Driver v Modems modem switches cables and power cables for remote support See Remote support switch on page 27 v The IBM workstation cables and power cables for ESSNet v The extension cord that the service provider uses to connect the service terminal to a power outlet See Extension cords on page 28 v Compact ...

Page 74: ...group to correct problems or provide additional support IBM might ship ECs as either mandatory or optional field bills You should install the mandatory field bills as directed by IBM Notes 1 The compact disc label indicates the EC level of the LIC 2 The ESS stores three EC levels of LIC code for the ESS and for any DDMs that IBM has installed on the ESS The ESS stores a new EC level prior to activ...

Page 75: ...Height 1 796 70 7 See Note 2 Width 1 383 54 4 Depth 0 91 35 8 Height 2 075 81 69 See Note 2 Width 1 573 62 00 Depth 1 067 42 00 1204 kg 2650 lbs 1432 kg 3154 lbs Model E20 or F20 with the expansion enclosure See Notes 3 and 5 Height 1 796 70 7 Width 2 938 115 7 Depth 0 91 35 8 Height 2 075 81 69 Width 3 128 123 30 Depth 1 067 42 00 2545 kg 5600 lbs See Note 4 Model 100 See Note 6 Height 1 780 70 W...

Page 76: ... its front of Models E20 and F20 6 Install the Model 100 to the right as you face its front of Models E10 E20 and E10 F20 IBM recommends that you install the ESS on a raised floor When you install the ESS you can cut out tiles for cable entry at the front IBM recommends that you place two fully perforated tiles in front of the ESS for cooling Center all openings and cutouts at the front of the enc...

Page 77: ...tion ESCON fibre channel small computer system interface SCSI cables and power cables Models E10 F10 E20 F20 Dimensions shown are centimeters inches 68 9 27 1 8 114 3 45 74 9 29 1 2 56 5 22 1 4 86 3 34 83 4 32 7 8 90 8 35 3 4 71 1 28 129 5 51 138 4 54 1 2 19 9 7 7 8 19 9 7 7 8 7 6 3 7 6 3 22 8 9 22 8 9 24 1 9 1 2 1 2 3 4 4 S008303R Figure 9 Cable cutout and door clearance for Models E10 F10 E20 an...

Page 78: ... The reference keys in Figure 10 identify the following locations 1 is the front of the enclosure 2 is the rear of the enclosure 3 is the cutout for power cables Dimensions shown are centimeters inches S009111 30 11 7 8 15 6 76 6 30 1 8 76 6 30 1 8 15 6 102 40 1 8 2 5 1 107 42 1 8 128 6 50 5 8 75 29 1 2 84 33 1 2 3 3 Figure 10 Cable cutout and door clearance for Model 100 54 ESS Introduction and P...

Page 79: ... 184 mm 7 25 in 432 mm 17 in 572 mm 22 5 in 361 kg m 70 lb ft 559 mm 22 in 432 mm 17 in 572 mm 22 5 in 2105 Model E20 and F20 Weight 1202 kg 2650 lbs Note 2 864 mm 34 in 1145 mm 45 in 610 kg m 125 lb ft 15 mm 6 in 432 mm 17 in 572 mm 22 5 in 488 kg m 100 lb ft 229 mm 9 in 432 mm 17 in 572 mm 22 5 in 439 kg m 90 lb ft 368 mm 14 5 in 432 mm 17 in 572 mm 22 5 in 342 kg m 70 lb ft 762 mm 30 in 483 mm ...

Page 80: ... 12 5 in 559 mm 22 in 488 kg m 100 lb ft 102 mm 4 in 572 mm 22 5 in 406 mm 16 in 439 kg m 90 lb ft 178 mm 7 in 572 mm 22 5 in 406 mm 16 in 342 kg m 70 lb ft 425 mm 16 75 in 572 mm 22 5 in 406 mm 16 in 2105 Model 100s Weight 1542 kg 3400 lbs Note 2 7 8 1145 mm 45 in 813 mm 32in 610 kg m 125 lb ft 0 mm 0 in 419 mm 16 25 in 419 mm 16 25 in 488 kg m 100 lb ft 178 mm 7 in 572 mm 22 5 in 406 mm 16 in 43...

Page 81: ... floor loading of each machine 7 When having two Model 100s the Model 100 frames are bolted together with a 40 mm 1 6 in spacer between them and physically positioned to the right of the Model E20 or F20 8 There can be a maximum of six drawers in a Model 100 9 A clearance of 102 mm 4 in on each side of the ESS is required to open the covers to 90 degrees 10 If you place an ESS Model E10 E20 F10 or...

Page 82: ...PC does not exceed 30 kg 65 lbs Power requirements This section provides power and cooling requirements and environmental information for the ESS Input voltages and frequencies See Table 14 for the input voltages and frequencies that the ESS supports The values apply to both primary power cables on any expansion enclosure or any model Inputs are either single phase or balanced three phase dependin...

Page 83: ...r from the rear and top Cooling requirements For cooling install two fully perforated tiles in front of each ESS Also install one fully perforated tile in front of an expansion enclosure and one fully perforated tile at the back of an expansion enclosure Operating environment The following sections list the environmental operating points and ranges that IBM recommends for the ESS Power on environm...

Page 84: ... Temperature 10 43 C 50 110 F Relative humidity 8 80 Wet Bulb Temperature 27 C 80 F Table 20 gives the temperatures and humidity that IBM recommends for storing an ESS Table 20 Recommended temperatures and humidity while in storage Temperature 29 C 84 F Relative humidity 5 80 Wet Bulb Temperature 29 C 84 F Recommended storage points or ranges The recommended storage points or ranges are Wet bulb 2...

Page 85: ...rs and receptacles Select the feature code that is appropriate for your site Phase rotation on three phase power cable connectors is counterclockwise as you look at the plug Phase rotation is clockwise as you look at the face of the power receptacle Chapter 3 Installation planning 61 ...

Page 86: ...closure 5 Not available on the Model E10 or F10 6 Install IEC309 receptacle in a metal backed box with the green wire ground connected to the grounding lug within the box Ensure continuity between the box and the metallic shielding of the liquid tight conduit 7 The 7428 78 in line connector must have the appropriate JPA adapter included in the assembly to ensure continuity between the connector ho...

Page 87: ...e modem is 3 33 m 10 ft long You supply the cable to connect the modem to a telephone jack Select the appropriate power cables for the modem and for the remote support switch Make your selection based on the feature code for the remote support switch power cable The modems that IBM offers are for worldwide use and they meet all required standards Connect the remote support switch to the serial por...

Page 88: ...64 ESS Introduction and Planning ...

Page 89: ...s remote service IBM recommends that you enable this service by checking Yes When you enable outgoing modem calls the ESS places the call back password in the header of each call home record The call back password allows your service provider to login to the ESS in response to the service call v Enable remote login You control this remote access IBM recommends that you enable this service by check...

Page 90: ...ee the AIX System Management Guide Communications and Networks Version 4 SC23 2526 Work with the IBM service personnel at your ESS site to set up advanced TCP IP configuration on the ESS If you want to attach your LAN to the ESSNet hub you need to provide the following TCP IP information to IBM IBM will connect your LAN cable to the ESSNet hub and enter the TCP IP information Note IBM will attach ...

Page 91: ...SNet for access over the network For example 555 555 555 0 h Network mask Enter the dotted decimal network mask that you are applying to TCP IP on this machine For example 255 255 255 0 i Nameserver Internet address Enter the dotted decimal address of the nameserver that this machine is to access For example 9 113 42 250 j Nameserver domain name Enter the domain name of the nameserver For example ...

Page 92: ...ween heartbeat call homes from the ESS clusters to IBM IBM uses this record to monitor the health of the call home process for each cluster If you enter 0 the ESS does not send a call home heartbeat The default interval is 5 days d Enable e mail across the LAN The ESS can send e mail to your LAN when it requires service It sends e mail through the ESSNet if you have attached your LAN to the ESSNet...

Page 93: ... suggests that you set support as the password k Outside line prefix This is the number you dial to access an outside line Enter up to three numbers in this field l Enable remote IBM PE login across a LAN Check Yes to enable IBM product engineering PE personnel to login to the ESS The PE personnel have service experience and development experience for this product Check No to disallow this access ...

Page 94: ... machine v Enter the full e mail address for each destination for example maria host com v For each recipient check one box Errors information all or none This specifies which notification the recipient receives c Enable smart relay host Note You cannot enable smart relay host if you have enabled local e mail as the two configurations are mutually exclusive Select Yes to enable a smart relay host ...

Page 95: ...ons you want sent for each trap condition To ensure that traps are not lost you may want to send each trap notification more than once e SNMP community name Enter the SNMP community name up to 31 characters to use for authenticating requests If you do not enter a name this entry defaults to public access f SNMP SysContact This is an optional entry If you like enter the name of the person responsib...

Page 96: ...v Direct access storage device DASD SIM This SIM tracks disk drive module DDM failures and problems v Media SIM This SIM tracks data check problems on the media v Storage facility SIM This SIM tracks control unit power control and other hardware problems You select the number of times that the ESS sends a SIM to your console The ESS can send a SIM 1 9 times or not at all 0 You also select the seve...

Page 97: ...eck Permit All if all hosts are to have access to all LUNs Communications for ESS Web Copy Services This section gives guidelines for filling out the Copy Services work sheet The ESS clusters that are part of a Copy Services Server Group use the TCP IP network to communicate Each ESS cluster needs to have an IP address assigned to it You enter this information on the Communication Resources Copy S...

Page 98: ...1 for additional information Attention This work sheet must be copied and provided for each ESS Web copy services server group defined 1 Server Group Identify the server group _ that is being defined by this work sheet 2 Primary Copy Services Server IP Address For example 9 113 152 148 3 Backup Copy Services Server IP Address For example 9 113 152 147 4 Is a Domain Name Server DNS configured on ES...

Page 99: ...e dotted decimal address you are assigning to cluster 1 of this machine For example 9 113 152 149 c Cluster 2 Hostname Enter the hostname that you are assigning to cluster 2 for access over the network For example Storage04 company com d Cluster 2 IP Address Enter the dotted decimal address you are assigning to cluster 2 of this machine For example 9 113 152 151 7 ESS Machine Serial Number for Bac...

Page 100: ...ine Interface Host 4 Hostname Enter the hostname that you are assigning to Command Line Interface 4 for access over the network For example Storage03 company com 6 ESSNet workstation Internet address Enter the Internet address that you are assigning to ESSNet for access over the network For example 555 555 555 0 ESSNet workstation hostname Enter the hostname that you are assigning to ESSNet for ac...

Page 101: ...y site before you can execute tasks to begin using the volumes Creating tasks for PPRC and FlashCopy We recommend you create all tasks during setup and that you name the tasks in such a way that will be meaningful to you The Web User Interface will enforce rules so the names you choose will be compatible with command line invocation As the following steps show each time you create a task you also ...

Page 102: ...red for disaster recovery because FlashCopy operates only in the same LSS We show them here for planning purposes only Step 4a a Create tasks for establish pairs b Select background copy or no background copy c Name and save each task Step 4b For each establish pairs task created in step 4a a Copy and edit to create an associated withdrawal task b Name and save the task 5 Finally after creating al...

Page 103: ...st of files to copy from its standard input You typically use it with the UNIX find command to copy complete directory structures v AIX backup and restore commands You commonly use these commands on AIX systems to archive and restore data However they do not support a direct disk to disk copy They require an intermediate device such as a tape drive or spare disk drive to store the archive that is ...

Page 104: ...d a 2 byte longitudinal redundancy check LRC complete the extra bytes The ESS LIC uses the sequence number and LRC The ESS does not transfer them to the host system For a description of the new format see 524 byte sector format 524 byte sector format Most fixed block disk architectures use a fixed byte sector of 512 bytes This includes most UNIX systems including AIX When used in an ESS subsystem ...

Page 105: ...iple controllers with anywhere from zero to eight LUNs under each controller for each 9337 emulated subsystem Most of the extra controllers will have a status of not connected and may still show that operational disk units are attached Although these differences may be confusing to the user they do not cause functional problems with the ESS UNIX systems For UNIX based systems the ESS emulates mult...

Page 106: ...u plan your migration v Non SMS If your environment is non SMS you can coordinate a migration to SMS with a migration to the new storage server You can also consider SMS and non SMS migrations as separate projects 2 Use IBM 3390 Direct Access Storage Migration Guide GG24 3373 as a reference for overall migration for both SMS and non SMS environments 3 Identify the most critical data and determine ...

Page 107: ...stems to one central location v Consolidation of your data center v Post migration services An IBM services specialist performs the service at your site by using an IBM supplied software tool installed on your systems This tool mirrors source data and target data and allows continued systems operation during the process To ensure a smooth migration the tool only updates your files when there is mi...

Page 108: ...84 ESS Introduction and Planning ...

Page 109: ...lf duplex 3 Customer information a Business name or company name b Location c Telephone number d Name of contacts e E mail address a _____________________________________ b _____________________________________ c _____________________________________ d _____________________________________ e _____________________________________ 4 Enable ESS Specialist a Enable check one h Yes h No 5 Call home and...

Page 110: ...e modem _____ 1 16 h Expander port for cluster 1 _____ 1 16 i Expander port for cluster 2 _____ 1 16 7 e mail configuration a Maximum error notification count per problem ________________ b Add e mail destinations ______________________________ ______________________________ Enable for check one 1 herrors h information h all h none 2 herrors h information h all h none c Enable smart relay host che...

Page 111: ... 10 Service information messages SIMs for S 390 a Enter the SIM severity reporting level for DASD SIMs check one b Enter the number of times a DASD SIM is to be sent 0 9 c Enter the SIM severity reporting level to media SIMs check one d Enter the number of times a media SIM is to be sent 0 9 e Enter the SIM severity reporting level for a storage server SIM check one f Enter the number of times the...

Page 112: ...88 ESS Introduction and Planning ...

Page 113: ... maximum b Cluster 1 IP address dotted decimal c Cluster 2 Hostname 100 characters maximum d Cluster 2 IP address dotted decimal Attention When Copy Services is being used without a Domain Name Server for example when the ESS s in this Server Group are attached to the ESSNet on a private network additional information must be entered into the Host Tables in both the ESS and the Host In addition to...

Page 114: ...Note Copy this table if more than four 4 hosts are using CLI to this ESS Web Copy Services server group 90 ESS Introduction and Planning ...

Page 115: ...00 rack This ensures the power systems will be fully compatible Feature code 1000 battery back up is required The Model 100 racks will be populated from the bottom to the top so that the center of gravity remains low ensuring better stability See 7133 Model 20 and D40 Note Prior to relocating a drawer to an ESS rack you must backup critical data You lose all existing data during ESS installation c...

Page 116: ... right hand corner of the 7133 drawer so that it is visible Note This visual label provides essential information that you and the service representative need when preparing the configuration work sheets Model D40 Requirements Your Model D40 drawer must meet the following requirements before a service representative can install it in a ESS v It must be a 7133 Model D40 Note You cannot install a 71...

Page 117: ... not currently containing DDMs All DDMs in a drawer must be the same size and RPM Order a 7133 MES Order the DDMs against the serial number of the 7133 drawer you are upgrading For Model 20 Order FC 3401 for each 4 5 GB DDM Order FC 3901 for each 9 1 GB DDM For Model D40 Order FC 8204 for each 4 5 GB DDM Order FC 8509 for each 9 1 GB DDM Order FC 8518 for each 18 2 GB DDM Order FC 8536 for each 36...

Page 118: ...94 ESS Introduction and Planning ...

Page 119: ...S THIS PUBLICATIONS AS IS WITHOUT WARRANTY OF ANY KIND EITHER EXPRESS OR IMPLIED INCLUDING BUT NOT LIMITED TO THE IMPLIED WARRANTIES OF NON INFRINGEMENT MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE Some states do not allow disclaimer of express or implied warranties in certain transactions therefore this statement may not apply to you This information could include technical inaccuracies or...

Page 120: ... of The Open Group in the United States and other countries Other company product and service names may be trademarks or service marks of others Electronic emission notices This section contains the electronic emission notices or statements for the United States and other countries Federal Communications Commission FCC statement This equipment has been tested and complies with the limits for a Cla...

Page 121: ...336 EEC on the approximation of the laws of the Member States relating to electromagnetic compatibility IBM cannot accept responsibility for any failure to satisfy the protection requirements resulting from a nonrecommended modification of the product including the fitting of non IBM option cards Germany only Zulassungsbescheinigung laut Gesetz ueber die elektromagnetische Vertraeglichkeit von Ger...

Page 122: ...rnment Ministry of Communication MOC statement Please note that this device has been approved for business purpose with regard to electromagnetic interference If you find this is not suitable for your use you may exchange it for a nonbusiness purpose one Taiwan class A compliance statement IBM agreement for licensed internal code Read Before Using IMPORTANT YOU ACCEPT THE TERMS OF THIS IBM LICENSE...

Page 123: ...cute and display the Code as necessary to maintain the Specific Machine You agree to acquire any replacement for or additional copy of Code directly from IBM in accordance with IBM s standard policies and practices You also agree to use that Code under these terms You may transfer possession of the Code to another party only with the transfer of the Specific Machine If you do so you must 1 destroy...

Page 124: ... Machines are eligible for On site warranty service depending on the country where service is performed The IBM Warranty for Machines IBM warrants that each Machine 1 is free from defects in materials and workmanship and 2 conforms to IBM s Official Published Specifications Specifications The warranty period for a Machine is a specified fixed period commencing on its Date of Installation The date ...

Page 125: ...service center to keep Machines in or restore them to conformance with their Specifications IBM or your reseller will inform you of the available types of service for a Machine based on its country of installation IBM may repair the failing Machine or exchange it at its discretion When warranty service involves the exchange of a Machine or part the item IBM or your reseller replaces becomes its pr...

Page 126: ...ncluding fundamental breach negligence misrepresentation or other contract or tort claim IBM is liable for no more than 1 damages for bodily injury including death and damage to real property and tangible personal property and 2 the amount of any other actual direct damages up to the greater of U S 100 000 or equivalent in local currency or the charges if recurring 12 months charges apply for the ...

Page 127: ...hine that is the subject of the claim NEW ZEALAND The IBM Warranty for Machines The following paragraph is added to this Section The warranties specified in this Section are in addition to any rights you may have under the Consumer Guarantees Act 1993 or other legislation which cannot be excluded or limited The Consumer Guarantees Act 1993 will not apply in respect of any goods which IBM provides ...

Page 128: ...ed to claim damages from IBM IBM is liable for no more than items 1 and 2 unchanged GERMANY The IBM Warranty for Machines The following replaces the first sentence of the first paragraph of this Section The warranty for an IBM Machine covers the functionality of the Machine for its normal use and the Machine s conformity to its Specifications The following paragraphs are added to this Section The ...

Page 129: ...iability and your sole remedy whether in contract or in tort in respect of any default shall be limited to damages ITALY Limitation of Liability The following replaces the second sentence in the first paragraph In each such instance unless otherwise provided by mandatory law IBM is liable for no more than item 1 unchanged 2 as to any other actual damage arising in all situations involving nonperfo...

Page 130: ...ng 150 000 or 125 percent of the charges if recurring the 12 months charges apply for the Machine that is the subject of the claim or which otherwise gives rise to the claim The following item is added to this paragraph 3 breach of IBM s obligations implied by Section 12 of the Sale of Goods Act 1979 or Section 2 of the Supply of Goods and Services Act 1982 Applicability of suppliers and resellers...

Page 131: ...eed to perform some service action 2 allegiance In the ESA 390 architecture a relationship that is created between a device and one or more channel paths during the processing of certain conditions Refer to implicit allegiance contingent allegiance and reserved allegiance allocated storage On an IBM storage server the space allocated to volumes but not yet assigned See assigned storage American Na...

Page 132: ...computer that manages I O communication between the program and any attached controllers channel subsystem image In the ESA 390 architecture the logical functions that a system requires to perform the function of a channel subsystem With EMIF one channel subsystem image exists in the channel subsystem for each LPAR Each image appears to be an independent channel subsystem program but all images sh...

Page 133: ...rack that can contain one or more records each consisting of a count field a key field optional and a data field optional CPC See cluster processor complex CRC See cyclic redundancy check CU See control unit customer console See console CUT See Universaile Tempes du Coordinaire cyclic redundancy check CRC A redundancy check in which the check key is generated by a cyclic algorithm T cylinder A uni...

Page 134: ...thin a subsystem The number and type of storage devices within a storage facility may vary disk drive module group A group of eight disk drive modules DDMs Each DDM group is a RAID array domain 1 That part of a computer network in which the data processing resources are under common control 2 In TCP IP the naming system used in hierarchical networks drawer A unit that contains multiple DDMs and pr...

Page 135: ...g A fast write operation reduces the time an application must wait for the I O operation to complete FBA See fixed block address FC AL See Fibre Channel Arbitrated Loop FCP See fibre channel protocol FCS See fibre channel standard Fibre Channel Arbitrated Loop FC AL An implementation of the fibre channel technology that uses a ring topology for communication In this topology two or more fibre chan...

Page 136: ...ering is composed of IBM engineers who have experience in supporting a product or who are knowledgeable about the product ID See identifier identifier ID A unique name or address that identifies things such as programs devices or systems implicit allegiance In the ESA 390 architecture a relationship that a controller creates between a device and a channel path when the device accepts a read or wri...

Page 137: ...terface local area network LAN A computer network located on a user s premises within a limited geographic area local e mail An e mail configuration option for storage servers that are connected to a host system network that does not have a domain name server DNS logical address On an ESCON interface the portion of a source or destination address in a frame used to select a specific channel subsys...

Page 138: ...Micro Channel architecture MCA The rules that define how subsystems and adapters use the Micro Channel bus in a computer The architecture defines the services that each subsystem can or must provide mirrored pair Two units that contain the same data The system refers to them as one entity mirroring In the AS 400 host systems the process of writing the same data to two disk units within the same au...

Page 139: ... volume peripheral component interconnection see program conrolled interruption point to point connection A fibre channel topology that allows you to interconnect ports directly POST See power on self test power on self test POST A diagnostic test run by servers or computers when they are turned on PPRC See Peer to Peer Remote Copy predictable write A write operation that can cache without knowled...

Page 140: ...over a network service boundary Physical space on an ESS rack It consists of a bay that contains SCSI and ESCON host adapter cards and the attached devices DDMs If a single component in a service boundary is being serviced none of its components are available to the ESS service information message SIM A message sent by a storage server to service personnel service processor A dedicated processing ...

Page 141: ... a host computer 2 A storage server and its attached storage devices storage server A unit that manages attached storage devices and provides access to the storage or storage related functions for one or more attached hosts StorWatch Enterprise Storage Server Specialist The Web based management interface to the IBM Enterprise Storage Server striping A technique that distributes data in bit byte mu...

Page 142: ...r and device pair on the interface Universaile Tempes du Coordinaire UTC The basis for coordinated world wide time This system formerly known as Greenwich Mean Time GMT was officially renamed to UTC for Universaile Tempes du Coordinaire because the world clock is now in Paris France It is also known as coordinated universal time CUT UTC See Universaile Tempes du Coordinaire utility device The ESA ...

Page 143: ...SS definition xiii RAID 1 AS 400 emulation 81 hardware resource manager 81 support for SCSI attachment 3 ASCII definition 107 assigned storage definition 107 attaching 7133 drawers 36 audience xiii authorized program analysis report definition 107 availability continuous 2 definition 107 features 14 System 390 19 UNIX 18 Windows NT 18 B battery disposal xi bay definition 107 bit definition 107 blo...

Page 144: ...nt Copy definition 108 configuration capacity 34 changes 40 date 65 e mail 70 ESS Copy Services 45 configuration continued high performance 33 minimum for an ESS 32 modem 69 pager 71 Peer to Peer Remote Copy 46 physical 31 32 planning 25 SNMP 71 TCP IP 66 time zone 65 ultra high performance 33 configure definition 109 with ESS Specialist 6 connection fibre channel 10 hardware 37 modem 63 remote su...

Page 145: ...ry 75 disk drive module definition 110 failure 15 group definition 110 disk drive module continued reformatting existing 80 disk group non RAID 15 disposal product xi documents ordering xvii domain definition 110 drawer definition 110 drive definition 110 duplex definition 110 dynamic sparing definition 110 E e mail configuration 70 destinations 70 EBCDIC definition 110 EC definition 110 ECKD defi...

Page 146: ...stration of 11 failover 12 failover definition 111 failover protection 15 failure 15 fast write definition 111 FB disk groups 6 FBA definition 111 FC AL definition 111 FCC statement 96 FCP definition 111 FCS definition 111 feature codes 25 adapter 29 cable 37 cache 31 DDM 32 extended remote copy 41 FlashCopy 41 peer to peer remote copy 41 step ahead storage 35 storage capacity 33 Federal Communica...

Page 147: ...ada Compliance statement 97 information messages service 72 initial program load definition 112 initiator definition 112 input output definition 112 input voltage 26 58 installation planning 49 installation requirements ESSNet 57 interface network 66 service 9 Web 4 5 Internet Protocol definition 112 introduction to ESS 1 invalidate definition 112 IP definition 112 IPL definition 112 J Japanese Vo...

Page 148: ...tch 49 modem outgoing calls enable 68 MoST definition 114 MoST See mobile service terminal 9 MTBF definition 114 Multiple Allegiance 20 multiple virtual storage definition 114 MVS definition 114 N name SNMP community 71 nameserver domain name 67 74 nameserver internet address 67 network Ethernet 66 interface 66 mask 67 node definition 114 non RAID definition 114 non RAID disk group 15 non removabl...

Page 149: ...er 32 POST definition 115 power cable 26 60 cable connectors 61 cables for remote support switch 27 consumption 58 power continued cord connectors 50 differences between models 21 features 25 outlet 50 63 outlets 25 remote control 27 63 requirements 58 uninterruptible 26 power on self test definition 115 PPRC 115 feature codes by terabytes 41 operational environment example 45 PPRC Also see Peer t...

Page 150: ...on 116 information messages 72 interface 9 personnel xv processor definition 116 service continued remote support 9 service offerings 40 service support representative definition 116 shared storage definition 116 sharing data 19 short wave definition 116 side clearance for the ESS models 57 SIM definition 116 SIM See Service Information Messages 72 simple network management protocol definition 116...

Page 151: ...rabyte capacity xvi definition 117 terms frequently used xiii thousands of power on hours definition 117 tiles perforated 52 time sharing option definition 117 time zone configuration 65 topology arbitrated loop 11 point to point 10 switched fabric 10 TPF definition 117 track definition 117 track descriptor record definition 118 trademarks 95 transaction processing facility definition 118 Transmis...

Page 152: ...weight ESS 50 work sheet Communication Resources 65 74 Copy Services 89 workstation ESSNet 58 world wide port name definition 118 write hit definition 118 write penalty 118 X XRC feature codes by terabytes 41 XRC Also see Extended Remote Copy 19 XRC definition 118 128 ESS Introduction and Planning ...

Page 153: ...rmation in this book is Very Satisfied Satisfied Neutral Dissatisfied Very Dissatisfied Accurate h h h h h Complete h h h h h Easy to find h h h h h Easy to understand h h h h h Well organized h h h h h Applicable to your tasks h h h h h Please tell us how we can improve this book Thank you for your responses May we contact you h Yes h No When you send comments to IBM you grant IBM a nonexclusive ...

Page 154: ...rocessing Department G26 050 5600 Cottle Road San Jose CA 95193 0001 _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _...

Page 155: ......

Page 156: ...IBMR Printed in the United States of America on recycled paper containing 10 recovered post consumer fiber GC26 7294 05 ...

Reviews: