manualshive.com logo in svg

IBM System storage DS6000 Series, Redbook

Share
Download
IBM System storage DS6000 Series Redbook Download Page 8

vi

 

IBM System Storage DS6000 Series: Copy Services with IBM System z

Chapter 13.  Metro Mirror options and configuration . . . . . . . . . . . . . . . . . . . . . . . . . .  133
13.1  High availability solutions  . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  134

13.1.1  GDPS HyperSwap Manager . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  134
13.1.2  Open systems - Clustering . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  134

13.2  Failover and failback . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  134
13.3  Consistency Group function  . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  136

13.3.1  Data consistency and dependent writes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  136
13.3.2  Consistency Group function - how it works . . . . . . . . . . . . . . . . . . . . . . . . . . . .  137
13.3.3  FREEZE and RUN parameters . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  140
13.3.4  Critical attribute . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  141
13.3.5  Consistency Group and critical mode combination . . . . . . . . . . . . . . . . . . . . . .  142

13.4  Metro Mirror paths and links . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  142

13.4.1  Fibre Channel links . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  143
13.4.2  Logical paths . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  144

13.5  Bandwidth . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 145
13.6  LSS design  . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 145
13.7  Distance  . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  146
13.8  Symmetrical configuration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  146
13.9  Volumes  . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  147
13.10  Hardware requirements. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  148

Chapter 14.  Metro Mirror interfaces. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  149
14.1  Metro Mirror interfaces - overview. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  150
14.2  TSO commands for Metro Mirror management. . . . . . . . . . . . . . . . . . . . . . . . . . . . .  151

14.2.1  Commands overview. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  152
14.2.2  CESTPAIR  . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  152
14.2.3  CESTPATH . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  153
14.2.4  CDELPAIR  . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  154
14.2.5  CDELPATH . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  154
14.2.6  CGROUP  . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  154
14.2.7  CQUERY. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  155
14.2.8  CRECOVER . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  156
14.2.9  CSUSPEND  . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  157
14.2.10  Batch execution of Metro Mirror TSO commands . . . . . . . . . . . . . . . . . . . . . .  157

14.3  ICKDSF . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  157

14.3.1  Metro Mirror management with ICKDSF . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  158
14.3.2  Display the Fibre Channel Connection Information Table. . . . . . . . . . . . . . . . .  159
14.3.3  PPRCOPY DELPAIR  . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  159
14.3.4  PPRCOPY DELPATH . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  160
14.3.5  PPRCOPY ESTPATH . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  160
14.3.6  PPRCOPY ESTPAIR  . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  161
14.3.7  PPRCOPY FREEZE . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  161
14.3.8  PPRCOPY QUERY. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  161
14.3.9  PPRCOPY RECOVER . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  164
14.3.10  PPRCOPY SUSPEND  . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  164
14.3.11  PPRCOPY RUN . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  164
14.3.12  Refreshing the VTOC . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  164

14.4  DS Command-Line Interface. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  165

14.4.1  DS CLI supported environments . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  165

14.5  DS CLI command- examples  . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  165

14.5.1  Set up a Metro Mirror environment . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  166
14.5.2  Remove a Metro Mirror environment  . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  167
14.5.3  Manage a Metro Mirror environment. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  168

Summary of Contents for System storage DS6000 Series

Page 1: ...ll and configure DS6000 Copy Services with System z Learn how to use the management interfaces TSO DS CLI DS GUI Learn about TPC for replication support Gustavo Castets Bertrand Dufrasne Stephen Baird...

Page 2: ......

Page 3: ...International Technical Support Organization IBM System Storage DS6000 Series Copy Services with IBM System z December 2006 SG24 6782 02...

Page 4: ...Rights Use duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp Third Edition December 2006 This edition applies to features microcode GUI and DS CLI as announced for the DS...

Page 5: ...at is a Storage Complex 10 2 2 How the new structure of Copy Services works 11 2 2 1 Remote Mirror and Copy between Storage Complexes 12 2 2 2 Differences between the DS CLI and the DS GUI 12 2 3 Syst...

Page 6: ...opy option 48 6 4 FlashCopy in combination with other Copy Services 49 6 4 1 FlashCopy and Metro Mirror 49 6 4 2 FlashCopy and Global Copy 50 6 4 3 FlashCopy and Global Mirror 51 6 5 FlashCopy for z O...

Page 7: ...on of the workload Source and target volumes location 112 10 1 2 LSS LCU versus rank considerations 113 10 1 3 Rank geometry 113 10 1 4 Incremental FlashCopy 113 10 2 FlashCopy establish phase perform...

Page 8: ...aces 149 14 1 Metro Mirror interfaces overview 150 14 2 TSO commands for Metro Mirror management 151 14 2 1 Commands overview 152 14 2 2 CESTPAIR 152 14 2 3 CESTPATH 153 14 2 4 CDELPAIR 154 14 2 5 CDE...

Page 9: ...erview 202 17 2 Volume states and change logic 203 17 3 Global Copy positioning 204 Chapter 18 Global Copy options and configuration 205 18 1 Global Copy basic options 206 18 1 1 Establish Global Copy...

Page 10: ...2 Global Copy for migration using the DS CLI 241 21 2 1 Migration procedure steps 241 21 2 2 Cascading alternative 244 Chapter 22 Global Mirror overview 245 22 1 Synchronous and non synchronous data...

Page 11: ...298 24 2 Different interfaces for the same function 298 24 2 1 Establish FlashCopy using TSO 299 24 2 2 Establish FlashCopy using DS CLI 300 24 2 3 Establish FlashCopy using ICKDSF 301 24 2 4 Which in...

Page 12: ...ablish FlashCopy relationships 349 26 3 4 Define Global Mirror session 350 26 3 5 Populate the session with Global Copy primary volumes 351 26 3 6 Start Global Mirror session 352 26 4 Primary site fai...

Page 13: ...sing the DS CLI 401 26 12 1 Perform a Global Copy failover 401 26 12 2 Perform a Global Copy failback 401 26 12 3 Create a FlashCopy for backup 402 26 12 4 Verify FlashCopy status between B and C volu...

Page 14: ...RMC PPRC 437 29 2 8 Volume address considerations on the ESS 800 439 29 3 RMC Establishing paths between DS6000 and ESS 800 439 29 3 1 Decoding port IDs 439 29 3 2 Creating paths with the DS GUI 440 2...

Page 15: ...rements for TPC for Replication servers 486 31 15 TPC for Replication GUI 487 31 15 1 Connect to the TPC for Replication GUI 488 31 15 2 Health Overview panel 489 31 15 3 Sessions panel 491 31 15 4 St...

Page 16: ...al connection events 520 Remote copy events 522 Global Mirror related events 522 Appendix C Licensing 525 Licenses 526 Authorized level 527 Charging example 527 Appendix D CLI migration 529 Migrating...

Page 17: ...itions of the publication IBM may make improvements and or changes in the product s and or the program s described in this publication at any time without notice Any references in this information to...

Page 18: ...egistered trademarks of SAP AG in Germany and in several other countries NOW and the Network Appliance logo are trademarks or registered trademarks of Network Appliance Inc in the U S and other countr...

Page 19: ...s for IBM Global Delivery in Argentina as a Storage Specialist supporting US and European accounts Bert Dufrasne is a Certified Consulting IT Specialist and Project Leader for IBM TotalStorage and Sys...

Page 20: ...esponsible for the architecture and implementation of the disk storage envi ronment using EMC Symmetrix HDS Lightning and ESS Model 800 Today Peter s main focus is on Copy Services in the Open Systems...

Page 21: ...help with administrative tasks Many thanks to the authors of the previous edition of this redbook Peter Kimmel Jukka Myyrlainen Lu Nguyen Gero Schmidt Shin Takata Anthony Vandewerdt Bjoern Wesselbaum...

Page 22: ...nus you ll develop a network of contacts in IBM development labs and increase your productivity and marketability Find out more about the residency program browse the residency index and apply online...

Page 23: ...ges for SG24 6782 02 for IBM System Storage DS6000 Series Copy Services with IBM System z as created or updated on December 14 2006 December 2006 Third Edition This revision reflects the addition dele...

Page 24: ...xxii IBM System Storage DS6000 Series Copy Services with IBM System z...

Page 25: ...ome new terminology We also introduced these terms for Advanced Copy Services Version 2 for the ESS These terms are described in detail in IBM System Storage DS6000 Series Architecture and Implementat...

Page 26: ...Mirror and Copy RMC or PPRC and Point in Time Copy PTC or FlashCopy The DS CLI replaces both the ESS CLI and the ESS Copy Services CLI The DS CLI can also be used for ESS 800 Copy Services but not ESS...

Page 27: ...rivers for Copy Services and provides a brief summary of the various Copy Services functions available on the DS6000 series These services are very similar to the existing Copy Services for the IBM En...

Page 28: ...RC IBM System Storage Global Copy previously known as PPRC Extended Distance IBM System Storage Global Mirror previously known as Asynchronous PPRC z OS Global Mirror previously known as Extended Remo...

Page 29: ...rage Units To establish an RMC formerly PPRC relationship between the DS6000 and the ESS the ESS needs to have licensed internal code LIC Version 2 4 3 65 or later The Remote Mirror and Copy feature c...

Page 30: ...OS Global Mirror The z OS Global Mirror function mirrors data on the Storage Unit to a remote location for Disaster Recovery It protects data consistency across all volumes that you have defined for m...

Page 31: ...s an overview of the structure of the Copy Services communication architecture in either an open or System z environment The chapter covers the following topics Introduction to the Copy Services struc...

Page 32: ...nterface DS CLI It is possible using the DS GUI to manage Copy Services operations on multiple Storage Complexes 2 1 2 What is a Storage Unit A Storage Unit is the physical storage device including ex...

Page 33: ...SFI always ends in 2 DS8000 Model 921 and 922 SFI example In Example 2 2 we used the DS CLI to connect to a DS8000 Management Console We issued the lssu command to display the DS8000 Storage Unit of...

Page 34: ...logical view of two Storage Complexes each with one DS6000 Storage Unit They are running Remote Mirror and Copy Now because the two DS SMCs are linked by Ethernet you could use the DS GUI to connect t...

Page 35: ...Node which resides on each server of an SFI From this point the network interface talks to the microcode which operates the DS8000 1750 DS6000 management structure In Figure 2 2 you can see that The c...

Page 36: ...2 1 Remote Mirror and Copy between Storage Complexes It is possible to use Remote Mirror and Copy between Storage Complexes as depicted in Figure 2 3 In this scenario there are three Storage Complexes...

Page 37: ...y Services commands to the DS6000 and DS8000 via inband communication This is done by sending commands via a FICON or ESCON in the case of DS8000 host link to a conduit CKD volume From there it gets p...

Page 38: ...14 IBM System Storage DS6000 Series Copy Services with IBM System z...

Page 39: ...ces In this part we discuss the interfaces available to manage the Copy Services features of the DS6000 We give an overview of the interfaces discuss the options available discuss configuration consid...

Page 40: ...16 IBM System Storage DS6000 Series Copy Services with IBM System z...

Page 41: ...nister the DS storage system The DS Storage Manager is an interface that is used to perform logical configurations service Copy Services management and firmware upgrades The topics covered in this cha...

Page 42: ...ompatibility requirements 1 4 GHz Pentium 4 256 KB cache 512 MB memory 1 GB disk space for the DS Storage Manager software 1 GB work space per managed Integrated RAID Controller IRC IP Network connect...

Page 43: ...tivated These components can both be installed on the same server and are integrated into the user interface They are designed to help you create and manage the physical and logical configurations of...

Page 44: ...ou cannot use the Simulated manager to perform any type of Copy Services configuration You must perform Copy Services configuration from the Real time manager Real time online manager This provides re...

Page 45: ...our SMC IP address is 10 0 0 1 then you can access the Information Center running on that SMC at http 10 0 0 1 8455 If you are locally logged onto the SMC then you can also use http 127 0 0 1 8455 To...

Page 46: ...it Because an SMC can manage two DS6000s a single Storage Complex could consist of one SMC and two DS6000s Figure 3 4 shows how we connected to the Storage Complex managed by the SMC at the 10 0 0 1 I...

Page 47: ...anel Figure 3 5 Add Storage Complex panel 6 Type the IP address of the SMC for the other Storage Complex in the Management console 1 IP address field If the other Storage Complex has a second SMC sele...

Page 48: ...can use the DS6000 DS GUI to create paths and Remote Mirror and Copy pairs between any of the Storage Units You can also use the DS6000 DS GUI to manage FlashCopy pairs on any DS6000 This is all assum...

Page 49: ...introduction to the DS Command Line Interface DS CLI which can be used to configure and administer the DS6000 storage systems It describes how it can be used to manage Copy Services relationships In t...

Page 50: ...ns that you can perform with the DS CLI Create user IDs that can be used with the GUI and the DS CLI Manage user ID passwords Install activation keys for licensed features Manage Storage Complexes and...

Page 51: ...dministrator can assign to a user The groups and the associated functions allowed by the assignment are as follows admin Allows access to all storage management console server service methods and all...

Page 52: ...Two examples are c Program Files IBM DSCLI profile operation_name1 c Program Files IBM DSCLI profile operation_name2 These profile files can be specified using the DS CLI command parameter cfg profile...

Page 53: ...ommands Give you brief information about the copy services state See Table 4 1 2 show commands Give you detailed information about the copy services state See Table 4 2 3 mk commands Used to create re...

Page 54: ...mmand Description commitflash Commits data to a target volume to form a consistency between the source and target resyncflash Incremental FlashCopy process reverseflash Reverse the direction of a Flas...

Page 55: ...in20s BRT IBM DSCLI Version X X X X Name Group State admin admin locked admin admin active exit status of dscli 0 unfreezepprc Thaws an existing Remote Mirror and Copy Consistency Group pausegmir Paus...

Page 56: ...nel LW 0 I0002 500507630E05FC00 Online Fibre Channel LW SCSI FCP 0 I0003 500507630E07FC00 Online Fibre Channel LW 0 I0100 500507630E81FC00 Online Fibre Channel LW SCSI FCP 0 I0101 500507630E83FC00 Onl...

Page 57: ...igned A1 S4 0 146 0 Assigned A1 dscli lssi Date Time 24 de Maio de 2005 14h42min59s BRT IBM DSCLI Version X X X X Name ID Storage Unit Model WWNN State ESSNet IBM 1750 1312345 IBM 1750 1312345 511 500...

Page 58: ...d initiates a point in time copy from source volumes to target volumes In Example 4 5 the l parameter is used to obtain a list of all parameters that can be used with the mkflash command Example 4 5 U...

Page 59: ...py pair 0100 0300 successfully created CMUC00137I mkflash FlashCopy pair 0101 0301 successfully created CMUC00137I mkflash FlashCopy pair 0102 0302 successfully created The following command establish...

Page 60: ...36 IBM System Storage DS6000 Series Copy Services with IBM System z...

Page 61: ...stem z interfaces This chapter discusses the interfaces that are available with the System z servers for managing DS6000 Copy Services functions This chapter covers the following topics System z inter...

Page 62: ...oftware stacks 5 1 1 Operating system alternatives From an operating system point of view the alternatives to the DS GUI and DS CLI break out as follows z OS TSO commands ICKDSF DFSMSdss ANTRQST appli...

Page 63: ...in z OS DFSMSdss Storage Administration Reference SC35 0424 5 5 The ANTRQST macro The ANTRQST macro provides an application program call to the application programming interface API of the z OS syste...

Page 64: ...40 IBM System Storage DS6000 Series Copy Services with IBM System z...

Page 65: ...e features of FlashCopy and describe the options for its setup We also show which management interfaces can be used as well as the important aspects to be considered when establishing FlashCopy relati...

Page 66: ...42 IBM System Storage DS6000 Series Copy Services with IBM System z...

Page 67: ...refer to as a Point in Time copy instantaneous copy or time zero copy t0 copy This chapter explains the basic characteristics of FlashCopy when used in a System z environment with the DS6000 The follo...

Page 68: ...he production environment Thus the production continues and while a specific problem is being fixed the majority of the users can work with the application without recognizing any problems The FlashCo...

Page 69: ...ed by the application We use the term target to refer to the point in time backup copy Also the terms LUN and volume are used interchangeably in our discussions 6 3 Basic concepts In a System z enviro...

Page 70: ...igure 6 2 Figure 6 2 FlashCopy at time t0 Once the relationship has been established it is possible to perform read and write I Os on both the source and the target Assuming that the target is used fo...

Page 71: ...entify if the data has to be retrieved from the source or from the target If the bitmap states that the time zero data hasn t yet been copied to the target then the physical read is directed to the so...

Page 72: ...get is similar to the one in Figure 6 6 Figure 6 6 FlashCopy after updates to the target volume 6 3 2 Nocopy option If FlashCopy is established using the nocopy option then the result will be as shown...

Page 73: ...opy source volume can become a Metro Mirror primary volume and vice versa The order of creation is optional A FlashCopy target volume can become a Metro Mirror primary volume and vice versa If you wis...

Page 74: ...he primary Global Copy site the following combinations are possible A FlashCopy source volume can become a Global Copy primary volume and vice versa The order of creation is optional A FlashCopy targe...

Page 75: ...FlashCopy source volume can become a Global Mirror primary volume and vice versa The relationships can be established in any sequence A FlashCopy target volume cannot become a Global Mirror primary vo...

Page 76: ...52 IBM System Storage DS6000 Series Copy Services with IBM System z Figure 6 10 Source data set and target data set can reside in the same volume FlashCopy volume source dataset target dataset...

Page 77: ...ith IBM System Storage DS6000 series in a System z environment The following options are explained Multiple relationship FlashCopy Consistency Group FlashCopy FlashCopy on existing Metro Mirror or Glo...

Page 78: ...lustrates what is possible and what is not with multiple relationship FlashCopy Figure 7 1 Multiple relationship FlashCopy possibilities Multiple relationship FlashCopy at the data set level Multiple...

Page 79: ...tes to the FlashCopy source volumes is the basis for providing consistent data at the FlashCopy target volumes For a more detailed understanding of dependent writes and how extended long busy conditio...

Page 80: ...d Any attempt to write to the device during this period will be failed by the hardware and surfaced as an I O error an error from the access method or both With Incremental FlashCopy the initial Flash...

Page 81: ...nge Recording set no updates in source no updates in source updates took place in source volume updates took place in source volume no updates in target updates took place in target volume no updates...

Page 82: ...analyze which blocks need to be copied from the source volume to the target volume see Figure 7 5 Figure 7 5 Refresh of the FlashCopy target volume After the Refresh which takes place only on the bitm...

Page 83: ...ce methods If this option is not selected the FlashCopy relationship will exist until all data has been copied from the source volume to the target 7 7 Data set FlashCopy Data set FlashCopy is support...

Page 84: ...Global Mirror If you specify this option you can reverse the FlashCopy relationship without waiting for the completion of the background copy of the previous FlashCopy 7 10 Options and interfaces Now...

Page 85: ...verse restore Remote FlashCopy Incremental FlashCopy Target on existing Metro Mirror or Global Copy primary Consistency Group FlashCopy Multiple relationship FlashCopy ICKDSF TSO DFSMSdss DS CLI DS SM...

Page 86: ...62 IBM System Storage DS6000 Series Copy Services with IBM System z...

Page 87: ...Chapter 8 FlashCopy ordering and activation This chapter explains how to order and activate FlashCopy for the IBM System Storage DS6000 The information presented here can be complemented with the inf...

Page 88: ...licensed function This is also referred to as the authorization level The extent of IBM authorization for the use of a licensed function on a 1750 system is established by acquiring an 52xx feature n...

Page 89: ...hase of the 52xx feature number IBM provides an order confirmation code To activate the function in your machine you must assign the order confirmation code to your 1750 system using the 1750 base enc...

Page 90: ...ase in the license scope changing FB or CKD to ALL is a nondisruptive activity A lateral change changing FB to CKD or changing CKD to FB or a reduction of the license scope changing ALL to FB or CKD i...

Page 91: ...planning Model The model of the DS6000 can be taken from the order Serial number of the DS6000 The serial number of a DS6000 can be taken from the front of the base frame lower right corner If several...

Page 92: ...68 IBM System Storage DS6000 Series Copy Services with IBM System z...

Page 93: ...s The setup of FlashCopy in a System z environment can be done using different interfaces This chapter explains and gives examples of the interfaces that can be used for FlashCopy management when Flas...

Page 94: ...pter 31 IBM TotalStorage Productivity Center for Replication on page 467 TPC for Replication includes similar functions to Global Mirror Utility GMU GMU users should consider migrating to TPC for Repl...

Page 95: ...py Create a local FlashCopy mkflash Create Work with an existing FlashCopy Display a list of FlashCopy relationships lsflash Main panel Modify a FlashCopy pair that is part of a Global Mirror relation...

Page 96: ...is part of a Global Mirror relationship to revertible setremoteflashrevertible Commit data to the target volume commitremoteflash Increment an existing FlashCopy pair resyncremoteflash prerequisites...

Page 97: ...Provide information why DFSMSdss couldn t use FlashCopy DEBUG Terminate FlashCopy Remove local FlashCopy DUMP with FCWITHDRAW parameter FCWITHDR FLASHCPY WITHDRAW Is automatically removed as soon as...

Page 98: ...o so a second bitmap is created for the source volume which keeps track of all writes to the source This bitmap can later be used to refresh the target by only copying the updates from the source to t...

Page 99: ...kflash dev IBM 1750 13ABC2A freeze seqnum 01 0001 0101 0005 0105 Date Time July 8 2005 10 32 26 AM CEST IBM DSCLI Version 5 0 3 134 DS IBM 1750 13ABC2A CMUC00137I mkflash FlashCopy pair 0001 0101 succ...

Page 100: ...a persistent relationship Using other DS CLI commands it could be reversed and or resynchronized Example 4 0003 0103 The FlashCopy between volume 0003 and volume 0103 is established with the following...

Page 101: ...ri Jul 08 11 02 48 CEST 2005 Fri Jul 08 11 02 48 CEST 2005 0003 0103 00 3 300 Disabled Disabled Enabled Disabled Disabled Disabled Enabled 150255 Fri Jul 08 11 03 04 CEST 2005 Fri Jul 08 11 03 04 CEST...

Page 102: ...n the selected range of volumes for which a background copy is actively running The output format is the default output In our example there were no active background copies Example 6 list existing Fl...

Page 103: ...s following the one that caused the error will not be executed Commit data to target using commitflash The command commitflash can be used to commit data to a target volume to set consistency between...

Page 104: ...with return code 2 and any other commands following the one that causes the error will not be executed Incremental FlashCopy using resyncflash With the resyncflash command an existing FlashCopy relati...

Page 105: ...Disabled Enabled resyncflash dev IBM 1750 13ABC2A record persist seqnum 14 0004 0104 Date Time July 10 2005 5 06 51 PM CEST IBM DSCLI Version 5 0 3 134 DS IBM 1750 13ABC2A CMUN03027E resyncflash 0004...

Page 106: ...isabled Enabled Enabled Disabled Disabled Disabled Enabled 0105 0005 01 1 300 Disabled Enabled Enabled Disabled Disabled Disabled Enabled Example 2 reverseflash dev IBM 1750 13ABC2A record 0002 0102 D...

Page 107: ...4 DS IBM 1750 13ABC2A CMUC00137I mkflash FlashCopy pair 0001 0101 successfully created mkflash dev IBM 1750 13ABC2A nocp seqnum 04 0001 0104 0001 0105 Date Time July 11 2005 9 44 42 AM CEST IBM DSCLI...

Page 108: ...le 9 9 the existing FlashCopy relationship 0001 0101 is removed 9 4 3 FlashCopy Consistency Groups Typically large applications such as databases have their data spread across several volumes In order...

Page 109: ...nks between the two DS6000s that are used for mirroring purposes are also used to transmit the FlashCopy commands to the remote DS6000 For detailed information about the DS CLI refer to IBM System Sto...

Page 110: ...al FlashCopy commands on page 73 With regard to the parameter conduit which only applies to remote FlashCopy the following explanation applies conduit within a remote mirror environment the FlashCopy...

Page 111: ...ter you log in to the DS SM select Real time manager on the left then FlashCopy Identify the DS6000 for which you would like to initiate a FlashCopy From the Select Action box select Create See Figure...

Page 112: ...py can be defined by using the DS SM with a browser selecting the Create for FlashCopy or by using the DS CLI using the mkflash command Using the DS SM it is possible to define FlashCopies that will b...

Page 113: ...f the selected FlashCopy will be displayed Options for the target volume FlashCopy target can be Metro Mirror or Global Copy primary tgtpprc Establish target on existing Metro Mirror source Permit tar...

Page 114: ...ow with two folders General In this folder all properties of the selected FlashCopy are presented See Figure 9 6 Figure 9 6 General folder with FlashCopy information Note In case you are selecting mul...

Page 115: ...CLI vs the DS SM front end Properties with DS CLI command lsflash Properties with DS SM FlashCopy property Property Contents Property Contents Source LSS SrcLSS Source LSS in selection window From se...

Page 116: ...and then clicking OK will start the reverse process for the FlashCopy Persistent Enabled or disabled Relationship will remain Yes or no Identifies if the FlashCopy relationship can be changed by copy...

Page 117: ...nd window and select Real Time Manager on the left then FlashCopy Identify the DS6000 Storage Unit and LSS for example for which you would like to increment a FlashCopy This will give you a list of al...

Page 118: ...shCopy should run Figure 9 10 Prompt window for background copy 9 6 5 Resynchronize target To resynchronize a target volume start by displaying the list of active FlashCopy relationships as shown in F...

Page 119: ...ces 95 Figure 9 11 Resynchronize the FlashCopy relationship The following prompt window asks for more details for the resync request see Figure 9 12 Figure 9 12 Prompt window to detail resync request...

Page 120: ...ure 9 13 Then check the box at the left of the FlashCopy relationship you want to terminate Doing so the available Select Actions for this FlashCopy relationship will be shown Then select Delete Figur...

Page 121: ...ve for the same source volume The FASTREPLICATION NONE keyword must not be specified Not all tracks on the volume are copied when DFSMSdss invokes FlashCopy for a full volume copy DFSMSdss requests Fl...

Page 122: ...wing all the frozen volumes using the CGCREATE command after a FlashCopy Consistency Options Parameter with DFSMSdss COPY FULL Remark Options for the source volume Multiple relationship FlashCopy sele...

Page 123: ...ill help you determine whether the copies of the group of volumes are consistent An error message is issued if the frozen state cannot be verified Regardless of the verification result DFSMSdss will p...

Page 124: ...e the FCINCRVERIFY NOREVERSE REVERSE keyword to verify that the existing Incremental FlashCopy direction is what you expected DFSMSdss will fail the copy attempt if the existing direction is not as ex...

Page 125: ...able 9 13 on page 102 shows which functions are invoked by DFSMSdss depending on the type of data set parameter FASTREPLICATION PREFERRED This is the default For DFSMSdss the DS6000 FlashCopy is the p...

Page 126: ...FSMSdss IDCAMS DFSMSdss calls IDCAMS if the target CISIZE CASIZE physical record size or physical block size of the target is different from that of the source LDS DFSMSdss IDCAMS DFSMSdss calls IDCAM...

Page 127: ...T DD SYSOUT SYSUADS DD DSN SYS1 UADS DISP SHR SYSLBC DD DSN SYS1 BRODCAST DISP SHR SYSTSIN DD FCESTABL SDEVN X 3500 TDEVN X 4500 ACTION FREEZE FCESTABL SDEVN X 3501 TDEVN X 4501 ACTION FREEZE FCESTABL...

Page 128: ...copy FCESTABL with MODE COPY ESTABLISH FLASHCOPY RELATIONSHIP SDEVN SOURCE FLASHCOPY VOLUME TDEVN TARGET FLASHCOPY VOLUME STEP1 EXEC PGM IKJEFT01 REGION 256K SYSTSPRT DD SYSOUT SYSUADS DD DSN SYS1 UAD...

Page 129: ...dss can use the target device as input for backing up data to tape Change the NOCOPY to full volume copy relationship In order to change the NOCOPY relationship to a full volume copy use the TSO FCEST...

Page 130: ...When the background copy on the target FlashCopy volume which is at the same time the primary Metro Mirror volume is complete the FlashCopy relationship is ended unless INCREMENTAL YES was specified R...

Page 131: ...fied for the Metro Mirror secondary on the TSO CESTPAIR command DEVN 3500 is the Metro Mirror primary through which the FCESTABL command will be passed FlashCopy in a Global Mirror session Example 9 1...

Page 132: ...5 Withdraw FlashCopy relationships TSO FCWITHDR is used to remove existing FlashCopy relationships The FlashCopy withdraw process locates source tracks on the source device and target tracks on the ta...

Page 133: ...X 320A TDEVN X 320B The FCWITHDR command with the DDSW YES deleted data space withdraw parameter when issued against an entire source volume removes all target extents on the specified source device f...

Page 134: ...ion for volumes in a FlashCopy relationship The TSO FCQUERY command is used to display available information about FlashCopy and other copy services relationships active on the device If the device is...

Page 135: ...er discusses best practices when configuring FlashCopy for specific environments or scenarios The following topics are covered FlashCopy performance overview FlashCopy establish performance Background...

Page 136: ...ray site made into an array which is then made into a rank For the DS6000 a rank is a collection of 8 disk drive modules DDMs The lsrank command displays detailed information about the ranks 10 1 1 Di...

Page 137: ...ID 5 configuration then the target volumes should also be located on a rank configured as 7 p RAID 5 10 1 4 Incremental FlashCopy This chapter focuses on FlashCopy performance best practices but there...

Page 138: ...f incremental FlashCopy the DS6000 must create additional metadata bitmaps However the impact is negligible in most cases Finally the placement of the FlashCopy source and target volumes has an effect...

Page 139: ...application performance and this has already been discussed in 10 1 1 Distribution of the workload Source and target volumes location on page 112 In addition to the relative placement of volumes the...

Page 140: ...y on all first updates to source tracks since the preceding FlashCopy Again this copy only occurs when that track is destaged so in many cases there is no impact to application performance The designe...

Page 141: ...e volumes If this is the case then the location of the target volumes is less critical and might be decided by considerations other than performance If you choose the COPY option that s probably becau...

Page 142: ...write to a track that would cause a collision and only when that write gets destaged The reads do not suffer the collision degradation If using the COPY option consider also these tips Examine the ap...

Page 143: ...tion processing The advantage is that FlashCopy writes to target volumes will not compete with applications writing to the target volumes This allows the background copy to complete faster and thus re...

Page 144: ...120 IBM System Storage DS6000 Series Copy Services with IBM System z...

Page 145: ...hts reserved 121 Chapter 11 FlashCopy examples This chapter presents examples of the use of FlashCopy in the following scenarios Fast setup of test systems or integration systems Fast creation of volu...

Page 146: ...ed in our example Example 11 1 Create a one time test system using TSO FlashCopy commands ESTABLISH FLASHCOPY RELATIONSHIP SDEVN SOURCE FLASHCOPY VOLUME TDEVN TARGET FLASHCOPY VOLUME STEP1 EXEC PGM IK...

Page 147: ...X 3400 Whenever the test environment needs to be reset to the original data just run Part 2 of the job 11 2 Create a backup Using FlashCopy for backup purposes can be implemented in several ways as di...

Page 148: ...s unnecessary writes can be avoided See Example 11 4 Example 11 4 Withdraw the FlashCopy relationship Part 2 WITHDRAW FLASHCOPY RELATIONSHIP SDEVN SOURCE FLASHCOPY VOLUME TDEVN TARGET FLASHCOPY VOLUME...

Page 149: ...et before reversing it back to the source To avoid a situation where the full volume needs to be copied with each FlashCopy the Incremental FlashCopy should be used As logs may need to be applied to t...

Page 150: ...Part 2 THIS JOB WILL REVERSE THE DIRECTION OF FLASHCOPY ORIGINAL SOURCE 3200 FRR SOURCE 3400 ORIGINAL TARGET 3400 FRR TARGET 3200 STEP1 EXEC PGM IKJEFT01 REGION 256K SYSTSPRT DD SYSOUT SYSUADS DD DSN...

Page 151: ...en used in a System z environment Here we discuss the characteristics of Metro Mirror and describe the options for its setup We also show which management interfaces can be used as well as the importa...

Page 152: ...128 IBM System Storage DS6000 Series Copy Services with IBM System z...

Page 153: ...Copyright IBM Corp 2006 All rights reserved 129 Chapter 12 Metro Mirror overview This chapter explains the basic characteristics of Metro Mirror for DS6000 when used in a System z environment 12...

Page 154: ...isk subsystems will determine the effect on application response time Figure 12 1 illustrates the sequence of a write update with Metro Mirror Figure 12 1 Metro Mirror When the application performs a...

Page 155: ...full duplex indicates that the primary volume is unknown or cannot be queried and the secondary state is full duplex Target suspended indicates that the primary volume is unknown or cannot be queried...

Page 156: ...nd management Metro Mirror is a hardware mirroring solution A volume or LUN is paired with a volume or LUN in the remote disk subsystem As the size of the environment grows so does the complexity of m...

Page 157: ...Chapter 13 Metro Mirror options and configuration This chapter discusses the options available when using Metro Mirror for DS6000 It also discusses the configuration guidelines that should be consider...

Page 158: ...r function combines into a single task the three steps involved in the switch over planned or unplanned to the remote site terminate the original Metro Mirror relationship then establish and suspend a...

Page 159: ...ote For a planned switch over from site A to site B and in order to keep data consis tency at B the application at site A has to be quiesced before the Metro Mirror Failover operation at B Alternative...

Page 160: ...volving a log volume and a data volume 1 Write to log volume Data Record 2 is being updated 2 Update Data Record 2 on data volume 3 Write to log volume Data Record 2 update complete If the copy of the...

Page 161: ...condition where it cannot update the Metro Mirror target volume This operation can be done across multiple LUNs or volumes multiple LSSs and even across multiple disk subsystems You can specify this...

Page 162: ...n has not been completed In this case the first second and third updates are not included in the Metro Mirror target volumes in LSS21 LSS22 and LSS23 Therefore the Metro Mirror target volumes at the r...

Page 163: ...he LSS level If each write operation is not dependent the I O sequence is not kept in the Metro Mirror target volumes that are in LSSs with the Consistency Group option specified In the example illust...

Page 164: ...pends the volume pairs for a given LSS pairing If used in combination with the CGROUP Y option of the CESTPATH command then an extended long busy for z OS or queue full for open systems condition will...

Page 165: ...llow subsequent write requests to the Metro Mirror primary volume The pair is suspended the secondary volume does not receive any more updates and the primary DS6000 will perform change recording thus...

Page 166: ...volumes in LSSs usually in different disk subsystems and these are normally in separate locations A path or group of paths needs to be defined between the primary source LSS and the secondary target...

Page 167: ...1 Fibre Channel links A DS6000 Fibre Channel port can simultaneously be Sender for Metro Mirror primary Receiver for a Metro Mirror secondary Target for Fibre Channel Protocol FCP hosts I O from open...

Page 168: ...DS6000 1 to LSS1 in DS6000 2 LSS2 in DS6000 1 to LSS2 in DS6000 2 LSS3 in DS6000 1 to LSS3 in DS6000 2 Alternatively if the volumes in each of the LSSs of DS6000 1 map to volumes in all three secondar...

Page 169: ...o avoid any response time issues establish the peak write rate for your systems and ensure you have adequate bandwidth to cope with this load and allow for growth Remember that only writes are mirrore...

Page 170: ...ution will aid in identifying where any problems may exist Figure 13 8 shows this idea in a graphical form Figure 13 8 Symmetrical Metro Mirror configuration As shown in Figure 13 8 DS6000 1 has Metro...

Page 171: ...one for mirrored volumes and another for non mirrored volumes You will be able to move data around your disk environment easily without worrying about whether the target volume is a mirrored volume or...

Page 172: ...disk subsystems of the same or similar type and features For example a DS6000 can have a Metro Mirror pair with another DS6000 a DS8000 an ESS 800 or an ESS 750 It cannot have a Metro Mirror pair with...

Page 173: ...ed 149 Chapter 14 Metro Mirror interfaces This chapter discusses and provides examples of the interfaces that can be used for Metro Mirror management setup and control when used with the IBM System St...

Page 174: ...e DS6000 Storage Management Console DS SMC TotalStorage Productivity Center for Replication TPC for Replication The TPC Replication Manager server connects to the same network where the DS SMC is DS O...

Page 175: ...Consistency Group CGROUP FREEZE PPRCOPY FREEZE freezepprc Not available Thaw Consistency Group CGROUP RUN PPRCOPY RUN unfreezepprc Not available Suspend pair CSUSPEND PPRCOPY SUSPEND pausepprc Copy se...

Page 176: ...for the host for error reporting reasons and also for functions like Metro Mirror Each LSS must have a different SSID The authors recommend assigning consecutive SSID numbers to each LSS in a DS6000...

Page 177: ...useful for working with the configuration CCA is discussed in Channel connection address on page 152 The MSGREQ YES parameter specifies that Metro Mirror wait until the initial full volume copy opera...

Page 178: ...to the specified secondary LSS are affected All other paths to other LSSs are not affected Before issuing a CDELPATH command a CDELPAIR command to all Metro Mirror volume pairs should be issued The CD...

Page 179: ...command for device number 6400 Example 14 6 CQUERY command CQUERY DEVN 6400 The output of the CQUERY command shown in Example 14 7 provides volume related information such as SSID CCA LSS number DS600...

Page 180: ...VL 3 478 VOLUME REPORT PPRC REMOTE COPY CQUERY VOLUME PRIMARY SECONDARY SSID LUN LSS SSID LUN LSS DEVICE LEVEL STATE PATH STATUS SERIAL SERIAL 6030 PRIMARY PENDING ACTIVE FF16 00 16 FF16 00 16 CRIT NO...

Page 181: ...4 2 10 Batch execution of Metro Mirror TSO commands Batch procedures can be used to automate the management of Metro Mirror JCL can be used to issue Metro Mirror commands in batch jobs and automation...

Page 182: ...l number of the volume regardless of the real address of the volume see Example 14 14 Example 14 14 Addressing online volumes DELPAIR1 JOB ACCT ICKDSF DELPAIR MSGCLASS X NOTIFY SYSUID MSGLEVEL 1 1 STE...

Page 183: ...s the table seen in Example 14 16 that shows that volume DS6030 with WWNN 500507630EFFFC6F can potentially connect to a device with WWNN 500507630EFFFCA0 from PRI SAID 0000 through secondary SAID 0000...

Page 184: ...SER DS6400 DISP SHR SYSIN DD PPRCOPY DELPATH DDNAME VOL1 PRI X 0002 AAVCA SEC X 0003 AAVCA WWNN 500507630EFFFCA0 500507630EFFFCA0 LSS X 00 X 01 Example 14 18 shows how to specify the PPRCOPY DELPATH c...

Page 185: ...n page 187 14 3 7 PPRCOPY FREEZE The PPRCOPY FREEZE command suspends operations for the Metro Mirror volumes on a given LSS pair It is issued to control operations for multiple Metro Mirror volume pai...

Page 186: ...CE INFORMATION FOR 6400 IS CURRENTLY AS FOLLOWS PHYSICAL DEVICE 3390 STORAGE CONTROLLER 1750 STORAGE CONTROL DESCRIPTOR E8 DEVICE DESCRIPTOR 0A ADDITIONAL DEVICE INFORMATION 4800243D TRKS CYL 15 PRIMA...

Page 187: ...IAL MISMATCH 07 SCU SSID MISMATCH ICKDSF MVS ESA DEVICE SUPPORT FACILITIES 17 0 TIME 17 48 02 08 ESCON LINK IS OFFLINE 09 ESTABLISH FAILED BUT WILL RETRY AGAIN WHEN CONDITIONS CHANGE 0A SYSTEM ADAPTER...

Page 188: ...blished with the PPRCOPY ESTPAIR command the MODE RESYNC option can be used to copy only the updated tracks to synchronize the volumes again An example is shown in Example 14 24 Example 14 24 PPRCOPY...

Page 189: ...d DS CLI commands in a Metro Mirror environment and provide examples of their usage For most of these commands you must know some or all of the following information The serial number and device type...

Page 190: ...cified dev the source DS6000 which includes manufacturer type and serial number remotedev the target DS6000 which includes manufacturer type and serial number remotewwnn the WWNN of the target device...

Page 191: ...uired to confirm that we want to delete this volume pair We can use the quiet parameter to suppress this confirmation request Example 14 29 rmpprc command dscli rmpprc dev IBM 1750 1300247 remotedev I...

Page 192: ...mmand dscli unfreezepprc dev IBM 1750 1300247 remotedev IBM 1750 1300819 06 01 Date Time 23 November 2005 23 47 38 IBM DSCLI Version 5 1 0 204 DS IBM 1750 1300247 CMUC00198I unfreezepprc Remote Mirror...

Page 193: ...irror 01 unknown Disabled Invalid 0101 0601 Suspended Host Source Metro Mirror 01 unknown Disabled Invalid Following command issued to SMC at production site dscli lspprc dev IBM 13 00247 0600 0601 Da...

Page 194: ...t updates are copied from the remote disk subsystem to the local disk subsystem in other words from the backup site to the production site then you must have the corresponding remote copy paths establ...

Page 195: ...2005 0 40 53 IBM DSCLI Version 5 1 0 204 DS IBM 1750 1300247 ID State Reason Type SourceLSS Timeout secs Critical Mode First Pass Status 0100 0600 Target Full Duplex Metro Mirror 01 unknown Disabled 0...

Page 196: ...at are done using the DS SM Our examples use a single DS GUI to manage two DS6000s each in a different Storage Complex This means that we have added the remote Storage Complex to the local Storage Com...

Page 197: ...elect the device to which you want to establish the path In this example we chose LSS 01 on a different DS6000 Then click Next Figure 14 3 Select target LSS panel Next you select the source I O ports...

Page 198: ...port for each source port In the example shown in Figure 14 5 there are no selections however for your setup you might see menus Click Next Figure 14 5 Select target I O ports Next the panel shown in...

Page 199: ...click Back or Cancel as appropriate Figure 14 7 Create paths verification panel 14 6 2 Create Metro Mirror pairs To establish a Metro Mirror pair from the GUI you can follow the process below Figure...

Page 200: ...ted The panel shown in Figure 14 9 opens Select either automated or manual volume pairing and click Next Figure 14 9 Select volume pairing method If you select Automatic volume pair assignment then th...

Page 201: ...we selected automatic volume pairing we are taken straight to the target LSS so that we can select the target volumes Figure 14 11 Select target volume auto pairing In our example we selected volumes...

Page 202: ...cation panel see Figure 14 13 opens so that you can check your selections If all is correct you can click Finish Figure 14 13 Metro Mirror pair verification panel The Metro Mirror panel indicating the...

Page 203: ...Figure 14 15 Figure 14 15 Metro Mirror resume select volume and action The panel shown in Figure 14 16 opens This is where you confirm that you want to resume the volume in question Figure 14 16 Conf...

Page 204: ...180 IBM System Storage DS6000 Series Copy Services with IBM System z...

Page 205: ...yright IBM Corp 2006 All rights reserved 181 Chapter 15 Metro Mirror performance and scalability In this chapter we discuss performance and scalability considerations when using Metro Mirror for DS600...

Page 206: ...ill during month end or year end processing You must make allowances for this peak period when you are calculating bandwidth 15 1 2 RMF Resource Management Facility RMF can collect and report Metro Mi...

Page 207: ...ctivities As previously mentioned the logical nature of the LSS has made a Metro Mirror implementation on the DS6000 easier to plan implement and manage However if you need to add more LSSs to your Me...

Page 208: ...184 IBM System Storage DS6000 Series Copy Services with IBM System z...

Page 209: ...nds to manage Metro Mirror The examples presented are Resynchronization of a suspended volume pair with TSO commands Metro Mirror Failover and Failback procedure using TSO commands Define a Metro Mirr...

Page 210: ...507630EFFFCA0 5 0 00 0000 SECONDARY 1 500507630EFFFCA0 ANTP0001I CQUERY COMMAND COMPLETED FOR DEVICE 6400 COMPLETION CODE 00 We see from the output that the device number 6400 is currently a primary v...

Page 211: ...VN specifying the ACTION FAILOVER and reversing the original PRIMARY and SECONDARY parameters This establishes the B volumes as suspended primaries activates change recording on the B volumes and rele...

Page 212: ...SCRIPTION 1 0000 0000 13 PATH ESTABLISHED 00 NO PATH 00 NO PATH 00 NO PATH SUBSYSTEM WWNN LIC LEVEL PRIMARY 500507630EFFFC6F 5 0 00 0000 SECONDARY 1 500507630EFFFCA0 ANTP0001I CQUERY COMMAND COMPLETED...

Page 213: ...0AAVCA 0000000AAGXA PATHS PFCA SFCA STATUS DESCRIPTION 1 0100 0100 13 PATH ESTABLISHED 00 NO PATH 00 NO PATH 00 NO PATH SUBSYSTEM WWNN LIC LEVEL PRIMARY 500507630EFFFCA0 5 0 00 0000 SECONDARY 1 500507...

Page 214: ...STPAIR with FAILBACK action step 3 9 For step 3 the command shown in Example 16 5 will reestablish the Metro Mirror pair and copy any changes to the original primary volume remember to keep the origin...

Page 215: ...O CGRPLB NO 0000000AAVCA 0000000AAGXA PATHS PFCA SFCA STATUS DESCRIPTION 1 0100 0100 13 PATH ESTABLISHED 00 NO PATH 00 NO PATH 00 NO PATH SUBSYSTEM WWNN LIC LEVEL PRIMARY 500507630EFFFCA0 5 0 00 0000...

Page 216: ...00507630EFFFCA0 SECONDARY 2 500507630EFFFC6F ANTP0001I CQUERY COMMAND COMPLETED FOR DEVICE 6430 COMPLETION CODE 00 ANTP8802I CQUERY DEVN 6030 ANTP0090I CQUERY FORMATTED LVL 3 272 VOLUME REPORT PPRC RE...

Page 217: ...Y SSID CCA LSS SSID CCA LSS DEVICE LEVEL STATE PATH STATUS SERIAL SERIAL 6030 PRIMARY SUSPEND 3 ACTIVE 2060 30 00 0002 30 00 CRIT NO CGRPLB NO 0000000AAGXA 0000000AAVCA PATHS PFCA SFCA STATUS DESCRIPT...

Page 218: ...TH ESTABLISHED 00 NO PATH 00 NO PATH 00 NO PATH SUBSYSTEM WWNN LIC LEVEL PRIMARY 500507630EFFFC6F 5 0 00 0000 SECONDARY 1 500507630EFFFCA0 ANTP0001I CQUERY COMMAND COMPLETED FOR DEVICE 6030 COMPLETION...

Page 219: ...ONDARY SSID LUN LSS SSID LUN LSS DEVICE LEVEL STATE PATH STATUS SERIAL SERIAL 6030 SIMPLEX INACTIVE FF16 00 16 0000000AAGXA PATHS SAID DEST STATUS DESCRIPTION 0 00 NO PATH 00 NO PATH 00 NO PATH 00 NO...

Page 220: ...0100 0100 13 PATH ESTABLISHED 00 NO PATH 00 NO PATH IF STATE PENDING SUSPEND TRACKS OUT OF SYNC 40523 TRACKS ON VOLUME 81920 PERCENT OF COPY COMPLETE 51 SUBSYSTEM WWNN LIC LEVEL PRIMARY 500507630EFFFC...

Page 221: ...ICK04000I DEVICE IS IN SIMPLEX STATE ICK02201I PPRCOPY ESTPATH FUNCTION COMPLETED SUCCESSFULLY ICK00001I FUNCTION COMPLETED HIGHEST CONDITION CODE WAS 0 Example 16 14 shows the output from the PPRCOPY...

Page 222: ...en issue an unfreezepprc command or equivalent in the other interfaces to remove the extended long busy Example 16 15 shows an example of the use of the DS CLI freezepprc and the unfreezepprc commands...

Page 223: ...is part of the book we describe IBM System Storage Global Copy for DS6000 After presenting an overview of Global Copy we discuss the options available the interfaces you can use and the configuration...

Page 224: ...200 IBM System Storage DS6000 Series Copy Services with IBM System z...

Page 225: ...rights reserved 201 Chapter 17 Global Copy overview In this chapter we describe the characteristics and operation of Global Copy Also discussed are the considerations for its implementation with the...

Page 226: ...write I O to the primary DS6000 The write is staged through cache and non volatile storage NVS 2 The write returns as completed to the host server s application 3 At a later time that is in a non sync...

Page 227: ...e synchronously mirrored to the secondary volume with Metro Mirror this is possible With Global Copy however even when no tracks are out of sync the pair remains in copy pending status Copy Pending Up...

Page 228: ...s requires short quiescings of the application s I O activity It can be used over continental distances with excellent application performance The distances only limited by the network and channel ext...

Page 229: ...ter 18 Global Copy options and configuration This chapter discusses the options available when using Global Copy It also discusses the configuration guidelines that should be considered when planning...

Page 230: ...y pairs after the data has been synchronized You can use this option with the Go to sync operation the Go to sync operation is discussed in 18 1 5 Convert a Global Copy pair to Metro Mirror on page 20...

Page 231: ...nchronous condition that is a full duplex Metro Mirror pair The pair goes from the pending state to the duplex state At the end of this transition primary and secondary volumes are fully synchronized...

Page 232: ...X 01 X 05 PRI X 2901 FCA29 X 00 SEC X 2805 FCA28 X 00 OPTION SYNC 18 2 3 Go to sync using the DS Storage Manager In the DS Storage Manager in the Metro Mirror panel you can display the Metro Mirror o...

Page 233: ...tracks with the DS CLI or with the DS Storage Manager With the DS CLI you can use the lspprc command see Example 18 4 Example 18 4 lspprc command dscli lspprc dev IBM 1750 13AAGXA remotedev IBM 1750 1...

Page 234: ...is the name of the transition that occurs to a Global Copy pair when it goes from its normal out of sync condition until it reaches a full sync condition At the end of this transition the primary and...

Page 235: ...application is done you must remember that while in an active Global Copy relationship the secondary volumes always have a current fuzzy copy of the primary volumes so you have to keep the tertiary vo...

Page 236: ...2901 FCA29 X 00 SEC X 2805 FCA28 X 00 In DS CLI a cascading relationship is established by specifying parameter cascade for the mkpprc command as shown in Example 18 7 Example 18 7 Cascading with CLI...

Page 237: ...function feature number purchased for a 1750 machine enables that function for the entire 1750 system Authorization refers to the purchase of a feature number to establish the extent of IBM authoriza...

Page 238: ...e licensed internal code level LIC Refer to the DS6000 Interoperability Matrix for more information http www 1 ibm com servers storage disk ds6000 interop html 18 6 DS6800 I O ports The DS6800 can hav...

Page 239: ...irections each LSS holds both source and target volumes from the other LSS Moreover opposite direction paths are allowed to be defined on the same Fibre Channel physical link For bandwidth and redunda...

Page 240: ...eir products in a DS6000 Global Copy configuration Evaluation qualification approval and support of Global Copy configurations using channel extender products is the sole responsibility of the channel...

Page 241: ...system you should have an available set of volumes ready to become the FlashCopy target If your next step is to move the tertiary volumes onto tapes then you must ensure that the tape resources are ca...

Page 242: ...218 IBM System Storage DS6000 Series Copy Services with IBM System z...

Page 243: ...pyright IBM Corp 2006 All rights reserved 219 Chapter 19 Global Copy performance and scalability In this chapter we discuss performance and scalability considerations when using Global Copy for DS6000...

Page 244: ...ility The DS6000 Global Copy environment can be scaled up or down as required If new volumes are added to the DS6000 that require mirroring they can be dynamically added If additional Global Copy path...

Page 245: ...gives examples of the interfaces that can be used for Global Copy management when Global Copy is used with the IBM System Storage DS6000 in System z environments The information discussed in this chap...

Page 246: ...ng in a Web browser that communicates with the DS6000 Storage Management Console DS SMC DS Open Application Programming Interface DS Open API In this chapter we provide an overview of the z OS interfa...

Page 247: ...mands Failback CESTPAIR AC TION FAILBACK PPRCOPY EST PAIR FAILBACK failbackpprc Copy Services Global Copy Recover Failback Failover CESTPAIR AC TION FAILOVER PPRCOPY EST PAIR FAILOVER failoverpprc Cop...

Page 248: ...rom the suspended state That is whether this is an initial copy of a newly established pair or if it is a re synchronization of a suspended pair To indicate this use the MODE parameter to specify eith...

Page 249: ...command CDELPAIR DEVN X 6030 PRIM X 2060 AAGXA X 30 X 00 SEC X 0002 AAVCA X 30 X 00 Before issuing a CDELPAIR command verify that there are some active paths between the respective primary and second...

Page 250: ...o minutes or until a CGROUP command is issued with the RUN option During the extended long busy window update activity cannot proceed in the LSS where the freeze was done CGROUP RUN Resumes host appli...

Page 251: ...sync tracks Example 20 7 CQUERY command ANTP8802I CQUERY DEVN X 6030 ANTP0090I CQUERY FORMATTED LVL 3 161 VOLUME REPORT PPRC REMOTE COPY CQUERY VOLUME PRIMARY SECONDARY SSID CCA LSS SSID CCA LSS DEVIC...

Page 252: ...PEND DEVN X 6030 PRIM X 2060 AAGXA X 30 X 00 SEC X 0002 AAVCA X 30 X 00 20 2 10 Batch execution of Global Copy TSO commands Batch procedures can be automated to manage some Global Copy activities JCL...

Page 253: ...ed information refer to IBM System Storage DS6000 Command Line Interface User s Guide GC26 7922 DS CLI supported environments The DS CLI is supported on the operating systems listed below at the time...

Page 254: ...NA NA I0100 I0000 FCP NA NA I0100 I0100 FCP NA NA lspprcpath The lspprcpath command shows you the defined paths from an LSS Example 20 12 lists the paths from LSS 16 Example 20 12 lspprcpath command d...

Page 255: ...ailbackpprc command dscli failbackpprc dev IBM 1750 13AAVCA remotedev IBM 1750 13AAGXA 1600 1600 Date Time June 14 2005 1 40 22 PM CDT IBM DSCLI Version 5 0 3 110 DS IBM 1750 13AAVCA CMUC00197I failov...

Page 256: ...set with the unfreezepprc command During the long busy condition the primary volume reports long busy status Example 20 19 freezepprc command dscli freezepprc dev IBM 1750 13AAGXA remotedev IBM 1750 1...

Page 257: ...te as set by the freezepprc command Example 20 23 unfreezepprc command dscli unfreezepprc dev IBM 1750 13AAGXA remotedev IBM 1750 13AAVCA 16 16 Date Time June 14 2005 5 46 37 AM CDT IBM DSCLI Version...

Page 258: ...menu will give you the following additional possible actions Delete to delete the paths you have selected before LSS copy options to modify the copy options for an LSS see Figure 20 2 Figure 20 2 LSS...

Page 259: ...volume pair Delete Use this action to delete a Global Copy pair Suspend Use this action to suspend a Global Copy pair Convert to synchronous Use this action to convert a Global Copy pair into a synchr...

Page 260: ...236 IBM System Storage DS6000 Series Copy Services with IBM System z...

Page 261: ...r includes sample Global Copy scenarios and examples of the corresponding management activities using TSO and the DS CLI The examples presented are How to establish and manage Global Copy volume pairs...

Page 262: ...SO we had to specify the WWNN from the storage subsystems We used the CQUERY PATHS command to determine the SSID and WWNN of the primary and secondary LSSs The WWNN can also be found by using the DS G...

Page 263: ...mmand shows that the volume is in pending state and also shows the number of tracks out of sync When the write activity on the primary volume is stopped all data is eventually copied over to the secon...

Page 264: ...MOTE COPY CQUERY VOLUME PRIMARY SECONDARY SSID CCA LSS SSID CCA LSS DEVICE LEVEL STATE PATH STATUS SERIAL SERIAL 6030 PRIMARY SUSPEND 3 ACTIVE 2060 30 00 0002 30 00 CRIT NO CGRPLB NO 0000000AAGXA 0000...

Page 265: ...s to be enabled on the ESS 800 otherwise the DS CLI cannot be used to establish CKD volume pairs If the control switch is disabled the following message is issued CMUN03013E mkpprc CKD management is d...

Page 266: ...ate SS Port Attached Port Tgt WWNN 05 08 Success 8000 I0088 I0002 5005076303FFC08F 05 06 Success 6000 I000C I0103 500507630EFFFE16 05 02 Success E200 I00AC I0003 500507630EFFFE16 05 02 Success E200 I0...

Page 267: ...0 204 DS IBM 2105 22399 CMUC00153I mkpprc Remote Mirror and Copy volume pair relationship 050B 023B successfully created C IBM DSCLI dscli cfg ess 22399 prf lspprc dev ibm 2105 22399 050a 050b Date Ti...

Page 268: ...with CKD volumes the procedure applies equally well to open systems volumes because the same DS CLI commands are used for open systems 21 2 2 Cascading alternative The preceding example assumes that...

Page 269: ...bal Mirror works in a similar manner to a distributed application in a server and client relationship Finally in this chapter you will find a step by step process to establish a Global Mirror environm...

Page 270: ...al disk subsystem But when the application volumes are spread across multiple storage disk subsystems this time stamp concept alone is not sufficient to replicate data and provide data consistency at...

Page 271: ...dary site without doing some previous data recovery Consider a database environment that spreads across multiple storage disk subsystems at the local primary site Further assume that the remote copy v...

Page 272: ...mpletely The database subsystem is restarted at the secondary site after switching over to the secondary site 5 At startup the database subsystem discovers in its configuration file that the database...

Page 273: ...database configuration file on A3 Note volume A3 is no longer replicated due to the previous freeze Note also that volume A2 and B2 are still identical and at the very same level of data currency that...

Page 274: ...lable 22 1 2 Asynchronous data replication and dependent writes In normal operations for asynchronous data replication data consistency for dependent writes will be preserved depending on the techniqu...

Page 275: ...e 22 5 Global Copy sequence of data arrival not preserved at secondary site Global Copy by itself as a non synchronous data replication method does not provide data consistency at the secondary site I...

Page 276: ...ndary B volumes become synchronized Note the challenge to manage all volumes 3 Using FlashCopy create a point in time PiT copy of the B volumes at the remote site 4 The FlashCopy targets that is the C...

Page 277: ...maintained at the remote site Data currency at remote site lags a little behind the local site The remote site is always less current than the local site In peak write workloads this difference is goi...

Page 278: ...progresses to the next function task At the same time the server tries to do as much as possible in parallel to minimize the hit on throughput due to serialization and checkpoints When certain activit...

Page 279: ...t is the microcode that provides from the user perspective a transparent and autonomic mechanism to intelligently utilize Global Copy in conjunction with certain FlashCopy operations to attain consist...

Page 280: ...hip between the local or primary volume and the remote or secondary volume see Figure 22 11 This step changes the secondary volume state from simplex to copy pending This copy pending state applies to...

Page 281: ...xist at the remote site 22 3 4 Introduce FlashCopy FlashCopy is an integral part of the Global Mirror solution and now it follows as the next step in the course of establishing a Global Mirror session...

Page 282: ...he point in time copy Note that each Global Copy write to its secondary volume within the window of two adjacent Consistency Groups may cause FlashCopy I O operations Some interfaces to trigger this p...

Page 283: ...ing status Once a Consistency Group is formed the Global Copy primary volume will then be added to the session and will be placed in an in session status Nothing happens to the C volume after its init...

Page 284: ...urnal or a tertiary copy of the secondary volume With Global Mirror this third copy is naturally created through the use of FlashCopy The microcode automatically triggers a sequence of autonomic event...

Page 285: ...y and are consistent due to the serialization process in step 1 and the completed replication or drain process in step 2 Step 3 is now a FlashCopy that is triggered by the primary system s microcode a...

Page 286: ...s over more than one primary disk subsystem Global Mirror not only serializes all related Global Mirror primary volumes but also does the coordination with other storage disk subsystems Figure 22 17 C...

Page 287: ...ero seconds means that Consistency Group formation happens constantly As soon as a Consistency Group is successfully created the process to create a new Consistency Group starts again immediately Ther...

Page 288: ...264 IBM System Storage DS6000 Series Copy Services with IBM System z...

Page 289: ...when used in a System z environment We discuss the characteristics of Global Mirror and describe the options for its setup We also show which management interfaces can be used as well as the important...

Page 290: ...266 IBM System Storage DS6000 Series Copy Services with IBM System z...

Page 291: ...ue to a primary site failure The information discussed in this chapter can be complemented with the following IBM publications z OS DFSMS Advanced Copy Services SC35 0428 IBM System Storage DS6000 Com...

Page 292: ...ncy across all secondary volumes spread across multiple storage disk subsystems is essential for logical data integrity Data currency This term describes the difference of time since the last data was...

Page 293: ...e Master and the Subordinate and is required to create Consistency Groups of volumes that spread over more than one storage disk subsystem If all the volumes of a Global Mirror session reside in one p...

Page 294: ...ween the Master and the Subordinates within a single primary storage disk subsystem is transparent and internally performed 2 Once the communication paths are defined start the Global Copy pairs that...

Page 295: ...bal Mirror session or you may change the interval between the formation of Consistency Groups 23 3 1 Add or remove volumes to a Global Mirror session Volumes can be added to the session at any time af...

Page 296: ...new LSS to an active session and this LSS belongs to a storage disk subsystem that already has another LSS that belongs to this Global Mirror session you may add the new LSS to the session without st...

Page 297: ...d is required for the following Global Mirror operations Start a Global Mirror session Stop a Global Mirror session Pause a Global Mirror session Resume a Global Mirror session In Example 23 1 the top...

Page 298: ...volumes from Global Mirror session RVOLUME SNBR 01 VOLSER XX2C00 ACTION REMOVE LSSTYPE CKD LSSNBR 0C ESSSERIAL 27131 VOLLIST 00 RVOLUME SNBR 01 VOLSER XX2D00 ACTION REMOVE LSSTYPE CKD LSSNBR 0D ESSSER...

Page 299: ...of Global Mirror we recommend the following sequence of steps 1 Terminate the Global Mirror session 2 Remove all Global Copy primary volumes from the Global Mirror session 3 Close the Global Mirror s...

Page 300: ...irror paths This communication is highly optimized and minimizes any potential application write I O impact during the coordination phase to about a few milliseconds For details see 22 4 Consistency G...

Page 301: ...arate FCP ports Figure 23 4 Global Mirror paths over FCP links between primary storage disk subsystems The sample configuration in Figure 23 5 shows a mix of dedicated and shared FCP ports Primary Pri...

Page 302: ...23 6 Again from a performance and throughput viewpoint you would not need two Global Mirror links between the Master and its Subordinate storage disk subsystems Still dedicated ports for Global Mirro...

Page 303: ...with hosts connected to their local disk subsystems only In this example there is no connection between the hosts of one site and the storage disk subsystems of the other site This example shows a typ...

Page 304: ...may execute all commands that address the primary volumes The remote host may execute all the commands targeted to the secondary or tertiary volumes From a management viewpoint this may not be the pre...

Page 305: ...ror management of the remote storage disk subsystems can be done through inband commands from the local site This is limited to FlashCopy operations only Besides the TSO and ICKDSF inband FlashCopy co...

Page 306: ...ows a simple configuration with Global Mirror active and running Figure 23 9 Normal Global Mirror operation Host writes are replicated through Global Copy Consistency Groups are created as tertiary co...

Page 307: ...ecovery actions If the formation of a Consistency Group was in progress then most probably not all FlashCopy relationships between the B and C volumes at the remote site will have reached the correspo...

Page 308: ...ry suspended The A volumes state remains unchanged Example 23 4 shows the establish command that we give at the secondary site The key with this command is the FAILOVER option It is this option that i...

Page 309: ...eds a FlashCopy query to identify its state Example 23 5 shows FlashCopy query commands of four FlashCopy source volumes B volumes Example 23 5 FlashCopy query of four FlashCopy relationships TIME 09...

Page 310: ...occurs there are some combinations of revertible states and FlashCopy sequence numbers that need different corrective actions Use Table 23 1 as a guide This is a decision table that is read in the fo...

Page 311: ...cy group were started but not all of them The FlashCopy relationships that have not started are in a non revertible state and all of them have the same FlashCopy sequence number Other FlashCopy relati...

Page 312: ...EVN X 6500 ACTION REVERT The command in Example 23 6 restores the Consistency Group to the prior state and resets the revertible state to NO After this command the FlashCopy relationship is not remove...

Page 313: ...achieved with the FlashCopy parameter ACTION FRR in the FlashCopy establish command FRR stands for fast reverse restore The DS CLI also provides this option with the reverseflash command with the para...

Page 314: ...ONT NOTE FRR DOES NOT ALLOW REMOTE YES FCFRR EXEC PGM IKJEFT01 SYSPRINT DD SYSOUT SYSTSPRT DD SYSOUT SYSTSIN DD DDNAME SYSIN FCESTABL SDEVN X 3E00 TDEVN X 3C00 ACTION FRR Note that the FlashCopy sourc...

Page 315: ...hCopy source and a new D volume as FlashCopy target Example 23 11 Create another set of consistent data volumes TSO CREATE 5 FLASHCOPY B D TO CREATE COPY TO WORK TEST WITH FCESTBL EXEC PGM IKJEFT01 SY...

Page 316: ...in preparation for returning to local site The local site is back and operative again We assume that the local site did not lose the data at the time when the swap to the remote site was done It is t...

Page 317: ...PRT DD SYSOUT SYSTSIN DD DDNAME SYSIN CESTPAIR DEVN X 3C00 PRIM X 3C00 73081 X 00 X 0C SEC X 2C00 27131 X 00 X 0C ACTION FAILBACK ONLINSEC NO MSGREQ NO CRIT NO OPTION XD CASCADE NO A remark on the ONL...

Page 318: ...n at the local site This will change the state of the B volumes from primary pending to secondary pending and start to replicate updates from A to B In our example the application did not start yet at...

Page 319: ...Global Copy primary LSS 0C CAA 00 is Global Copy secondary and FlashCopy source LSS 0D CAA 00 is FlashCopy target FCESTBL EXEC PGM IKJEFT01 SYSPRINT DD SYSOUT SYSTSPRT DD SYSOUT SYSTSIN DD DDNAME SYS...

Page 320: ...check all the FlashCopy relationships after a primary site failure Note that for a planned site swap you may not have to check for a valid Consistency Group because through a proper command sequence a...

Page 321: ...ly we also discuss the DS Storage Manager Web based graphical user interface GUI which may also be used for Global Mirror management The information discussed here can be complemented with the followi...

Page 322: ...functions similar to Global Mirror Utility GMU GMU users should consider migrating to TPC for Replication 24 2 Different interfaces for the same function In this section we show how the same results...

Page 323: ...over the paths to the remote site Note that this example assumes that the Global Copy paths and pairs have already been established Example 24 2 inband TSO command to create a FlashCopy between B and...

Page 324: ...ers who want to work through the SMC This information is usually hidden in an encrypted password file Example 24 5 shows the creation of a FlashCopy relationship The source volume and target volume ar...

Page 325: ...1 DD UNIT 3390 VOL SER AA6000 DISP SHR SYSPRINT DD SYSOUT SYSIN DD FC DDNAME DD01 ESTABLISH SRCVOL X 00 X 00 X 0002 AAVCA TGTVOL X 00 X 00 6500 CHRCD YES CHANGE RECORDING NOTGTWR YES INHIBIT TARGET WR...

Page 326: ...oice when you have to set up a big and complex Global Mirror environment ANTRQST Macro We do not cover the ANTRQST macro here This macro is used by software automation routines to provide full functio...

Page 327: ...AN infrastructure In the latter case the FCP ports can be shared with either other remote copy connections or with host connections Still you may consider dedicated ports thus separating host I O from...

Page 328: ...subsystems If for a Global Mirror session you intend to use Global Copy primary volumes from LSSs from multiple primary storage disk subsystems one thing you need to do is to define the corresponding...

Page 329: ...r relationship Example 24 10 Define Global Copy pair relationship using TSO command TSO CREATE 2 ESTABLISH GLOBAL COPY PAIR S EPAIR EXEC PGM IKJEFT01 SYSPRINT DD SYSOUT SYSTSPRT DD SYSOUT SYSTSIN DD D...

Page 330: ...MPLETED FOR DEVICE 2C00 COMPLETION CODE 00 Example 24 12 provides the same information as Example 24 11 but in a space saving unformatted format Example 24 12 Unformatted query output CQUERY DEVN X 2C...

Page 331: ...l Copy pairs complete their initial replication phase you must create the FlashCopy relationships between the B and C volumes see Figure 24 5 Figure 24 5 Establish Global Mirror FlashCopy relationship...

Page 332: ...it is recommended to use some kind of utility device within each LSS for addressing purposes This utility device needs to be online to the z OS system where you execute the Global Mirror commands You...

Page 333: ...These are all the primary A volumes that are going to participate in the Global Mirror session at the local site see Example 24 16 Example 24 16 Add Global Copy primary volumes to Global Mirror sessi...

Page 334: ...the LSS number that receives this command This also defines the Master LSS which is LSS number x 0C You may override the default values of the Global Mirror session parameters In our example we keep...

Page 335: ...tifies whether this is an LSS with fixed blocked FB devices for open systems or count key data CKD devices for System z CKD is the default DVCNBR indicates the LUN for which the query report is reques...

Page 336: ...SO RQUERY commands with ACTION DVCSTAT One command is addressed to LSS 0C and the other to LSS 0D They both show for the corresponding LSS individual information for the Global Copy primary volumes th...

Page 337: ...S 800 LIC level 2 3 0 the newer LIC level is required for the ESS 800 to support the new DS CLI commands Refer to Chapter 26 Global Mirror examples on page 341 for examples of how to use DS CLI for Gl...

Page 338: ...imary storage disk subsystem at the local site you need to define paths between them for the Global Mirror session communication between the Master and the Subordinates Also you have to define the pat...

Page 339: ...CKDSF SYSPRINT DD SYSOUT DD01 DD UNIT 3390 VOL SER RS7000 DISP SHR SYSIN DD PPRCOPY DDNAME DD01 ESTPATH PRI X 7000 22399 SEC X 7800 25941 LSS X 00 X 00 FCPPATHS X 000C000C X 008C008C WWNN 5005076300C0...

Page 340: ...PPRCOPY DDNAME DD01 QUERY Note again the requirement for a JCL DD statement for the involved Global Copy primary volume This may become a bit cumbersome when you intend to establish hundreds or even t...

Page 341: ...provides addressing information for the FlashCopy source and target volumes at the remote site Example 24 25 shows an inband ICKDSF job example under the assumption that usually there is no host conn...

Page 342: ...The job shown in Example 24 25 on page 317 refers to the A volume which is the Global Copy primary volume via the UNIT parameter This requires the device on address 7000 to be offline When the device...

Page 343: ...000 DISP SHR SYSIN DD PPRC DDNAME DD01 DEFINESESSION OPEN SESSIONNO 001 Example 24 27 points again to an online volume by the DDNAME parameter A session is created involving the corresponding LSS it i...

Page 344: ...will become part of the Global Mirror session by either a list of CCA addresses the IVOLLIST parameter or a range of CCA addresses in the RVOLLIST parameter Let us look at more details of the VOLCOUNT...

Page 345: ...Figure 24 13 Figure 24 13 ICKDSF start Global Mirror session With the very first Global Mirror start command you decide which LSS becomes the Master LSS All further Global Mirror session commands hav...

Page 346: ...ry volumes simplex SX This means the volumes have been added to the session with the POPULATESESSION command although these volumes are not Global Copy primary volumes This is indicated by the SX code...

Page 347: ...IM INFORMATION UNAVAILABLE DUE TO FAILOVER OR IML N A NOT AVAILABLE PERHAPS DUE TO FAILOVER OR IML OR NOT APPLICABLE ERROR REASON 01 ASYNCHRONOUS PPRC STRUCTURES CANNNOT BE ACCESSED 02 ASYNCHRONOUS P...

Page 348: ...y step approach how to remove a Global Mirror environment using ICKDSF The sequence of steps followed in our example is the recommended one although it is not a mandatory one Still it guarantees a cle...

Page 349: ...F REMOVE EXEC PGM ICKDSF SYSPRINT DD SYSOUT DD01 DD UNIT 3390 VOL SER AA6000 DISP SHR SYSIN DD PPRCOPY DDNAME DD01 POPSESS REMOVE SESSNO 001 VOLCOUNT 1 RANGE YES RVOLLIST X 00 X 03 Example 24 34 is an...

Page 350: ...3390 VOL SER AA6000 DISP SHR DD02 DD UNIT 3390 VOL SER AA6001 DISP SHR DD03 DD UNIT 3390 VOL SER AA6002 DISP SHR DD04 DD UNIT 3390 VOL SER AA6003 DISP SHR SYSIN DD FC DDNAME DD01 WD WITHDRAW SRCVOL X...

Page 351: ...AAVCA X 02 PPRCOPY DDNAME DD04 DELPAIR LSS X 00 X 00 PRI X 2060 AAGXA X 03 SEC X 0002 AAVCA X 03 Note that ICKDSF explicitly refers to the source and target LSS The PRI and SEC parameters identify th...

Page 352: ...tains an Assembler sample program that starts a Global Mirror session 24 7 DS Storage Manager GUI Global Mirror can be managed through the DS Storage Manager provided Web based graphical user interfac...

Page 353: ...the View session volumes from the pull down list as shown in Figure 24 17 Figure 24 17 View Global Mirror volumes in session1 select action The next panel shown in Figure 24 18 provides the requested...

Page 354: ...numbers are 2000 The syntax of the nicknames is a bit limited and does for example not allow you to use numerics in the prefix part of the nickname when defined through the GUI 24 7 2 Pause and resum...

Page 355: ...shown in Figure 24 20 Figure 24 20 Pause selected session number 1 confirmation panel Click OK and you receive the next panel see Figure 24 21 Figure 24 21 Session is paused Figure 24 21 shows the res...

Page 356: ...tion parameter Resume from the Select Action pull down list see Figure 24 22 Figure 24 22 Resume paused session number 1 through the GUI You receive another confirmation panel asking whether to contin...

Page 357: ...then receive the next panel see Figure 24 24 Figure 24 24 Resume paused session number 1 through the GUI session is running The session is back and running There is a more extensive exercise based on...

Page 358: ...334 IBM System Storage DS6000 Series Copy Services with IBM System z...

Page 359: ...considerations for planning and configuring Global Mirror for DS6000 It also explains the potential impact that the three phases of Consistency Group formation might have on application write I Os Fin...

Page 360: ...ck which belongs to the point in time copy Be aware that each Global Copy write to a secondary volume in the window of two adjacent Consistency Groups causes such a FlashCopy I O operation For an appl...

Page 361: ...mind is whether the coordination window imposes an impact to the application write I O see Figure 25 2 Figure 25 2 Coordination time how it impacts application write I Os The coordination time which...

Page 362: ...is sent to the secondary storage disk subsystem with Global Copy This drain period can also be limited to replicate all remaining data from the primary to the secondary storage disk subsystem in a ti...

Page 363: ...nly over the fast disks but also over all ranks Basically follow a similar approach to that in Figure 25 3 You can keep particular busy B volumes and C volumes on the faster disks Figure 25 4 on page...

Page 364: ...volumes to an existing Global Mirror session in stages If possible and as a rough rule of thumb add only a few volumes in a rank during application peak I O periods After the first initial copy is com...

Page 365: ...ions Establish a Global Mirror environment paths pairs session Deal with a primary site failure and the subsequent recovery at the backup site Also the management of a planned outage is discussed Remo...

Page 366: ...ctive SSIDs in the remote disk subsystem 73081 so are the FlashCopy target volumes When a Global Mirror configuration is in normal operation the Global Copy secondary volume is at the same time the Fl...

Page 367: ...342 Through the VOLSER parameter the next RQUERY points to the another LSS that is also involved in this Global Mirror session see Example 26 2 Example 26 2 RQUERY with DVCSTAT of the second LSS with...

Page 368: ...Action GMLSTAT Version 001 SNbr GMLStat GoodCg Pct CrnBadCG TotBadCG LastGoodCGSCntlClock 01 Running 0000D0C1 99 00000005 19 May 2005 19 08 00 Master Serial SSID LSS CGInt CGDrn CrdInt 000107527131 2C...

Page 369: ...rTimeExcd DrnInPrg Prev 0002013AAGXA FF DrTimeExcd DrnInPrg First 0002013AAGXA 2060 00 CmdRej FC4 RunInPrg READY Note that you cannot rely on the internal disk subsystem clock time information as an a...

Page 370: ...duplex or suspended Volumes that have not completed their initial copy phase stay in a join pending state until the first pass is complete If a newly added volume to a session is a primary suspended...

Page 371: ...subsequent CQUERY reveals that there is a problem with one of the paths see Example 26 8 Example 26 8 Verify successful path creation PPRC REMOTE COPY CQUERY PATHS PRIMARY UNIT SERIAL 000000027131 SS...

Page 372: ...by accident With a value of NO when the potential Global Copy secondary volume is online to any system the establish pair command will fail When you specify YES the establish will happen independently...

Page 373: ...al Copy volume pairs and their status with ICKDSF based query commands 26 3 3 Establish FlashCopy relationships Once the first pass is completed for Global Copy establish the FlashCopy relationships b...

Page 374: ...PLETED FOR DEVICE 3C00 COMPLETION CODE 00 READY FCESTABL SDEVN X 3C00 TDEVN X 3E00 MODE ASYNC ONLINTGT YES FCESTABL COMMAND COMPLETED FOR DEVICE 3C00 COMPLETION CODE 00 READY FCQUERY DEVN X 3C00 FCQUE...

Page 375: ...l Mirror session with Global Copy primary volumes TSO CREATE 5 POPULATE SESSION X 01 WITH PRIMARY VOLUMES VOLUME LIST CONTAINS CCA NUMBERS JOIN EXEC PGM IKJEFT01 SYSPRINT DD SYSOUT SYSTSPRT DD SYSOUT...

Page 376: ...15 Start Global Mirror session TSO CREATE 6 START SESSION X 01 THROUGH LSS X 0C THEN LSS X 0C BECOMES THE MASTER LSS DS NOTE LSS SYNTAX IS WITHOUT X AND QUOTES CGINTERVAL BUILD CG WITHOUT A BREAK CGDR...

Page 377: ...e may be simulated through a V OFFLINE FORCE to the Global Copy primary volumes This will also fail the application I Os to the volumes If you use this testing procedure do not forget to reply to the...

Page 378: ...X 2C00 27131 X 0C SEC X 3C00 73081 X 0C RUN CGROUP DEVN X 2D00 PRIM X 2D00 27131 X 0D SEC X 3D00 73081 X 0D RUN CGROUP FREEZE immediately removes the paths between the primary and secondary LSSs An im...

Page 379: ...DEVN X 3D01 PRIM X 3D00 73081 X 01 X 0D SEC X 2D00 27131 X 01 X 0D ACTION FAILOVER ONLINSEC NO MSGREQ NO CRIT NO OPTION XD CASCADE NO The FAILOVER parameter value does not need to communicate to the p...

Page 380: ...ION FRR FCESTABL SDEVN X 3F00 TDEVN X 3D00 ACTION FRR FCESTABL SDEVN X 3F01 TDEVN X 3D01 ACTION FRR The FCESTABL command with the ACTION FRR parameter value does a background copy operation that copie...

Page 381: ...START CHANGE RECORDING NOCOPY ETC THROUGH MODE ASYNC OPTION GET READY FOR GM FCESTBL EXEC PGM IKJEFT01 SYSPRINT DD SYSOUT SYSTSPRT DD SYSOUT SYSTSIN DD DDNAME SYSIN FCESTABL SDEVN X 3C00 TDEVN X 3E00...

Page 382: ...ck operation from B to A to prepare return to the local site Example 26 22 illustrates how the failback is done using TSO commands The failback operation addresses the B volumes at the secondary site...

Page 383: ...there is no data to replicate Example 26 23 shows the failover failback sequence that is performed on the A volumes Example 26 23 Failover and Failback operations to the A volumes TSO FAILOVER ESTABL...

Page 384: ...e everything as it was you need to restart Global Mirror to resume the Consistency Group formation process 26 5 Remove Global Mirror environment using TSO To remove a Global Mirror environment follow...

Page 385: ...primary volumes from the session Example 26 26 shows how to do this The RQUERY commands are used to verify the status of the devices after their removal from the session Example 26 26 Remove volumes f...

Page 386: ...to do this Example 26 28 Delete the Global Mirror session from all involved LSSs TSO CLEANUP 3 UNdefine GM session number X 01 through both involved LSS s UNDEFINE EXEC PGM IKJEFT01 SYSPRINT DD SYSOU...

Page 387: ...VN SSID LSS CCA CU SERIAL ACT MAX XC PC CC RV SEQNUM 3C00 3C00 0C 00 2107 000000073081 1 50099 N S N N 429334DE FCQUERY COMMAND COMPLETED FOR DEVICE 3C00 COMPLETION CODE 00 READY FCWITHDR SDEVN X 3C00...

Page 388: ...01 X 0D SEC X 3D00 73081 X 01 X 0D CQUERY DEVN X 2C00 CQUERY DEVN X 2D00 CQUERY DEVN X 2D01 You may check the status of the Global Copy primary volumes before and after the CDELPAIR command sequence...

Page 389: ...UERY commands at once it is going to flood your SYSLOG And this is going to quickly exhaust the WTO buffers which will lead to the corresponding buffer shortage messages There is also an unformatted o...

Page 390: ...set up in 26 3 Set up the Global Mirror environment using TSO on page 345 26 6 Planned outage management using ICKDSF This section briefly presents an example of a Global Mirror planned outage that i...

Page 391: ...ure 26 7 ICKDSF command sequence for Global Mirror planned outage Note that in most command examples ICKDSF refers to a corresponding JCL DD statement through the DDNAME parameter This DD statement po...

Page 392: ...26 36 End Global Mirror session using ICKDSF TERMSESS EXEC PGM ICKDSF SYSPRINT DD SYSOUT DD01 DD UNIT 3390 VOL SER AA6000 DISP SHR SYSIN DD PPRCOPY DDNAME DD01 TMASYNC SESSNO 001 TERMINATE MASTER We u...

Page 393: ...ected to the FlashCopy source volumes which are identified by the SRCVOL parameters The FlashCopy target volumes are identified by the TGTVOL parameters Example 26 38 ICKDSF withdraw via an inband Fla...

Page 394: ...y the DDNAME parameter Example 26 39 Delete or remove a session from concerned LSS CLOSESS EXEC PGM ICKDSF SYSPRINT DD SYSOUT DD01 DD UNIT 3390 VOL SER AA6000 DISP SHR SYSIN DD PPRCOPY DDNAME DD01 DEF...

Page 395: ...mple that when the volumes are online ERP issues the state change message IEA494I Example 26 41 Delete Global Copy pairs with ICKDSF SYSLOG output HASP100 WBDELPR ON INTRDR ICKDSF PPRC FROM TSU01210 W...

Page 396: ...PATH PRI X 2060 AAGXA SEC X 0002 AAVCA LSS X 00 X 00 WWNN 500507630EFFFC6F 500507630EFFFCA0 PPRCOPY DDNAME DD01 QUERY PATHS The path commands delete path and establish path require the WWNN of both st...

Page 397: ...site 2 b Within site 1 between the Master storage image LSS or for short Master and the Subordinate storage image LSSs This task is not required if you have only one source storage image In this case...

Page 398: ...wizard first you need to go to the Paths panel under the Copy Services menu of the DS Storage Manager GUI In the Select Action pull down list choose Create to proceed with the first step of the wizard...

Page 399: ...eation step 2 select the target LSS Then the creation wizard displays the Select source I O ports panel see Figure 26 11 Here you select with the check boxes the I O ports through which you intend to...

Page 400: ...Next to proceed with the next step of this wizard Then the creation wizard displays the Select path options panel see Figure 26 13 Here you have a box that can be checked for the option Define as Con...

Page 401: ...r staged process with corresponding panels This procedure is demonstrated in this section To launch this wizard you need first to go to the Metro Mirror panel under the Copy Services menu of DS Storag...

Page 402: ...Figure 26 16 Here you select Manual volume pair assignment Figure 26 16 Global Copy creation step 1 choose volume pairing method Click Next to proceed with the second step of this wizard Then the cre...

Page 403: ...rror session Click Next to proceed with the third step of this wizard Then the creation wizard displays the Select target volumes panel see Figure 26 18 Figure 26 18 Global Copy creation step 3 select...

Page 404: ...x then the Storage unit then the Storage Image then the Resource type and if necessary its appropriate parameter to display the list of volumes Click the required Storage Unit then click the required...

Page 405: ...all the components of your Global Copy session configuration and if necessary click Back to correct any of them or click Finish to validate In Figure 26 20 you may move back to correct the Permit read...

Page 406: ...26 23 FlashCopy creation step 1 select the relationship type Click Next to proceed to the second step of this wizard Now the creation wizard displays the Select source volumes panel see Figure 26 24...

Page 407: ...shCopy creation step 2 select the source volumes Click Next to proceed with the third step of this wizard The creation wizard then displays the Select target volumes panel see Figure 26 25 Figure 26 2...

Page 408: ...rd then displays the Select common options panel see Figure 26 26 In this panel check the box for Enable change recording This should also automatically check the box for Make relationship s persisten...

Page 409: ...panel under the Copy Services menu of DS Storage Manager GUI see Figure 26 28 In the Select Action pull down list choose Create to proceed with the first step of the wizard Figure 26 28 Global Mirror...

Page 410: ...386 IBM System Storage DS6000 Series Copy Services with IBM System z Figure 26 29 Global Mirror session creation step 1 select volumes...

Page 411: ...in seconds how long to wait between the formation of Consistency Groups If this number is not specified or is set to zero Consistency Groups are formed continuously The maximum is 18 hours Maximum coo...

Page 412: ...third and last step of this wizard The creation wizard then displays the Verification panel see Figure 26 31 In this panel verify all the components of your Global Mirror session configuration and if...

Page 413: ...easy to understand through the DS CLI if you are not accustomed to working with it The following sections show how to perform the necessary activities for the setup of a Global Mirror environment usin...

Page 414: ...Profile for Windows systems Because we are using two storage disk subsystems and there is a local entry and a remote entry in these files indicated by devid and remotedevid we created two profile fil...

Page 415: ...tewwnn WWN of your remote Storage Image Source_LSS_ID Target_LSS_ID cfg Source device configuration file Example 26 47 shows the command and the corresponding output information a list of available po...

Page 416: ...ource_LSS_ID cfg Source device configuration file dscli lsfbvol lss Target_LSS_ID cfg Target device configuration file Example 26 49 shows the commands and the corresponding output information the vol...

Page 417: ...target storage image are available for FlashCopy For this use the following command dscli lsfbvol lss LSS_ID cfg Device configuration file Example 26 51 shows the command and its corresponding output...

Page 418: ...olume 6500 6501 cfg DSCLI profile DS 01 profile 01 Date Time June 14 2005 3 29 46 PM EDT IBM DSCLI Version 5 0 3 134 DS IBM 2107 7506551 CMUC00145I mksession Session 01 opened successfully Note that t...

Page 419: ...section lists the commands you use to control and query the Global Mirror environment 26 11 1 Query status of the paths To query the status of the paths use the DS CLI command lspprcpath dscli lspprcp...

Page 420: ...ith the DS CLI command lsflash The syntax of the lsflash command is as follows dscli lsflash cfg Device configuration file Source_Volume Target_Volume Source_Volume Target_Volume If we list FlashCopy...

Page 421: ...Secondary Simplex True Disable 26 11 5 Query Global Mirror session information The showgmir command displays detailed properties and performance metrics for the Global Mirror operations associated wit...

Page 422: ...th Master only dscli showgmir 65 cfg DSCLI profile DS 01 profile Date Time June 15 2005 10 23 07 AM EDT IBM DSCLI Version 5 0 3 134 DS IBM 2107 7506551 ID IBM 2107 7506551 65 Master Count 1 Master Ses...

Page 423: ...e at site 1 Example 26 64 pausegmir with Master only dscli pausegmir lss 65 session 01 cfg DSCLI profile DS 01 profile Date Time June 15 2005 10 22 39 AM EDT IBM DSCLI Version 5 0 3 134 DS IBM 2107 75...

Page 424: ...LSS 65 on the storage image at site 1 Example 26 66 resumegmir with Master only dscli resumegmir lss 65 session 01 cfg DSCLI profile DS 01 profile Date Time June 15 2005 10 56 51 AM EDT IBM DSCLI Ver...

Page 425: ...imary site only the recovery volumes will still be available and accessible at the end of a failover operation on the recovery site Example 26 68 shows a failover operation on two Global Copy secondar...

Page 426: ...bvol lss 65 cfg DSCLI profile DS 02 profile Date Time June 14 2005 7 15 47 PM EDT IBM DSCLI Version 5 0 3 134 DS IBM 2107 7573731 Name ID accstate datastate configstate deviceMTM datatype extpool cap...

Page 427: ...hCopy process is looking at the change recording bit map on the B volumes and is comparing it with the target bit map on the C volumes When the incremental FlashCopy is finished the change recording b...

Page 428: ...le Date Time June 15 2005 5 31 34 PM EDT IBM DSCLI Version 5 0 3 134 DS IBM 2107 7573731 CMUC00171I revertflash FlashCopy volume pair 6500 6500 successfully reverted CMUC00171I revertflash FlashCopy v...

Page 429: ...stent copy of the data on the FlashCopy target volumes If due to failures this command cannot complete without compromising the consistent copy the command stops processing and an error code is issued...

Page 430: ...volumes 6500 and 6501 and the corresponding target volumes 6502 and 6503 26 13 4 Remove Global Copy pairs To remove the Global Copy pairs we use the command rmpprc The syntax of the rmpprc command is...

Page 431: ...l Mirror Master with its Subordinates if there was more than one source storage image involved Example 26 78 rmpprcpath dscli rmpprcpath quiet 65 65 cfg DSCLI profile DS 01 profile Date Time June 15 2...

Page 432: ...408 IBM System Storage DS6000 Series Copy Services with IBM System z...

Page 433: ...Copyright IBM Corp 2006 All rights reserved 409 Part 7 Interoperability In this part we discuss the interoperability of the DS6000 Copy Services functions with other IBM storage disk subsystems Part 7...

Page 434: ...410 IBM System Storage DS6000 Series Copy Services with IBM System z...

Page 435: ...ll rights reserved 411 Chapter 27 Combining Copy Service functions In this chapter we discuss the interoperability of Global Copy Metro Mirror and FlashCopy Examples and suggestions are also given for...

Page 436: ...ndary tertiary and remote will reach a point after some time where they are all equal therefore they will be consistent and data has successfully been migrated to the remote site volumes In the second...

Page 437: ...hows the new configuration with the Metro Mirror and Global Copy reversed and production running at the remote site In this example it is shown that to protect the production at the remote the remote...

Page 438: ...414 IBM System Storage DS6000 Series Copy Services with IBM System z...

Page 439: ...t contains the following sections DS6000 and DS8000 Copy Services interoperability Preparing the environment RMC Establishing paths between DS6000 and DS8000 Managing Metro Mirror or Global Copy pairs...

Page 440: ...S6000 cannot be used as a z OS Global Mirror primary Storage Unit There is consequently no feature code for z OS Global Mirror RMZ for DS6000 The DS6000 can be used as a secondary Storage Unit 28 2 3...

Page 441: ...on to the DS6000 DS GUI is used to authenticate with the DS8000 HMC The same applies if you use the DS8000 DS GUI to manage a DS6000 This means that the same user ID and password must be defined in bo...

Page 442: ...dscli cfg 1750source profile We saved the BAT file onto the Windows desktop and started it by double clicking the icon The DS CLI opened and started the specified profile By creating a BAT file and p...

Page 443: ...e the DS8000 DS GUI to manage FlashCopy pairs on the DS6000 Adding the DS8000 Storage Complex to a DS6000 Storage Complex You add a DS8000 Storage Complex to a DS6000 Storage Complex as follows 1 Conn...

Page 444: ...added the DS8000 Storage Complex to the DS6000 Storage Complex you are now able to use the DS6000 DS GUI to create paths and Remote Mirror and Copy pairs where the DS8000 is the source device You can...

Page 445: ...xactly the same size 28 2 8 Determining DS6000 and DS8000 CKD volume size When CKD volumes are created on a DS6000 or DS8000 the size must be specified in cylinders In Example 28 3 two CKD volumes of...

Page 446: ...he same physical path Adding or deleting paths You can add additional paths to an LSS pair by simply creating more paths To remove a path open the Paths panel select the relevant source machine and LS...

Page 447: ...orts using the DS CLI Having determined the remote devices WWNN we can now display the ports that are available to establish PPRC paths In Example 28 6 we are logged onto the DS8000 using DS CLI so th...

Page 448: ...204 DS IBM 2107 7503461 CMUC00149I mkpprcpath Remote Mirror and Copy path 14 18 successfully established dscli lspprcpath 14 Date Time 3 November 2005 20 37 53 IBM DSCLI Version 5 1 0 204 DS IBM 2107...

Page 449: ...he source volumes and the target volumes on the DS6000 are 0601 and 0602 Example 28 9 shows how we created two pairs with the mkpprc command We then listed them with the lspprc command and removed one...

Page 450: ...eLSS Timeout secs Critical Mode First Pass 0801 0601 Copy Pending Global Copy 08 unknown Disabled False 0802 0602 Copy Pending Global Copy 08 unknown Disabled False dscli pausepprc remotedev IBM 1750...

Page 451: ...ry Simplex True dscli mkgmir lss 08 session 90 Date Time 9 November 2005 2 58 19 IBM DSCLI Version 5 1 0 204 DS IBM 2107 7503461 CMUC00162I mkgmir Global Mirror for session 90 successfully started dds...

Page 452: ...flash Removal of the remote FlashCopy volume pair 0601 0602 has been initiated successfully Use the lsremoteflash command to determine when the relationship is deleted You could also reverse the scena...

Page 453: ...ilure occurs in a z OS Global Mirror environment and applications failover to the secondary site and are running at the secondary site on the secondary Storage Units Later after the primary site has b...

Page 454: ...430 IBM System Storage DS6000 Series Copy Services with IBM System z...

Page 455: ...s part we discuss solutions offered by IBM to assist you in the management automation and control of your Copy Services implementation on the DS6000 We provide an overview of the solutions discuss the...

Page 456: ...432 IBM System Storage DS6000 Series Copy Services with IBM System z...

Page 457: ...Copy Services functions in the DS8000 and the ESS 800 This chapter contains the following sections Sections in this chapter include DS6000 and ESS 800 Copy Services interoperability Preparing the envi...

Page 458: ...cascaded installation where an ESS F20 is mirrored to an ESS 800 that is then mirrored to a DS6000 The ESS F20 to ESS 800 relationship must however be managed with ESS management tools such as the ES...

Page 459: ...er ID on the DS6000 Log on to the DS6000 SMC using the DS GUI and create a user ID that is in either the admin op_storage or op_copy_services groups Log off and then log on with that user ID and chang...

Page 460: ...les ibm dscli profile directory as 2105source profile Then you create a simple Windows BAT file with three lines as shown in Example 29 2 Example 29 2 Windows BAT file to start a specific profile titl...

Page 461: ...lume from one storage device to another it is possible for the PPRC target volume to be larger than the PPRC source volume However if an attempt is made to reverse the relationship so that the source...

Page 462: ...ls extpool cap cyl av_6K_CKD_0600 0600 Online Normal Normal 3390 3 CKD Base P2 3339 av_6K_CKD_0601 0601 Online Normal Normal 3390 3 CKD Base P2 3339 Determining ESS volume size To view the ESS volume...

Page 463: ...s might result in an unplanned outage on the System z environment that was using CKD volume 0001 29 3 RMC Establishing paths between DS6000 and ESS 800 To create a PPRC relationship between a DS6000 a...

Page 464: ...vides the source LSS 5 Click Create See Figure 29 4 Figure 29 4 Path panel 6 In the panel that opens select the source LSS of the DS6000 from which you want to establish the PPRC paths Click Next In t...

Page 465: ...the target LSS on the ESS is LSS 05 Figure 29 6 Select target LSS 8 The next panel shows you which Fibre Channel ports are available for establishing Metro Mirror and Copy paths see Figure 29 7 on pag...

Page 466: ...rget I O ports 10 In the next two panels you are asked whether you want built a Consistency Group and to verify the information that you entered during the process Verify the information and click Fin...

Page 467: ...blishing logical paths between DS6000 and ESS 800 using DS CLI You can also use the DS CLI to establish logical paths However you must know the WWNN of the target Storage Image The three commands you...

Page 468: ...ESS Specialist user ID and password 4 On the welcome panel you see the WWNN as shown in Figure 29 10 Write it down Figure 29 10 Using ESS 800 Specialist GUI to display the ESS 800 WWNN Determining the...

Page 469: ...Time 8 November 2005 23 28 53 IBM DSCLI Version 5 1 0 204 DS IBM 1750 1300247 CMUC00149I mkpprcpath Remote Mirror and Copy path 06 05 successfully established dscli lspprcpath 06 Date Time 8 November...

Page 470: ...0EFFFE16 Primary DS6000 LSS ID 06 Secondary ESS 800 LCU SSID 2105 Secondary ESS 800 WWNN 5005076300C09517 Secondary ESS 800 LSS ID 05 First path established I0003 to I00AC Second path established I010...

Page 471: ...mation you entered before you establish the Metro Mirror pairs Also during the process you can at any time go back to modify specifications that you have already done or you can cancel the process 6 I...

Page 472: ...get volumes Then select the target volume for the first source volume When you are finished click Next as shown in Figure 29 14 To expand your choices you must select the small blue boxes Figure 29 14...

Page 473: ...tead use Global Copy this is where you would select it Figure 29 16 Copy options 11 The Verify panel opens Verify the information that you entered and if everything is correct click Finish to establis...

Page 474: ...DSCLI Version 5 1 0 204 DS IBM 1750 1300247 ID State Reason Type SourceLSS Timeout secs Critical Mode First 0600 0500 Copy Pending Metro Mirror 06 unknown Disabled Invalid 0601 0501 Copy Pending Metro...

Page 475: ...Version 5 1 0 204 DS IBM 1750 1300247 CMUC00153I mkpprc Remote Mirror and Copy volume pair relationship 0603 0503 successfully created dscli lspprc 0603 Date Time 9 November 2005 1 41 30 IBM DSCLI Ve...

Page 476: ...py Pending Secondary Simplex True dscli mkgmir lss 05 session 20 Date Time 9 November 2005 1 52 59 IBM DSCLI Version 5 1 0 204 DS IBM 2105 22399 CMUC00162I mkgmir Global Mirror for session 20 successf...

Page 477: ...n 6 Make selections from the Resource type and Specify LSS pull downs 7 From the Select Action menu select Create as shown in Figure 29 18 Figure 29 18 Creating ESS 800 FlashCopy using DS GUI 8 Select...

Page 478: ...he ESS 800 between ESS 800 volumes 0500 and 0501 using a conduit LSS to send the command We then removed the remote FlashCopy Example 29 16 Creating a remote FlashCopy where the ESS 800 is the remote...

Page 479: ...r to define the machine on which the FlashCopy is to be performed Other commands such as mkpprc commands refer to this device as the remote device using remotedev However because a Flashcopy must be s...

Page 480: ...456 IBM System Storage DS6000 Series Copy Services with IBM System z...

Page 481: ...Mirror Global Copy Global Mirror and Metro Global Copy At each site a FlashCopy of the local volumes can also be managed This solution simplifies the process of repairing inconsistent Remote Copy pai...

Page 482: ...ion highlights The eRCMF solution highlights and benefits are summarized in the following list It Provides automation capability Simplifies disaster recovery operations Improves protection of critical...

Page 483: ...e storage enterprise must be maintained to insure data integrity Figure 30 1 Sample update sequence in a database The order of Dependent Writes across volumes must be maintained at remote locations Fa...

Page 484: ...cy Group is unable to complete a write to its counterpart in the Remote Copy relationship an Extended Long Busy ELB for mainframe environments or a SCSI Queue Full condition for open systems will be i...

Page 485: ...to the primary LSS is temporarily queued During this interval other automated operations can be triggered such as freezing other application related LSS pairs When using freeze through DS Storage Mana...

Page 486: ...Storage Servers in this solution because ESS800 DS6000 and DS8000 share the same Copy Services functions With DS8000 and DS6000 no Copy Services Server is required since each Storage Server can handl...

Page 487: ...Authentication file ESS Network Interface ESS Network Interface WebSphere HTTPS Backup process Master process Master process Backup process Shadow Volumes Host Volumes Journal Volumes Shadow Volumes S...

Page 488: ...mote Copy to ensure that data is secure at the remote site before signaling the host that the write is complete During a disaster you can combine the Consistency Group and Freeze functions in the Stor...

Page 489: ...continue in the production data center while maintaining a consistent copy of the data in either the backup or remote data center Meanwhile the business is able to determine the cause of the event an...

Page 490: ...466 IBM System Storage DS6000 Series Copy Services with IBM System z...

Page 491: ...es for the SAN Volume Controller SVC as well as the ESS 800 when using FCP links for PPRC paths between ESS 800s or between ESS 800 and DS6000 and or DS8000 This applies also to FlashCopy For installa...

Page 492: ...d on open standard interfaces to query gather and collect all available data necessary for performance management 2 TPC for Data focus on data management and addresses aspects related to information l...

Page 493: ...tential for enhancements and can evolve over time and according to user requirements TPC for Replication does build on all previous experiences with storage management tools and framework proposals to...

Page 494: ...ices sessions Note that TPC for Replication also manages FlashCopy and Metro Mirror for IBM SAN Volume Controller SVC 31 4 Copy Services terminology Although it is covered in a previous part of this b...

Page 495: ...tion over any distance It is a combination of GC and FlashCopy complemented by unique firmware features The firmware drives the copy operations in a fully autonomic fashion to guarantee consistent dat...

Page 496: ...chronize both sites with the data level at the local site you issue the Failback command towards the volumes at the local site This replicates the data changed since the suspend from the local to the...

Page 497: ...s for example a PPRC primary volume and a PPRC secondary volume Figure 31 4 shows three Metro Mirror Copy pairs In TPC for Replication each pair is considered a Copy Set A Copy Set here contains two v...

Page 498: ...performing against a session apply these actions to all Copy Sets within the session Again this is similar to a Global Mirror for System z XRC session Figure 31 6 on page 475 shows an example of two s...

Page 499: ...his context it is recommended to have application dependent volume granularity within the scope of an LSS Or in other words volumes or Copy Sets that require consistent data and can be subject to a fr...

Page 500: ...to site 1 This may happen through Failover Failback operations Global Mirror Global Mirror implies three volumes for each Global Mirror Copy Set Again this happens between a local site site 1 and a d...

Page 501: ...suspend command or any other suspend trigger which may be an error in the storage subsystem or loss of connectivity between sites Eventually the process to suspend Copy Sets ends and copying has stop...

Page 502: ...ost volume A host volume is identical to what is called a primary or source volume in Copy Services The host designation represents the volume functional role from an application point of view It is u...

Page 503: ...Session 3 is a Metro Mirror configuration between the local and intermediate site The session at the bottom in Figure 31 7 Session 4 is a Global Mirror session between the local and remote sites 31 10...

Page 504: ...ssage This also includes a capability to distinguish between the different storage servers that can be managed by the Replication Manager such as DS6000 DS8000 ESS 800 and SVC This approach has the po...

Page 505: ...s in sever0 and a second card installs in server1 9A2 and 9B2 with feature code 1802 for the Ethernet adapter pair for the first LPAR 9A2 and 9B2 with feature code 1803 for the Ethernet adapter pair f...

Page 506: ...21 N9801 Example 31 2 shows an output example of lsnetworkport l which provides an overview of all available Ethernet ports on the concerned Storage Image Facility Example 31 2 Output of the lsnetwork...

Page 507: ...ly the Replication Manager server connects only to one Ethernet port out of the two ports on the Ethernet card which must reside in the first slot of the System p server in the DS8000 Note that the in...

Page 508: ...ite I Os are held until the freeze process ends and the TPC server communicates to the storage server to continue processing write I O requests to the concerned primary volumes in the session After th...

Page 509: ...the RM server issues freeze commands to all other LSS pairs in the affected session once the heartbeat expired and the RM server could not receive heartbeat information from any one of the involved st...

Page 510: ...atforms For the latest software requirements refer to http www ibm com servers storage support software tpcrep installing html 31 14 Hardware requirements for TPC for Replication servers For Windows a...

Page 511: ...e and monitor any Copy Services configuration and Copy Services operations This GUI is Web browser based and does not rely on any other product such asTotalStorage Productivity Center and IBM Director...

Page 512: ...nected storage servers and is usually closely installed to the storage servers that interface with the RM server 31 15 1 Connect to the TPC for Replication GUI You connect to the GUI by specifying the...

Page 513: ...as a text string on the UserID field and a password in a hidden text field User IDs are defined and set up in the RM server system 31 15 2 Health Overview panel After a successful login into the Repli...

Page 514: ...ts that all sessions are in normal status and working fine There is no high availability server environment and one or more storage servers cannot be reached by the Replication Manager The upper left...

Page 515: ...activities of the user and its results 31 15 3 Sessions panel This is the panel of all sessions within the RM server Figure 31 17 Sessions overview Each session comprises a number of Copy Sets that ma...

Page 516: ...31 17 on page 491 you may select any action from the action list shown in Figure 31 19 Figure 31 19 Actions against a session This may be an action against the entire session such as suspending all vo...

Page 517: ...he panel used to add a new server is shown in Figure 31 22 on page 494 Figure 31 21 displays the available action list From this list you select for instance the View Modify Details action and apply i...

Page 518: ...subsystem details You usually use the storage subsystem application only to connect a storage server to the RM server Figure 31 22 also shows the standard port used by the RM server to communicate wit...

Page 519: ...aths currently defined for the selected storage subsystem Figure 31 24 displays all the defined PPRC paths for the selected LSS and the ports used for these PPRC paths Figure 31 24 Path overview of a...

Page 520: ...th two servers has a slightly different appearance than what is shown in Figure 31 25 You use this panel for basic operations such as defining a server as Standby or to take over in the event of a dis...

Page 521: ...the Replication Manager server and the connected storage servers see also 31 12 TPC for Replication heartbeat on page 484 The diagnostic package contains all RM logs Its location on the RM server is...

Page 522: ...ation through a command line interface CSMCLI As with the DSCLI for DS8000 and DSCLI for DS6000 the CSMCLI command structure is similar for all three CLI products such as mk for make ch for change etc...

Page 523: ...i csmcli lsdevice devtype ds csmcli lsdevice devtype ess The third mode is the script mode running commands out of a file Example 31 6 Script mode to execute CLI commands start csmcli csmcli script rm...

Page 524: ...500 IBM System Storage DS6000 Series Copy Services with IBM System z...

Page 525: ...lly Dispersed Parallel Sysplex is such a full function solution and provides various levels of IT continuous availability through different implementation levels GDPS as a continuous availability and...

Page 526: ...IBM as well as Other Equipment Manufacturer OEM disk vendors as long as the vendor meets the specific functions of the Metro Mirror Global Mirror and z OS Global Mirror architectures required to suppo...

Page 527: ...e following GDPS PPRC GDPS PPRC a Tier 7 solution GDPS PPRC HyperSwap Manager a Tier 6 solution RCMF PPRC a remote copy management solution for PPRC GDPS XRC GDPS XRC a Tier 7 solution RCMF XRC a remo...

Page 528: ...y attributes of GDPS PPRC by extending the Parallel Sysplex redundancy to disk subsystems The HyperSwap function can help significantly reduce the time needed to switch to the secondary set of disks w...

Page 529: ...lability reaching into the tens of thousands of System z volumes Consistency of the data is maintained via the Consistency Group function within the System Data Mover GDPS XRC includes automation to m...

Page 530: ...nd like Metro Mirror Global Mirror requires that the primary and secondary disk subsystems are from the same vendor however Global Mirror is currently only supported by IBM disk subsystems On the othe...

Page 531: ...t GDPS integration work including education is done using IBM Global Services in addition to the planning and installation of the code This ensures that the GDPS solution provides the intended value t...

Page 532: ...long with providing operational education for the enterprise GDPS PPRC HyperSwap Manager IBM Implementation Services for GDPS PPRC HyperSwap Manager helps simplify implementation by working with you t...

Page 533: ...Copyright IBM Corp 2006 All rights reserved 509 Appendix A Concurrent Copy In this appendix we describe the Concurrent Copy function on the DS6000 series A...

Page 534: ...ng Concurrent Copy works with the IBM System Storage DS6000 and the DFSMS System Data Mover SDM Concurrent Copy is available for the z OS and OS 390 operating systems and requires software support pro...

Page 535: ...sidefile for later processing Together the DS6000 and the SDM maintain two sidefiles one in the DS6000 cache and another in processor storage Terminate The Concurrent Copy terminates when DFSMSdss has...

Page 536: ...arameters DFSMShsm also allows Concurrent Copy to be used when copying data using Aggregate Backup and Recovery Support ABARS Using the CONCURRENT control statement of the DB2 COPY utility you can inv...

Page 537: ...delta to determine at what percentage value new Concurrent Copy data sets will not be copied using Concurrent Copy SDM subtracts this delta value from the lower MVS percentage The newly computed SDM p...

Page 538: ...simplifies the use of Concurrent Copy because it builds on existing experience with DFSMSdss For example IMS databases can be backed up using DFSMSdss During the recovery process IMS database recover...

Page 539: ...e than 2048 data mover sessions per DS6000 at the same time you receive an error message and the copy continues using the traditional DFSMSdss copy Sessions for aggregate group If you relate Concurren...

Page 540: ...SYSOUT TAPE DD UNIT TAPE VOL SER TAPE01 TAPE02 TAPE03 LABEL 1 SL DISP NEW KEEP DSN USER BACKUP SYSIN DD DUMP DATASET INCLUDE USER LOG USER TABLE USER XREF OUTDDNAME TAPE OPTIMIZE 4 CONCURRENT Example...

Page 541: ...t invoke DFSMSdss and must provide a pointer to a user interaction module UIM list DFSMSdss can be invoked by any of the following system macros ATTACH EP ADRDSSU PARAM OPTPTR DDPTR PAGEPTR UIMPTR UAP...

Page 542: ...exit Usage of the Concurrent Copy function can also be controlled through the installation options exit a product sensitive programming interface intended for users Refer to Options Installation Exit...

Page 543: ...endix B SNMP notifications This appendix describes SNMP traps that are sent out in a Remote Copy environment It repeats some of the SNMP trap information that is available in IBM System Storage DS6000...

Page 544: ...trap 100 as shown in Example B 1 is posted it indicates that the redundancy is degraded The RC column in the trap represents the reason code for the interruption of the link The reason codes are list...

Page 545: ...shed on the port or link The establish paths operation will not be retried within the control unit automatically 0B Reserved for use by StorageTek 10 Configuration Error The source of the error is one...

Page 546: ...suspended pair information contains a hexadecimal string of 64 characters By converting this hex string into binary each bit represents a single device If the bit is 1 then the device is suspended ot...

Page 547: ...the DS CLI command rmgmir or the corresponding GUI function Example B 10 Trap 214 Asynchronous PPRC Master terminated Asynchronous PPRC Master Terminated UNIT Mnf Type Mod SerialNm IBM 1750 511 13 00...

Page 548: ...hown in Example B 13 is sent if a Global Mirror Copy Environment was suspended by the DS CLI command pausegmir or the corresponding GUI function Example B 13 Trap 217 Asynchronous PPRC paused Asynchro...

Page 549: ...Copyright IBM Corp 2006 All rights reserved 525 Appendix C Licensing In this appendix we describe how the licensing functions for Copy Services for the DS6000 Series are arranged C...

Page 550: ...t License OEL 1 TB 5010 OEL 5 TB 5011 OEL 10 TB 5012 OEL 25 TB 5013 OEL 50 TB 5014 FICON z OS attachment FICON Attachment 5920 PAV Parallel Access Volumes PAV 1 TB 5110 PAV 5 TB 5111 PAV 10 TB 5112 PA...

Page 551: ...gured capacity of the machine Authorization level is maintained by the licensed code in the controller and the DSFA application Example Actual capacity is 15 TB used for both CKD and FB the scope for...

Page 552: ...528 IBM System Storage DS6000 Series Copy Services with IBM System z...

Page 553: ...s appendix discusses the ways that you can migrate Copy Services tasks on the ESS environment to the DS Copy Services environment The Copy Services functions described here cover the GUI and the CLI E...

Page 554: ...level 2 4 x or higher Reviewing the ESS tasks to migrate Review the Copy Services tasks you want to migrate You can perform this review from your ESS GUI or ESS CLI In Example D 1 esscli list is used...

Page 555: ...DS6000 Command Line Interface User s Guide GC26 7922 You can then save each translated task and run it in the DS6000 CLI environment Translate also if needed and edit the individual server scripts tha...

Page 556: ...ght digit format xxx sssss where xxx is the LUN ID and sssss is the serial number of the ESS 800 In the example used in this appendix the volumes shown are 004 23953 to 005 23953 These volumes are ope...

Page 557: ...cs parameter that returns the performance counter values for the respective I O port IDs The metrics parameter provides the means to monitor I O port performance statistics set port setioport See Note...

Page 558: ...nks A fixed block Extent is 1 GB using binary counting list featurecode lsda lshba lsioencl lsuser mkuser rmuser chuser lsstgencl The 1750 CLI commands can display feature codes when the appropriate p...

Page 559: ...bric or FC AL connection topologies A port that uses the point to point switched fabric topology can be simultaneously used for OS host system I O and for PPRC path configurations The Fibre Channel SC...

Page 560: ...536 IBM System Storage DS6000 Series Copy Services with IBM System z...

Page 561: ...ion SG24 6786 IBM System Storage DS8000 Series Copy Services in Open Environments SG24 6788 IBM System Storage DS8000 Series Copy Services with System z servers SG24 6787 IBM TotalStorage Enterprise S...

Page 562: ...ers storage support disk 1750 html The interoperability matrix at http www ibm com servers storage disk ds6000 interop html Fibre Channel host bus adapter firmware and driver level matrix at http know...

Page 563: ...view or download Redbooks Redpapers Hints and Tips draft publications and Additional materials as well as order hardcopy Redbooks or CD ROMs at this Web site ibm com redbooks Help from IBM IBM Support...

Page 564: ...540 IBM System Storage DS6000 Series Copy Services with IBM System z...

Page 565: ...Concurrent Copy 510 domain 511 DS6000 512 invoking 512 operation 512 Concurrent Copy terminology Concurrent Copy domain 511 consistent copy 511 fuzzy copy 511 intercepted writes 511 session 511 sessi...

Page 566: ...return codes 33 script command mode 32 single shot mode 31 supported environments 165 supported operating systems for the DS CLI 26 usage examples 35 user accounts 27 user assistance 34 using the appl...

Page 567: ...using the DS SM 89 DS CLI example to establish between B and C 300 DS front ends 71 establish relationship 45 establish with DS SM 381 establish with ICKDSF 317 fast reverse restore 60 flow 70 full vo...

Page 568: ...aths 216 lsavailpprcport 230 lspprcpath 230 Metro Mirror panel 234 mkpprcpath 230 overview 202 path commands 230 path panel 233 peak bandwidth requirements 220 performance 220 planning considerations...

Page 569: ...ion through ICKDSF 322 query environment 395 recovery scenario 282 recovery utilizing TSO commands 352 reestablish FlashCopy relationship between B and C volumes 290 relationship between local and rem...

Page 570: ...427 managing Global Mirror 426 managing Metro Mirror or Global Copy pairs 425 path creating using the DS GUI 422 volume size considerations for RMC 421 DS6000 and DS8000 Copy Services 415 DS6000 and...

Page 571: ...RCOPY ESTPAIR 161 PPRCOPY ESTPATH 160 PPRCOPY FREEZE 161 PPRCOPY QUERY 161 PPRCOPY RECOVER 164 PPRCOPY RUN 164 PPRCOPY SUSPEND 164 refreshing the VTOC 164 resume suspended pair 179 resumepprc 168 resy...

Page 572: ...obal Mirror environment 275 remove FlashCopy relationship 274 remove with ICKDSF 327 replicating data over a distance 246 Resource Management Facility see RMF restart application at remote site 292 re...

Page 573: ...ite failure scenario 352 manage Global Mirror 302 populate a Global Mirror session 309 query a Global Mirror session 310 start a Global Mirror environment 310 TSO example 241 U unfreezepprc 233 usage...

Page 574: ...550 IBM System Storage DS6000 Series Copy Services with IBM System z...

Page 575: ...Storage DS6000 Series Copy Services with IBM System z IBM System Storage DS6000 Series Copy Services with IBM System z IBM System Storage DS6000 Series Copy Services with IBM System z IBM System Stora...

Page 576: ...IBM System Storage DS6000 Series Copy Services with IBM System z IBM System Storage DS6000 Series Copy Services with IBM System z...

Page 577: ......

Page 578: ...for replication support This IBM Redbook will help you plan install and configure the IBM System Storage DS6000 Copy Services functions in System z environments and provides the details you need to i...

Reviews:

No comments

Brands by name

Popular brands

Load more brands