Hitachi TAGMASTORE MK-90RD011-25 User Manual Download Page 218

Page: 218 / 388

200

Chapter 4 Performing CCI Operations

Table 4.16 State Transition Table for HA Control Script

Volume Attributes and Pair Status

Results Executing pairvolchk and horctakeover from DC1(DC2)

State
No.

DC1(DC2) DC2(DC1)

pairvolchk

-s

(local volume)

pairvolchk -s -c
(remote volume)

Pair
Status

Horctakeover
result

1 SMPL

SMPL

EX_VOLCRE

2 COPY

3 PAIR/PFUL

4 PSUS

4-1 PFUS

5 PSUE

P-VOL

PDUB

PVOL_XXX XXX Nop

8 S-VOL

EX_EVOLCE

SMPL

or

SVOL-

PSUS
(SSWS)

Unknown

SMPL

or

SVOL-PSUS

EX_ENORMT or
EX_CMDIOE

(EX_ENORMT)
(EX_CMDIOE)

10 SMPL

SMPL

XXX

EX_VOLCRE

P-VOL

P-VOL EX_EVOLCE

EX_EVOLCE

data or

status &
PSUE or

PDUB

PVOL-PSUE

or PVOL-SMPL

Other

S-VOL SVOL_YYY

XXX

Nop

data or

status &
PSUE or

PDUB

PVOL-PSUE

or PVOL-SMPL

Other

Unknown

PVOL_XXX

EX_ENORMT or
EX_CMDIOE

XXX

Nop

14 SMPL

EX_EVOLCE

15 COPY

SVOL_E*

4,5

SVOL_E*

16 PAIR/

PFUL

Swap

PSUS SVOL_E

PFUS

SVOL_YYY

SVOL

4-1

S-VOL

P-VOL

PSUE data

PVOL_XXX XXX

SVOL

5,6

Summary of Contents for TAGMASTORE MK-90RD011-25

Page 1: ...ontrol Interface CCI User and Reference Guide Hitachi Universal Storage Platform V VM Hitachi TagmaStore Universal Storage Platform Hitachi TagmaStore Network Storage Controller Hitachi Lightning 9900 V Series Hitachi Lightning 9900 ...

Page 2: ......

Page 3: ...d information becomes available this entire document will be updated and distributed to all registered users Trademarks Hitachi the Hitachi logo and Hitachi Data Systems are registered trademarks and service marks of Hitachi Ltd The Hitachi Data Systems logo is a trademark of Hitachi Ltd Hitachi Lightning 9900 and Hitachi TagmaStore are registered trademarks or trademarks of Hitachi Data Systems C...

Page 4: ...pport for IPv6 HP OpenVMS for Integrity Server 64 bit RAID Manager for RH IA64 Added SSB to the output of the EX_CMDRJE error message Table 5 3 Added support for Oracle10g H A R D Added the vt rd10g option for the raidvchkset command section 4 12 1 Added identification of NON zero checking to the output of the raidvchkdsp and raidvchkscan commands sections 4 12 2 4 12 3 Added pathID as HORCM_INSTP...

Page 5: ...00 9900 This document assumes the following The user has a background in data processing and understands RAID storage systems and their basic functions The user is familiar with the Hitachi RAID storage systems and has read and understands the User and Reference Guide for the storage system The user is familiar with the host operating system The user is familiar with the Hitachi business continuit...

Page 6: ...er s Guide MK 96RD612 Database Validator User s Guide MK 96RD611 Copy on Write Snapshot User s Guide MK 96RD607 Universal Replicator User s Guide MK 96RD624 Hitachi TagmaStore USP V VM and NSC documents Universal Storage Platform User and Reference Guide MK 94RD231 Network Storage Controller User and Reference Guide MK 95RD279 Storage Navigator User s Guide MK 94RD206 Hitachi ShadowImage User Guid...

Page 7: ...003 Hitachi ShadowImage User s Guide MK 90RD031 Hitachi TrueCopy User and Reference Guide MK 91RD051 Comments Please send us your comments on this document Make sure to include the document title number and revision Please refer to specific section s and paragraph s whenever possible E mail doc comments hds com Fax 858 695 1186 Mail Technical Writing M S 35 10 Hitachi Data Systems 10277 Scripps Ra...

Page 8: ...viii Preface ...

Page 9: ...py ShadowImage Universal Replicator Volume Status 19 2 4 2 TrueCopy Async TrueCopy Sync CTG and Universal Replicator Volumes 23 2 4 3 TrueCopy Sync Async and Universal Replicator Fence Level Settings 28 2 5 Applications of Hitachi TrueCopy ShadowImage Commands 31 2 6 Overview of Copy on Write Snapshot Operations 37 2 6 1 Creating SnapShot 38 2 6 2 SnapShot Volume Specifications 38 2 6 3 SnapShot V...

Page 10: ...Software Installation for OpenVMS Systems 131 3 3 4 Changing the CCI User UNIX Systems 133 3 3 5 Changing the CCI User Windows Systems 134 3 3 6 Uninstallation 136 3 4 Creating Editing the Configuration File 137 3 5 Porting Notice for OpenVMS 139 3 5 1 Requirements and Restrictions 139 3 5 2 Known Issues 145 3 5 3 Start up Procedures Using Detached Process on DCL 146 3 5 4 Command Examples in DCL ...

Page 11: ... UR 255 4 12 5 Raidvchkscan Command for Snapshot Pool and Dynamic Provisioning 259 4 13 Controlling CCI Activity 261 4 13 1 Horcmstart Command 261 4 13 2 Horcmshutdown Command 262 4 13 3 Horcctl Command 263 4 13 4 3DC Control Command using HORC UR NEW 265 4 13 5 Windows Subcommands 270 4 13 6 Findcmddev Subcommand 270 4 13 7 Drivescan Subcommand 271 4 13 8 Portscan Subcommand 272 4 13 9 Sync and S...

Page 12: ...e Migration 329 4 22 2 Commands to Control the Volume Migration 331 4 22 3 Relations between cc Command Issues and Status 335 4 22 4 Restrictions for Volume Migration 336 Chapter 5 Troubleshooting 337 5 1 General Troubleshooting 338 5 1 1 About Linux Kernel 2 6 9 XX supported ioctl SG_IO 341 5 2 Changing IO Way of the Command Device for AIX 342 5 3 Error Reporting 343 5 4 Calling the Hitachi Data ...

Page 13: ...ID Manager Communication Among Different Operating Systems 49 Figure 2 23 Configuration Definition of Paired Volumes 50 Figure 2 24 Configuration File Example UNIX Based Servers 51 Figure 2 25 Configuration File Example Windows Servers 51 Figure 2 26 Configuration and Unit IDs for Multiple Storage Systems 53 Figure 2 27 Configuration for Multiple Networks 58 Figure 2 28 Network Configuration for I...

Page 14: ...Figure 4 6 Normal Resync and ShadowImage Restore Resync 181 Figure 4 7 Example of FHORC Option for Pairresync 185 Figure 4 8 Example of FMRCF Option for Pairresync 185 Figure 4 9 Swap Operation 186 Figure 4 10 Example swaps option with FHORC MU 186 Figure 4 11 Pair Event Waiting 187 Figure 4 12 Example of FHORC Option for Pairevtwait 190 Figure 4 13 Example of FMRCF Option for Pairevtwait 190 Figu...

Page 15: ... 272 Figure 4 54 Sync Subcommand Example Pairsplit 274 Figure 4 55 Sync Subcommand Example Pairsplit S 274 Figure 4 56 Mount Subcommand Example for Windows NT 275 Figure 4 57 Mount Subcommand Example for Windows 2003 2000 276 Figure 4 58 Umount Subcommand Example 277 Figure 4 59 Environment Variable Subcommand Examples 279 Figure 4 60 Inqraid Command Tool Examples 283 281 Figure 4 61 Inqraid Examp...

Page 16: ...NIX based Systems 71 Table 2 11 CCI Files for Windows based Systems 72 Table 2 12 CCI Files for OpenVMS based Systems 74 Table 2 13 Mirror Descriptors and Group Assignments 100 Table 3 1 Supported Platforms for TrueCopy 114 Table 3 2 Supported Platforms for ShadowImage 115 Table 3 3 Supported Platforms for TrueCopy Async 116 Table 3 4 Supported Platforms for Universal Replicator 117 Table 3 5 Supp...

Page 17: ...3 Detailed Status of the Journal Volume 258 Table 4 34 Raidvchkscan Command Parameters Snapshot HDP 259 Table 4 35 Horcmstart Command Parameters 261 Table 4 36 Horcmshutdown Command Parameters 262 Table 4 37 Horcctl Command Parameters 263 Table 4 38 Horctakeoff Command Parameters 265 Table 4 39 Findcmddev Subcommand Parameters 270 Table 4 40 Drivescan Subcommand Parameters 271 Table 4 41 Portscan ...

Page 18: ...xviii Contents ...

Page 19: ...synchronous ShadowImage Universal Replicator USP V VM TagmaStore USP NSC Copy on Write Snapshot USP V VM TagmaStore USP NSC The Hitachi data protection operations supported by CCI include see section 1 3 Database Validator Data Retention Utility called Open LDEV Guard on Lightning 9900V 9900 For remote copy operations CCI interfaces with the system software and high availability HA software on the...

Page 20: ...ions can be performed using the Command Control Interface CCI software on the UNIX PC server host or the TrueCopy software on Storage Navigator The CCI software on the UNIX PC server displays Hitachi TrueCopy information and allows you to perform TrueCopy operations from the UNIX command line or via a script file The CCI software interfaces with the RAID storage systems through a dedicated LU call...

Page 21: ...plication activities For details on ShadowImage operations please refer to the ShadowImage User s Guide for the storage system e g Hitachi TagmaStore USP NSC ShadowImage User s Guide Note The 7700E data duplication feature software is called Hitachi Open Multi RAID Coupling Feature HOMRCF 1 2 3 Hitachi Universal Replicator Universal Replicator UR provides a RAID storage based hardware solution for...

Page 22: ... a short time with reduced cost However since only some of the P VOL data is copied by COW Snapshot the data stored in the S VOL is not guaranteed in certain cases e g physical P VOL failure ShadowImage copies the entire P VOL to the S VOL so even if a physical failure occurs the P VOL data can be recovered using the S VOL ShadowImage provides higher data integrity than COW Snapshot so you should ...

Page 23: ...ronments and minimizes risk and potential costs in backup restore and recovery operations Database Validator combined with the Oracle9i Database product provides a resilient system that can operate for 24 hours a day 365 days a year to provide the uptime required by enterprises today The Hitachi RAID storage systems support parameters for validation checking at the volume level and these parameter...

Page 24: ...rameters for guarding of open volumes using either the Storage Navigator software or the Command Control Interface CCI software on the host Once guarding is enabled the RAID storage system conceals the target volumes from SCSI commands e g SCSI Inquiry SCSI Read Capacity prevents reading and writing to the volume and protects the volume from being used as a copy volume i e TrueCopy and ShadowImage...

Page 25: ...tion 2 2 Overview of CCI ShadowImage Operations section 2 3 Hitachi TrueCopy ShadowImage Volumes section 2 4 Applications of Hitachi TrueCopy ShadowImage Commands section 2 5 Overview of Copy on Write Snapshot operations section 2 6 Overview of CCI Data Protection Operations section 2 7 CCI Software Structure section 2 8 Configuration Definition File section 2 9 Error Monitoring and Configuration ...

Page 26: ... enhance disk reliability e g mirroring provided by the LVM or device driver RAID5 or equivalent function provided by the LVM UNIX PC servers also feature hot standby and mutual hot standby functions in case of failures on the server side However mutual hot standby for disaster recovery has not yet been achieved since it requires the remote mirroring function Hitachi TrueCopy supports the remote m...

Page 27: ...Server B Oradb Group name oradb Paired logical volume Volume A Volume C Oradb1 Paired logical volume Volume B Volume D Oradb2 Special files C and D Server C Oradb Local volume space of server A Figure 2 1 Concept of Paired Volumes Addressing paired logical volumes The correspondences between the paired logical volumes and physical volumes are defined by users by describing any intended paired logi...

Page 28: ...2 in the configuration definition file as shown below Group name oradb Paired logical volume Volume C Oradb1 Paired logical volume Volume D Oradb2 Volume A Volume B Group name oradb 1 Paired logical volume Volume E Oradb1 1 Paired logical volume Volume F Oradb1 2 Group name oradb 2 Paired logical volume Volume G Oradb2 1 Paired logical volume Volume H Oradb2 2 Volume A MU 1 Volume B MU 1 Volume A ...

Page 29: ...le as shown below The MU 0 of a mirror descriptor is used for connection of the S VOL Group name oradb Volume A P VOL Volume B P VOL MU 0 Volume C S VOL Oradb1 Volume D S VOL Oradb2 Volume A P VOL MU 1 Volume B P VOL MU 1 Volume E S VOL Oradb11 Volume F S VOL Oradb21 Volume C P VOL MU 1 Volume D P VOL MU 1 Group name oradb1 Volume G S VOL Oradb21 Volume H S VOL Oradb22 Volume C P VOL MU 2 Volume D...

Page 30: ...tate condition of S PVOL oradb due to ShadowImage asynchronous copy If the pair splitting of SVOL oradb1 is performed at the COPY or PAIR state of S PVOL oradb the pairsplit command will be rejected with EX_CMDRJE or EX_CMDIOE PVOL S P VOL SVOL SVOL oradb oradb1 oradb2 1 2 0 0 Pair Restore Pair restore resync from SVOL oradb1 to S PVOL can only be performed when the state condition of SVOL oradb a...

Page 31: ...opy 2 2 2 3 Overview of CCI TrueCopy Operations CCI TrueCopy operates in conjunction with the software on the UNIX PC servers and the Hitachi TrueCopy HORC functions of the RAID storage systems The CCI software provides failover and other functions such as backup commands to allow mutual hot standby in cooperation with the failover product on the UNIX PC server e g MC ServiceGuard FirstWatch HACMP...

Page 32: ...RAID Swapping Figure 2 4 Server Failover System Configuration In a high availability HA environment a package is a group of applications that are scripted to run on the secondary host in the event of a primary host failure When using the HA software e g MC ServiceGuard the package can be transferred to the standby node as an operation executed by the system administrator see Figure 2 5 However if ...

Page 33: ...an be created in units of volume or group Pair splitting command Splits a volume pair and allows read and write access to the secondary volume Pair resynchronization command Resynchronizes a split volume pair based on the primary volume The primary volume remains accessible during resynchronization Swaps p option TrueCopy only Swaps volume from the SVOL PVOL to PVOL SVOL at suspending state on the...

Page 34: ...uration The TrueCopy local commands support a function which links the system operation for the purpose of volume backup among UNIX servers with the operation management of the server system The TrueCopy local commands perform the same functions as the remote commands only within the same storage system instead of between two storage systems Commands Commands HORCM CCI HORCM CCI Host A Host B Serv...

Page 35: ...mmand Resynchronizes a split volume pair based on the primary volume The primary volume remains accessible during resynchronization Restore option Resynchronizes a split pair based on the secondary volume reverse resync The primary volume is not accessible during resync with restore option Event waiting command Used to wait for completion of volume pair creation or resynchronization and to check t...

Page 36: ...is 8191 for TagmaStore USP NSC 4095 for 9900V and 2047 for 9900 For details on ShadowImage volumes and operations please refer to the Hitachi ShadowImage User s Guide for the storage system Each volume pair that you want to create must be registered in the CCI configuration file ShadowImage volume pairs must include an MU mirrored unit number assigned to the S VOL The MU number indicates that the ...

Page 37: ...are processed asynchronously R W enabled R enabled COPY In paired state but initial copy pairsplit or resync operation is not complete Includes COPY PD COPY SP and COPY RS status In paired state but initial copy pairsplit or resync operation is not complete Includes COPY PD COPY SP and COPY RS status R W enabled R enabled RCPY Not used for Hitachi TrueCopy In paired state but reverse resync operat...

Page 38: ...ble e PAIR Acceptable Acceptable Accepted f Accepted f Accepted c Acceptable f PSUS Rejected Rejected Acceptable Acceptable Accepted c Accepted d see Note g PSUE Rejected Rejected Rejected Rejected Accepted c Accepted d see Note h PDUB Rejected Rejected Rejected Rejected Accepted c Accepted d see Note Pairsplit of a Hitachi TrueCopy Asynchronous volume will be returned after verification of state ...

Page 39: ...d without specification of split for paircreate command Note 2 The dÆf state change is displayed as PVOL_PSUS SVOL_COPY see display example below and reading and writing are enabled for SVOL in SVOL_COPY state pairsplit g oradb pairdisplay g oradb fc Group PairVol L R Port TID LU M Seq LDEV P S Status P LDEV M oradb oradev3 L CL2 N 3 4 0 8071 28 P VOL PSUS 100 29 W oradb oradev3 R CL2 N 3 5 0 8071...

Page 40: ...eturn code used pairvolchk ss command on SVOL side or pairvolchk ss c command on PVOL side OR you can use pairevtwait ss ssus on both PVOL and SVOL pairevtwait ss ssus l on SVOL locally If you will attempt the pairresync restore or pairsplit S in PVOL_PSUS SVOL_COPY state then HOMRCF will reject this command due to unable to perform In this case you need to wait until the SVol state becomes SVOL_S...

Page 41: ...Async Universal Replicator pair command will be terminated with EX_ENOCTG when the maximum number of CT groups is exceeded Relationships between CTGID and Journal group ID CT group numbers 0 127 are used for TrueCopy Asynchronous TrueCopy Sync CTG and Universal Replicator The rest of the CT group numbers 128 255 are used only for Universal Replicator and are mapped to the journal groups Table 2 5 ...

Page 42: ...lumes are created by the paircreate command and groups of configuration file are mapped to CTGID If more than one group defined in the configuration definition file is assigned to the same CT group ID then pair operations of the group specification apply to the entire CT group R W Resynchronization Asynchronous transfer Process A write 1 write 4 write 5 Process B write 2 write 3 HA Software Packag...

Page 43: ... area 30 to 70 of cache as set on Storage Navigator or SVP default sidefile 40 for TagmaStore USP NSC 50 for 9900V 9900 Write I O control at high water mark HWM When the quantity of data in sidefile reaches 30 of cache the Hitachi TrueCopy Async pair status is HWM of PAIR state and the host write I Os receive delayed response in the range of 0 5 seconds to 4 seconds Following is an arithmetic expr...

Page 44: ...to the S VOL s FIFO queue and the pair status is then set to PSUS SMPL state when all data in the P VOL s FIFO queue has been transmitted PFUL If the quantity of data in sidefile cache exceeds 30 of cache storage the internal status of the RAID storage system is PFUL and host write I Os receive delayed response in the range of 0 5 seconds to 4 seconds PFUS If the quantity of data in sidefile cache...

Page 45: ...map Usual None Note 1 If the host has more Write I Os in COPY state then host Write I Os will be delayed until there is enough space in the sidefile Explanation of terms in Table 2 6 Bitmap Host writes noted without ordering in a delta data bit map Normal Host side writing data is not managed by BITMAP or sidefile Usual Host side writing response is not delayed HWM High Water Mark Sidefile quantit...

Page 46: ... recovered using the pairresync command which merges the S VOL bitmap with the P VOL bitmap shows its situation on the secondary side BITMAP Secondary volume BITMAP FIFO sidefile Secondary volume RCU secondary PSUE PAIR Asynchronous transfer 1 2 3 5 4 ESCON fibre failure 5 3 2 1 Figure 2 11 Hitachi TrueCopy Async Suspension Condition 2 4 3 TrueCopy Sync Async and Universal Replicator Fence Level S...

Page 47: ... O order based on host 1 When fence level is data Mirroring consistency is assured since a write error is returned if mirror consistency with the remote SVOL is lost The secondary volume can continue operation regardless of the status Note A PVOL write that discovers a link down situation will in addition to returning an error to the host likely be recorded on only the PVOL side 2 When fence level...

Page 48: ...ust be defined as data Once the fence level is set to data the P VOL returns an error if data may possibly be inconsistent when a write request is issued by the host Since the writing into the data file has not been executed due to a write error of the redo log file the log file stays consistent with the data file However when the fence level is set to data a write I O error occurs even in the cas...

Page 49: ...py or ShadowImage Swapping paired volume for duplex operation TrueCopy only Restoring secondary volume for duplex operation TrueCopy only Secondary COPY Secondary PSUS Secondary PSUS Primary PAIR Secondary PAIR R W Primary PSUS W Database flushing ePair splitting Read dEvent waiting PAIR Primary COPY gPair resynchronization Primary PSUS Read R W dEvent waiting PSUS cBackup request cDatabase freezi...

Page 50: ... Primary PSUS Read R W fBackup executing hBackup completion R W eDatabase mount r gDatabase unmount differential data After copied the status changes to PSUS Figure 2 14 Backing Up S VOL in Paired Status Using ShadowImage Note When you issue the pairsplit command to a ShadowImage paired volume the pair status changes to COPY and the differential data due to asynchronous copy is copied to the secon...

Page 51: ... e Pair generation Remote Secondary COPY Primary COPY R W R W d unmount Secondary PSUS Primary PSUS W Database flushing R h Event waiting PSUS g Restoration request c Database freezing d Pair splitting Read e Database unfreezing i mount r Secondary PAIR Primary PAIR R W f Event waiting PAIR Figure 2 15 Restoring S VOL to P VOL in Split Status Using Hitachi TrueCopy ...

Page 52: ...abase flushing h Event waiting PSUS g Restoration request c Database freezing d Pair splitting e Database unfreezing i mount r Secondary PAIR Primary PAIR R W f Event waiting PAIR Secondary PSUS Primary PSUS R W R Secondary COPY Primary COPY R W differential data Swapping paired volume Figure 2 16 Restoring S VOL to P VOL in Split Status Using ShadowImage Note When a swap of the primary secondary ...

Page 53: ...ary PAIR Primary PAIR Secondary PAIR R W c Pair splitting Simplex R W d Pair generation No Copy Local c R W stop R W i Pair splitting R W R W Server A Server B d Server swapping instruction Splitting from swapped duplex state e Event waiting PAIR Figure 2 17 Swapping Paired Volume for Duplex Operation Hitachi TrueCopy Only ...

Page 54: ...OPY SMPL SMPL Primary PSUS Secondary PSUS f Pair splitting Simplex g Pair generation No Copy R W R W Server A Server B c Pair splitting Simplex e Event waiting PAIR c DB shutdown d Pair generation Remote d DB completion notification Figure 2 18 Restoring S VOL for Duplex Operation Hitachi TrueCopy Only ...

Page 55: ...r APP to use the same CCI command in order to maintain the compatibility of ShadowImage SnapShot uses two techniques called V VOL mapping and SnapShot using copy on write Also SnapShot volumes are put into pooling volumes called SnapShot pool and the SnapShot pool are specified as pool ID when a SnapShot is made The SnapShot and volume mapping is illustrated in Figure 2 19 SnapShot pool PVOL 10 0 ...

Page 56: ...hot will reply to SCSI Inquiry and Reading and or Writing will be allowed 2 6 2 SnapShot Volume Specifications Allowable type of paired volume The supported volume type is OPEN V only for P VOL and OPEN 0V for S VOL Number of volumes SnapShot can be paired This depends on P VOL capacity SnapShot pool capacity and shared memory capacity on the RAID storage system Duplicated writing mode Copying on ...

Page 57: ... enabled R W disable RCPY The copying state from snapshot to the primary volume by using restore option R W disable R W disable PSUS PFUS The differences of the updated data of the primary and secondary volume are controlled with copying on write R W enabled R W enabled PSUE Error PSUS status owing to an internal failure The differences of the updated data for the snapshot volume are not controlle...

Page 58: ...EV Guard User s Guide for Lightning 9900V and 9900 2 7 1 Database Validator The purpose of Database Validator 9900V and later is to prevent data corruption by checking Oracle data validation before ORACLE data block is written on a disk Data Block corruption Oracle data is corrupted by some intervening software layer and hardware components The RAID storage system can check the validity of the dat...

Page 59: ...t be less than or equal to the minimum of the LVM stripe size and the largest block size that LVM will not fracture known as Logical Track Group in LVM which is 256 KB in LVM When adding new physical volumes PVs to a logical volume LV to be used as an Oracle datafile controlfile or online log in order to have HARD checking take effect on those new PVs the data validation should be re enabled Simil...

Page 60: ...esponding unpopulated volume 0x7F to the device type SIZE 0 volume The RAID storage system replies with SIZE 0 to the target volumes through SCSI Read capacity command Protection of reading The RAID storage system protects from reading the target volumes by responding the check condition of Illegal function SenseKey 0x05 SenseCode 0x2200 Protection of writing The RAID storage system replies with W...

Page 61: ...rating the LVM volumes to be used by DRU Open LDEV guard LVM commands may be writing the volumes and then DRU Open LDEV Guard should be re enabled Data Retention Utility Open LDEV Guard in HA Cluster Server If HA Cluster software will be writing to the metadata at regular intervals in order to confirm whether its disks are available or not then DRU Open LDEV Guard should not be used in HA environm...

Page 62: ...er for the protection checking to the specified volumes raidvchkdsp see section 4 12 2 This command shows the parameter for the protection checking on the specified volumes based on CCI configuration definition file raidvchkscan see section 4 12 3 This command shows the parameter for the protection checking on the specified volumes based on the raidscan command raidvchkscan for the journal status ...

Page 63: ...ition file defined by the user The Hitachi TrueCopy and or ShadowImage user execution environments which contain the TrueCopy ShadowImage commands a command log and a monitoring function 2 8 1 HORCM Operational Environment The HORCM operates as a daemon process on the host server and is activated automatically when the server machine starts up or manually by the start up script HORCM refers to the...

Page 64: ...onment variable HORCC_MRCF The default command execution environment for CCI is Hitachi TrueCopy The CCI instance shown in Figure 2 21 has a remote execution link and a connection to the RAID storage system The remote execution link is a network connection to another PC to allow you to execute CCI functions remotely The connection between the CCI instance and the storage system illustrates the con...

Page 65: ... Connecting the host to one storage system allows you to maintain multiple copies of your data for testing purposes or offline backup Connecting the host to two storage systems enables you to migrate data or implement disaster recovery by maintaining duplicate sets of data in two different storage systems You can implement disaster recovery solutions by placing the storage systems in different geo...

Page 66: ... other Each RAID storage system has a command device which communicates with each CCI instance independently Each storage system contains the primary volumes of its connected CCI instance and the secondary volumes of the other CCI instance located on a different host in this case 2 8 3 Host Machines that Can be Paired Host machines are combined when a paired logical volume is defined provided the ...

Page 67: ...little big little big big 32 bit little AV AV AV AV big AV AV AV AV 64 bit little AV AV AV NA big MPE iX big AV AV NA AV Restriction RAID Manager for MPE iX cannot communicate with 64bit HORCM Restriction RAID Manager s communications among different operating systems is supported on HP UX Solaris AIX Linux and Windows except for Tru64 UNIX Digital UNIX Also RAID Manager does not require that the ...

Page 68: ...ection 3 4 for instructions on creating the CCI configuration file Figure 2 23 illustrates the configuration definition of paired volumes Figure 2 24 shows a sample configuration file for a UNIX based operating system Figure 2 25 shows a sample configuration file for a Windows operating system L4 L3 L2 L1 Group G2 Oradb2 Oradb3 G1 Oradb1 P1 T1 L1 G1 HOSTB G2 Oradb2 P2 T2 L3 G2 Oradb3 P2 T2 L4 G2 H...

Page 69: ...ev_name dev_name dev rdsk c1t0d0 HORCM_DEV dev_group dev_name port TargetID LU MU oradb oradb1 CL1 A 3 1 0 oradb oradb2 CL1 A 3 1 1 oralog oralog1 CL1 A 5 0 oralog oralog2 CL1 A1 5 0 oralog oralog3 CL1 A1 5 1 oralog oralog4 CL1 A1 5 1 h1 HORCM_INST dev_group ip_address service oradb HST2 horcm oradb HST3 horcm oralog HST3 horcm Figure 2 24 Configuration File Example UNIX Based Servers Figure 2 25 ...

Page 70: ... HORCM_CMD defines the UNIX device path or Windows physical device number of the command device The command device must be mapped to the SCSI fibre using the LUN Manager remote console software or SVP You can define more than one command device to provide failover in case the original command device becomes unavailable see section 2 8 6 Note To enable dual pathing of the command device under Solar...

Page 71: ...in the CCI configuration file CCI supports the following naming format specifying Serial LDEV Port as notation of the command device for only Windows CMD Ser ldev Port HORCM_CMD dev_name dev_name dev_name CMD 30095 250 CL1 A To allow more flexibility CCI allows the following format For minimum specification Specifies to use any command device for Serial 30095 CMD 30095 If Windows has two different...

Page 72: ...k c10 dev rhdisk Æ this finds a specified CMD from dev rhdisk The device files discovered during HINT are filtered with the following pattern HP UX dev rdsk or dev rdisk disk Solaris dev rdsk s2 AIX dev rhdisk Linux dev sd zLinux dev sd MPE iX dev Tru64 dev rrz c or dev rdisk dsk c or dev cport scp DYNIX dev rdsk sd IRIX64 dev rdsk vol or dev rdsk node_wwn vol If a HINT is already specified HINT c...

Page 73: ...ume within a group i e name of the special file or unique logical volume The name of paired logical volume must be different than the dev name on another group Port Defines the RAID storage system port number of the volume that corresponds with the dev_name volume The following n shows unit ID when the server is connected to two or more storage systems e g CL1 A1 CL1 A in unit ID 1 If the n option...

Page 74: ...al volume on the specified port See Appendix C for further information on fibre address conversion LU Defines the SCSI fibre logical unit number LU of the physical volume on the specified target ID and port Note In case of fibre channel if the TID and LU displayed on the system are different than the TID on the fibre address conversion table then you must use the TID and LU indicated by the raidsc...

Page 75: ...the remote server active or standby It is used to refer to or change the status of the paired volume in the remote server active or standby When the primary volume is shared by two or more servers there are two or more remote servers using the secondary volume Thus it is necessary to describe the addresses of all of these servers The following values are defined in the HORCM_INST parameter dev_gro...

Page 76: ...Hitachi RAID Storage Hitachi RAID Storage PVOL SVOL Oradb HORCM_MON ip_address service poll 10ms timeout 10ms NONE horcm 1000 3000 HORCM_INST dev_group ip_address service oradb HST1_IPA horcm oradb HST1_IPB horcm Figure 2 27 Configuration for Multiple Networks For example horcctl ND g IP46G Current network address 158 214 135 106 services 50060 horcctl NC g IP46G Changed network address 158 214 13...

Page 77: ...roup dev_name Serial LDEV MU IPV6G dev1 63502 577 For HORCM_INST HORCM_INST dev_group ip_address service IPV6G fe80 202 a5ff fe55 c1d2 horcm0 HORCM_MON ip_address service poll 10ms timeout 10ms NONE6 horcm0 1000 3000 fe80 202 a5ff fe55 c1d2 horcm0 1000 3000 For HORCM_CMD HORCM_CMD dev_name UnitID 0 Serial 63502 dev rdsk c1t0d0s2 For HORCM_LDEV HORCM_LDEV dev_group dev_name Serial LDEV MU IPV6G dev...

Page 78: ...dev1 63502 577 For HORCM_INST HORCM_INST dev_group ip_address service IPM4G 158 214 135 105 horcm6 HORCM_MON ip_address service poll 10ms timeout 10ms NONE6 horcm6 1000 3000 ffff 158 214 135 105 horcm6 1000 3000 For HORCM_CMD HORCM_CMD dev_name UnitID 0 Serial 63502 dev rdsk c1t0d0s2 For HORCM_LDEV HORCM_LDEV dev_group dev_name Serial LDEV MU IPM4G dev1 63502 677 For HORCM_INST HORCM_INST dev_grou...

Page 79: ...name UnitID 0 Serial 63502 dev rdsk c1t0d0s2 For HORCM_LDEV HORCM_LDEV dev_group dev_name Serial LDEV MU IP46G dev1 63502 577 For HORCM_INST HORCM_INST dev_group ip_address service IP46G 158 214 135 105 horcm4 IP46G fe80 202 a5ff fe55 c1d2 horcm6 HORCM_MON ip_address service poll 10ms timeout 10ms NONE6 horcm6 1000 3000 For HORCM_CMD HORCM_CMD dev_name UnitID 0 Serial 63502 dev rdsk c1t0d0s2 For H...

Page 80: ...0095 02 40 0 oradb dev2 30095 02 41 0 Specifying CU LDEV in hex used by SVP or Web console Example for LDEV 260 01 04 Specifying LDEV in decimal used by inqraid command of RAID Manager Example for LDEV 260 260 Specifying LDEV in hex used by inqraid command of RAID Manager Example for LDEV 260 0x104 Note HORCM_LDEV format can be used for Lightning 9900V and later LDEV will be converted to Port Targ...

Page 81: ...to an alternate command device if one is defined If a command device is blocked e g online maintenance you can switch to an alternate command device manually If no alternate command device is defined or available all Hitachi TrueCopy and ShadowImage commands will terminate abnormally and the host will not be able to issue commands to the storage system The user must set one or more alternate comma...

Page 82: ...g of alternate command devices When the HORCM receives an error notification in reply from the operating system via the raw I O interface the command device is alternated It is possible to alternate the command device forcibly by issuing an alternating command provided by Hitachi TrueCopy horcctl C Operation of alternating command If the command device will be blocked due to online maintenance e g...

Page 83: ...al disk viewed from the SCSI interface the operating system may access the control area of its local The RAID storage system must distinguish such accesses from the control command accesses Normally several megabytes of the OS control area is used from the initial LAB To avoid using this area a specific LBA area is decided and control commands are issued within this area The command LAB recognized...

Page 84: ... two or more WR commands to a single LDEV unless the storage system can receive commands with independent initiator number LDEV number simultaneously Hitachi RAID Command device RD WR command Command process HORCM CCI Command process Command process Figure 2 34 HORCM and Command Issue Process 2 8 7 2 Flow of Commands Figure 2 35 shows the flow of RD WR command control in a specified LBA Write Comm...

Page 85: ...le logical unit Since it is necessary to know about the configuration of the LDEVs when issuing a command a new command is used This command specifies a target LU and acquires LDEV configuration data see Figure 2 36 LDEV n LDEV n 1 LDEV n 2 Command area Special LDEV space Initial LBA of command Target LU Port SCSI ID LU Special LDEV Figure 2 36 LUSE Device and Command Issue ...

Page 86: ...C c Converting to LDKC and 2 byte LDEV returns the LDEV number to the host by converting from 4 byte LDEV to LDKC and 2 byte LDEV LDKC 0 or 1 for 128K LDEVs internal DKC LDEV 64K LDEV for the Host internal DKC LDEV 64K d Converting to 4 byte LDEV converts as internal LDEV from LDKC and 2 byte LDEV to 4 byte LDEV internal DKC LDEV 64K LDKC 0 or 1 for 128K LDEVs LDEV from the host e Filtering to 2 b...

Page 87: ... and CCI support this protection in order to guard from the similar access 2 8 9 1 Guarding Method Currently assignment of the instance via the command device is ONE phase Therefore if the command device will be read a special allocation area of the instance through the maintenance tool and so on then it causes a fault of full space of the instance because the command device interprets as assignme...

Page 88: ...lear up all temporary allocation 1 0 and re assigns the required instance automatically This does not require a service personnel to do OFF ON of the command device for clear up the instance table 2 8 9 2 Verifying the RM Instance Number RAID Manager provides a way to verify number of temporary allocation 1 0 and actual allocation 1 1 on the instance table so that a user can confirm own validity o...

Page 89: ...08 Event waiting usr bin pairevtwait pairevtwait 0544 root sys 09 Error notification usr bin pairmon pairmon 0544 root sys 10 Volume check usr bin pairvolchk pairvolchk 0544 root sys 11 Pair configuration confirmation usr bin pairdisplay pairdisplay 0544 root sys 12 RAID scanning usr bin raidscan raidscan 0544 root sys 13 RAID activity reporting usr bin raidar raidar 0544 root sys 14 Connection co...

Page 90: ... control HORCM etc horcctl exe horcctl 016 HORCM activation script HORCM etc horcmstart exe horcmstart 017 HORCM shutdown script HORCM etc horcmshutdown exe horcmshutdown 018 Synchronous waiting HORCM etc pairsyncwait exe pairsyncwait 019 Connection confirmation HORCM etc inqraid exe inqraid 020 Configuration file making HORCM Tool mkconf exe mkconf 021 Oracle Validation setting HORCM etc raidvchk...

Page 91: ...n HORCM usr bin raidqry exe raidqry 039 Oracle Validation setting HORCM usr bin raidvchkset raidvchkset 040 Oracle Validation confirmation HORCM usr bin raidvchkdsp raidvchkdsp 041 Oracle Validation confirmation HORCM usr bin raidvchkscan raidvchkscan Notes The HORCM etc commands are used from the console window If these commands are executed without an argument the interactive mode will start up ...

Page 92: ...sr bin raidscan exe raidscan sys 013 RAID activity report ROOT HORCM usr bin raidar exe raidar sys 014 Connection confirmation ROOT HORCM usr bin raidqry exe raidqry sys 015 Trace control ROOT HORCM usr bin horcctl exe horcctl sys 016 HORCM activation script ROOT HORCM usr bin horcmstart exe horcmstart sh sys 017 HORCM shutdown script ROOT HORCM usr bin horcmshutdown exe horcmshutdown sh sys 018 C...

Page 93: ... for Windows based platforms are defined in a text file The host reads the script file and sends the commands to the command device to execute the TrueCopy ShadowImage operations automatically The CCI scripts are HORCM startup script horcmstart sh horcmstart exe A script which starts HORCM etc horcmgr sets environmental variables as needed e g HORCM_CONF HORCM_LOG HORCM_LOGS and starts HORCM HORCM...

Page 94: ...does not need to be labeled during format command AIX HORCM_CMD of HOSTA dev rhdiskXX HORCM_CMD of HOSTB dev rhdiskXX where XX device number assigned by AIX Tru64 UNIX HORCM_CMD of HOSTA dev rrzbXXc HORCM_CMD of HOSTB dev rrzbXXc where XX device number assigned by Tru64 UNIX DYNIX ptx HORCM_CMD of HOSTA dev rdsk sdXX HORCM_CMD of HOSTB dev rdsk sdXX where XX device number assigned by DYNIX ptx Win...

Page 95: ...e Seq P LDEV M oradb oradev1 L CL1 A 1 1 30053 18 P VOL COPY NEVER 30054 19 oradb oradev1 R CL1 D 2 1 30054 19 S VOL COPY NEVER 18 oradb oradev2 L CL1 A 1 2 30053 20 P VOL COPY NEVER 30054 21 oradb oradev2 R CL1 D 2 2 30054 21 S VOL COPY NEVER 20 Example of CCI commands with HOSTB Designate a group name and a remote host P VOL a case paircreate g Oradb f never vr This command creates pairs for all...

Page 96: ... dev rhdiskXX where XX device number assigned by AIX Tru64 UNIX HORCM_CMD of HOSTA dev rrzbXXc HORCM_CMD of HOSTB dev rrzbXXc where XX device number assigned by Tru64 UNIX DYNIX ptx HORCM_CMD of HOSTA dev rdsk sdXX HORCM_CMD of HOSTB dev rdsk sdXX where XX device number assigned by DYNIX ptx Windows 2008 2003 2000 HORCM_CMD of HOSTA CMD Ser ldev Port HORCM_CMD of HOSTB CMD Ser ldev Port Windows NT...

Page 97: ...etID LU Oradb oradev1 CL1 D 2 1 Oradb oradev2 CL1 D 2 2 HORCM_INST dev_group ip_address service Oradb HST1 horcm Configuration file for HOSTB etc horcm conf LAN Tx Target ID Lx LUN Note Use of command device by user is not possible command device established from Remote Console PC or SVP Ip address HST2 A B CL1 Oradb oradev1 oradev2 P Vol P Vol T1 L1 T1 L2 Command device T0 L1 C D CL1 S Vol S Vol ...

Page 98: ... NEVER 18 oradb oradev2 L CL1 A 1 2 30053 20 P VOL COPY NEVER 30053 21 oradb oradev2 R CL1 D 2 2 30053 21 S VOL COPY NEVER 20 Example of CCI commands with HOSTB Designate a group name and a remote host P VOL a case paircreate g Oradb f never vr This command creates pairs for all LU designated as Oradb in the configuration definition file two pairs for the configuration in Figure 2 41 Designate a v...

Page 99: ...ersion 01 09 03 04 and higher the command device does not need to be labeled during format command AIX HORCM_CMD of HORCMINST0 dev rhdiskXX HORCM_CMD of HORCMINST1 dev rhdiskXX where XX device number assigned by AIX Tru64 UNIX HORCM_CMD of HORCMINST0 dev rrzbXXc HORCM_CMD of HORCMINST1 dev rrzbXXc where XX device number assigned by Tru64 UNIX DYNIX ptx HORCM_CMD of HORCMINST0 dev rdsk sdXX HORCM_C...

Page 100: ...ev1 CL1 D 2 1 Oradb oradev2 CL1 D 2 2 HORCM_INST dev_group ip_address service Oradb HST1 horcm0 Configuration file for HORCMINST1 horcm1 conf LAN Tx Target ID Lx LUN Note Use of command device by user is not possible command device established from Remote Console PC or SVP A B CL1 Oradb oradev1 oradev2 P Vol P Vol T1 L1 T1 L2 Command device T0 L1 C D CL1 S Vol S Vol T2 L2 T2 L1 T0 L1 Hitachi RAID ...

Page 101: ...19 S VOL COPY NEVER 18 oradb oradev2 L CL1 A 1 2 30053 20 P VOL COPY NEVER 30053 21 oradb oradev2 R CL1 D 2 2 30053 21 S VOL COPY NEVER 20 Example of CCI commands with Instance 1 on HOSTA When the command execution environment is not set set an instance number For C shell setenv HORCMINST 1 For Windows set HORCMINST 1 Designate a group name and a remote instance P VOL a case paircreate g Oradb f n...

Page 102: ...OSTA dev rhdiskXX HORCM_CMD of HOSTB dev rhdiskXX HORCM_CMD of HOSTC dev rhdiskXX HORCM_CMD of HOSTD dev rhdiskXX where XX device number assigned by AIX Tru64 UNIX HORCM_CMD of HOSTA dev rrzbXXc HORCM_CMD of HOSTB dev rrzbXXc HORCM_CMD of HOSTC dev rrzbXXc HORCM_CMD of HOSTD dev rrzbXXc where XX device number assigned by Tru64 UNIX DYNIX ptx HORCM_CMD of HOSTA dev rdsk sdXX HORCM_CMD of HOSTB dev ...

Page 103: ...D of HOSTD dev sdX where X device number assigned by Linux zLinux IRIX HORCM_CMD for HOSTA dev rdsk dks0d0l1vol or dev rdsk node_wwn lun1vol c0p0 HORCM_CMD for HOSTB dev rdsk dks1d0l1vol or dev rdsk node_wwn lun1vol c1p0 HORCM_CMD for HOSTC dev rdsk dks1d0l1vol or dev rdsk node_wwn lun1vol c1p0 HORCM_CMD for HOSTD dev rdsk dks1d0l1vol or dev rdsk node_wwn lun1vol c1p0 ...

Page 104: ...le C1 dev rdsk c1t2d1 dev rdsk c1t2d2 dev rdsk c1t0d1 Fibre port LAN A B C D CL1 Hitachi RAID Storage System Command device T0 L1 A B C D CL2 T0 L1 HOST A HORCM CONF file Ip address HST1 C0 dev rdsk c0t1d1 dev rdsk c0t1d2 dev rdsk c0t0d1 Fibre channel Fibre channel Fibre port Oradb oradev1 oradev2 P Vol T1 L1 S Vol S Vol T2 L2 T2 L1 Oradb1 oradev1 1 oradev1 2 P Vol L MU 1 S Vol S Vol T2 L2 T2 L1 O...

Page 105: ...ev_name port TargetID LU MU Oradb oradev1 CL2 B 2 1 Oradb oradev2 CL2 B 2 2 HORCM_INST dev_group ip_address service Oradb HST1 horcm Configuration file for HOSTB etc horcm conf HORCM_MON ip_address service poll 10ms timeout 10ms HST3 horcm 1000 3000 HORCM_CMD dev_name dev xxx Note 1 HORCM_DEV dev_group dev_name port TargetID LU MU Oradb1 oradev1 1 CL2 C 2 1 Oradb1 oradev1 2 CL2 C 2 2 HORCM_INST de...

Page 106: ... S VOL COPY 18 oradb oradev2 L CL1 A 1 2 0 30053 19 P VOL COPY 30053 21 oradb oradev2 R CL2 B 2 2 0 30053 21 S VOL COPY 19 Example of CCI commands with HOSTB group Oradb When the command execution environment is not set set HORCC_MRCF to the environment variable For C shell setenv HORCC_MRCF 1 Windows set HORCC_MRCF 1 Designate a group name and a remote host P VOL a case paircreate g Oradb vr This...

Page 107: ...30053 22 S VOL COPY 18 oradb1 oradev1 2 L CL1 A 1 2 1 30053 19 P VOL COPY 30053 23 oradb1 oradev1 2 R CL2 C 2 2 0 30053 23 S VOL COPY 19 Example of CCI commands with HOSTC group Oradb1 When the command execution environment is not set set HORCC_MRCF to the environment variable For C shell setenv HORCC_MRCF 1 For Windows set HORCC_MRCF 1 Designate a group name and a remote host P VOL a case paircre...

Page 108: ...L COPY 18 oradb2 oradev2 2 L CL1 A 1 2 2 30053 19 P VOL COPY 30053 25 oradb2 oradev2 2 R CL2 D 2 2 0 30053 25 S VOL COPY 19 Example of CCI commands with HOSTD group Oradb2 When the command execution environment is not set set HORCC_MRCF to the environment variable For C shell setenv HORCC_MRCF 1 For Windows set HORCC_MRCF 1 Designate a group name and a remote host P VOL a case paircreate g Oradb2 ...

Page 109: ...ersion 01 09 03 04 and higher the command device does not need to be labeled during format command AIX HORCM_CMD of HORCMINST0 dev rhdiskXX HORCM_CMD of HORCMINST1 dev rhdiskXX where XX device number assigned by AIX Tru64 UNIX HORCM_CMD of HORCMINST0 dev rrzbXXc HORCM_CMD of HORCMINST1 dev rrzbXXc where XX device number assigned by Tru64 UNIX DYNIX ptx HORCM_CMD of HORCMINST0 dev rdsk sdXX HORCM_C...

Page 110: ... CL1 D 2 2 0 Oradb1 oradev11 CL1 D 2 1 1 Oradb1 oradev12 CL1 D 2 2 1 Oradb2 oradev21 CL1 D 2 1 2 Oradb2 oradev22 CL1 D 2 2 2 HORCM_INST dev_group ip_address service Oradb HST1 horcm0 Oradb1 HST1 horcm0 Oradb2 HST1 horcm0 Configuration file for HOSTA etc horcm1 conf A B CL1 Oradb oradev1 oradev2 P Vol P Vol T1 L1 T1 L2 Command device T0 L1 C D CL1 S P Vol S P Vol T2 L2 T2 L1 T0 L1 Hitachi RAID Stor...

Page 111: ...1 L CL1 A 1 1 0 30053 266 P VOL PAIR 30053 268 oradb oradev1 R CL1 D 2 1 0 30053 268 S VOL PAIR 266 oradb1 oradev11 R CL1 D 2 1 1 30053 268 P VOL PAIR 30053 270 oradb2 oradev21 R CL1 D 2 1 2 30053 268 SMPL oradb oradev2 L CL1 A 1 2 0 30053 267 P VOL PAIR 30053 269 oradb oradev2 R CL1 D 2 2 0 30053 269 S VOL PAIR 267 oradb1 oradev12 R CL1 D 2 2 1 30053 269 P VOL PAIR 30053 271 oradb2 oradev22 R CL1...

Page 112: ...e If this restriction is exceeded then use a different SCSI path for each instance For example the command devices for Figure 2 45 would be HP UX HORCM_CMD of HOSTA etc horcm conf dev rdsk c0t0d1 HORCM_CMD of HOSTB etc horcm conf dev rdsk c1t0d1 HORCM_CMD of HOSTB etc horcm0 conf dev rdsk c1t0d1 Solaris HORCM_CMD of HOSTA etc horcm conf dev rdsk c0t0d1s2 HORCM_CMD of HOSTB etc horcm conf dev rdsk ...

Page 113: ... conf CMD Ser ldev Port HORCM_CMD of HOSTB etc horcm0 conf CMD Ser ldev Port Linux zLinux HORCM_CMD of HOSTA etc horcm conf dev sdX HORCM_CMD of HOSTB etc horcm conf dev sdX HORCM_CMD of HOSTB etc horcm0 conf dev sdX where X device number assigned by Linux zLinux IRIX HORCM_CMD for HOSTA etc horcm conf dev rdsk dks0d0l1vol or dev rdsk node_wwn lun1vol c0p0 HORCM_CMD for HOSTB etc horcm conf dev rd...

Page 114: ...MU Oradb oradev1 CL1 D 2 1 Oradb oradev2 CL1 D 2 2 Oradb1 oradev11 CL1 D 2 1 0 Oradb1 oradev12 CL1 D 2 2 0 Oradb2 oradev21 CL1 D 2 1 1 Oradb2 oradev22 CL1 D 2 2 1 HORCM_INST dev_group ip_address service Oradb HST1 horcm Oradb1 HST2 horcm0 Oradb2 HST2 horcm0 HORCM_MON ip_address service poll 10ms timeout HST2 horcm0 1000 3000 HORCM_CMD dev_name dev xxx Note 1 HORCM_DEV dev_groupdev_name port TID LU...

Page 115: ...SMPL oradb oradev1 L CL1 A 1 1 30052 266 P VOL COPY 30053 268 oradb1 oradev11 R CL1 D 2 1 0 30053 268 P VOL COPY 30053 270 oradb2 oradev21 R CL1 D 2 1 1 30053 268 SMPL oradb oradev1 R CL1 D 2 1 30053 268 S VOL COPY 266 oradb oradev2 L CL1 A 1 2 0 30052 267 SMPL oradb oradev2 L CL1 A 1 2 30052 267 P VOL COPY 30053 269 oradb1 oradev12 R CL1 D 2 2 0 30053 269 P VOL COPY 30053 271 oradb2 oradev22 R CL...

Page 116: ... Seq LDEV P S Status Seq P LDEV M oradb1 oradev11 L CL1 D 2 1 0 30053 268 P VOL PAIR 30053 270 oradb2 oradev21 L CL1 D 2 1 1 30053 268 SMPL oradb oradev1 L CL1 D 2 1 30053 268 S VOL PAIR 266 oradb1 oradev11 R CL1 D 3 1 0 30053 270 S VOL PAIR 268 oradb1 oradev12 L CL1 D 2 2 0 30053 269 P VOL PAIR 30053 271 oradb2 oradev22 L CL1 D 2 2 1 30053 269 SMPL oradb oradev2 L CL1 D 2 2 30053 269 S VOL PAIR 2...

Page 117: ...file Oradb1 Oradb LDEV MU 1 2 Oradb2 3 MU 3 63 Oradb7 ShadowImage TrueCopy MU 0 MU 1 3 Oradb4 6 UR Figure 2 46 Mirror Descriptors and Group Assignment 2 9 1 1 Correspondence of the Configuration File and Mirror Descriptors The group name and MU which are described in HORCM_DEV of a configuration definition file are assigned the corresponding mirror descriptors as outlined in Table 2 13 Omission of...

Page 118: ...11 oradev21 HORCM_DEV dev_group dev_name port TargetID LU MU Oradb oradev1 CL1 D 2 1 Oradb1 oradev11 CL1 D 2 1 0 Oradb2 oradev21 CL1 D 2 1 1 Oradb3 oradev31 CL1 D 2 1 2 oradev1 oradev11 oradev21 oradev31 HORCM_DEV dev_group dev_name port TargetID LU MU Oradb oradev1 CL1 D 2 1 0 oradev1 HORCM_DEV dev_group dev_name port TargetID LU MU Oradb oradev1 CL1 D 2 1 0 Oradb1 oradev1 CL1 D 2 1 1 Oradb2 orad...

Page 119: ...le of this HORCM_DEV dev_group dev_name port TargetID LU MU Oradb oradev1 CL1 D 3 0 0 Oradb1 oradev11 CL1 D 3 4 0 Oradb2 oradev21 CL1 D 3 6 0 HORCM_INST dev_group ip_address service Oradb HST1 horcm1 Oradb1 HST1 horcm1 Oradb2 HST1 horcm1 HORCM_DEV dev_group dev_name port TargetID LU MU Oradb oradev1 CL1 D 3 2 0 Oradb1 oradev11 CL1 D 3 2 1 Oradb2 oradev21 CL1 D 3 2 2 HORCM_INST dev_group ip_address...

Page 120: ...db2 1 2 0 0 pairdisplay g oradb m cas Group PairVol L R Port TID LU M Seq LDEV P S Status Seq P LDEV M oradb oradev1 L CL1 D 3 0 0 30053 266 P VOL PAIR 30053 268 oradb oradev1 R CL1 D 3 2 0 30053 268 S VOL PAIR 266 oradb1 oradev11 R CL1 D 3 2 1 30053 268 P VOL PAIR 30053 270 oradb2 oradev21 R CL1 D 3 2 2 30053 268 P VOL PAIR 30053 272 Figure 2 48 Pairdisplay on HORCMINST0 S P VOL 268 PVOL 266 270 ...

Page 121: ... dev rdsk c0t3d4 m cas Group PairVol L R Port TID LU M Seq LDEV P S Status Seq P LDEV M oradb1 oradev11 L CL1 D 3 4 0 30053 270 S VOL PAIR 268 oradb1 oradev11 R CL1 D 3 2 1 30053 268 P VOL PAIR 30053 270 oradb oradev1 R CL1 D 3 2 0 30053 268 S VOL PAIR 266 oradb2 oradev21 R CL1 D 3 2 2 30053 268 P VOL PAIR 30053 272 Figure 2 50 Pairdisplay on HORCMINST0 ...

Page 122: ...orcm Oradb HST2 horcm0 HORCM_DEV group dev_name port TID LU MU Oradb oradev1 CL1 D 3 2 Oradb1 oradev11 CL1 D 3 2 0 Oradb2 oradev21 CL1 D 3 2 1 HORCM_INST dev_group ip_address service Oradb HST1 horcm Oradb1 HST2 horcm0 Oradb2 HST2 horcm0 HORCM_DEV group dev_name port TID LU MU Oradb oradev1 CL1 D 3 2 Oradb1 oradev11 CL1 D 3 4 0 Oradb2 oradev21 CL1 D 3 6 0 HORCM_INST dev_group ip_address service Or...

Page 123: ...30053 268 P VOL COPY 30053 270 oradb2 oradev21 R CL1 D 3 2 1 30053 268 P VOL PSUS 30053 272 W oradb oradev1 R CL1 D 3 2 30053 268 S VOL COPY 266 Figure 2 52 Pairdisplay for Hitachi TrueCopy on HOST1 S P VOL 268 PVOL 266 270 272 Oradb Oradb1 Oradb2 0 1 0 SMPL Seq 30052 Seq 30053 pairdisplay g oradb m cas Group PairVol L R Port TID LU M Seq LDEV P S Status Seq P LDEV M oradb1 oradev11 L CL1 D 3 2 0 ...

Page 124: ... 0 1 0 dev rdsk c0t3d4 Seq 30053 pairdisplay g oradb1 m cas Group PairVol L R Port TID LU M Seq LDEV P S Status Seq P LDEV M oradb1 oradev11 L CL1 D 3 4 0 30053 270 S VOL PAIR 268 oradb1 oradev11 R CL1 D 3 2 0 30053 268 P VOL PAIR 30053 270 oradb2 oradev21 R CL1 D 3 2 1 30053 268 P VOL PSUS 30053 272 W oradb oradev1 R CL1 D 3 2 30053 268 S VOL PAIR 266 pairdisplay d dev rdsk c0t3d4 m cas Group Pai...

Page 125: ...mal Hitachi TrueCopy operation an error message is displayed by Storage Navigator and SVP However no error message may be displayed depending on the system operation form Since the operation management of the UNIX server checks Syslog to find system errors in many cases Hitachi TrueCopy error messages are output to Syslog for linkage with the system operation management Error notification command ...

Page 126: ...tatus Fence Seq Pair LDEV G1 Oradb1 L P1 T1 L1 Seq 20 P VOL Pair Never Seq 30 G1 Oradb1 R P2 T2 L2 Seq 30 S VOL Pair Never Seq 20 G1 Oradb1 P1 T1 L1 G1 HOSTB Primary LDEV 20 Secondary LDEV 30 Paired logical volumes G1 Oradb1 P1 T1 L1 Port Target LUN P2 T2 L2 HOSTA G1 Oradb1 P2 T2 L2 G1 HOSTA Special file HOSTB Special file Configuration definition file Configuration definition file Hitachi RAID Se...

Page 127: ...l P Vol c d Host A goes down Host A Host B P Vol S Vol Host A Host B P Vol Svol SSUS SSWS Host A Host B S Vol P Vol c d e Difference Pvol goes down Mirror state Takeover state Recovery state c A failure occurs in the host A server 1 top or in the Pvol 1 bottom d Host B detects the failure of host A or the Pvol and issues a takeover command to make the SVOL usable Host B takes over processing from ...

Page 128: ...riting The fence level determines whether host A continues processing or host B takes over the processing from host A d The PVOL changes the paired volume status to PSUE and keeps track of the difference data The HORCM detects the status change and outputs a message to syslog If the client of host A has initiated the monitoring command the message concerned is displayed on the screen of the client...

Page 129: ...his chapter covers the following topics System requirements section 3 1 Hardware installation section 3 2 Software installation section 3 3 Creating editing the configuration file section 3 4 Porting notice for OpenVMS section 3 5 CCI startup section 3 6 Starting CCI as a Service Windows Systems section 3 7 ...

Page 130: ...city minimum 300 KB maximum 500 KB Dynamic memory capacity set in HORCM_CONF maximum 500 KB per unit ID CCI supports several failover products including FirstWatch MC ServiceGuard HACMP TruCluster and ptx CLUSTERS Please contact your Hitachi Data Systems account team for the latest information on failover software support for CCI The system which runs and operates Hitachi TrueCopy in an HA configu...

Page 131: ...een the primary and secondary volumes The port modes LCP RCP RCU target etc and MCU RCU paths must be defined TrueCopy Async TrueCopy Async option must be installed and enabled ShadowImage ShadowImage must be installed and enabled on the storage system s Minimum 9900V microcode for Host Group support is 21 06 00 Database Validator All USP V VM and USP NSC features support Database Validator The 99...

Page 132: ...bre Digital UNIX 4 0 TruCluster LSM SCSI Tru64 UNIX 5 0 TruCluster LSM SCSI Fibre OpenVMS 7 3 1 Fibre IBM DYNIX ptx 4 4 ptx Custer LVM SCSI Fibre AIX 4 3 HACMP LVM SCSI Fibre zLinux Suse 8 For restrictions on zLinux see section 3 1 3 Fibre FCP Microsoft Windows NT 4 0 Windows 2000 2003 2008 MSCS LDM Fibre iSCSI Windows 2003 2008 on IA64 Windows 2003 2008 on EM64T MSCS LDM Fibre Red Hat Red Hat Lin...

Page 133: ...SM SCSI Tru64 UNIX 5 0 TruCluster LSM SCSI Fibre OpenVMS 7 3 1 Fibre IBM DYNIX ptx 4 4 ptx Custer LVM SCSI Fibre AIX 4 3 HACMP LVM SCSI Fibre zLinux Suse 8 For restrictions on zLinux see section 3 1 3 Fibre FCP Microsoft Windows NT 4 0 Windows 2000 2003 2008 MSCS LDM iSCSI Fibre Windows 2003 2008 on IA64 Windows 2003 2008 on EM64T MSCS LDM Fibre Red Hat Red Hat Linux 6 0 7 0 AS2 1 3 0 4 0 SCSI Fib...

Page 134: ...4 UNIX 5 0 TruCluster LSM SCSI Fibre OpenVMS 7 3 1 Fibre IBM DYNIX ptx 4 4 ptx Custer LVM SCSI Fibre AIX 4 3 HACMP LVM SCSI Fibre zLinux Suse 8 For restrictions on zLinux see section 3 1 3 Fibre FCP Microsoft Windows NT 4 0 Windows 2000 2003 2008 MSCS LDM iSCSI Fibre Windows 2003 2008 on IA64 Windows 2003 2008 on EM64T MSCS LDM Fibre Red Hat Red Hat Linux 6 0 7 0 AS 2 1 3 0 4 0 SCSI Fibre AS 2 1 3...

Page 135: ...nVMS 7 3 1 TruCluster LSM Fibre SGI IRIX 64 6 5 Fibre IA64 using IA 32EL on IA64 except CCI for Linux IA64 Please refer to section 5 1 1 about RHEL 4 0 using Kernel 2 6 9 XX Table 3 5 Supported Platforms for Copy on Write Snapshot Vendor Operating System Failover Software Volume Manager I O Interface Solaris 2 8 VxVM Fibre SUN Solaris 10 x86 VxVM Fibre HP HP UX 11 0 11 2x LVM SLVM Fibre HP UX 11 2...

Page 136: ...3 VIO Server Note 2 Server AIX 5 3 See 4 in section 3 1 4 2 Direct Fibre RDM Raw Device Mapping using Physical Compatibility Mode Note 1 Please refer to section 3 1 4 1 about restrictions on VMware ESX Server Note 2 Please refer to section 3 1 4 2 about restrictions on AIX VIO Table 3 7 Supported Platforms IPv6 vs IPv6 CCI IPv6 Note 1 IPv6 IPv6 HP UX Solaris AIX Windows Linux Tru64 HP UX OpenVMS H...

Page 137: ...DYNIX N A N A N A N A N A N A N A Note 1 Please refer to section 3 1 5 about platform support for IPv6 AV Available for communicating with different platforms N A Not Applicable Windows LH does not support IPv4 mapped IPv6 Minimum platform versions for CCI IPv6 support HP UX HP UX 11 23 PA IA or later Solaris Solaris 8 Sparc or later Solaris 10 x86 64 or later AIX AIX 5 1 or later Windows Windows ...

Page 138: ... raidvchkdsp raidvchkscan The following XP API CLI commands are rejected with EX_ERPERM 2 on HITACHI storage system even when both CCI and Raid Manager XP provided by HP are installed pairvolchk s pairdisplay CLI raidscan CLI paircreate m noread for TrueCopy paircreate m dif inc for ShadowImage Table 3 9 Relationship between CCI and RAID Storage System CCI Version Installation RAID System Common A...

Page 139: ... use XP API CLI on XP array only Figure 3 1 Relationship between APP CCI and Storage System 3 1 3 Restrictions on zLinux In the following example zLinux defines the Open Volumes that are connected to FCP as dev sd Also the mainframe volumes 3390 xx that are connected to FICON are defined as dev dasd LDEV 18 RAID zLinux RM MVS OPEN 3390 9A Command device FICON FCP ZVM Z990 Figure 3 2 Example of a R...

Page 140: ... volume information by using SCSI inquiry FICON volumes can only be discovered by using RAID Manager to convert the mainframe interface Read_device_characteristics or Read_configuration_data to SCSI Inquiry As such the information that is required to run the inqraid command cannot be implemented as shown in the following example sles8z HORCM usr bin ls dev dasd inqraid dev dasda ST Unknown Ser 192...

Page 141: ...e supported guest OS e g Windows Server 2003 Red Hat Linux SuSE Linux Refer to Table 3 6 in section 3 1 1 2 Command device CCI uses SCSI path through driver to access the command device Therefore the command device must be mapped as Raw Device Mapping using Physical Compatibility Mode At least one command device must be assigned for each guest OS 3 CCI RM instance numbers among different guest OS ...

Page 142: ...CSI Inquiry so CCI will perform like running on Linux regardless of guest OS However VMware protects the service console with a firewall According to current documentation the firewall allows only PORT 902 80 443 22 SSH and ICMP ping DHCP DNS as defaults so the CCI user must enable a PORT for CCI HORCM using the iptables command 3 1 4 2 Restrictions on AIX VIO Whether CCI can function completely o...

Page 143: ...d command lsdev Cc disk HORCM usr bin inqraid hdisk0 NOT supported INQ AIX VDASD hdisk1 NOT supported INQ AIX VDASD hdisk2 NOT supported INQ AIX VDASD hdisk19 NOT supported INQ AIX VDASD The following commands option discovers the volumes by issuing SCSI inquiry These commands option cannot be used because there is no Port LDEV for RAID information raidscan pd device raidar pd device raidvchkscan ...

Page 144: ...if an OLD platform e g Windows NT HP UX 10 20 Solaris 5 does not support it So CCI links dynamically above functions by resolving the symbol after determining whether the shared library and function for IPv6 exists It depends on supporting of the platform whether CCI can support IPv6 or not If platform does not support IPv6 library then CCI uses its own internal function corresponding to inet_pton...

Page 145: ...as default for specifying to the getaddrinfo function for IPv6 For example export IPV6_GET_ADDR 9 horcmstart sh 10 HORCM Start Up Log Support level of IPv6 feature depends on the platform and OS version In certain OS platform environments CCI will not be able to perform IPv6 communication completely so CCI logs the results of whether the OS environment supports the IPv6 feature or not HORCM log cu...

Page 146: ...orrect e Hitachi TrueCopy only install the remote copy connections between the TrueCopy main and remote control units MCUs and RCUs For detailed information on installing the TrueCopy remote copy connections please refer to the Hitachi TrueCopy User and Reference Guide for the storage system 3 User and Hitachi Data Systems Rep Ensure that the storage systems are accessible via Storage Navigator Fo...

Page 147: ...d file modification times m flag and copy unconditionally u flag For floppy disks load them sequentially and repeat the command An I O device name of floppy disk designates a surface partition of the raw device file unpartitioned raw device file 4 Execute the HORCM installation command HORCM horcminstall sh 5 Verify installation of the proper version using the raidqry command raidqry h Model RAID ...

Page 148: ...s using q option 2 Insert the installation medium e g CD ROM into the proper I O device 3 Move to the directory containing the HORCM directory e g cd for root directory 4 Copy all files from the installation medium using the cpio command cpio idmu dev XXXX XXXX I O device Preserve the directory structure d flag and file modification times m flag and copy unconditionally u flag For floppy disks loa...

Page 149: ...te the installation 4 Verify installation of the proper version using the raidqry command D HORCM etc raidqry h Model RAID Manager Windows2000 Ver Rev 01 22 03 02 Usage raidqry options 3 3 3 Software Installation for OpenVMS Systems Make sure to install CCI on all servers involved in CCI operations Establish the network TCP IP if not already established CCI will be provided as the following PolyCe...

Page 150: ...or porting for OpenVMS Version update To update the CCI software version on an OpenVMS system 1 Perform the update after making sure that HORCM is not in operation horcmshutdown for one HORCM instance horcmshutdown 0 1 for two HORCM instances When a command is being used in interactive mode terminate it using the q option 2 Insert and mount the provided CD or diskette 3 Execute the following comma...

Page 151: ... be owned by the CCI administrator The environment variable HORCMINST HORCM_CONF establishes as the need arises 4 Optional Establishing the command execution environment If users have designation of the environment variables HORCC_LOG then the HORCC_LOG directory must be owned by the CCI administrator The environment variable HORCMINST establishes as the need arises Note A user account for the Lin...

Page 152: ...name of the CCI administrator to the Device Objects of the Volume GUID For example C HORCM tool chgacl A RMadmin Volume Volume b0736c01 9b14 11d8 b1b6 806d6172696f Device CdRom0 Volume b0736c01 9b14 11d8 b1b6 806d6172696f changed to allow RMadmin Volume b0736c02 9b14 11d8 b1b6 806d6172696f Device Floppy0 Volume b0736c02 9b14 11d8 b1b6 806d6172696f changed to allow RMadmin Volume b0736c00 9b14 11d8...

Page 153: ... allow to write However RAID Manager will be able to change from SystemDrive windows directory to TEMP directory by setting HORCM_USE_TEMP environment variable For example C HORCM etc set HORCM_USE_TEMP 1 C HORCM etc inqraid Phys gvinf 2 Ensure that RAID Manager and CCI HORCM have the same privileges If the RAID Manager command and CCI will be executing different privileges different users then th...

Page 154: ...directory HORCM is a symbolic link Execute the horcmuninstall command Directory HORCM horcmuninstall sh Move to the root directory cd Delete the symbolic link for HORCM rm HORCM Delete the product using the rm command rm rf Directory HORCM Uninstallation for Windows systems To uninstall the CCI software 1 Confirm that CCI HORCM is not running If it is running shut it down One CCI instance D HORCM ...

Page 155: ...te Do not mix pairs created with the At Time Split option m grp and pairs created without this option in the same group defined in the CCI configuration file If you do the pairsplit operation might end abnormally or S VOLs of the P VOLs in the same consistency group might not be created correctly at the time when the pairsplit request is received Restrictions for a ShadowImage volume group 9900V a...

Page 156: ...HORCM_DEV None Character string 31 characters dev_group None Character string 31 characters Recommended value 8 char or less port None Character string 31 characters target ID None Numeric value See Note 7 characters LU None Numeric value See Note 7 characters MU 0 Numeric value See Note 7 characters Serial None Numeric value 12 characters CU LDEV LDEV None Numeric value 6 characters dev_name for ...

Page 157: ...unning the CCI For example DEFINE TRANSLATION CONCEALED TERMINAL SYS POSIX_ROOT Device directory where Device directory is defined as SYS POSIX_ROOT 3 IPC method using MailBox driver As alternate method of the UNIX domain socket for IPC Inter Process Communication RAID Manager use the mailbox driver to enable the communication between Raid Manager command and HORCM Therefore if the Raid Manager co...

Page 158: ...IX_ROOT horcm etc DEFINE TABLE LNM PROCESS_DIRECTORY LNM TEMPORARY_MAILBOX LNM GROUP horcmstart 1 run DETACHED SYS SYSTEM LOGINOUT EXE PROCESS_NAME horcm0 _ INPUT VMS4 DKB100 SYS0 SYSMGR horcm loginhorcm0 com _ OUTPUT VMS4 DKB100 SYS0 SYSMGR horcm run0 out _ ERROR VMS4 DKB100 SYS0 SYSMGR horcm run0 err RUN S PROC_ID identification of created process is 00004160 run DETACHED SYS SYSTEM LOGINOUT EXE...

Page 159: ...SYSTEM DKA145 1 DGA145 DEFINE SYSTEM DKA146 1 DGA146 DEFINE SYSTEM DKA153 1 DGA153 6 zx option for Raid Manager commands zx option for Raid manager commands are using the select function to wait a event from STDIN but OpenVMS select function does not support to wait any events from STDIN and the behavior of select for terminal STDIN is unable to echo back the terminal input Therefore zx option for...

Page 160: ... such as HORCMINST controlled by CRTL Also you need to define the following logical name to your login com in order to distinguish the uppercase and the lowercase DEFINE DECC ARGV_PARSE_STYLE ENABLE SET PROCESS PARSE_STYLE EXTENDED 10 Regarding using spawn command You can also start the HORCM process easily by using the spawn command The following examples used SPAWN command on DCL For example usi...

Page 161: ...mand and HORCM will be executing in different privileges different user then the RAID Manager command will be hang or unable to attach to HORCM because the RAID Manager command and HORCM will be denied to communicate through the Mailbox 12 Installation RAID Manager will be provided a file for installing as the following PCSI PolyCenter Software Installation file HITACHI ARMVMS RM V0122 2 1 PCSI HI...

Page 162: ... if the process was invoked by the DCL the status is interpreted by DCL and a message is displayed as below on DCL of OpenVMS pairdisplay jjj PAIRDISPLAY requires jjj or jjj as argument PAIRDISPLAY EX_REQARG Required Arg list Refer to the command log SYS POSIX_ROOT HORCM LOG HORCC_RMOVMS LOG HORCM log horcc_rmovms log for details sh sym status STATUS X0035A7F1 pairdisplay g aaa PAIRDISPLAY EX_ATTH...

Page 163: ...roup PRODUCT_ID DKA145 CL1 H 30009 145 OPEN 9 CM DKA146 CL1 H 30009 146 s P ss 0004 5 01 11 OPEN 9 DKA147 CL1 H 30009 147 s S ss 0004 5 01 11 OPEN 9 DKA148 DKA149 CL1 H 30009 149 P s ss 0004 5 01 11 OPEN 9 DKA150 DKA151 CL1 H 30009 151 P s ss 0004 5 01 11 OPEN 9 DKA152 CL1 H 30009 152 s s ss 0004 5 01 11 OPEN 9 DKA153 CL1 H 30009 153 s s ss 0004 5 01 11 OPEN 9 inqraid DKA148 sys assign DKA148 errc...

Page 164: ...S4 Online 0 1 DGA146 VMS4 Online 0 1 DGA153 VMS4 Online 0 DEFINE SYSTEM DKA145 1 DGA145 DEFINE SYSTEM DKA146 1 DGA146 DEFINE SYSTEM DKA153 1 DGA153 2 Define the environment for RAID Manager in LOGIN COM You need to define the Path for the RAID Manager commands to DCL PATH as the foreign command Refer to the section about Automatic Foreign Commands in the OpenVMS User s Manual DEFINE DCL PATH SYS P...

Page 165: ...description for HORCM_DEV and HORCM_INST because target ID LUN are Unknown You will be able to know about a mapping of a physical device with a logical name easily by using the raidscan find command option 4 Execute an horcmstart 0 run DETACHED SYS SYSTEM LOGINOUT EXE PROCESS_NAME horcm0 _ INPUT VMS4 DKB100 SYS0 SYSMGR horcm loginhorcm0 com _ OUTPUT VMS4 DKB100 SYS0 SYSMGR horcm run0 out _ ERROR V...

Page 166: ...s the Detached process run DETACHED SYS SYSTEM LOGINOUT EXE PROCESS_NAME horcm0 _ INPUT VMS4 DKB100 SYS0 SYSMGR horcm loginhorcm0 com _ OUTPUT VMS4 DKB100 SYS0 SYSMGR horcm run0 out _ ERROR VMS4 DKB100 SYS0 SYSMGR horcm run0 err RUN S PROC_ID identification of created process is 00004160 run DETACHED SYS SYSTEM LOGINOUT EXE PROCESS_NAME horcm1 _ INPUT VMS4 DKB100 SYS0 SYSMGR horcm loginhorcm1 com ...

Page 167: ...b1 L DKA146 30009 146 SMPL VG01 oradb1 R DKA147 30009 147 SMPL VG01 oradb2 L DKA148 30009 148 SMPL VG01 oradb2 R DKA149 30009 149 SMPL VG01 oradb3 L DKA150 30009 150 SMPL VG01 oradb3 R DKA151 30009 151 SMPL 3 Changing the default log directory HORCC_LOG horcm horcm TEST pairdisplay PAIRDISPLAY requires x xxx as argument PAIRDISPLAY EX_REQARG Required Arg list Refer to the command log SYS POSIX_ROO...

Page 168: ...st 9 Please check SYS SYSROOT SYSMGR HORCM9 CONF SYS SYSROOT SYSMGR LOG9 CURLOG HORCM_ LOG and modify ip_address service HORCM inst 9 finished successfully SYS SYSROOT SYSMGR horcm9 conf sys sysroot sysmgr horcm9 conf Created by mkconf on Thu Mar 13 20 08 41 HORCM_MON ip_address service poll 10ms timeout 10ms 127 0 0 1 52323 1000 3000 HORCM_CMD dev_name dev_name dev_name UnitID 0 Serial 30009 DKA1...

Page 169: ...y completed HORCM inst 9 finished successfully starting HORCM inst 9 DEVICE_FILE Group PairVol PORT TARG LUN M SERIAL LDEV 1 DGA145 30009 145 1 DGA146 URA URA_000 CL2 H 0 2 0 30009 146 1 DGA147 URA URA_001 CL2 H 0 3 0 30009 147 1 DGA148 URA URA_002 CL2 H 0 4 0 30009 148 HORCM Shutdown inst 9 Please check SYS SYSROOT SYSMGR HORCM9 CONF SYS SYSROOT SYSMGR LOG9 CURLOG HORCM_ LOG and modify ip_address...

Page 170: ...STEM command but then does not need to be mounted show device Device Device Error Volume Free Trans Mnt Name Status Count Label Blocks Count Cnt 1 DGA145 VMS4 Online 0 1 DGA146 VMS4 Online 0 1 DGA153 VMS4 Online 0 DEFINE SYSTEM DKA145 1 DGA145 DEFINE SYSTEM DKA146 1 DGA146 DEFINE SYSTEM DKA153 1 DGA153 2 Define the environment for RAID Manager in LOGIN COM If Raid Manager command and HORCM will be...

Page 171: ...ame dev_name DKA145 HORCM_DEV dev_group dev_name port TargetID LU MU HORCM_INST dev_group ip_address service You will have to start HORCM without a description for HORCM_DEV and HORCM_INST because target ID Lun are Unknown You will be able to know about a mapping of a physical device with a logical name easily by using the raidscan find command option 4 Execute an horcmstart 0 as background bash h...

Page 172: ...ev_group ip_address service VG01 HOSTB horcm1 FOR horcm1 conf HORCM_DEV dev_group dev_name port TargetID LU MU VG01 oradb1 CL1 H 0 3 0 VG01 oradb2 CL1 H 0 5 0 VG01 oradb3 CL1 H 0 7 0 HORCM_INST dev_group ip_address service VG01 HOSTA horcm0 7 Start horcmstart 0 1 Note The subprocess HORCM created by bash will be terminated when the bash is EXIT bash horcmstart 0 19 bash starting HORCM inst 0 bash ...

Page 173: ...e configuration definition file Make the port name number the same on all servers horcm xxxxx udp xxxxx the port name number of horcm conf 2 If you want HORCM to start automatically each time the system starts up add etc horcmstart sh to the system automatic start up file e g sbin rc 3 Execute the horcmstart sh script manually to start the CCI instance horcmstart sh 4 Set the log directory HORCC_L...

Page 174: ... automatic start up file e g sbin rc 3 Execute the horcmstart sh script manually to start the CCI instances horcmstart sh 0 1 4 Set an instance number to the environment which executes a command For B shell HORCMINST X X instance number 0 or 1 export HORCMINST For C shell setenv HORCMINST X 5 Set the log directory HORCC_LOG in the command execution environment as needed 6 If you want to perform Hi...

Page 175: ... HORCM etc pairdisplay g xxxx xxxx group name Two Instances To start up two instances of CCI on a Windows system 1 Modify WINNT system32 drivers etc services to register the port name number service of the configuration definition files Make sure that the port name number is different for each instance horcm0 xxxxx udp xxxxx the port name number of horcm0 conf horcm1 xxxxx udp xxxxx the port name ...

Page 176: ...start Note The subprocess HORCM created by SPAWN will be terminated when the terminal will be LOGOFF or the session will be terminated If you want independence Process to the terminal LOGOFF then use RUN DETACHED command Refer to item 4 in section 3 5 1 3 Confirm the configuration Set the log directory HORCC_LOG in the command execution environment as required Note If the log directory under SYS P...

Page 177: ...start 1 Note The subprocess HORCM created by SPAWN will be terminated when the terminal will be LOGOFF or the session will be terminated If you want independence Process to the terminal LOGOFF then use RUN DETACHED command Refer to item 4 in section 3 5 1 3 Set the HORCM instance numbers in the environment in which the command is to be executed HORCMINST X where X denotes an instance number 0 or 1...

Page 178: ...d example uses HORCM0 for the registration of the service name for HORCM instance 0 Example for adding HORCM0 svcexe S HORCM0 A C HORCM tool svcexe exe for deleting HORCM0 svcexe S HORCM0 D for starting HORCM0 1 make a C HORCM tool HORCM0_run txt file 2 set a user account to this service 3 confirm to start by horcmstart 0 4 confirm to stop by horcmshutdown 0 5 start from a service by net start HOR...

Page 179: ...CMINST X as needed START set HORCM_EVERYCLI 1 set HORCMINST 0 set HORCC_LOG STDERROUT C HORCM etc horcmstart exe exit 0 4 Starting the HORCM instance from the service After you have confirmed starting and stopping using horcmstart 0 and horcmshutdown 0 you must verify that HORCM0 starts from the service and that HORCM0 started automatically from REBOOT using the following command C HORCM tool net ...

Page 180: ...162 Chapter 3 Preparing for CCI Operations ...

Page 181: ...ncy paircurchk section 4 9 Performing Hitachi TrueCopy takeover operations horctakeover section 4 10 Displaying configuration information raidscan raidar raidqry section 4 11 Performing data protection operations raidvchkset raidvchkdsp raidvchkscan section 4 12 Controlling CCI activity hormstart horcmshutdown horcctl section 4 13 CCI command tools inqraid mkconf section 4 14 Synchronous waiting c...

Page 182: ...16 7 Hitachi TrueCopy command environmental variables HORCC_LOG Specifies the command log directory name default HORCM log instance number If this variable has STDERROUT as magic strings then the command will change an output of the logging to STDERR This strings is used to inhibit an output of the logging when the user script does handle in prospect of an error code for the command HORCC_TRCSZ Sp...

Page 183: ...tibility across RAID storage systems these environment variables are ignored by 9900V 9900 which enables you to use a script with HORCC_SPLT HORCC_RSYN HORCC_REST for USP NSC on the 9900V 9900 storage systems HORCC_SPLT NORMAL The pairsplit and paircreate split will be performed as Non quick mode regardless of setting of the system option mode 122 via SVP QUICK The pairsplit and paircreate split w...

Page 184: ...ce of HORCM For example to set HORC TC mode pairdisplay g group IH For example to set HORC TC mode and HORCMINST 5 pairdisplay g group IH5 IM instance or ISI instance This option used for specifying the command as HOMRCF and used for specifying Instance of HORCM For example to set HOMRCF SI mode pairdisplay g group IM For example to set HOMRCF SI mode and HORCMINST 5 pairdisplay g group IM5 Note I...

Page 185: ...ecified Executing as HORC TC mode X this shows the Instance Number 4 1 2 Verifying HORCC_MRCF HORCMINST RAID Manager provides a way to verify HORCC_MRCF and HORCMINST environment variable so that a user can confirm RM instance number and Copy mode they are setting pairdisplay h Model RAID Manager Solaris Ver Rev 01 22 03 02 Usage pairdisplay options for HORC 5 h Help Usage I Set to the instance of...

Page 186: ...nitial copy operation is complete Table 4 3 lists and describes the paircreate command parameters and returned values Table 4 4 lists and describes the error codes for the paircreate command Note Snapshot support for the TagmaStore USP NSC depends on the microcode version Pair generation command Server A Server B Local is specified Remote is specified Primary volume Secondary volume Secondary volu...

Page 187: ...e 4 3 Paircreate Command Parameters Parameter Value Command Name paircreate Format paircreate h q z g group d pair Vol d g raw_device MU FHORC MU d g seq LDEV MU f g fence CTGID v c size nocopy nomsg split m mode jp id js id pid PID fq mode cto o time c time r time nocsus ...

Page 188: ... group to an existing CTGID 0 15 63 127 255 on the Hitachi RAID storage systems The CTGID option is ignored unless you specify the f async or fg option vl or vr Specifies the data flow direction and must always be specified The vl option specifies local and the host which issues the command possesses the primary volume The vr option specifies remote and the remote host possesses the primary volume...

Page 189: ...e Returned values This command sets the following returned values during exit allowing the user to check the execution results Normal termination 0 When creating groups 0 normal termination for all pairs Abnormal termination other than 0 refer to the execution logs for error details ...

Page 190: ...scan f and make sure volume sizes are identical 212 Resource EX_ENOCTG Not enough CT groups in the RAID Choose an existing CTGID pairvolchk displays CTGIDs Use f async CTGID or m grp CTGID option of paircreate to force the pair into a pre existing CTGID 217 EX_ENXCTG No CT groups left for OPEN Vol use Confirm whether all CT groups are already used by TC TC390 Async or SI SI390 215 Unrecoverable EX...

Page 191: ...ume Secondary volume Secondary volume Primary volume Paired logical volume Figure 4 2 Pair Splitting The primary volume s server is automatically detected by the pairsplit command so the server does not need to be specified in the pairsplit command parameters If the S option simplex is used the volume pair is deleted the volumes are returned to the simplex state and the primary and secondary volum...

Page 192: ...CCI Operations Table 4 5 Pairsplit Command Parameters Parameter Value Command Name pairsplit Format pairsplit h q z g group d pair Vol d g raw_device MU FHORC MU FMRCF MU d g seq LDEV MU r rw S R S B P l nomsg C size E fq mode ...

Page 193: ... failure has occurred the pair status of S VOL cannot be changed to SMPL R Brings the secondary volume into the simplex mode forcibly It is issued by the secondary host if the host possessing the primary volume is down or has failed R S B Specifiable for HORC only This option is used to bring the secondary volume forcibly into simplex mode It is issued by the secondary host if the host possessing ...

Page 194: ...apter 4 Performing CCI Operations Returned values Normal termination 0 When splitting groups 0 normal termination for all pairs Abnormal termination other than 0 refer to the execution logs for error details ...

Page 195: ...r status using pairdisplay 228 Unrecoverable EX_EWSUSE Pair suspended at WAIT state Issue pairresync manually to the identified failed paired volume to try to recover it If the trouble persists call the Hitachi Data Systems Support Center 234 Note Unrecoverable errors are fixed and will not be resolved even after re executing the command If the command failed the detailed status will be logged in ...

Page 196: ...ete and then use the fsck command to check the consistency of the secondary volume file system Mount mount r the secondary volume Execute the backup Restore the volumes to their previous state and resynchronize the volume pair Instantaneous offline backup of Windows file system Execute x umount on the PVOL then split the volume pair with the rw option Execute x mount on the primary volume Make sur...

Page 197: ...ation is executed by using the S option of the pairsplit command When the pairsplit S command is issued the specified Hitachi TrueCopy or ShadowImage pair is deleted and each volume is changed to SMPL simplex mode If you want to re establish a pair which has been deleted you must use the paircreate command not pairresync ...

Page 198: ...d only for TrueCopy TrueCopy Async or UR If no data was written to the secondary volume while the pair was split the differential data on the primary volume is copied If data was written to the secondary volume the differential data on the primary volume and secondary volume is copied This process is reversed when the ShadowImage restore option is specified Before issuing the pairresync command no...

Page 199: ...e Secondary volume Secondary volume Primary volume Paired logical volumes Differential entire data copy Figure 4 5 Pair Resynchronization P VOL S VOL Write Data COPY Read Write Read P VOL S VOL Write Data RCPY Read Read Normal Resync Copy Restore Resync Copy ShadowImage only Figure 4 6 Normal Resync and ShadowImage Restore Resync ...

Page 200: ...7 Pairresync Command Parameters Parameter Value Command Name pairresync Format pairresync h q z g group d pair Vol d g raw_device MU FHORC MU FMRCF MU d g seq LDEV MU c size nomsg l restore swaps swapp fq mode cto o time c time r time f g fence CTGID ...

Page 201: ...cibly specifies a cascading ShadowImage volume for specified pair logical volumes on TrueCopy environment see example in Figure 4 8 If the l option is specified this option resyncs a cascading ShadowImage volume on a local host near site If no l option is specified this option resyncs a cascading ShadowImage volume on a remote host far site The target ShadowImage volume must be a P VOL swaps with ...

Page 202: ...Performing CCI Operations Parameter Value Returned values Normal termination 0 When resynching groups 0 normal termination for all pairs Abnormal termination other than 0 refer to the execution logs for error details ...

Page 203: ... executing the command If the command failed the detailed status will be logged in the CCI command log HORCC_LOG see Table A 2 even if the user script has no error handling The primary and secondary volumes must not be mounted on any UNIX system because this command renews data on both the primary and secondary volumes This command cannot execute copy rejection in case of the trouble single error ...

Page 204: ...n PVOL T0 T1 Figure 4 9 Swap Operation L2 0 L1 1 0 2 SSW S L PVOL SVOL SL SM PL G1 Sync G2 UR DC2 DC1 L3 DC3 2 1 PVOL SM PL APP1 L2 0 L1 1 0 2 SVO L PVOL PVO L SM PL G1 Sync G2 UR DC2 DC1 L3 DC3 2 1 SVO L SM PL pairresync g G1 FHORC 1 A PP1 pairresync g G1 swapp After DC 1 recovery Failback from DC3 Figure 4 10 Example swaps option with FHORC MU ...

Page 205: ...mmand The pair event waiting command waits until the specified status is established and terminates abnormally if an abnormal status is detected The transition of the paired volume status is judged by the status of the primary volume If the event waiting command is issued for a group the command waits until the status of each volume in the group changes to the specified status When the event waiti...

Page 206: ...he target ShadowImage volume must be P VOL or SMPL d g seq LDEV MU Searches a group on the configuration definition file local instance for the specified LDEV and if the specified LDEV is contained in the group the target volume is executed as the paired logical volume d or group dg This option is effective without specification of g group option If the specified LDEV is contained in two or more g...

Page 207: ...ssage Recommended Action Value Volume status EX_ENQVOL Unmatched volume status within the group Confirm status using the pairdisplay command Make sure all volumes in the group have the same fence level and volume attributes 236 EX_INCSTG Inconsistent status in group Confirm pair status using pairdisplay 229 EX_INVVOL Invalid volume status Confirm pair status using pairdisplay l 222 EX_EVOLCE Pair ...

Page 208: ...n SVOL_COPY state because PVOL is already in PVOL_PSUS state If you want to wait the SVOL_SSUS state then use ss status and nowaits option in order for waiting the pair status on SVOL side This will be needed for operating pairresync restore or pairsplit S The figure below shows five examples of waiting until PVOL_PSUS SVOL_COPY state will be changed to SVOL_SSUS Pairevtwait g G1 ss ssus t 600 Wai...

Page 209: ... In DC1 host failure if APP1 want to wait until DC3 become the suspend state then they can verify SSUS state by using the pairevtwait command as shown below L1 0 L2 1 0 2 SVOL PVOL PVOL PSUS SMPL G1 Sync G2 UR DC1 DC2 L3 DC3 2 1 SVOL SSUS SMPL Pairevtwait g G3 FHORC 1 ss ssus t 600 APP1 G3 UR horctakeover g G1 APP1 APP Figure 4 15 Example for waiting SSUS on 3DC using TC UR ...

Page 210: ... and exits this command z or zx OpenVMS cannot use the zx option Makes the pairmon command enter the interactive mode The zx option guards performing of the HORCM in the interactive mode When this option detects a HORCM shut down interactive mode terminates I H M instance or I TC SI instance Specifies the command as HORC HOMRCF and used for specifying instance of HORCM D Selects the default report...

Page 211: ...ts exist then it reports one event and resets the event which it reported Invalid allsnd When HORCM does not have an event this option waits until an event occurs If one or more events exist then it reports all events Invalid resevt When HORCM does not have an event this option waits until an event occurs If one or more events exist then it reports one event and resets all events Invalid resevt al...

Page 212: ...pairvolchk command Table 4 15 shows the truth table for pairvolchk group status display Table 4 16 provides the state transition table for an HA control script using the pairvolchk and horctakeover commands pairvolchk g oradb pairvolchk Volstat is P VOL status PAIR fence ASYNC CTGID 2 Å TC Async pairvolchk g oradb pairvolchk Volstat is P VOL status PAIR fence DATA Å TrueCopy Sync pairvolchk g orad...

Page 213: ... remote host If this option is not specified the volume attribute of the local host is reported ss Used to acquire the attribute of a volume and the pair status of a volume If this option is not specified the volume attribute is reported nomsg Suppresses messages to be displayed when this command is executed It is used to execute a command from a user program This option must be specified at the b...

Page 214: ...urnal file For Hitachi TrueCopy Async and Universal Replicator 42 The status is PVOL_COPY 43 The status is PVOL_PAIR 44 The status is PVOL_PSUS 45 The status is PVOL_PSUE 46 The status is PVOL_PDUB TrueCopy LUSE volume only 47 The status is PVOL_PFUL 48 The status is PVOL_PFUS 52 The status is SVOL_COPY or SVOL_RCPY 53 The status is SVOL_PAIR 54 The status is SVOL_PSUS 55 The status is SVOL_PSUE 5...

Page 215: ...ay command Make sure all volumes in the group have the same fence level and volume attributes 236 Unrecoverable EX_EVOLCE Pair Volume combination error Confirm pair status using pairdisplay and change combination of volumes 235 Note Unrecoverable errors are fixed and will not be resolved even after re executing the command If the command failed the detailed status will be logged in the CCI command...

Page 216: ...ediate S Pvol MU 1 through specified pair group on Hitachi TrueCopy environment ShadowImage Environment pairvolchk g oradb1 c s FHORC SVOL P P VOL SVOL SVOL Ora TrueCopy Oradb1 ShadowImage Oradb2 ShadowImage 0 1 0 Seq 30052 Seq 30053 Figure 4 18 Example of FHORC Option for Pairvolchk TrueCopy Environment pairvolchk g ora c s FMRCF 1 PVOL S P VOL SVOL SVOL Ora TrueCopy Oradb1 ShadowImage Oradb2 Sha...

Page 217: ...e TRUE x x x x PDUB false false false x x TRUE x PFUL false false false x x false TRUE PAIR false false false TRUE false false false PFUS false false false false TRUE false false PSUS COPY COPY or RCPY x true or false does not matter Notes The PFUL state is displayed as PAIR by all commands except the fc option of the pairdisplay command since PFUL indicates PAIR state with sidefile at the HWM The...

Page 218: ...DUB PVOL_XXX XXX Nop 8 S VOL EX_EVOLCE EX_EVOLCE 9 SMPL or SVOL PSUS SSWS Unknown SMPL or SVOL PSUS EX_ENORMT or EX_CMDIOE EX_ENORMT EX_CMDIOE 10 SMPL SMPL XXX EX_VOLCRE 11 P VOL P VOL EX_EVOLCE EX_EVOLCE data or status PSUE or PDUB PVOL PSUE Æ12 or PVOL SMPL Æ8 12 Other S VOL SVOL_YYY XXX Nop data or status PSUE or PDUB PVOL PSUE Æ13 or PVOL SMPL Æ9 13 Other Unknown PVOL_XXX EX_ENORMT or EX_CMDIO...

Page 219: ...S is reported as PVOL_XXX except when the P VOL s status is Unknown PVOL PSUE PVOL PSUE takeover PVOL SMPL PVOL SMPL takeover Nop Nop takeover Swap Swap takeover When the horctakeover command execution succeeds the state transitions to the indicated Æ state number SVOL SVOL SSUS takeover or Swap takeover In case of a host failure this function executes Swap takeover In case of an ESCON fibre chann...

Page 220: ...st B PVOL COPY DC1 State No 15 dpaircreate vl Host A SVOL PAIR DC2 Host B PVOL PAIR DC1 State No 16 epairevtwait Host A PVOL PAIR DC2 Host B SVOL PAIR DC1 State No 16 horctakeover After operations state is No 16 when the DC2 takes over processing from the DC1 the horctakeover command will execute a swap takeover operation due to DC2 SVOL DC1 PVOL_PAIR on the DC2 side If the DC1 side has NO this op...

Page 221: ...ide Æ state is No 15 If the DC2 takes over processing from the DC1 without their confirmation operations horctakeover command will be returned with SVOL_E execute SVOL takeover and return EX_VOLCUR on the DC2 side Æ state is No 15 As for other case If the DC2 takes over processing from the DC1 on processing paircreate operation horctakeover command will be returned with EX_ENQVOL Unmatch volume st...

Page 222: ...over command will be returned with SVOL_E execute SVOL takeover and return EX_VOLCUR on the DC1 side Æ state is No 17 Host A PVOL PSUS DC2 Host B SVOL PSUS DC1 State No 17 Consideration as for state No 9 The horctakeover command will be failed with EX_ENORMT on the following nested failure case state No 4Æ9 Therefore HA Control Script will be needed that ask operator for decision and do nothing on...

Page 223: ...the suspend state PSUE or PDUB Æ PSUE PAIR Æ PSUS which permits WRITE to all primary volumes of the group Host C Host A Host B PSUS PSUE PSUS PSUE PSUS PAIR PAIR PAIR PAIR PAIR horctakeover P VOL ESCON or Fibre channel failure Host C Host A Host B PAIR PSUE PAIR PSUE PAIR PAIR PAIR PAIR PAIR PAIR S VOL P VOL S VOL The horctakeover command will be returned with PVOL PSUE takeover also on the follow...

Page 224: ...UE as the group status therefore the pairvolchk command returned give priority PSUE PDUB instead of PSUS as the group status Therefore the group status of the PVOL is also continued after the PVOL PSUE takeover 4 7 3 Recovery in Case of PVOL PSUE Takeover This special state PSUE turns back to original state after the successful execution of the pairresync command after the recovery of ESCON fibre ...

Page 225: ...hk command will return SVOL status as SVOL_PSUS Also this special state is displayed as SSWS using the fc option of the pairdisplay command This special state PVOL_PSUE and SVOL_PSUS between PVOL and SVOL may be needed that is handled by HA Control Script Hitachi TrueCopy Async UR Before the SVOL is changed to SSUS the SVOL takeover will try to copy non transmitted data which remains in the FIFO q...

Page 226: ...Y pairresync swaps on Host B only S VOL P VOL Host C Host A Host B PAIR PAIR PAIR PAIR PAIR PAIR PAIR PAIR PAIR PAIR S VOL P VOL If the pairresync swaps command has been failed at the ESCON FC link is not restored then this special state PVOL_PSUE and SVOL_PSUS is NOT changed Failback after recovery on Host B After recovery with execution of the pairresync swaps command on Host B if you stop the a...

Page 227: ...US SSUS S VOL Host C Host A Host B COPY COPY COPY COPY COPY COPY COPY COPY COPY COPY pairresync swapp on Host A S VOL P VOL Host C Host A Host B PAIR PAIR PAIR PAIR PAIR PAIR PAIR PAIR PAIR PAIR S VOL P VOL After PAIR horctakeover Host C Host A Host B PAIR PAIR PAIR PAIR PAIR PAIR PAIR PAIR PAIR PAIR P VOL S VOL Note The pairresync swapp option is used to be swapped volume from the PVOL to SVOL at...

Page 228: ...t is specified by t timeout option After the completion of a synchronous state between the PVOL and SVOL the SVOL takeover will be split and the state will be changed to SSUS and the operation of after that is same horctakeover P VOL Host C Host A Host B PAIR PAIR PAIR PAIR PAIR PAIR PAIR PAIR PAIR PAIR S VOL Host C Host A Host B PSUS PSUS PSUS PSUS PSUS SSUS SSUS SSUS SSUS SSUS P VOL S VOL Host C...

Page 229: ...mes and servers The pairdisplay command can be used for a paired volume or a group of paired volumes Table 4 17 lists and describes the pairdisplay command parameters and returned values Figure 4 20 and Figure 4 21 show examples of the pairdisplay command and its output Figure 4 22 shows examples of the m option of the pairdisplay command Table 4 17 Pairdisplay Command Parameters Parameter Value C...

Page 230: ...mode option on the same command line d g seq LDEV MU Searches a group on the configuration definition file local instance for the specified LDEV and if the specified LDEV is contained in the group the target volume is executed as the paired logical volume d or group dg This option is effective without specification of g group option If the specified LDEV is contained in two or more groups the comm...

Page 231: ...ter Value Returned values 1 The volume attribute is SMPL 2 The volume attribute is P VOL 3 The volume attribute is S VOL When displaying groups 1 2 3 normal termination for all pairs Abnormal termination other than 0 to 127 refer to the execution log files for error details ...

Page 232: ... 270 oradb2 oradev21 R CL1 D 3 2 1 30053 268 P VOL PSUS 30053 272 W oradb oradev1 R CL1 D 3 2 30053 268 S VOL COPY 266 Display examples for m all pairdisplay g oradb m all Group PairVol L R Port TID LU M Seq LDEV P S Status Seq P LDEV M oradb oradev1 L CL1 D 3 0 0 30052 266 SMPL L CL1 D 3 0 1 30052 266 SMPL L CL1 D 3 0 2 30052 266 SMPL oradb oradev1 L CL1 D 3 0 30052 266 P VOL PAIR 30053 268 oradb...

Page 233: ...AIR PSUS SSUS PJNS SJNS OTHER PVOL CR JF JF BMP SVOL JF JF BMP CR Shows the copy operation rate identical rate of a pair BMP Shows the identical percentage of BITMAP both PVOL and SVOL SF Shows sidefile percentage of each CT group as sidefile 100 on cache of both PVOL and SVOL Following is an arithmetic expression using the High Water Mark HWM as 100 of a sidefile space HWM High water mark Sidefil...

Page 234: ...ution log file and displayed Paircurchk is also executed as part of the TrueCopy takeover horctakeover command see next section Table 4 18 Data Consistency Displayed by the Paircurchk Command Object Volume Currency Attribute Status Fence Paircurchk SVOL_takeover SMPL To be confirmed P VOL To be confirmed S VOL COPY Data Inconsistent Inconsistent Status Never Async Inconsistent Inconsistent PAIR Da...

Page 235: ... the command as HORC HOMRCF and used for specifying Instance of HORCM g group Specifies a group name defined in the configuration definition file The command is executed for the specified group unless the d pair Vol option is specified d pair Vol Specifies paired logical volume name defined in the configuration definition file When this option is specified the command is executed for the specified...

Page 236: ...coverable EX_VOLCUR S VOL currency error Check volume list to see if an operation was directed to the wrong S VOL 225 Note Unrecoverable errors are fixed and will not be resolved even after re executing the command If the command failed the detailed status will be logged in the CCI command log HORCC_LOG see Table A 2 even if the user script has no error handling ...

Page 237: ...nsistency check is executed for all volumes in the group and all inconsistent volumes are found in the execution log file and displayed same as paircurchk command The takeover command allows swapping of the primary and secondary volumes so that if the primary or secondary volume is switched due to a server error or package transfer duplex operations can be continued using the reversed volumes When...

Page 238: ... decimal notation S Selects and executes SVOL takeover The target volume of the local host must be an S VOL If this option is specified then the following l option is invalid l Enables read and write to the primary volume s by a local host only without a remote host and executes PVOL takeover when the primary volume cannot be used because it is fenced fence DATA or STATUS state PSUE or PDUB or PSU...

Page 239: ...cal Volume currency error Confirm pair status of the local volume 224 Unrecoverable EX_VOLCRE Local and Remote Volume currency error Confirm pair status of remote and local volumes using pairdisplay command 223 Timer Recoverable EX_EWSTOT Timeout waiting for specified status Increase timeout value using t option 233 Note Unrecoverable errors are fixed and will not be resolved even after re executi...

Page 240: ... the original PVOL based on SVOL using pairresync g group swaps c size for a fast failback operation If this pairresync operation fails with EX_CMDRJE or EX_CMDIOE there will be a cause of ESCON link down and or site failure If this operation fails then HA Control Script reports the following message After a recovery from failure please try pairresync g group swaps c size command To avoid above re...

Page 241: ...ination of attributes Table 4 23 Volume Attributes and Takeover Actions Local Node Takeover Node Remote Node Volume Attribute Fence Level and Status Volume Attribute P VOL Status Takeover Action SMPL SMPL NG 1 P VOL Nop Takeover 2 S VOL Volumes not conform 3 Unknown 4 NG SMPL NG P VOL Volumes not conform S VOL PVOL Takeover Fence Data or Status and Status PSUE or PDUB or MINAP 0 Unknown Status e g...

Page 242: ...OL If this step fails swap takeover is disabled and an error is returned 2 Execute Resync for Swapping for switch to the primary volume that the local volume S VOL is swapped as the NEW_PVOL and resynchronizes the NEW_SVOL based on the NEW_PVOL As for copy tracks if the remote host is known the command will use the value of PVOL specified at paircreate time If the remote host is unknown the comman...

Page 243: ...rueCopy Async UR The CCI software on the S VOL side will issue a Suspend for Swapping to the S VOL side RAID storage system Non transmitted data of the P VOL will be copied to the S VOL side and a Resync for Swapping operation will be performed after the copy process In case of a host failure this data synchronize operation will be accomplished and SVOL takeover function will return Swap takeover ...

Page 244: ...akeover Changes the primary volume to the suspend PSUE PSUS state which enables write I Os to all primary volumes of the group The action of the PVOL PSUE Takeover causes PSUE and or PSUS to be intermingled in the group This intermingled pair status is PSUE as the group status therefore pairvolchk command returned give priority PSUE PDUB than PSUS as the group status This special state turns back ...

Page 245: ...r Communication with the primary site is disabled Accordingly SVOL takeover is executed SVOL SSUS takeover The secondary volume is R W enabled 2 vgchange a e The LVM is activated in exclusive mode and the svol server gets the right to use The svol accepts R W 3 fsck Conformability of the file system is checked 4 mount The file system is mounted for R W 5 Server software activation The server DB so...

Page 246: ...ecked 4 Server software activation The server DB software is activated and the database is rolled back and rolled forward 5 Application activation The user program is activated Takeover Command 1 horctakeover 2 x mount 3 chkdsk 4 Server software activation 5 Application activation User s Script User s Environment Activation from HA software Manual activation Execution Log S VOL SMPL or SVOL_SSUS E...

Page 247: ...nd physical drives designated as the objects of the sync command are not opened to any applications For example confirm that Explore is not pointed on the target drive If Explore is pointed on the target drive the target drive will be opening Sync command does not ignore the detected error on the NT file system so sync executes successfully in normal case NO ERROR case only on NT file system For e...

Page 248: ...D If this option is not specified the command applies to all LUNs If this option is specified the TID must also be specified f or ff Specifies display of volume type for a display column If this is specified f g d option is invalid fx Displays the LDEV number in hexadecimal notation fg Specifies display of group_name for a display column This option searches a group on the configuration definition...

Page 249: ...V P S Status Fence LDEV Vol Type CL1 R ce 15 15 7 5 100 101 P VOL PAIR NEVER 100 OPEN 3 CL1 R ce 15 15 6 5 200 201 SMPL OPEN 3 Figure 4 28 Raidscan Command Examples for Fibre Channel Ports ls dev rdsk raidscan find DEVICE_FILE UID S F PORT TARG LUN SERIAL LDEV PRODUCT_ID dev rdsk c0t0d4 0 S CL1 M 0 4 31168 216 OPEN 3 CVS CM dev rdsk c0t0d1 0 S CL1 M 0 1 31168 117 OPEN 3 CVS dev rdsk c1t0d1 CL1 M 3...

Page 250: ...232 Chapter 4 Performing CCI Operations Vol Type logical unit LU type e g OPEN V OPEN 9 ...

Page 251: ...or HORCM_CMD is not found S F Displays whether a PORT is SCSI or fibre PORT Displays the RAID storage system port number TARG Displays the target ID which was converted by the fibre conversion table LUN Displays the LUN which was converted by the fibre conversion table SERIAL Displays the production serial number of the RAID storage system LDEV Displays the LDEV within the RAID storage system PROD...

Page 252: ...ption guards performing of the HORCM in the interactive mode When this option detects a HORCM shutdown interactive mode terminates I H M instance or I TC SI instance Specifies the command as HORC HOMRCF and used for specifying instance of HORCM p port targ lun mun Monitors one or more up to 16 devices at a time port Specifies the port to be reported CL1 A to CL1 R and CL2 A to CL2 R excluding CL1 ...

Page 253: ... 13 45 28 CL1 A 15 6 SMPL 200 0 80 0 40 0 600 CL1 B 14 5 P VOL PAIR 133 3 35 0 13 4 400 CL1 A 12 3 P VOL PSUS 200 0 35 0 40 6 600 Figure 4 30 Raidar Command Example Output of the raidar command IOPS of I Os read write per second total I O rate HIT Hit rate for read I Os read hit rate W Ratio of write I Os to total I Os percent writes IOCNT number of write and read I Os ...

Page 254: ... raidqry command No This column shows the order when the group name dev_group which is described in the configuration definition file has multiple remote hosts Group When the r option is used this column shows the group name dev_group which is described in the configuration definition file Floatable Host When the f option is used this column shows the host name ip_address which is described in the...

Page 255: ...e hostname ip_address as specified in the configuration definition file Use this option if floatable IP address is used for the hostname ip_address in the configuration file g This option is used for displaying the lists of group name dev_group which described in the configuration file of a local host instance raidqry g GNo Group RAID_type IV H IV M MUN H MUN M 1 ora HTC_RAID 12 9 4 64 2 orb XP_RA...

Page 256: ... raidvchkset command parameters Note This command will be controlled as protection facility This command will be rejected with EX_ERPERM by connectivity checking between CCI and the RAID storage system raidvchkset g oralog vt redo8 É Sets volumes in oralog group as redolog file prior to Oracle9I raidvchkset g oradat vt data8 vs 16 É Sets volumes in oradat group as data file that Oracle block size ...

Page 257: ...s command is executed It is used to execute this command from a user program This option must be specified at the beginning of a command argument The command execution log is not affected by this option vt type Specifies the following data type that assumes the target volumes as Oracle database If type is not specified then this option will disable all of the checking redo8 The target volumes sets...

Page 258: ...tention time in units of day If rtime is not specified the default time defined by the storage system will be used The default time is zero in 9900V microcode version 21 08 xx This option is ignored default infinite in 9900V microcode version 21 06 xx or 21 07 xx This option sets each four flags for guarding type as follows type INQ RCAP READ WRITE inv 1 1 1 1 Sz0 0 1 1 1 rwd 0 0 1 1 wtd 0 0 0 1 R...

Page 259: ...nd TagmaStore USP NSC Oracle Storage System Version CHKDBA ASM Setting Parameter TagmaStore USP NSC 9iR2 Disable Same as current setting Enable vt redo9 data9 vbf we bne VM 9 is fixed 10gR2 Disable unused vt rd10g used vt rd10g vbf disable Block check Enable unused Impossible Due to be fixed as VM 9 used Impossible Due to be fixed as VM 9 USP V VM 9iR2 Disable Same as current setting Enable vt red...

Page 260: ...kdsp command parameters Figure 4 34 Figure 4 36 show examples of the raidvchkdsp command Note This command will be controlled as protection facility Non permitted volume is shown without LDEV information LDEV information is This command will be rejected with EX_ERPERM by connectivity checking between CCI and the storage system Table 4 30 Raidvchkdsp Command Parameters Parameter Value Command Name ...

Page 261: ...hkdsp command will be rejected in protection mode Non permitted volume is shown without LDEV information LDEV is fe Displays the serial and LDEV of the external LUNs mapped to the LDEV for the target volume Figure 4 33 by adding to last column ignores the format of 80 column c When RAID Manager starts HORCM_DEV in horcm conf will be translated from Port target lun numbers to the CU Ldev informatio...

Page 262: ... BR W B SR W B S vg01 oradb1 Unknown 2332 vg01 oradb2 c4t0d3 2332 3 D E B R D D D D E E D E D D raidvchkdsp g horc0 v gflag fe Å Example of fe option Group TID LU Seq LDEV GI C R W S PI C R W S R Time EM E Seq E LDEV horc0 0 20 63528 65 E E E E E E E E E E 0 horc0 0 20 63528 66 E E E E E E E E E E 0 Figure 4 33 Raidvchkdsp Command Examples with fd and fe Options ...

Page 263: ...ize on Read is disabled W E Checking for data block size on Write is enabled D Checking for data block size on Write is disabled E L Data block on Read Write is interpreted as little endian format B Data block on Read Write is interpreted as big endian format E W Warning that Read Write is not rejected when validation error is detected C Read Write is rejected when validation error is detected MR ...

Page 264: ...checking in units of 512 bytes ENLBA Displays the end of LBA on a target volume for checking in units of 512 bytes Note If STLBA and ENLBA are both zero this means to check all blocks BNM Displays the number of bits for checking regarding CHK F2 in units of bits If BNM is zero this means the checking for CHK F2 will be disabled raidvchkdsp g vg01 fd v errcnt Å Example of v errcnt option Group Pair...

Page 265: ... Æ E C flag can be changed to enable D C flag cannot be changed to enable R Æ E R flag can be changed to enable D R flag cannot be changed to enable WÆ E W flag can be changed to enable D W flag cannot be changed to enable SÆ E S flag can be changed to enable D S flag cannot be changed to enable R Time This displays the retention time for write protect in units of day The hyphen shows that the ret...

Page 266: ...ed MB LU_CAP MB U T PID AOU AOU_001 CL2 D 2 7 62500 167 20050 1100000 10 70 1 AOU AOU_002 CL2 D 2 10 62500 170 110000 1100000 10 70 1 Figure 4 39 Raidvchkdsp Command Example with v aou Option Output of the raidqvchkdsp command with v aou option Used MB Displays the usage size of the allocated block on this LUN Range 0 Used MB LU_CAP MB 42MB LU_CAP MB Displays the LUN capacity responded to the Read...

Page 267: ...f the configuration definition file Table 4 31 lists and describes the raidvchkscan command parameters Figure 4 40 through Figure 4 42 show examples of the raidvchkscan command Note This command will be rejected with EX_ERPERM by connectivity checking between CCI and the Hitachi RAID storage system Table 4 31 Raidvchkscan Command Parameters Parameter Value Command Name raidvchkscan Format raidvchk...

Page 268: ...by finding a host group 9900V and later s Seq Used to specify the Seq serial of the storage system when this option cannot specify the unit ID which is contained for p port option This option scans the port specified by p port option of the storage system which corresponds with the unit ID that searches the unit ID from Seq If this option is specified then the unit ID which is contained in p port ...

Page 269: ...ng that Read Write is not rejected when validation error is detected C Read Write is rejected when validation error is detected MR W B This column displays the flags for checking regarding CHK F3 in the data block R E Checking for CHK F3 on Read is enabled D Checking for CHK F3 on Read is disabled W E Checking for CHK F3 on Write is enabled D Checking for CHK F3 on Write is disabled B E Checking f...

Page 270: ... v offset option Bsize This column displays the data block size of Oracle I O in units of bytes STLBA Displays the Start of LBA on a target volume for checking in units of 512 bytes ENLBA Displays the End of LBA on a target volume for checking in units of 512 bytes Note If STLBA and ENLBA are both zero this means to check all blocks BNM Displays the number of bits for checking regarding CHK F2 in ...

Page 271: ...nd D Disabled for Write command SÆ E Enabled for becoming the SVOL D Disabled for becoming the SVOL PI C R W S This displays the permission flags that show whether each mode flag can be changed to enable or not I Æ E I flag can be changed to enable D I flag cannot be changed to enable C Æ E C flag can be changed to enable D C flag cannot be changed to enable R Æ E R flag can be changed to enable D...

Page 272: ...ays the total capacity in the SnapShot pool in units of Bsize raidvchkscan v aou p CL2 d 0 PORT ALPA C TID LU Seq Num LDEV Used MB LU_CAP MB U T PID CL2 D 0 e4 0 2 0 62500 1 160 20050 1100000 1 60 1 CL2 D 0 e4 0 2 1 62500 1 161 200500 1100000 18 60 2 Figure 4 45 Raidvchkscan Command Example with v aou Option Output of the raidvchkscan command with v aou option Used MB Displays the usage size the a...

Page 273: ...ive mode terminates I H M instance or I TC SI instance Specifies the command as HORC HOMRCF and used for specifying instance of HORCM s Seq Used to specify the Seq serial of the storage system when this option cannot specify unitID which is contained for v jnl option If this option is specified the unitID which is contained in v jnl is invalid fx Displays the LDEV number in hexadecimal notation v ...

Page 274: ...is means P S vol Journal Error suspend created with nocsus option AP Displays the following two conditions status according to the pair status Shows the number of active paths on the initiator port in UR links Unknown is shown as P JNL AP S JNL AP Control Read Data control AM AM The activity monitor that detects whether or not there is a request for data from the initiator at regular intervals If ...

Page 275: ... 4 47 Example of Q Marker and Q CNT U Displays the usage rate of the journal data D SZ Displays the capacity for the journal data on the journal volume Seq Displays the serial number of the RAID storage system Num Displays the number of LDEV configured the journal volume LDEV Displays the first number of the LDEV that is configured for the journal volume Using a combination of JNLS status and othe...

Page 276: ... Suspending the journal volume due to full journal 0 Suspended journal volume due to failure Link failure PJSE N Suspending the journal volume due to failure Link failure N Suspended journal volume due to failure 0 0 Suspended journal volume due to Link failure N Suspending the journal volume due to failure SJSE N 0 Suspending the journal volume due to Link failure raidvchkscan v jnlt JID MU CTG J...

Page 277: ...ot specify unitID which is contained for v jnl option If this option is specified the unitID which is contained in v jnl is invalid fx Displays the LDEV number in hexadecimal notation v pid Displays information for the snapshot pool see Figure 4 49 v pida Displays information for the HDP pool see Figure 4 50 raidvchkscan v pid 0 PID POLS U SSCNT Available MB Capacity MB Seq Num LDEV H 001 POLN 10 ...

Page 278: ...and with v pida option PID Displays the HDP pool ID POLS Displays the status of the HDP pool POLN Pool Normal POLF Pool Full POLS Pool Suspend POLE Pool failure In this state information for the pool cannot be displayed U Displays the usage rate of the HDP pool AV_CAP MB Displays the available capacity for the HDP volumes mapped to this pool TP_CAP MB Displays the total capacity of the HDP pool W ...

Page 279: ...OGS HORCM log tmplog If no HORCMINST is specified HORCM_CONF etc horcm conf HORCM_LOG HORCM log curlog HORCM_LOGS HORCM log tmplog For Windows platform If HORCMINST is specified HORCM_CONF WINNT horcm conf is instance number HORCM_LOG HORCM log curlog HORCM_LOGS HORCM log tmplog If no HORCMINST is specified HORCM_CONF WINNT horcm conf HORCM_LOG HORCM log curlog HORCM_LOGS HORCM log tmplog environm...

Page 280: ... inst Option Inst Specifies the HORCM CCI instance number numerical value When this option is specified the command stops the specified HORCM instance When this option is not specified the command refers to the instance environment variable HORCMINST of the execution environment of this shell script and stops the following the HORCM instance When HORCMINST is specified this command stops the HORCM...

Page 281: ...command allows you to change and display the internal trace control parameters e g level type buffer size of the HORC Manager and or Hitachi TrueCopy commands If a new value for a parameter is not specified the current trace control parameter is displayed Table 4 37 lists and describes the horcctl command parameters Caution Do not change the trace level unless directed to do so by a Hitachi Data S...

Page 282: ... One or more values can be specified s size KB Changes the default trace buffer size which is 1 MB in units of 1024 bytes S Shuts down HORCM D Displays the command device name currently used by HORCM If the command device is blocked due to online maintenance microcode replacement of the storage system you can check the command device name in advance using this option C Changes the command device n...

Page 283: ...n is defined to change from 3DC multi target to 3DC multi hop with the state of running APP after that horctakeover command will be able to configure 3DC multi target on the remote site without stopping the APP The granularity of either a logical volume or volume group can be specified with this command Table 4 38 Horctakeoff Command Parameters Parameter Value Command name horctakeoff Format horct...

Page 284: ...HORC UR only Horctakeoff command can be changed 3DC configuration from 3 DC multi target to 3 DC multi hop In order to create 3 DC multi hop CA_SyncÆCA_Sync UR_PVOLÆUR it will be needed to specify a journal group ID for UR_PVOL So this option is used for that purpose If this option will not be specified a journal group ID for UR_PVOL used for 3 DC multi target will be inherited automatically js id...

Page 285: ...Guide 267 Note Unrecoverable error should have been done without re execute by handling of an error code The command has failed and then the detailed status will be logged on Raid Manager command log HORCC_LOG even though the user script has no error handling ...

Page 286: ...2 is in progress horctakeoff pairresync g G1 is in progress horctakeoff pairresync g G1 FHORC 2 is in progress horctakeoff horctakeoff done 3 DC Multi Hop L1 L2 L3 G1 G2 3 DC Multi Target L1 L2 L3 G1 G2 G3 G3 horctakeoff command on L2 local site horctakeoff g G1 gs G3 horctakeoff pairsplit g G1 S FHORC 1 is in progress horctakeoff pairsplit g G1 is in progress horctakeoff pairsplit g G3 S is in pr...

Page 287: ...g G2 is in progress horctakeoff pairresync g G1 is in progress horctakeoff pairresync g G2 is in progress horctakeoff horctakeoff done 3 DC Multi Target L1 L2 L3 G1 G2 3 DC Multi Hop L1 L2 L3 G1 G2 G3 G3 horctakeoff command on L2 remote site horctakeoff g G1 gs G3 horctakeoff pairsplit g G3 S is in progress horctakeoff pairsplit g G1 is in progress horctakeoff pairsplit g G1 FHORC 1 S is in progre...

Page 288: ...eters D HORCM etc raidscan x findcmddev hdisk0 20 cmddev of Ser 62496 PhysicalDrive0 cmddev of Ser 62496 E cmddev of Ser 62496 Volume b9b31c79 240a 11d5 a37f 00c00d003b1e This example searches for command devices in the range of disk drive numbers 0 20 Figure 4 51 Findcmddev Subcommand Example Caution The findcmddev subcommand must be used when HORCM is not running Note The findcmddev subcommand s...

Page 289: ...disk 3 Port 2 PhId 4 TId 29 Lun 6 HITACHI OPEN 3 CM Port CL1 J Ser 30053 LDEV 15 0x00F Note This example displays the devices for the range of disk drive numbers from 0 to 20 Figure 4 52 Drivescan Subcommand Example Output of the drivescan subcommand Harddisk Shows the hard disk recognized by the Windows system Port Shows the port number on the device adapter recognized by the Windows system Phid ...

Page 290: ...8H 43WS Claimed PORT 2 IID 7 SCSI Devices PhId 0 TId 5 Lun 0 HITACHI OPEN 3 Claimed PhId 0 TId 5 Lun 1 HITACHI OPEN 3 Claimed PhId 0 TId 5 Lun 2 HITACHI OPEN 3 Claimed PhId 0 TId 6 Lun 0 HITACHI 3390 3A Claimed Note This example displays the devices for the range of ports from 0 to 20 Figure 4 53 Portscan Subcommand Example Output of the portscan subcommand Port Shows the port number on the device...

Page 291: ... HarddiskVolume8 SYNC D hd2 HarddiskVolume9 directory or Directory pattern is used to find the directory mount point on the logical drive If the directory is specified then SYNC does execute to a directory mounted volume only pairsplit x sync D hd1 SYNC D hd1 HarddiskVolume8 If the directory pattern is specified then SYNC does execute to any directory mounted volumes identified to directory patter...

Page 292: ...he logical drives designated as the objects of the sync command will not be opened to any applications then sync flushes the system buffer to a drive and makes the dismount state for this drive If the logical drives designated as the objects of the sync command are already opened to any applications then sync only flushes the system buffer to a drive This will be allowed to flush the system buffer...

Page 293: ...ume must be specified Vol or Dms or Dmt or Dmr as LDM volume for Windows 2008 2003 2000 To mount HarddiskVolumeX x mount C hdX or x mount C VolX See section4 18 1 for information on Vol or Dms or Dmt or Dmr for LDM volumes directory Specifies the directory mount point on the logical drive pairsplit x mount D hd1 Vol8 D hd1 HarddiskVolume8 pairsplit x mount D hd2 Vol9 D hd2 HarddiskVolume9 Restrict...

Page 294: ...mple in Figure 4 57executes mount from command option of the pairsplit and then displays the mounted devices The F drive is mounted to harddiskvolume2 D is mounted to harddiskvolume3 D hd1 directory hd1 directory on D drive is mounted to harddiskvolume4 D hd2 directory is mounted to harddiskvolume5 and G drive is mounted to harddiskDmVolumes Volume1 for spanned volume configured with three harddis...

Page 295: ... x umount D hd2 Vol9 D hd2 HarddiskVolume9 Example for waiting 45 sec pairsplit x umount D 45 D HarddiskVolume8 Restriction The logical drive to be unmounted and the corresponding physical drive must be closed to all applications pairsplit x umount F x umount G g oradb rw pairsplit x mount Drive FS_name VOL_name Device Partition Port PathID Targ Lun C FAT Null Harddisk0 Partition1 1 0 0 0 Z Unknow...

Page 296: ...mal case NO ERROR case only on NT file system For example confirm the target drive has no failure on the system for Event Viewer If so you must reboot the system or delete the partition and reconfigure the target drive Note Umountd has the following behavior as well Unmount the logical drive after waiting 30 sec the delayed paging IO for dismount after flushed the system buffer to a drive This avo...

Page 297: ...v sleep Format x setenv vaname value x usetenv vaname x env x sleep time Argument Vaname Specifies the environment variable to be set or canceled Value Specifies the value or character string of the environment variable to be set Time Specifies the sleep time in seconds Restriction The environment variables must be set before connecting to HORCM and must be specified during interactive mode z opti...

Page 298: ...or ShadowImage pairdisplay d Seq LDEV 0 1 2 l fx CLI 2 dev null For Hitachi TrueCopy pairdisplay d Seq LDEV l fx CLI 2 dev null Note Seq and LDEV are included using SCSI Inquiry command special file This option is used to specify the special file name as argument of command If no argument this command makes mode that wait for STDIN without argument findc Uses the following options of the pairdispl...

Page 299: ...LBA in units of 512 bytes ELBA Displays usable ending LBA ELBA 1 in units of 512 bytes PCNT Displays the number of partitions Example for setting of Harddisk11 C HORCM etc raidvchkset d hd11 vs 16 0x00003f00 0x000620d9 fv only Windows 2008 2003 2000 systems Displays the Volume GUID via Volume with wide format Example C HORCM etc inqraid CLI Vol fv DEVICE_FILE PORT SERIAL LDEV CTG H M 12 SSID R Gro...

Page 300: ... 11605 OPEN 3 c1t0d2 CL1 E 63516 12403 0 0 3 11605 OPEN 9 c1t0d3 CL1 E 63516 12405 0 0 10 11605 OPEN E c1t0d4 CL1 E 63516 12800 0 0 11 11605 OPEN 8 c1t0d5 CL1 E 63516 12801 0 0 13 11605 OPEN 8 2 c1t0d6 CL1 E 63516 13057 0 0 21 11605 OPEN L c2t0d6 CL2 E 63516 13057 0 0 21 11605 OPEN L SL This displays the SLPR number of LDEV CL This displays the CLPR number of LDEV SI SI This shows the total of Bit...

Page 301: ...disk inqraid hdisk1 SQ CL2 D Ser 30053 LDEV 9 HITACHI OPEN 3 HORC P VOL HOMRCF MU 0 SMPL MU 1 SMPL MU 2 SMPL RAID5 Group 2 1 SSID 0x0008 CTGID 3 hdisk2 SQ CL2 D Ser 30053 LDEV 14 HITACHI OPEN 3 CM RAID5 Group 2 1 SSID 0x0008 Windows System C HORCM etc echo hd1 2 inqraid or inqraid hd1 2 Harddisk 1 SQ CL2 D Ser 30053 LDEV 9 HITACHI OPEN 3 HORC P VOL HOMRCF MU 0 SMPL MU 1 SMPL MU 2 SMPL RAID5 Group ...

Page 302: ...8 Figure 4 60 Inqraid Command Tool Examples The following items are output for the inqraid command tool CLX Y Displays the port number on the RAID storage system Ser Displays the production serial number on the RAID storage system LDEV Displays the LDEV in the RAID storage system HORC Displays the attribute PVOL SVOL SMPL of a volume as TrueCopy in the RAID storage system HOMRCF Displays the attri...

Page 303: ...P LDEV M horc1 dev10 L CL2 J 2 3 0 61456 209 S VOL SSUS 206 dev rdsk c23t2d3 Figure 4 62 Inqraid Example of find Option HP UX example shown echo dev rdsk c23t0d0 dev rdsk c23t2d3 inqraid findc DEVICE_FILE M Group PairVol P S Stat R_DEVICE M P S Stat LK c23t0d0 0 horc1 dev00 S VOL SSUS c23t0d1 0 P VOL PSUS OK dev rdsk c23t0d0 1 No such on the group dev rdsk c23t0d0 2 No such on the group DEVICE_FIL...

Page 304: ...an LDEV in the storage system R Group Displays the physical position of an LDEV according to mapping of LDEV in the storage system LDEV Mapping R Group RAID Group RAID Level 1 Æ RAID1 5 Æ RAID5 6 Æ RAID6 RAID Group number Sub number SnapShot SVOL S Pool ID number Unmapped U 00000 External LUN E External Group number HDP AOU volume A Pool ID number PRODUCT_ID Displays product id field in the STD in...

Page 305: ...Phys gvinf CLI PhysicalDrive0 Harddisk0 VOL61459_448_DA7C0D91 OPEN 3 PhysicalDrive1 Harddisk1 VOL61459_449_DA7C0D92 OPEN 3 PhysicalDrive2 Harddisk2 VOL61459_450_DA7C0D93 OPEN 3 ÉS N ÉLDEV ÉSignature Figure 4 67 Inqraid Example of gvinf Option D HORCM etc pairdisplay l fd g URA Group PairVol L R Device_File M Seq LDEV P S Status Seq P LDEV M URA URA_000 L Harddisk3 0 61459 451 S VOL SSUS 448 URA UR...

Page 306: ...he user must modify the ip_address service of an existing configuration file as needed Table 4 47 Mkconf Command Parameters Parameter Value Command Name HORCM usr bin mkconf sh UNIX systems HORCM Tool mkconf exe Windows and OpenVMS systems Format mkconf sh g g group m mu i inst s service a mkconf exe g g group m mu i inst s service a c drive Options No argument No option displays Help Usage g grou...

Page 307: ...uration and log files horcm9 conf log9 vi conf ÅVerify config file check ip address service Created by mkconf sh on Mon Jan 22 17 59 11 JST 2001 HORCM_MON ip_address service poll 10ms timeout 10ms 127 0 0 1 52323 1000 3000 HORCM_CMD dev_name dev_name dev_name UnitID 0 Serial 61456 dev rdsk c23t3d0 HORCM_DEV dev_group dev_name port TargetID LU MU dev rdsk c23t0d0 SER 61456 LDEV 192 FIBRE FCTBL 4 OR...

Page 308: ...et device has shared an LDEV among multiple device files and an LDEV is displayed by another target device already then its target device is suppressed as comment as shown below ERROR LDEV LINK dev rdsk c24t0d3 SER 61456 LDEV 195 FIBRE FCTBL 4 If the target device does not have a valid MU then its target device is suppressed as comment as shown below ERROR INVALID MUN 2 1 dev rdsk c24t0d3 SER 6145...

Page 309: ...quence whose block was transferred and stored in DFW area of RCU with data consistency and will compare the latest sequence of MCU sidefile with the sequence of RCU DFW area within the term HORCM replies return code to this command when the write of MCU sidefile was stored in RCU DFW area In use this function a client will be able to confirm that a commit has been reached to remote site and also t...

Page 310: ...up ID and the sequence of RCU DFW within the CT group ID which correspond to the group or raw_device that is specified by pairsyncwait and compares MCU with RCU sequence at that time and at regular interval If RCU sequence is over the value of MCU sequence within the term that was specified by pairsysncwait this command reports the return code 0 with the meaning of completion of synchronization Th...

Page 311: ... Specifies the sequence of MCU PVOL called the Q marker If the application gets Q marker as the result of execution of pairsyncwait because of timeout or nowait the application can reconfirm the completion of Async transfer by using pairsysncwait with Q marker If the application does not specify Q marker CCI uses the latest sequence when CCI receives pairsysncwait It is also possible to wait for t...

Page 312: ...normal termination other than 0 to 127 refer to the execution logs for error details Restriction Specified group volume must be PVol with status PAIR Other cases reply with error EX_INVVOL It is possible to issue pairsysncwait from SVOL side with m marker Table 4 49 Specific Error Code for Pairsyncwait Category Error Code Error Message Recommended Action Value Volume status Unrecoverable EX_INVVOL...

Page 313: ...100 Sidefile percentage is the rate showed to column with PAIR state by Pairdisplay command Sidefile capacity is the capacity within 30 to 70 of the cache setting as the sidefile Following is an arithmetic expression for determining the average data per Q Marker in a CT group Data per Q Marker Remaining data in CT group QM Cnt pairsyncwait g oradb nowait Å nowait is specified UnitID CTGID Q Marker...

Page 314: ...cility CCI distinguishes the attribute ON from OFF when CCI recognizes the command device Figure 4 72 shows the definition of protected volumes Note If the command device is set to enable protection mode there is no impact on CCI operations CCI controls pairs under current specification Permitted volumes Volumes on Host view via LUN Security Volumes on Horcm conf via protection On command device P...

Page 315: ...CM makes tables for protected volume and permitted volumes from horcm conf and Inquiry result Inquiry result is based on configuration of Hitachi Data Retention Utility When the user controls pair volumes request to protected volumes is rejected with error code EX_ENPERM Protection Facility is based on host side view at the result of Hitachi SANtinel You need to configure SANtinel before CCI opera...

Page 316: ...vice then Ora1 and Ora2 are permitted to operate the paired volume Note The Protection Facility is implemented by only CCI CCI needs to know the protection attribute for the command device whether should be permitted the operation for paired volume If HORCM has protection ON command device at its time then HORCM checks a permission for a paired volume Grp1 Grp2 Horcm conf on HOST1 volumes for Grp1...

Page 317: ...or Grp1 volumes for Grp3 Horcm0 conf on HOST2 volumes for Grp2 Visible to Grp2 Grp4 Visible to Grp1 Grp3 Grp3 Ora1 Ora2 CM Grp4 Horcm1 conf on HOST1 volumes for Grp2 volumes for Grp4 Horcm1 conf on HOST2 volumes for Grp4 Ora3 CM protection On command device Figure 4 74 Example for the One Host Configuration ...

Page 318: ... storage system information by using internal Inquiry result You can use raidscan find to make horcm conf because only permitted volumes are shown with host side view Example for HP UX systems ioscan fun grep rdsk raidscan find DEVICE_FILE UID S F PORT TARG LUN SERIAL LDEV PRODUCT_ID dev rdsk c0t3d0 0 F CL1 D 3 0 35013 17 OPEN 3 dev rdsk c0t3d1 0 F CL1 D 3 1 35013 18 OPEN 3 4 16 4 Permission Comma...

Page 319: ...AL LDEV dev rdsk c0t3d0 oradb oradev1 CL1 D 3 0 35013 17 dev rdsk c0t3d0 oradb oradev1 CL1 D 3 0 0 35013 17 Note When multiple device files share the same LDEV the first device file is registered to the LDEV map table find verify MU This option shows relation between group on horcm conf and Device_File registered to the LDEV map tables from DEVICE_FILE of STDIN ioscan fun grep rdsk raidscan find v...

Page 320: ...ion process is executed automatically by etc horcmgr see 1 and 2 below 1 The following is executed for registration of permitted volume file HORCMPERM file if HORCMPERM file is existing and there are permitted volumes If the user wants to permit only the volumes specified then the volume list must be described in HORCMPERM file Naming of HORCMPERM file UNIX systems HORCMPERM is etc horcmperm conf ...

Page 321: ...x ls dev sd dev dasd HORCM usr bin raidscan find inst For Solaris ls dev rdsk HORCM usr bin raidscan find inst For AIX lsdev C c disk grep hdisk HORCM usr bin raidscan find inst For Tru64 UNIX ls dev rdisk dsk HORCM usr bin raidscan find inst For Digital UNIX ls dev rrz HORCM usr bin raidscan find inst For DYNIX ptx etc dumpconf d grep sd HORCM usr bin raidscan find inst For IRIX64 ls dev rdsk vol...

Page 322: ... HORCMPERM x HORCM etc raidscan exe find inst If no HORCM permission file exists then etc horcmgr executes the built in command to permit all volumes of own host Examples HP UX ioscan fun grep e rdisk e rdsk HORCM usr bin raidscan find inst Linux ls dev sd HORCM usr bin raidscan find inst zLinux ls dev sd dev dasd HORCM usr bin raidscan find inst Solaris ls dev rdsk HORCM usr bin raidscan find ins...

Page 323: ...ice with protection mode ON Therefore CCI provides how to find the protection mode command device To determine the currently used command device use the horcctl D command This command shows the protection mode command device by adding an asterisk to the device file name Example for HP UX systems horcctl D Current control device dev rdsk c0t0d0 Å indicates protection ON ...

Page 324: ...USP NSC specific facility because CCI applies the minimum version to all storage systems To expand the capability for mixed storage system configurations and avoid problems such as this CCI supports the following group version control to manage a version for each group CCI HORCM daemon makes a facility version for each group based on a configuration file at the start up of HORCM In a mixed storage...

Page 325: ... the relationship between LDM volumes and the physical volumes of the RAID storage system The user makes the CCI configuration file and then needs to know the relationship that is illustrated in Figure 4 76 ORB ORA Group in CCI configuration file Mounted point G F E Volume guid Volume guid Volume guid PhysicalDriveY Device HarddiskDmVolumes VolumeX or StripeX Device HarddiskX DR Device HarddiskVol...

Page 326: ...000 Device HarddiskDmVolumes VolumeX for spanned volume Æ DmsX DskYs Device HarddiskDmVolumes StripeX for striped volume Æ DmtX DskYs Device HarddiskDmVolumes RaidX for Raid 5 volume Æ DmrX DskYs DskYs shows that DmsX DmtX Dmr volumes are configured through bundling multiple HarddiskY1 Y2 Device Object Name of the PhysicalDrive for Windows 2008 2003 2000 Device HarddiskX DR Æ HarddiskX The user wi...

Page 327: ...3 inqraid Phy CLI DEVICE_FILE PORT SERIAL LDEV CTG H M 12 SSID R Group PRODUCT_ID Harddisk0 DDRS 34560D Harddisk1 CL2 K 61456 194 s s ss 0005 1 01 11 OPEN 3 The user wants to know the relationship between LDM volumes and a group of the configuration files and then will be able to find a group of the configuration file by given a KEY WORD to raidscan find verify command raidscan pi LETALL find veri...

Page 328: ...volume mount point MOUNTVOL drive path VolumeName MOUNTVOL drive path D MOUNTVOL drive path L Volume 56e4954a 28d5 4824 a408 3ff9a6521e5d G Volume bf48a395 0ef6 11d5 8d69 00c00d003b1e F The user will be able to know what Volume guid is configured as follows inqraid Volume bf48a395 0ef6 11d5 8d69 00c00d003b1e CLI DEVICE_FILE PORT SERIAL LDEV CTG H M 12 SSID R Group PRODUCT_ID Vol46 Dsk1 CL2 K 61456...

Page 329: ...calDriveY Device HarddiskDmVolumes VolumeX or StripeX Device HarddiskX DR Device HarddiskVolumeX Device HarddiskVolumeY Mirrored Volume NT File system Buffer Drive Letter LDM Volumes Physicall Volumes Figure 4 77 LDM Volume Flushing The following example flushes the system buffer associated to ORB group through Volume raidscan pi Volume find sync g ORB SYNC ORB ORB_000 Dmt1 Dsk1 Volume bf48a395 0e...

Page 330: ...t commands The following is an example for group ORB P VOL Side S VOL Side Close all logical drives on the P VOL by APP Flush the system buffer for P VOL using raidscan pi Volume find sync g ORB Split the paired volume using pairsplit g ORB with r w mode Open all logical drives on the P VOL by APP Resynchronize the paired volume using pairresync g ORB Flush the system buffer for NEW S VOL data usi...

Page 331: ...ush the system buffer for PVOL using raidscan pi Volume find sync g ORB Splits the paired volume using pairsplit g ORB with r w mode Unfreeze DB on opening PVOL by APP Resynchronize the paired volume using pairresync g ORB Flush the system buffer for NEW SVOL data using raidscan pi Volume find sync g ORB Back up the SVOL data Flush the system buffer for SVOL updates using raidscan pi Volume find s...

Page 332: ...HOMRCF Figure 4 78 Configurations with MSCS and ShadowImage HOMRCF MSCS on Node2 will misunderstand the SVOL as MSCS cluster resource because the signature of SVOL and PVOL is the same due to copied The reason is that MSCS cluster resources are managed with the signature only Therefore SVOL of Node2 will unable to backup so that MSCS of Node2 carry away the SVOL This is a problem of MSCS service b...

Page 333: ...nd Play Driver The user will be able to verify this situation using inqraid command as follows inqraid Phy CLI DEVICE_FILE PORT SERIAL LDEV CTG H M 12 SSID R Group PRODUCT_ID Harddisk0 Harddisk1 In this case you need to perform the following procedures to disable the Cluster Disk Driver 1 In the Computer Management window double click System Tools and then click Device Manager 2 On the View menu c...

Page 334: ...ORCM etc inqraid Phys gvinfex CLI PhysicalDrive10 Harddisk10 VOL61459_448_DA7C0D91 OPEN V PhysicalDrive11 Harddisk11 VOL61459_449_D4CB5F17 2ADC 4FEE 8650 D3628379E8F5 OPEN V PhysicalDrive12 Harddisk12 VOL61459_450_9ABDCB73 3BA1 4048 9E94 22E3798C3B61 OPEN V svinfex PTN option Only Windows 2003 This option writes LUN signature GUID DiskId and volume layout information that had previously been saved...

Page 335: ...003 Only This option is used for displaying usable LBA on a Physical drive in units of 512 bytes and is used to specify slba elba options for raidvchkset command C HORCM Tool inqraid CLI gplbaex hd10 13 Harddisk10 SLBA 0x0000003f ELBA 0x013fe5d9 PCNT 1 OPEN V Harddisk11 SLBA 0x00000022 ELBA 0x013fffdf PCNT 2 OPEN V Harddisk12 SLBA 0x00000022 ELBA 0x013fffdf PCNT 3 OPEN V SLBA displays usable start...

Page 336: ...Volume guid Volume guid Device Harddisk0 Device Harddisk1 Figure 4 79 Directory Mount Structure Volume discovery for directory mounted volume CCI will be able to discover the directory mounted volume by using LETALL that shows the relationship between logical drive and the physical volumes The KEY WORD LETALL can also be used with the raidscan find and mkconf commands D HORCM etc inqraid LETALL CL...

Page 337: ...y using inqraid Volu fv command option Examples C HORCM etc inqraid CLI Vol fv DEVICE_FILE PORT SERIAL LDEV CTG H M 12 SSID R Group ÆPRODUCT_ID Volume cec25efe d3b8 11d4 aead 00c00d003b1e Vol3 Dsk0 CL2 D 62496 256 OPEN 3 CVS CM Mount used DefineDosDevice Note This may forcibly dismount the mounted volume due to LOG OFF of Windows 2008 2003 2000 For example C HORCM etc raidscan x mount E Volume cec...

Page 338: ...ile will not be able to maintain the compatibility with conventional CLI Therefore CCI adopts a way that supports in the form which specifies a host group in the port strings as follows CL1 A GRP GRP are up to 127 Specifying the host group for the raidscan command as follows raidscan p CL1 A 5 Specifying the host group for the configuration file dev_group dev_name port TargetID LU MU ORA ORA_000 C...

Page 339: ...Status Fence LDEV P Seq P LDEV CL2 D 1 da 0 4 0 1 256 SMPL CL2 D 1 da 0 4 1 1 257 SMPL CL2 D 1 da 0 4 2 1 258 SMPL Specified device hgrp 1 is LDEV 0257 raidscan findg ls dev rdsk c57 raidscan findg DEVICE_FILE UID S F PORT TARG LUN SERIAL LDEV PRODUCT_ID dev rdsk c57t4d0 0 F CL2 D 1 4 0 62500 256 OPEN3 CVS CM dev rdsk c57t4d1 0 F CL2 D 1 4 1 62500 257 OPEN3 CVS dev rdsk c57t4d2 0 F CL2 D 1 4 2 625...

Page 340: ...rget volumes crossing SLPR through the command device The purpose of CCI SLPR security is to prevent CCI from operating the volumes on another SLPR SLPR N through the command device from the SLPR SLPR M that is assigned to its Host You can use CCI SLPR Security by defining the command device through the Web console or the SVP installed VPM feature so that CCI can protect the target volume The foll...

Page 341: ... will automatically set the bitmap corresponding to SLPR 1 and SLPR 2 2 Testing SLPR CCI verifies whether or not the command device can access a target within SLPR So if the command device belongs to SLPR 0 or CCI has no SLPR function then the SLPR protection is ignored However if the command device will be shared with the port on SLPR 1 and SLPR 2 CCI allows you to operate the volume on SLPR 1 an...

Page 342: ...om the SLPR of the command device so the raidscan p CL3 A command cannot scan any ports that are defined as SLPR N SLPR0 SLPR M SLPR N Host RM INST0 RM INST1 CM PVOL SVOL CL1 A CL3 A Figure 4 81 SLPR Configuration on a Single Host To operate SLPR N assign the command device If RM INST1 has a command device for SLPR N the paircreate command is permitted However the raidscan p CL3 A command via RMIN...

Page 343: ...LPR N share the command device If RMINST1 has a shared command device for SLPR N the paircreate command is permitted Additionally the raidscan p CL3 A command via RMINST0 will be permitted to scan a port because the shared command device has the Bitmap settings SLPR M and SLPR N SLPR0 SLPR M SLPR N Host RM INST0 RM INST1 CM PVOL SVOL CL1 A CL3 A Figure 4 83 Operation Across SLPRs Using a Shared Co...

Page 344: ...SLPR N HostB HostA RM INST0 RM INST1 CM PVOL SVOL CL1 A CL3 A Figure 4 84 SLPR Configuration on Dual Hosts To operate SLPR N assign the command device If HostB has a command device for SLPR N the paircreate command will be permitted However the raidscan p CL3 A command via HostA will be unable to scan a port because the specified port is different than the SLPR of the command device In this case r...

Page 345: ...d device for SLPR N the paircreate command is permitted Also the raidscan p CL3 A command via HostA will be allowed to scan a port because the shared command device has the Bitmap settings SLPR M and SLPR N SLPR0 SLPR M SLPR N CM PVOL SVOL CL1 A CL3 A HostB HostA RM INST0 RM INST1 Figure 4 86 Operating SLPR N by Sharing the Command Device ...

Page 346: ...s should be permitted at a remote site The result is that the paircreate command is not allowed to operate the paired volume because the volume described on HostB differs from the SLPR of the command device Also the raidscan p CL3 A command on HostB will not be allowed to scan a port SLPR N SLPR M HostA RM INST0 HostB RM INST1 CM PVOL SVOL CL1 A CL3 A CM Figure 4 87 TrueCopy Operation using SLPR ...

Page 347: ...ion For this purpose CCI makes the CLI interface that works by minimum compatible of the APP by specifying the COPY mode for CC Cruising Copy to the CLI of CCI 4 22 1 Specifications for Volume Migration CCI is necessary to be mapped to the port for pooling of RAID in order to control the volume of the external connection So the external volume need to be mapped previously to the port of RAID witho...

Page 348: ... execute the volume migration as group by describing to the horcm conf however LU LDEV which was mapped to SVOL after command execution does not maintain the consistency as the group In other words the user must consider the volume mapped to SVOL after execution as the discarded volume When HORCM demon is KILLed or the host has crash during group operation the group aborted the execution of the co...

Page 349: ...ote instance LU is migrated from PVOL to SVOL and the physical volume mapping between PVOL and SVOL is swapped after copied c size This option is used to specify a track size of the case which copies paired volume at 1 15 extents When omits specification of this option it uses a default value 3 for a track size 2 Command for discovering an external volume It is possible to discover the external vo...

Page 350: ... the copy pairdisplay g horc0 fe Group Seq LDEV P S Status Seq P LDEV M CTG CM EM E Seq E LDEV horc0 62496 18 P VOL COPY 62496 19 C horc0 62496 19 S VOL COPY 18 C H 30053 30 After completion of CC command pairdisplay g horc0 fe Group Seq LDEV P S Status Seq P LDEV M CTG CM EM E Seq E LDEV horc0 62496 18 P VOL PSUS 62496 19 C V 30053 30 horc0 62496 19 S VOL SSUS 18 C CM Displays the Copy mode N Æ N...

Page 351: ... 1 Æ RAID1 5 Æ RAID5 6Æ RAID6 RAID Group number Sub number SnapShot SVOL S PoolID number Unmapped U 00000 External LUN E External Group number Example in Linux ls dev sd inqraid dev sdh CHNO 0 TID 1 LUN 1 SQ CL2 G Ser 63528 LDEV 15360 HITACHI OPEN V HORC SMPL HOMRCF MU 0 SMPL MU 1 SMPL MU 2 SMPL RAID5 Group 1 9 SSID 0x0100 dev sdu CHNO 0 TID 1 LUN 14 SQ CL2 G Ser 63528 LDEV 2755 HITACHI OPEN V HOR...

Page 352: ...mapping of LDEV in the RAID storage system LDEV Mapping Display Formats RAID Group RAID1 Group Group number Sub number RAID5 Group Group number Sub number RAID6 Group Group number Sub number SnapShot SVOL SNAPS PoolID poolID number Unmapped UNMAP Group 00000 External LUN E LUN Group External Group number ...

Page 353: ...g Status Transition Command Pair Creation Pair Splitting Pairing Status CC m cc Simlex S c SMPL Accepted dÆe dÆf Acceptable d COPY È Acceptable Accepted e PSUS Accepted c f PSUE PDUB Accepted c Explanation of terms in Table 4 52 Accepted A command is accepted and executed When the command execution succeeds the status changes to that of the shown number Acceptable No operation is executed though a...

Page 354: ...topped if pairsplit command for of HOMRCF will be executed PVOL S P VOL CC SVOL COPY or PAIR CC 1 2 0 0 1 CC SVOL CC COPY or PAIR TrueCopy HORC The operation for the volume migration must be operated at the SMPL or PSUS state If not paircreate m cc command will be rejected with EX_CMDRJE or EX_CMDIOE Also HORC can not be operated to CC_SVOL copying in Cruising Copy On one hand in copying CC_SVOL t...

Page 355: ...chapter contains the following resources to address issues that you may encounter while working with the CCI software General Troubleshooting section 5 1 Changing IO way of the command device for AIX section 5 2 Error Reporting section 5 3 Calling the Hitachi Data Systems Support Center section 5 4 ...

Page 356: ...secondary volume has been PSUS R W enable or in the SMPL state by server shutdown sequence Hot standby operations Hitachi TrueCopy commands cannot execute hot standby operations between the primary and secondary volumes Use the takeover command intended for the HA configuration to execute the hot standby operation In hot standby operation two servers are used and the active primary and standby sec...

Page 357: ...on Command device Each Hitachi TrueCopy ShadowImage command is executed by issuing a command to the command device The Hitachi TrueCopy ShadowImage command is read or written from into the specific block area of the command device Therefore the command device cannot be used by the user In addition this device must not belong to an LVM volume group For Windows systems do not assign a drive letter t...

Page 358: ...red volume to try to recover it If the secondary volume is proved to be the failed volume issue the pair resynchronization command to recover it If the primary volume fails delete the paired volume pair splitting simplex and use the secondary volume as the substitute volume About var usr tmp directory CCI uses var tmp or usr tmp as the directory for UNIX domain socket for IPC Inter Process Communi...

Page 359: ... switch cmd case SCSI_IOCTL_SEND_COMMAND case SCSI_IOCTL_TEST_UNIT_READY case SCSI_IOCTL_BENCHMARK_COMMAND case SCSI_IOCTL_SYNC case SCSI_IOCTL_START_UNIT case SCSI_IOCTL_STOP_UNIT printk KERN_WARNING program s is using a deprecated SCSI ioctl please convert it to SG_IO n current comm Thus RAID Manager supports a way to change to the ioctl SG_IO automatically if Linux kernel supports the ioctl SG_...

Page 360: ...AIX FCP driver which does not support the ioctl DK_PASSTHRU fully in the customer site After this consideration RAID Manager also supports by defining either following environment variable or HORCM etc USE_OLD_IOCTLfile size 0 that uses the RAW_IO forcibly For Example export USE_OLD_IOCTL 1 horcmstart sh 10 HORCM etc rw r r 1 root root 0 Nov 11 11 12 USE_OLD_IOCT r r r 1 root sys 32651 Nov 10 20 0...

Page 361: ... of the error HORCM_006 HORCM memory allocation failed HORCM memory could not be secured Increase the system virtual memory or close any unnecessary programs HORCM_007 An error exists in the HORCM setup file An error exists in the HORCM setup file Refer to the startup log and reset the parameters HORCM_008 HORCM configuration file parameters could not be read An error exists in the format or param...

Page 362: ...o the configuration file of the remote and local hosts 247 EX_ENODEV No such device The designated device name does not exist in the configuration file Verify the device name and add it to the configuration file of the remote and local hosts 246 EX_ENOUNT No such RAID unit The designated RAID unit ID does not exist in the configuration file Verify the RAID unit ID and add it to the configuration f...

Page 363: ...CMDRJE except for Tru64 DYNIX Example paircreate g G1 f never vl nocopy paircreate EX_CMDRJE An order to the control command device was rejected Refer to the command log HORCM log10 horcc_u1 1 log for details It was rejected due to SKEY 0x05 ASC 0x26 SSB 0xB9BF 0xB9C7 on Serial 63502 221 EX_CMDIOE Control command I O error or rejected A read write to the command device failed with an I O error or ...

Page 364: ... device defined in the configuration file does not have a mapping to a real LUN and target ID within the RAID storage system Please confirm that the Port Target ID LUN are defined correctly under HORCM_DEV in the configuration file 227 EX_INVRCD Invalid return code Wrong return code Call the Hitachi Data Systems Support Center 226 EX_VOLCUR S Vol currency error Currency check error for S VOL Canno...

Page 365: ...2 EX_ERPERM Permission denied with the RAID A storage system RAID mentioned in the configuration file does not have a permission for CCI Please confirm if the type of storage system is permitted for a CCI by using the inqraid CLI and raidqry h commands 211 EX_ESVOLD SVOL denied due to be disabling A target volume for SVOL is denied to become SVOL via LDEV guarding Please confirm whether a target v...

Page 366: ... group 239 EX_ENOENT No such device or group 247 EX_ENODEV No such device 246 EX_ENLDEV No such LDEV within the RAID 227 EX_ENOUNT No such RAID unit 219 EX_INVMUN Invalid mu with HORC or HOMRCF 220 EX_ENQSER Unmatched Serial vs RAID unitID 218 EX_EXTCTG Extended CTgroup across RAIDs 216 EX_ENQCTG Unmatched CTGID within the group 214 EX_ENPERM Permission denied with the LDEV 213 EX_ERPERM Permissio...

Page 367: ...nd 230 EX_ERANGE Result too large 244 EX_ENAMLG File name too long 243 Unrecoverable EX_INVRCD Invalid return code 226 Configuration EX_ENLDEV No such LDEV within the RAID 227 EX_ENOUNT No such RAID unit 219 EX_INVMUN Invalid mu with HORC or HOMRCF 220 EX_ERPERM Permission denied with the RAID 211 EX_ENOSUP Micro code not supported 210 Unrecoverable EX_ESPERM Permission denied with the SLPR 207 Co...

Page 368: ...e group 236 EX_INCSTG Inconsistent status in group 229 EX_INVVOL Invalid volume status 222 EX_EVOLCE Pair Volume combination error 235 EX_INVSTP Invalid pair status 228 EX_VOLCUR S VOL currency error 225 EX_VOLCUE Local Volume currency error 224 EX_VOLCRE Local and Remote Volume currency error 223 EX_EWSUSE Pair suspended at WAIT state 234 EX_ENQSIZ Unmatched volume size for pairing 212 EX_ESVOLD ...

Page 369: ... or FDCOPY function see the Storage Navigator User s Guide for the storage system The circumstances surrounding the error or failure The exact content of any error messages displayed on the host system s The remote service information messages R SIMs logged by Storage Navigator and the reference codes and severity levels of the recent R SIMs The Hitachi Data Systems customer support staff is avail...

Page 370: ...352 Chapter 5 Troubleshooting ...

Page 371: ...p due to improper environment setting users should refer to the start up logs to resolve the problem The HORCM execution logs error log trace and core files contain data on errors which are caused by software or hardware problems These logs contain internal error data which does not apply to any user settings and so users do not need to refer to the HORCM execution logs When an error occurs in exe...

Page 372: ... txt Error log HORCM error log HORCM_LOG horcmlog_HOST horcm log HORCM error log HORCM_LOG horcmlog_HOST horcm_log txt Trace HORCM trace HORCM_LOG horcmlog_HOST horcm_PID trc Command trace HORCM_LOG horcmlog_HOST horcc_PID trc HORCM trace HORCM_LOG horcmlog_HOST horcm_PID_trc txt Command trace HORCM_LOG horcmlog_HOST horcc_PID_trc txt Core HORCM core HORCM_LOG core_HOST_PID core Command core HORCM...

Page 373: ...ariables or trace control commands with trace control parameters are issued to start tracing and the trace file is created The trace control parameters include trace level file size mode etc More detailed tracing is enabled by increasing the trace level Tracing is made in wraparound within the range of the file size HORCM makes the trace file according to the trace level specified in the HORCM sta...

Page 374: ...ed below For Example setting 2MB size HORCC_LOGSZ 2048 Export HORCC_LOGSZ HORCM log horcc_HOST conf file This file is used to describe HORCC_LOGSZ variable and the masking variable for logging If the HORCC_LOGSZ as the environment variable is not specified then HORCC_LOGSZ variable of this file is used If both variable is not specified then it is same as the current logging for only command error ...

Page 375: ...fault value 0 The same as the current logging for only command error HORCM log directory root raidmanager log9 ls l total 16 drwxr xr x 3 root root 4096 Oct 27 17 33 curlog rw r r 1 root root 3936 Oct 27 17 36 horcc_raidmanager log rw r r 1 root root 2097452 Oct 27 17 29 horcc_raidmanager oldlog rw r r 1 root root 46 Oct 27 17 19 horcc_raidmanager conf drwxr xr x 3 root root 4096 Oct 27 17 19 tmpl...

Page 376: ...he masking variable This variable is used to disable the logging by the command and exit code For masking below log pairvolchk returned 32 status is SVOL_COPY COMMAND NORMAL EUserId for HORC root 0 Tue Nov 1 12 21 53 2005 CMDLINE pairvolchk ss g URA 12 21 54 2d27f 10090 pairvolchk exit 32 pairvolchk 32 pairvolchk 22 ...

Page 377: ...e the uninstall command go to the root directory delete the HORCM link and delete the HORCM directory HORCM horcmuninstall sh Í Issue the uninstall command cd Í Change directories rm rf HORCM Í Delete the CCI directory Figure B 1 Uninstalling the CCI Software from a Root Directory HORCM horcmuninstall sh Í Issue the uninstall command cd Í Change directories rm HORCM Í Delete the CCI link rm rf non...

Page 378: ... software is not running you can upgrade the CCI software If the CCI software is still running when you want to upgrade software versions shut down the CCI software using the horcmshutdown command to ensure a normal end to all Hitachi TrueCopy and or ShadowImage functions To upgrade the CCI software 1 On the Control panel select the Add Remove programs option 2 When the Add Remove Program Properti...

Page 379: ...C 1 Example Fibre Address Conversion Note Use fixed address AL_PA 0xEF when using iSCSI CCI converts fibre channel physical addresses to SCSI target IDs TIDs using a conversion table see Figure C 2 Table C 1 shows the current limits for SCSI TIDs and LUNs on various operating systems Table C 1 Limits for Target IDs and LUNs HP UX other Systems Solaris IRIX Systems Windows Systems Port TID LUN TID ...

Page 380: ...vice is LDEV 0014 Figure C 2 Using Raidscan to Display TID and LUN for Fibre Channel Devices In this case the target ID indicated by the raidscan command must be used in the configuration definition file This can be accomplished using either of the following two methods Using default conversion table Use the TID and LU indicated by the raidscan command in the HORCM configuration definition file TI...

Page 381: ...get ID LUN indicated by the raidscan command should be used In this case you must start HORCM without a description for HORCM_DEV and HORCM_INST because target ID LUN are unknown Use the port target ID and LUN displayed by the raidscan find or raidscan find conf command for HORCM_DEV see Figure C 5 Note For details on LUN discovery based on a host group see section 4 20 ls dev rdsk raidscan find D...

Page 382: ...vice files then this table number should be changed by using the HORCMFCTBL variable Note If the TID displayed on the system is different than the TID indicated in the fibre address conversion table you must use the TID and LU returned by the raidscan command to specify the device s Table C 2 Fibre Address Conversion Table for HP UX Systems Table 0 C0 C1 C2 C3 C4 C5 C6 C7 AL PA TID AL PA TID AL PA...

Page 383: ... 8F 51 6D 67 52 83 35 99 1E 115 E1 4 C9 20 AC 36 88 52 6C 68 51 84 34 100 1D 116 E0 5 C7 21 AB 37 84 53 6B 69 4E 85 33 101 1B 117 DC 6 C6 22 AA 38 82 54 6A 70 4D 86 32 101 18 118 DA 7 C5 23 A9 39 81 55 69 71 4C 87 31 103 17 119 D9 8 C3 24 A7 40 80 56 67 72 4B 88 2E 104 10 120 D6 9 BC 25 A6 41 7C 57 66 73 4A 89 2D 105 0F 121 D5 10 BA 26 A5 42 7A 58 65 74 49 90 2C 106 08 122 D4 11 B9 27 A3 43 79 59 ...

Page 384: ...2 AD 28 8F 12 6E 28 53 12 39 28 23 12 E0 27 C7 11 AC 27 88 11 6D 27 52 11 36 27 1F 11 DC 26 C6 10 AB 26 84 10 6C 26 51 10 35 26 1E 10 DA 25 C5 9 AA 25 82 9 6B 25 4E 9 34 25 1D 9 D9 24 C3 8 A9 24 81 8 6A 24 4D 8 33 24 1B 8 D6 23 BC 7 A7 23 80 7 69 23 4C 7 32 23 18 7 D5 22 BA 6 A6 22 7C 6 67 22 4B 6 31 22 17 6 D4 21 B9 5 A5 21 7A 5 66 21 4A 5 2E 21 10 5 D3 20 B6 4 A3 20 79 4 65 20 49 4 2D 20 0F 4 D2...

Page 385: ...ast write DRU Data Retention Utility ELBA ending logical block address ESCON Enterprise System Connection IBM trademark for optical channels FC fibre channel FCP fibre channel protocol FIFO first in first out GB gigabyte GUI graphical user interface HA high availability HACMP High Availability Cluster Multiprocessing HARD Hardware Assisted Resilient Data hdisk hard disk HDLM Hitachi Dynamic Link M...

Page 386: ...PB petabyte PC personal computer system PCSI PolyCenter Software Installation PnP Plug and Play PV physical volume P VOL primary volume RAID600 R600 factory model number for the Universal Storage Platform V VM RAID500 R500 factory model number for the TagmaStore USP NSC RAID450 R450 factory model number for the Lightning 9900V RAID400 R400 factory model number for the Lightning 9900 R W RD WR read...

Page 387: ... Control Interface CCI User and Reference Guide 369 TID target ID UR Hitachi Universal Replicator USP Universal Storage Platform VPM Virtual Partition Manager V VOL virtual volume VxVM VERITAS Volume Manager WR write ...

Page 388: ...370 Acronyms and Abbreviations ...

Search results

Summary of Contents for TAGMASTORE MK-90RD011-25

Reviews:

Related manuals for TAGMASTORE MK-90RD011-25

Brands by name

Popular brands

Hitachi TAGMASTORE MK-90RD011-25, User Manual

Search results

Summary of Contents for TAGMASTORE MK-90RD011-25

Reviews:

Related manuals for TAGMASTORE MK-90RD011-25

Brands by name

Popular brands