Hitachi AMS 2000 Series Скачать руководство пользователя страница 5

Страница: 5 / 262

Table of Contents

Hitachi AMS 2000 Family Command Control Interface (CCI) Reference Guide

Recovering the pair . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .2-31

Internal LUN, device recognized by the host . . . . . . . . . . . . . . . . . . . . . .2-32

Pair-splitting guidelines . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .2-32

Data recovery for PSUE using SnapShot . . . . . . . . . . . . . . . . . . . . . . . . . . .2-33

Recovering the pair . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .2-33

Data recovery for PSUE using TrueCopy and TCE . . . . . . . . . . . . . . . . . . . .2-34

Recovering the pair . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .2-34

Maintenance log and tracing functions . . . . . . . . . . . . . . . . . . . . .3-1

Log files . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-2

Trace files . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-4

Trace control command . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-4

How to read detailed error log codes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-5

Solaris . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-6

Linux . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-7

Windows . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-8

Sense code and detail code . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-9

Logging of a command . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .3-66

Command options . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4-1

Command options for copy types. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4-2

Glossary

Index

Содержание AMS 2000 Series

Страница 1: ...Applicable platforms Changes in this revision Getting help Table of contents FASTFIND LINKS MK 97DF8121 20 Hitachi AMS 2000 Family Command Control Interface CCI Reference Guide ...

Страница 2: ...d under the terms and conditions of Hitachi Data Systems applicable agreements All of the features described in this document may not be currently available Refer to the most recent product announcement or contact your local Hitachi Data Systems sales office for information on feature and product availability Notice Hitachi Data Systems products and services can be ordered only under the terms and...

Страница 3: ...Performing CCI Operations 1 1 Important notice 1 2 Environment variables 1 3 Instance number and option for command execution environment 1 4 Creating pairs paircreate 1 7 Splitting pairs pairslpit 1 14 Timing of pairsplit operations 1 19 Resynchronizing pairs pairresync 1 20 Confirming pair operations pairevtwait 1 25 Monitoring pair activity pairmon 1 29 Checking attribute and status pairvolchk ...

Страница 4: ...ddev subcommand 1 73 Drivescan subcommand 1 74 Portscan subcommand 1 75 Sync and syncd subcommand 1 76 Mount subcommand 1 78 Umount subcommand 1 81 Environment variable subcommands 1 83 Command tools 1 85 Inqraid command tool 1 85 Mkconf command tool 1 93 Host group control 1 96 Specifying a host group 1 96 Commands and options including a host group 1 96 Volume migration 1 98 Overview 1 98 Specif...

Страница 5: ...ng SnapShot 2 33 Recovering the pair 2 33 Data recovery for PSUE using TrueCopy and TCE 2 34 Recovering the pair 2 34 3 Maintenance log and tracing functions 3 1 Log files 3 2 Trace files 3 4 Trace control command 3 4 How to read detailed error log codes 3 5 Solaris 3 6 Linux 3 7 Windows 3 8 Sense code and detail code 3 9 Logging of a command 3 66 4 Command options 4 1 Command options for copy typ...

Страница 6: ...vi Table of Contents Hitachi AMS 2000 Family Command Control Interface CCI Reference Guide ...

Страница 7: ...ed SnapShot ShadowImage in system replication hereafter called ShadowImage Synchronous Remote Copy hereinafter called TrueCopy and Asynchronous Remote Copy hereinafter called TCE commands to the AMS array from the open systems host UNIX based or PC server host This preface includes the following information Product version Release notes and readme Changes in this revision Changes in this revision ...

Страница 8: ...e Modular Volume Migration User s Guide Have read and understand the TrueCopy Remote Replication User s Guide Have read and understand the TrueCopy Extended Distance User s Guide Product version This document revision applies to CCI software version 01 32 03 01 or later and AMS 2000 Family firmware version 08C5 K or later Release notes and readme Read the release notes and readme file before insta...

Страница 9: ...is 10 x86 Solaris 10 x64 Microsoft Windows 2000 Windows Server 2003 IA32 Windows Server 2008 IA32 Windows Server 2003 x64 Windows Server 2008 x64 Windows Server 2003 IA64 Windows Server 2008 IA64 Windows Server 2012 x64 Red Hat Red Hat Linux AS 2 1 IA32 Red Hat Linux AS ES 3 0 IA32 Red Hat Linux AS ES 4 0 IA32 Red Hat Linux AS ES 5 0 IA32 Red Hat Linux AS ES 3 0 AMD64 EM64T Red Hat Linux AS ES 4 0...

Страница 10: ...t IA64 it is required to install all the 32 bit compatible packages for IA 32EL Execution Layer When you install the IA 32EL install all the 32 bit compatible packages except CCI for Linux IA64 Vendor Host Operating System Guest Operating System VMware VMware ESX Server 3 0 Windows 2000 Windows Server 2003 Red Hat Linux AS3 0 Red Hat Linux AS4 0 VMware ESX Server 4 0 Windows Server 2003 Windows Se...

Страница 11: ...nstall IA64 N A Windows Server 2008 IA64 N A Windows Server 2012 x64 N A Oracle Solaris 8 SPARC Solaris 9 SPARC Solaris 10 SPARC Solaris 10 x86 Solaris 10 x64 IBM AIX 5 1 AIX 5 2 AIX 5 3 AIX 6 1 Red Hat Red Hat Linux AS ES 2 1 IA32 Red Hat Linux AS ES 3 0 IA32 Red Hat Linux AS ES 4 0 IA32 Red Hat Linux AS ES 5 0 IA32 Red Hat Linux AS ES 3 0 AMD64 EM64T Red Hat Linux AS ES 4 0 AMD64 EM64T Red Hat L...

Страница 12: ...cate variables square brackets Indicates optional values Example a b indicates that you can choose a b or nothing braces Indicates required or expected values Example a b indicates that you must choose either a or b vertical bar Indicates that you have a choice between two or more options or arguments Examples a b indicates that you can choose a b or nothing a b indicates that you must choose eith...

Страница 13: ... Release Notes Storage Navigator Modular 2 Release Notes Installation and getting started The following documents provide instructions for installing an AMS 2000 Family storage system They include rack information safety information site preparation instructions getting started guides for experienced users Physical capacity unit Value 1 KB 1 000 bytes 1 MB 1 000 KB or 1 0002 bytes 1 GB 1 000 MB or...

Страница 14: ...t Installation Guide MK 08DF8189 Describes how to prepare Hitachi AMS 2000 Family Fibre Channel storage systems for use with host servers running supported operating systems AMS 2000 Family iSCSI Host Installation Guide MK 08DF8188 Describes how to prepare Hitachi AMS 2000 Family iSCSI storage systems for use with host servers running supported operating systems Storage and replication features Th...

Страница 15: ...cribes how to perform high speed nondisruptive local mirroring to create a copy of mission critical data in AMS 2100 AMS 2300 and AMS 2500 storage systems ShadowImage keeps data RAID protected and fully recoverable without affecting service or performance levels Replicated data volumes can be split from host applications and used for system backups application testing and data mining applications ...

Страница 16: ...em Hardware Guide MK 97DF8007 Provides detailed information about installing configuring and maintaining an AMS 2500 storage system AMS 2000 Family Storage System Reference Guide MK 97DF8008 Contains specifications and technical information about power cables system parameters interfaces logical blocks RAID levels and configurations and regulatory information about AMS 2100 AMS 2300 and AMS 2500 s...

Страница 17: ...3 Describes how to use CCI to perform TrueCopy and ShadowImage operations on AMS 2100 AMS 2300 and AMS 2500 storage systems Command Line Interface CLI The following documents describe how to use Hitachi Storage Navigator Modular 2 to perform management and replication activities from a command line Storage Navigator Modular 2 Command Line Interface CLI Unified Reference Guide MK 97DF8089 Describes...

Страница 18: ...ou need to contact the Hitachi Data Systems support center please provide as much information about the problem as possible including The circumstances surrounding the error or failure The exact content of any messages displayed on the host systems The exact content of any messages displayed on Storage Navigator Modular 2 The Storage Navigator Modular 2 configuration information This information i...

Страница 19: ...ronizing pairs pairresync Confirming pair operations pairevtwait Monitoring pair activity pairmon Checking attribute and status pairvolchk Displaying pair status pairdisplay Checking pair currency paircurchk Performing takeover operations horctakeover Displaying configuration information Data protection Controlling CCI activity Windows 2000 and Windows Server subcommands Command tools Host group c...

Страница 20: ...ine is 4 min for each CTL the copying process will be suspended for 4 minutes per CTL The waiting process in the batch file may end abnormally when executing a copy using a batch file by designating a specific time Commands that change the status of pairs paircreate pairsplit pairresync of TrueCopy and TCE cannot be executed while the host is re starting in the TrueCopy and TCE environment The com...

Страница 21: ...e trace mode can be changed using the horcctl c b command HORCM_TRCUENV Specifies whether or not to succeed the trace control parameters TRCLVL and TRCBUF as they are when a command is issued When this variable is specified the HORCM default trace control parameters are used to the trace control parameters of HORCM as global parameters If not the default trace control parameters for HORCM commands...

Страница 22: ...orcctl d s HORCC_TRCLVL Specifies the command trace level 0 15 default 4 or the specified HORCM trace level If a negative value is specified trace mode is canceled The default trace level for HORCM commands can be changed using the horcctl d l HORCC_TRCBUF Specifies the command trace mode If specified data is written in the trace file in the non buffer mode If not the HORCM trace mode is used The ...

Страница 23: ...I instance This option selects the ShadowImage SnapShot Data Retention execution environment and specifies the instance number Example Execute the pairdisplay command in the ShadowImage SnapShot Data Retention execution environment setting the instance number as no instance number pairdisplay g group IM Execute the pairdisplay command in the ShadowImage SnapShot Data Retention execution environmen...

Страница 24: ... number X Not specified HORCMINST X Instance number X Not specified No instance number Table 1 3 Command Environment Variables IH IM or ITC ISI Option HORCMINST Command Environment IH or ITC Don t care TrueCopy and TCE IM or ISI ShadowImage SnapShot and Data Retention Not specified HORCC_MRCF 1 ShadowImage SnapShot and Data Retention Not specified TrueCopy and TCE C HORCM etc pairdisplay h Model R...

Страница 25: ...te command ShadowImage SnapShot allows you to simultaneously create and split pairs using a single CCI command When split is used the pair status changes from COPY to PSUS instead of PAIR when the initial copy operation is complete Table 1 4 lists and describes the paircreate command parameters and returned values Figure 1 1 Pair Creation C HORCM etc pairdisplay z pairdisplay HOMRCF 5 IM pairdispl...

Страница 26: ...inates before the initial copy operation is complete except when the nocopy option is specified Use the pair event waiting or pair display command to verify that the initial copy operation completed successfully status changes from COPY to PAIR or from COPY to PSUS if the split option was specified The execution log file also shows completion of the initial copy operation Table 1 4 Paircreate Comm...

Страница 27: ...ted as the paired logical volume d or group dg This option is effective without specification of g group option If the specified LDEV is contained in two or more groups the command is executed on the first group The seq LDEV values can be specified in hexadecimal by addition of 0x or decimal notation f fence CTGID or fg fence CTGID TrueCopy and TCE only Specifies the level for assuring the consist...

Страница 28: ... Marker ShadowImage and SnapShot only Splits the paired volume after the initial copy operation is complete Also an optional character string with ASCII 31 characters which is specified by a user can be added to the S VOL V VOL as a Split Marker m mode ShadowImage only For mode users can specify the following option noread Specifies the noread mode for hiding the secondary volume The secondary vol...

Страница 29: ...number data pool ID which the pair to create uses When one P VOL configures a pair with two or more V VOLs the pair configured by the same P VOL needs to use a common data pool If this option is omitted 0 is used as a data pool ID Returned values Normal termination 0 When creating groups 0 normal termination for all pairs Abnormal termination Returns a common error code and a unique error code for...

Страница 30: ...1 12 Performing CCI Operations Hitachi AMS 2000 Family Command Control Interface CCI Reference Guide Figure 1 4 Paircreate Command m Option Correct Example ...

Страница 31: ...Performing CCI Operations 1 13 Hitachi AMS 2000 Family Command Control Interface CCI Reference Guide Figure 1 5 Paircreate Command m Option Incorrect Example ...

Страница 32: ...d is issued If you want to synchronize the volumes the pairsplit command must be issued after write I Os to the paired volume have been completed When splitting a pair regardless of whether you can change the pair status of S VOL changing the pair status of P VOL to SMPL takes priority Therefore if the pair status of S VOL cannot be changed to SMPL the pair status of P VOL might not correspond wit...

Страница 33: ...ion for command execution environment on page 1 4 g group Specifies a group name defined in the configuration definition file This option must always be specified The command is executed for the specified group unless the d pair Vol option is specified d pair Vol Specifies the paired logical volume name defined in the configuration definition file When this option is specified the command is execu...

Страница 34: ...ry host if the host possessing the primary volume is down or has failed RB for TrueCopy Backs up the secondary volume forcibly from SSWS into PSUS PSUE SSUS mode This makes it able to back up from the primary volume if the user wants to back from the secondary host in SSWS state due to a Link failure of the primary host l When this command cannot utilize the remote host for host down this option e...

Страница 35: ...e operation must be performed for each pair within that group Note 2 When two or more groups which are specified in the configuration definition file exist in the CTG an instruction to split the pairs issued to a group specified in the configuration definition file is executed for the entire CTG Note 3 When the TCE pairsplit command is executed the response time differs depending on the options pa...

Страница 36: ... C HORCM etc pairsplit g VG01 C HORCM etc pairdisplay g VG01 Group PairVol L R Port TID LU M Seq LDEV P S Status Seq P LDEV M VG01 oradb1 L CL1 A 1 1 0 85000174 1 P VOL PSUS 85000174 2 VG01 oradb1 R CL1 A 1 2 0 85000174 2 S VOL SSUS 1 C HORCM etc pairsplit g VG01 E C HORCM etc pairdisplay g VG01 Group PairVol L R Port TID LU M Seq LDEV P S Status Seq P LDEV M VG01 oradb1 L CL1 A 1 1 0 85000174 1 P...

Страница 37: ...e file system buffer and then split the volume pair in Read Write mode Verify that the pairsplit is complete and then use the fsck command to check the consistency of the secondary volume file system Mount mount the secondary volume Execute the backup Restore the volumes to their previous state and resynchronize the volume pair ShadowImage and TrueCopy Instantaneous offline backup of the Windows 2...

Страница 38: ...olume becomes write disabled when the pairresync command is issued Table 1 6 lists and describes the pairresync command parameters and returned values The primary volume s host is automatically detected by the pairresync command so the host does not need to be specified in the pairresync command parameters The pairresync command terminates before resynchronization of the secondary or primary volum...

Страница 39: ...store option is specified Before issuing the pairresync command normal or reverse direction make sure that the secondary volume is not mounted on any UNIX system Before issuing a reverse pairresync command make sure that the primary volume is not mounted on any UNIX system Figure 1 13 Pair Resynchronization Figure 1 14 Normal Resync and ShadowImage Restore Resync NOTE Commands that change the stat...

Страница 40: ...figuration definition file This option must always be specified The command is executed for the specified group unless the d pair Vol option is specified d pair Vol Specifies a paired logical volume name defined in the configuration definition file When this option is specified the command is executed for the specified paired logical volumes d g raw_device MU Searches a group on the configuration ...

Страница 41: ...nning of a command argument The command execution log is not affected by this option l When this command cannot utilize the remote host for host down this option enables a pairresync operation by the local host only The target volume of the local host can be P VOL or S VOL restore Performs reverse resync from secondary volume to primary volume swaps TrueCopy only Executed from the S VOL side when ...

Страница 42: ... for Pairresync Figure 1 18 Pairresync Command Figure 1 19 Swap Operation C HORCM etc pairresync g VG01 c 15 C HORCM etc pairevtwait g VG01 s pair t 300 10 pairevtwait Wait status done C HORCM etc pairdisplay g VG01 Group PairVol L R Port TID LU M Seq LDEV P S Status Seq P LDEV M VG01 oradb1 L CL1 A 1 1 0 85000174 1 P VOL PAIR 85000174 2 VG01 oradb1 R CL1 A 1 2 0 85000174 2 S VOL PAIR 1 ...

Страница 43: ...ting command parameters and returned values The pair event waiting command waits until the specified status is established and terminates abnormally if an abnormal status is detected The transition of the paired volume status is judged by the status of the primary volume If the event waiting command is issued for a group the command waits until the status of each volume in the group becomes identi...

Страница 44: ...air logical volumes in a ShadowImage or SnapShot environment see example in Figure 1 21 If the l option is specified this option tests status of a cascading TrueCopy or TCE volume on a local host If no l option is specified this option tests status of a cascading TrueCopy or TCE volume on a remote host The target TrueCopy or TCE volume must be P VOL or SMPL FMRCF MU or FBC MU Forcibly specifies a ...

Страница 45: ... a local host only The target volume of the local host can be P VOL or S VOL nomsg Suppresses messages to be displayed when this command is executed It is used to execute a command from a user program This option must be specified at the beginning of a command argument The command execution log is not affected by this option Returned values When the nowait option is specified Normal termination 1 ...

Страница 46: ...erface CCI Reference Guide Figure 1 21 Example of FHORC Option for Pairevtwait Figure 1 22 Example of FMRCF Option for Pairevtwait Figure 1 23 Pairevtwait Command C HORCM etc paircreate g VG01 vl c 15 C HORCM etc pairevtwait g VG01 s pair t 300 10 pairevtwait Wait status done ...

Страница 47: ...s change to the output result of the pairmon command You can calculate the maximum value of this time in the following formula The maximum time to reflect the pair status to the output result Interval time x number of all pairs defined in the configuration definition file Value of poll in the configuration definition file Calculating the value for poll 0ms 6000 x the number of all CCI instances th...

Страница 48: ...is reported and the event is reset If there is no pair status transition information to be reported the command waits The report mode consists of the three flags allsnd resevt and nowait options allsnd Reports all events if there is pair status transition information resevt Reports events if there is pair status transition information then resets all events nowait When this option is specified the...

Страница 49: ...e events exist it reports all events Invalid resevt When HORCM does not have an event this option waits until an event occurs If one or more events exist it reports one event and resets all events Invalid resevt allsnd When HORCM does not have an event this option waits until an event occurs If one or more events exist it reports all events and resets all events Invalid nowait When HORCM does not ...

Страница 50: ... specified Normal termination 1 The volume attribute is SMPL 2 The volume attribute is P VOL 3 The volume attribute is S VOL Abnormal termination Returns a common error code and a unique error code for this command For details on error codes see Chapter 2 Troubleshooting When the ss option is specified Normal termination 11 The status is SMPL For SnapShot 22 The status is PVOL_COPY or PVOL_RCPY 23...

Страница 51: ...of paired volume For the pair status in the case of specifying a group refer to Table 1 11 fence Shows fence level CTGID Shows CTGID MINAP The number of active link paths of TrueCopy or TCE is shown on the P VOL pairvolchk g ora Pairvolchk Volstat is S VOL status PAIR fence ASYNC CTGID 5 MINAP 2 Table 1 11 Truth Table for Pairvolchk Group Status Display Status of Each Volume in the Group Option CO...

Страница 52: ...e false TRUE x PSUS false false false false TRUE PAIR ss TRUE x x x x COPY false TRUE x x x PSUE false false x x TRUE PAIR false false TRUE false false PFUS false false false TRUE false PSUS Table 1 11 Truth Table for Pairvolchk Group Status Display Continued Status of Each Volume in the Group NOTE A case where the pairvolchk s command is executed with the setting of the environmental variable of ...

Страница 53: ...tion displays status of a cascading TrueCopy or TCE volume on a local host If no l option is specified this option displays status of a cascading TrueCopy or TCE volume on a remote host This option cannot be specified with m mode option on the same command line FMRCF MU or FBC MU Forcibly specifies a cascading ShadowImage or SnapShot volume for specified pair logical volumes on a TrueCopy or TCE e...

Страница 54: ... 20 0 85000101 20 S VOL SSUS 21 W pairdisplay g oradb fwe Group PairVol L R WWN LU M Seq LDEV P S Status Seq P LDEV M CTG CM EM E Seq E LDEV LUN WWN oradb oradev1 L 50060e8010200650 21 0 85000101 21 P VOL PSUS 85000101 20 W N 60060e80102006500510ffa500000014 oradb oradev1 R 50060e8010200654 20 0 85000101 20 S VOL SSUS 21 W N 60060e80102006500510ffa500000015 CLI Used to specify display for command ...

Страница 55: ...ent pair synchronization CR Shows the copy operation rate identical rate of a pair BMP Shows the identical percentage of BITMAP for both P VOL and S VOL Options continued Note This option displays nothing if the target volume is NOT SnapShot volume m mode Used to display a paired status of each mirror descriptors for the specified pair logical volume and used for paired status indication of the ca...

Страница 56: ...sure of the pair which is displayed by Navigator 2 status of which is PSUS PSUS N and no reading writing from to which is allowed Figure 1 29 shows examples of the m option of the pairdisplay command Display examples for m all Figure 1 29 Pairdisplay Command m Option shows examples of the fe option of the pairdisplay command Figure 1 30 Figure 1 31 and Figure 1 32 show examples of the fe option of...

Страница 57: ... pairdisplay command includes UTC TIME The UTC when the Split Marker was added to the V VOL is displayed Split Marker The Split Marker added to the V VOL is displayed When the pair concerned is the SnapShot pair that was split by the pairsplit ms command the Split Marker is displayed as information on the V VOL Figure 1 34 shows examples of the v pid option of the pairdisplay command pairdisplay g...

Страница 58: ...rcurchk command checks the currency of the TrueCopy or TCE secondary volumes by evaluating the data consistency based on pair status and fence level Table 1 13 specifies the data consistency for each possible state of a TrueCopy or TCE volume A paired volume or group can be specified as the target of the paircurchk command The paircurchk command assumes that the target is an S VOL If the paircurch...

Страница 59: ...SUE the mirror consistency is suspected Suspected S VOL has no mirror consistency OK Mirroring consistency is assured in TrueCopy Mirroring consistency is not assured in TCE Table 1 13 Data Consistency Displayed by the Paircurchk Command Object Volume Paircurchk Attribute Status Fence User Specification SVOL_Takeover Processing SMPL To be confirmed Not executed P VOL To be confirmed Not executed S...

Страница 60: ...of TCE the horctakeover command is executed for each CTG however the paircurchk command is executed for the specified group d pair Vol This option is used to specify the paired logical volume name defined in the configuration definition file When this option is specified the command is executed for the specified paired logical volumes d g seq LDEV MU Searches a group on the configuration definitio...

Страница 61: ... the PSUE status depending on the time when the change is made because of a collision with an I O instruction issued by a host to the local array This status transition occurs because the change is untimely However even if this occurs reading to and writing from an S VOL of the remote array can be done because the horctakeover command keeps the S VOL in the PSUS status SSWS Note 2 In the case of T...

Страница 62: ...d execution environment Refer to Instance number and option for command execution environment on page 1 4 g group Specifies the group name defined in the configuration definition file This option must always be specified The command is executed for the specified group unless the d pair Vol option is specified d pair Vol This option is used to specify the paired logical volume name defined in the c...

Страница 63: ...cute a command from a user program This option must be specified at the beginning of a command argument The command execution log is not affected by this option Returned values Normal termination 0 Nop takeover no operation 1 Swap takeover was successfully executed 2 SVOL takeover was successfully executed 3 PVOL SMPL takeover was successfully executed 4 PVOL PSUE takeover was successfully execute...

Страница 64: ...f attributes Table 1 17 lists the volume attributes and specifies the TCE takeover action for each combination of attributes Table 1 16 Volume Attributes and Takeover Actions TrueCopy Local Node Takeover Node Remote Node Volume Attribute Fence Level and Status Volume Attribute P VOL Status Takeover Action SMPL SMPL NG 1 P VOL Nop Takeover 2 S VOL Volumes not conform 3 Unknown 4 NG P VOL primary Fe...

Страница 65: ...mmands except the fc option of the pairdisplay command When the attribute of the self node volume is SSUS the target displays the NG message but the status changes to SSWS Table 1 17 Volume Attributes and Takeover Actions TCE Local Node Takeover Node Remote Node Volume Attribute Fence Level and Status Volume Attribute P VOL Status Takeover Action SMPL SMPL NG 1 P VOL Nop Takeover 2 S VOL Volumes n...

Страница 66: ...US state which allows and keeps track of write I Os using a bitmap for the S VOL This special state is displayed as SSWS using the fc option of the pairdisplay command s SVOL takeover function The SVOL takeover function allows the takeover node to use the secondary volume except in COPY state in SSUS PSUS state that is reading and writing are enabled on the assumption that the remote node possessi...

Страница 67: ... group This intermingled pair status is PSUE as the group status therefore pairvolchk command returned gives priority to PSUE rather than PSUS as the group status This special state turns back to the original state when the pairresync command is issued PVOL SMPL takeover Changes the primary volume to the simplex SMPL state First PVOL takeover executes PVOL PSUE takeover further than PVOL SMPL take...

Страница 68: ...forming CCI Operations Hitachi AMS 2000 Family Command Control Interface CCI Reference Guide Figure 1 36 TrueCopy or TCE Takeover Example UNIX System Figure 1 37 TrueCopy or TCE Takeover Example Windows System ...

Страница 69: ...n a port for array pd g raw_device Specifies the raw device name This option finds Seq and port_name of the array that the specified device can be connected and scans the port of the array which corresponds with the unit ID that searches the unit ID from Seq This option must always be specified pdg option is specified to find host group and to display LUN s Seq Used to specify the Seq of the array...

Страница 70: ...numbers indicate the drive number LETALL Volume Phys D Vol Dms Dmt Dmr X DskY Vol Dms Dmt Dmr X DskY For Windows LDM volumes refer to the Hitachi AMS 2000 Family Command Control Interface CCI User s Guide find g Displays the port target ID and LUN array notation which was mapped for LDEV using a special file raw device file provided via STDIN see Figure 1 39 If target ID and LUN are Unknown for th...

Страница 71: ... instance and sends the unwritten data on the file system buffer to the logical drive physical disk to synchronize the pair see Figure 1 43 Notes The sync option executes the following procedures depending on the execution condition If the logical device that corresponds to the group described in the configuration definition file is closed from the application the sync option flushes the system bu...

Страница 72: ...hows the group name dev_group described in the configuration definition file If is displayed the device that corresponds to this group does not exist in the configuration definition file PairVol Shows the dev_name described in the configuration definition file Port Shows the port name described in the configuration definition file TARG Shows the target ID described in the configuration definition ...

Страница 73: ...n definition file LUN Shows the LU number described in the configuration definition file M Shows the MU described in the configuration definition file SERIAL Shows the production serial number of the array LDEV Shows the LDEV within the array LDEV indicates LU echo Phys raidscan find verify DEVICE_FILE Group PairVol PORT TARG LUN M SERIAL LDEV Harddisk0 oradb oradev1 CL1 A 3 0 0 85003501 17 Harddi...

Страница 74: ...RROR CMDDEV Harddisk0 SER 85006145 LDEV 9 DF600F CM If an STDIN device is shared by multiple device files and is displayed as target device a comment is displayed as follows and the target device will not be included ERROR LDEV LINK Harddisk17 SER 85006145 LDEV 5 FIBRE FCTBL 4 If the STDIN device does not have a proper MU a comment is displayed as follows and the target device will not be included...

Страница 75: ...dar h q z I H M instance p port targ lun mun pd g raw_device s interval count Options h Displays help usage and version information q Terminates the interactive mode and exits the command z or zx Makes the raidar command enter the interactive mode The zx option guards performing of the HORCM in the interactive mode When this option detects a HORCM shut down interactive mode terminates I H M instan...

Страница 76: ...the paired volume IOPS Shows the number of I Os read write per second total I O rate HIT Shows the hit rate for read I Os read hit rate W Shows the ratio of write I Os to total I Os percent writes IOCNT Shows the number of times of write and read Raidqry command The raidqry command RAID query displays the configuration of the connected host and array Table 1 20 lists and describes the raidqry comm...

Страница 77: ...ractive mode and exits the command z or zx Makes the raidqry command enter the interactive mode The zx option guards performing of the HORCM in the interactive mode When this option detects a HORCM shut down interactive mode terminates I H M instance or I TC SI instance Specifies the instance number and the command execution environment Refer to Instance number and option for command execution env...

Страница 78: ...for the maintenance MUN H When the g option is used this column shows the number of maximum MUs for TrueCopy or TCE that made the consistence in a group MUN M When the g option is used this column shows the number of maximum MUs for ShadowImage or SnapShot that made the consistence in a group Data protection The AMS array supports parameters for data protection of each LU and these parameters are ...

Страница 79: ... executed on the first group d g seq LDEV MU Searches a group on the configuration definition file local instance for the specified LDEV and if the specified LDEV is in the group the target volume is executed as the paired logical volume d or group dg This option is effective without specification of g group option If the specified LDEV is contained in two or more groups the command is executed on...

Страница 80: ...d must be temporarily placed in the status in which the check on it is inhibited by the raidvchkset vg command Place the volume again in the status in which it is checked when the LVM configuration change is completed There may be a case where a volume to which the data protection is applied cannot be used as a resource of the HA cluster software such as the MSCS This is because the HA cluster sof...

Страница 81: ...ups the command is executed on the first group d g seq LDEV MU Searches a group on the configuration definition file local instance for the specified LDEV and if the specified LDEV is in the group the target volume is executed as the paired logical volume d or group dg This option is effective without specification of g group option If the specified LDEV is contained in two or more groups the comm...

Страница 82: ...ite from or to the object volume S E The volume can be assigned to an S VOL S D The volume cannot be assigned to an S VOL PI C R W S This displays the permission flags that shows whether each mode flags can be changed to enable or not I E This shows that I flag can be changed to enable I D This shows that I flag cannot be changed to enable C E This shows that C flag can be changed to enable C D Th...

Страница 83: ...vailable capacity for the volume data on the pool Capacity Shows the total capacity in the pool Figure 1 50 Raidvchkdsp Command Examples with c Options The output of the raidvchkdsp command with c option includes Group Shows the group name dev_group described in the configuration definition file Pair Vol Shows the paired volume name dev_name described in the configuration definition file Port Show...

Страница 84: ...port for AMS array pd g raw_device Specifies the raw device name This option finds Seq and port_name of the AMS array that the specified device can be connected and scans the port of the AMS array which corresponds with the unit ID that searches the unit ID from Seq This option must always be specified pdg option is specified to find host group and to display LUN s Seq Used to specify the Seq of t...

Страница 85: ...ct volume W D It is prohibited to write from or to the object volume S E The volume can be assigned to an S VOL S D The volume cannot be assigned to an S VOL PI C R W S This displays the permission flags that shows whether each mode flags can be changed to enable or not I E This shows that I flag can be changed to enable I D This shows that I flag cannot be changed to enable C E This shows that C ...

Страница 86: ...meters raidvchkscan p CL1 A v pool PORT ALPA C TID LU Seq Num LDEV Bsize Available Capacity CL1 A ef 5 1 0 85000052 1 0 2048 0 0 CL1 A ef 5 1 1 85000052 1 1 2048 0 0 CL1 A ef 5 1 2 85000052 1 2 2048 0 0 CL1 A ef 5 1 3 85000052 1 3 2048 5120 5120 CL1 A ef 5 1 4 85000052 1 4 2048 0 0 CL1 A ef 5 1 5 85000052 1 5 2048 5120 5120 Table 1 24 Horcmstart Command Parameters Parameter Value Command Name horc...

Страница 87: ...ctory This log directory must give an equality class with HORCM_LOG Note 2 The HORCMSTART_WAIT environment variable waits until HORCM becomes ready for use However this time may take longer than usual depending the operating system HBA driver or command device As a result a time out may occur exceeding this waiting time and the start may fail the process exists in the status where HORCM is startin...

Страница 88: ...scribes the horcctl command parameters Table 1 25 Horcmshutdown Command Parameters Parameter Value Command Name horcmshutdown Format horcmshutdown sh inst horcmshutdown exe inst Option Inst Specifies the HORCM CCI instance number numerical value When this option is specified the command stops the specified HORCM instance When this option is not specified the command refers to the instance environm...

Страница 89: ...ting Setting a trace level other than 4 may impact problem resolution If you request a change of the trace level using the horcctl l level command a warning message is displayed and this command enters interactive mode b y n Sets the trace writing mode Y buffer mode N synchronous mode t type Sets the trace type range 0 to 511 When this option is used only traces of the specified type are output On...

Страница 90: ... trace control parameters of the HORC manager and HORC commands are changed and displayed These trace control parameters should not be changed unless directed by a CS S service representative For cancel Enter q option For continue Re enter c or d options WARNING horcctl HOMRCF q C HORCM etc C HORCM etc horcctl d logdir C HORCM log1 curlog Client trace ON level 4 mode Buffer size 1024 KB type 0 1 2...

Страница 91: ...command used as an option of the raidscan command output The following searches for command devices in the range of disk drive numbers 0 to 20 Figure 1 56 Findcmddev Subcommand CAUTION The findcmddev subcommand must be used when HORCM is not running NOTE The findcmddev subcommand searches for the physical and logical devices associated with the command device If the command device is indicated as ...

Страница 92: ...r system PhId Shows the bus number on the device adapter port recognized by the Windows 2000 or Windows Server 2003 system Tid Shows the target ID of the hard disks on the specified port and bus LUN Shows the LU number of the hard disk on the specified port bus and TID Port CLX Y Shows the port number on the array Ser Shows the production number of the array Table 1 28 Drivescan Subcommand Paramet...

Страница 93: ...es for the range of ports from 0 to 20 Figure 1 58 Portscan Subcommand The output of the portscan subcommand includes Port Shows the port number on the device adapter recognized by the Windows system IID Shows the initiator ID on the specified device adapter port PhId Shows the BUS number on the specified device adapter port Tid Shows the target ID of the hard disks on the specified adapter port a...

Страница 94: ...00 Windows Server systems only Argument A B C directory or directory pattern Specifies the logical devices that you want to synchronize The data is flushed to the specified logical device and to the physical device that corresponds to the specified logical device If a directory mounted volume exists in the specified logical device the data will be flushed including the directory mounted volume as ...

Страница 95: ...arddiskVolume1 SYNC D hd1 HarddiskVolume8 SYNC D hd2 HarddiskVolume9 SYNC G HarddiskVolume10 drive 0 N Specifies the range of devices on the Windows 2000 or Windows Server system Volume 0 N Synchronizes the data to the specified LDM logical device manager volume The LDM volume specifies the following device objects Vol Dms Dmt Dmr or Volume GUID Note The sync command executes the following procedu...

Страница 96: ...e was mounted using the x mount command Correct Example Wrong Example Wrong Example Be awa CAUTION The partition on the specified disk drive hard disk must be recognized on the Windows 2000 or Windows Server system pairsplit x mount F pairsplit x mount F mnt pairsplit x mount F CAUTION To avoid Windows Server mount problems set USE_MOUNTVOL_P of the environment variable To avoid mount problems ass...

Страница 97: ...irectory mount point in the logical device The character string of the directory cannot include space letters pairsplit x mount D hd1 Vol8 D hd1 HarddiskVolume8 pairsplit x mount D hd2 Vol9 D hd2 HarddiskVolume9 If this command is executed without any argument the device that is already mounted will be displayed NOTE When mounting it by using the mountvol command supplied with Windows 2000 or Wind...

Страница 98: ...ment for mount sub command on Windows 2000 and Windows Server the Volume guid of secondary volumes S VOL or V VOL of ShadowImage SnapShot TrueCopy or TCE is set by recognizing from OS by the Control Panel Administrative Tools Computer Management Storage folder Rescan Disks while status is PSUS after pair create Afterwards the set Volume guid can be confirmed by inqraid exe CLI Vol fv However if Vo...

Страница 99: ...ent is started or the Rescan Disks is executed on Windows Server 2003 the Write command may be issued by Windows Server 2003 Besides the Write command by Disk Management start or the Rescan Disks is also issued to a logical drive unmounted by the unmount sub command Therefore when Disk Management is started or the Rescan Disk is executed in the status where a logical drive is not writable in the d...

Страница 100: ...arg Lun Shows the port number path ID bus target ID and LUN for the specified drive Table 1 32 Umount Subcommand Parameters Parameter Value Command Name umount Format x umount drive x umount drive directory Windows 2000 and Windows Server systems only Argument drive Specifies the mounted logical device Drive directory Specify the mounted logical device for drive directory Specifies the directory f...

Страница 101: ...ote 1 For Windows 2000 or Windows Server system Even if this sub command is executed a drive letter may not be deleted In this case the target volume may be used Execute the command after making the target volume to unused status Alternatively a drive letter can be deleted by activating the Disk Management in the Control Panel Administrative Tools Computer Management Storage folder Note 2 If you u...

Страница 102: ...le Important Always set HORCC_MRCF 1 for the ShadowImage SnapShot Data Retention Figure 1 63 Environment Variable Subcommand Table 1 33 Environment Variable Subcommand Parameters Paramet er Value Command Name setenv usetenv env sleep Format x setenv vaname value x usetenv vaname x env x sleep time Argument Vaname Specifies the environment variable to be set or canceled Value Specifies the value or...

Страница 103: ...roup on the configuration definition file local instance from special file of STDIN by using pairdisplay command and uses the following options of the pairdisplay command to display its state The find option executes the following command see Figure 1 72 pairdisplay d Seq LDEV 0 1 2 l fx CLI 2 dev null The find c option executes the following command and then displays the result edited to CLI form...

Страница 104: ...er of the array and the LDEV number and then reads the applicable VOLssss_llll ini file Therefore even if the hard disk number is changed due to changing the configuration the signature and the volume layout information will be set correctly since it is managed by the array serial number and the LDEV number For PTN specify a pattern for selecting the character string that is given as a device by a...

Страница 105: ...dev sdc inqraid Table 1 34 Inqraid Command Parameters Continued Parameter Value ioscan fun grep rdsk inqraid dev rdsk c0t2d1 ST CL2 A Ser 85003005 LDEV 9 HITACHI DF600F HORC SMPL HOMRCF MU 0 SMPL MU 1 NONE MU 2 NONE RAID5 Group 2 0 SSID 0x0000 dev rdsk c0t4d0 ST CL2 A Ser 85003005 LDEV 14 HITACHI DF600F CM ls dev rdsk inqraid dev rdsk c0t2d1s2 ST CL2 A Ser 85003005 LDEV 9 HITACHI DF600F HORC SMPL ...

Страница 106: ...r Linux systems TID Target ID of the volume Displayed only for Linux systems ls dev rdisk dsk inqraid dev rdisk dsk10c ST CL2 A Ser 85003005 LDEV 9 HITACHI DF600F HORC SMPL HOMRCF MU 0 SMPL MU 1 NONE MU 2 NONE RAID5 Group 2 0 SSID 0x0000 dev rdisk dsk11c ST CL2 A Ser 85003005 LDEV 14 HITACHI DF600F CM echo hd10 11 inqraid Harddisk10 ST CL2 A Ser 85003005 LDEV 9 HITACHI DF600F HORC SMPL HOMRCF MU 0...

Страница 107: ...volumes between the hosts NOTE The display of HOMRCF Group and SSID depends on the array firmware level C HORCM etc echo hd01 hd03 inqraid find Group PairVol L R Port TID LU M Seq LDEV P S Status Seq P LDEV M horcl dev00 L CL2 A 0 0 0 85006145 0 S VOL SSUS 9 Harddisk1 Group PairVol L R Port TID LU M Seq LDEV P S Status Seq P LDEV M horcl dev10 L CL2 A 2 3 0 85006145 3 S VOL SSUS 6 Harddisk3 C HORC...

Страница 108: ...IWP Option Example Windows The output of the inqraid command with CLIWP includes DEVICE_FILE Shows only the device file name WWN PWWN or NWWN For fibre channel if CLIWP option is specified this option shows the Port_WWN of the host adaptor for the specified device If CLIWN option is specified this option shows the Node_WWN of the host adaptor For iSCSI 0000000000000000 will be always displayed AL ...

Страница 109: ...d in Noread status However executing the pairsplit command and then executing the inqraid svinf command results in generation of the device object Device HarddiskVolume and the Volume guid C HORCM etc echo hd0 10 inqraid sort CM CLI HORCM_CMD dev_name dev_name dev_name UnitID 0 Serial 85003001 PhysicalDrive6 NOTE The unit ID is added in the order of the array s product number If multiple command d...

Страница 110: ...he serial number of the array and the LDEV number will be sorted in numbers Example The following is an example of using the fw option of the inqraid command Figure 1 79 Inqraid Command fw Option Example Windows D HORCM etc echo hd5 hd4 hd3 inqraid svinf sort VOL85006145_51_5296A763 Harddisk3 DF600F VOL85006145_52_5296A760 Harddisk4 DF600F VOL85006145_53_5296A761 Harddisk5 DF600F C horcm etc inqra...

Страница 111: ...e g g group m mu I inst s service a c drive Options If no argument this command creates a mode that waits for STDIN without argument g g group This option specifies the group described in the configuration definition file If omitted VG is used for the group name gg option is specified to find host group and to display LUN m MU This option specifies the mirror descriptor MU I inst This option shows...

Страница 112: ...isk6 ORA ORA_005 CL2 A 0 5 0 85006145 5 Harddisk6 0 85006145 HORCM Shutdown inst 9 Please check C HORCM horcm9 conf C HORCM log9 curlog horcm_ _log txt and modify ip_address service C HORCM dir b horcm9 conf log9 Tool usr C HORCM type horcm9 conf Created by mkconf on Tue Sep 11 17 11 41 HORCM_MON ip_address service poll 10ms timeout 10ms localhost 52323 1000 Note 3000 HORCM_CMD dev_name dev_name d...

Страница 113: ...rol the target device will be displayed as the comment shown below and will be omitted Example NOTE Remember to change the value of poll 0ms parameter using the equation Unit Ids are added in the order of the array product number If multiple command devices exist in the array the device file that was shared between the ports of the array will be selected and will be handled as an alternative comma...

Страница 114: ...as follows CL1 A GRP GRP are up to 127 Specifying the host group for the raidscan command as follows Specifying the host group for the configuration file If the port including a host group is specified to the port name then maximum of specifiable LUNs are up to 255 2 Specify the port strings CCI supports four formats Specifying the Port name without a host group CL1 A CL1 An where n unit ID for mu...

Страница 115: ...fied device hgrp 1 is LDEV 0257 ls dev rdsk c57 raidscan findg DEVICE_FILE UID S F PORT TARG LUN SERIAL LDEV PRODUCT_ID dev rdsk c57t4d0 0 F CL1 A 1 4 0 85001000 256 DF600F CM dev rdsk c57t4d1 0 F CL1 A 1 4 1 85001000 257 DF600F dev rdsk c57t4d2 0 F CL1 A 1 4 2 85001000 258 DF600F ls dev rdsk c57 raidscan findg conf 0 g ORA HORCM_DEV dev_group dev_name port TargetID LU MU dev rdsk c57t4d1 SER 8500...

Страница 116: ...migration source volume and the migration destination volume The volumes are registered in the horcm conf file of CCI in the same way as ShadowImage to define the mapping When the remote instance is instructed to execute the migration by Volume Migration the volume of the remote instance is interpreted as the migration source volume and a volume of the local instance is made to be the migration de...

Страница 117: ...Name paircreate Format paircreate g group d pair Vol m cc vl r c size Options m cc This option instructs the copying of the volume migration to be made Note This option cannot be specified with split option in the same command vl pvol or vr svol Specifies the data flow direction and must always be specified The vl pvol specifies the local instruction that is an instruction to copy a local instance...

Страница 118: ...n number Acceptable No operation is executed though a command is accepted Shaded portions Command execution is rejected and the operation terminates abnormally C HORCM etc echo hd0 inqraid Harddisk0 ST CL1 A Ser 85000067 LDEV 1 HITACHI DF600F HORC SMPL HOMRCF MU 0 S VOL MU 1 SMPL MU 2 SMPL RAID5 Group 1 0 SSID 0x0000 C HORCM etc paircreate g vg01 m cc vl C HORCM etc echo hd0 inqraid Harddisk0 ST C...

Страница 119: ...ommand Parameters Parameter Value Command Name pairsyncwait Format pairsyncwait h q z I H M instance g group d pair Vol d g raw_device MU d g seq LDEV MU t timeout nowait m marker nomsg Options h Displays help usage and version information q Terminates the interactive mode and exits the command z or zx Makes the raidvchkscan command enter the interactive mode The zx option guards performing of the...

Страница 120: ...m This option must be specified at the beginning of a command argument The command execution log is not affected by this option m marker Specifies the sequence of local array P VOL called the Q marker If the application gets Q marker as the result of execution of pairsyncwait because of timeout or nowait the application can reconfirm the completion of asynchronous transfer by using pairsyncwait wi...

Страница 121: ... number 1 0100340210 2 0100340211 3 0100340212 4 0100340213 5 0100340214 Write Differential data determined Write Write Write P VOL 4 5 1 2 3 1 2 3 pairsyncwait g oradb nowait nowait is specified UnitID CTGID Q Marker Status Q Num 0 3 01003408ef NOWAIT 2 pairsyncwait g oradb t 100 nowait is not specified UnitID CTGID Q Marker Status Q Num 0 3 01003408ef DONE 2 pairsyncwait g oradb t 1 UnitID CTGID...

Страница 122: ...but the output result becomes as it is shown in the table below Table 1 39 Command is Issued to the Primary Array in which a TCE Pair has been Created Options Result g or g nowait The command can be executed when a status of a pair which is defined as the lead pair of the specified group in the configuration definition file is PAIR d or d nowait The command can be executed when the status of the s...

Страница 123: ...pter includes the following troubleshooting information ShadowImage troubleshooting SnapShot troubleshooting TrueCopy troubleshooting TCE troubleshooting General troubleshooting Error reporting Data recovery for PSUE using ShadowImage Data recovery for PSUE using SnapShot Data recovery for PSUE using TrueCopy and TCE ...

Страница 124: ...ol to complete If a failure occurs due to DP pool capacity depletion you can return the DP pool status to normal by performing the DP pool capacity growing and DP pool optimization operations and increasing the DP pool free capacity If a hardware error occurs while you are operating ShadowImage both of the following are necessary A CCI user intervention Assistance from a Hitachi Customer Service r...

Страница 125: ...move the error by cooperating with the maintenance personnel Message ID HORCM_102 Table 2 1 ShadowImage Operational Notes Action Action taken by whom Confirm the message syslog User Verify that PSUE is caused by you operation User Verify the status of the array User Call maintenance personnel when the array malfunctions User For other reasons call the Hitachi support center User only for users tha...

Страница 126: ...es you to issue CCI commands Note that the Hitachi personnel can only remove errors which result from hardware An operation such as recovering a SnapShot pair status for example paircreate must be done by you When the DP VOL created in the DP pool is used for a SnapShot pair a pair failure can occur since the required area cannot be allocated If a failure occurs during the DP pool formatting wait ...

Страница 127: ...maintenance personnel Message ID HORCM_102 Table 2 2 SnapShot Operational Notes Action Action taken by whom Confirm the message syslog User Refer to the information message issued by the array built in Web Server a shortage of a POOL capacity User Verify the status of the array User Call maintenance personnel when the array malfunctions User For other reasons call the Hitachi support center User o...

Страница 128: ...ervention Assistance from a Hitachi Customer Service representative For example when formatting is needed to resolve an LU error and that LU is used for TrueCopy the pair must be released by you CCI operation by you before the LU can be formatted Therefore please contact Hitachi personnel because maintenance requires you to issue CCI commands Note that the Hitachi personnel can only remove errors ...

Страница 129: ...h status Is the path status blocked After having recovered the ShadowImage volume from suspended status PSUE resynchronize it in the direction of P VOL to S VOL Collect the error log and traces and maintain together with the maintenance personal After recovering the error resynchronize the PSUE pairs NO YES Confirm the local array and remote array status Is the error displayed Start It is necessar...

Страница 130: ...O Is the target LU of the remote side in formatting YES YES YES YES Is the SyncCache command executed for the remote array NO NO 2 3 4 1 NO YES NO NO YES YES YES NO Is the path specified value on the remote array different Is the pair status of the remote array SSWS Note 1 Is the TrueCopy option in the remote array locked Is the command from CCI in progress in the remote array Note 1 Release the p...

Страница 131: ...atus NO Only while using AIX server Confirm and retry the system Was the pairsplit R issued to S VOL NO YES Since S VOL will be SMPL when releasing S VOL in PAIR status forcibly issue pairsplit S to P VOL to change the PAIR status of P VOL to SMPL Resynchronize the PSUE pairs End Release the pair and create the pair again Review the DP pool status and secure the capacity of the DP pool required fo...

Страница 132: ...hronize in the direction of P VOL to S VOL by user End The remote maintenance such as HITRACK and SNMP Agent or Web message notifies that a path blockage occurs Remove the error by the maintenance personal Table 2 3 TrueCopy Operational Notes Action Action taken by whom Confirm the message syslog User Confirm whether PSUE is caused by you operation User Confirm the status of the array User Call th...

Страница 133: ...solve an LU error and that LU is used for TCE the pair must be released by you CCI operation by you before the LU can be formatted Therefore please contact Hitachi personnel because maintenance requires you to issue CCI commands Note that the Hitachi personnel can only remove errors which result from hardware An operation such as recovering the TCE pair status for example resynchronizing must be d...

Страница 134: ...ize the PSUE pairs End NO YES Confirm the path status Is the path status blocked The Data pool capacity is insufficient Resynchronize the PSUE pairs Collect the error log and traces and maintain together with the maintenance personal After recovering the error resynchronize the PSUE pairs NO YES Confirm the local array and remote array status Is the error displayed Start It is necessary to specify...

Страница 135: ...O NO Is the target LU of the remote side in formatting YES YES YES YES Is the SyncCache command executed for the remote array NO NO 2 3 4 1 NO YES NO NO YES YES YES NO Is the path specified value on the remote array different Is the pair status of the remote array SSWS Note 1 Is the TCE option in the remote array locked Is the command from CCI in progress in the remote array Note 1 Release the pai...

Страница 136: ...eue full occurred in the remote array or is the system very busy NO YES Is the target LU of the remote side in ACA Active status NO Only while using AIX server Confirm and retry the system Was the pairsplit R issued to S VOL NO YES Since S VOL will be SMPL when releasing S VOL in PAIR status forcibly issue pairsplit S to P VOL to change the PAIR status of P VOL to SMPL Resynchronize the PSUE pairs...

Страница 137: ...aintenance personal Table 2 4 TCE Operational Notes Action Action taken by whom Confirm the message syslog User Checking the Information message sent from the Web built in array making sure of insufficiency of the data pool capacity User Confirm whether PSUE is caused by you operation User Confirm the status of the array User Call the maintenance personnel when the array malfunctions User For othe...

Страница 138: ...nds cannot execute hot standby operations between the primary and secondary volumes Use the takeover command intended for the HA configuration to execute the hot standby operation In hot standby operation two hosts are used and the active primary and standby secondary host programs are run alternately in each host in case one host fails Follow these precautions Operation across volumes Since each ...

Страница 139: ...for election Maintenance A HORCM restart is required if the array configuration is changed for example firmware exchange cache memory install or uninstall Command device Each CCI command is executed by issuing a command to the command device This command is read or written from or into the specific block area of the command device Therefore you cannot use the command device In addition this device...

Страница 140: ...than or equal to 6 000 If you have created the configuration definition file using the mkconf command tool set this value manually If the value is set incorrectly it may cause a conflict between the CCI and the array which causes the internal process of the array to suspend temporary The process may not proceed Internal process conflict between the CCI and the array When an internal process confli...

Страница 141: ...aemon processes running simultaneously HORCM_004 HORCM assertion failed resulting in a fatal internal error in the HORCM An internal error occurred which could not be identified by the HORCM Restart the system collect all HORCM log and trace information and call the Hitachi support center HORCM_005 The CCI software failed to create the end point for remote communication HORCM failed to create a so...

Страница 142: ...ror in the array Collect all HORCM log and trace information and call the Hitachi support center After maintenance personnel have recovered the array refer to Data recovery for PSUE using ShadowImage on page 2 31 Data recovery for PSUE using SnapShot on page 2 33 or Data recovery for PSUE using TrueCopy and TCE on page 2 34 Note Unrecoverable indicates errors that cannot be recovered by executing ...

Страница 143: ...CMINST is set correctly Note 1 For Windows Server when a path detachment which is caused by a controller detachment or interface failure continues for longer than one minute the command device may be unable to be recognized at the time when recovery from the path detachment is made To make the recovery execute the re scanning of the disks of Windows When Windows cannot access the command device al...

Страница 144: ...nnecessary programs and daemon processes 245 EX_ERANGE Result too large Tried to use arguments for an option beyond the maximum allowed or a result beyond the maximum was created Refer to the error message and designate an appropriate value 244 EX_ENAMLG File name too long Undefined error 243 EX_ENORMT No remote host alive for remote commands or Remote Raid Manager might be blocked sleepi ng on an...

Страница 145: ...log of the host or the HORCM log refer to How to read detailed error log codes on page 3 5 Confirm the following items and if the problem persists collect all HORCM log information and call the Hitachi Support Center Verify ShadowImage SnapShot TrueCopy and TCE functions are installed Verify that the target volume is available 221 EX_CMDIOE Control command I O error or rejected A read write to the...

Страница 146: ... errors that can be recovered by executing the command again However EX_EWSTOT of the horctakeover command is excluded When the command completed with an error the error is recorded in the CCI command log HORCC_LOG see Chapter 3 Maintenance log and tracing functions 234 EX_EWSTOT Timeout waiting for specified status Detected a timeout before it achieved the designated status Increase the value of ...

Страница 147: ... EX_VOLCUR S Vol currency error Currency check error for S VOL Cannot guarantee identical data on S VOL Check the volume list to see if an operation was directed to the wrong S VOL 225 EX_VOLCUE Local Volumecurrenc y error The volume specified with the SVOL takeover command is not the same as the P VOL Verify the pair status of the local volume 224 EX_VOLCRE Local and Remote Volumecurrenc y error ...

Страница 148: ...the pair operation 213 EX_ENQSIZ Unmatched volume size for pairing 1 The number or the size of the volume between the local and remote volume is not appropriate 2 The product ID on the local array does not correspond with the product ID on the remote array 1 Check the volume size of the target pair using raidscan f option and then set the same size for local and remote volumes for the target pair ...

Страница 149: ...eover Paircurchk Paircreate Pairsplit Pairresync Pairevtwait Pairvolchk Pairsyncwait and Pairdisplay Commands Type Message ID Error Message Return Value Syntax for Argument Unrecoverable EX_REQARG Required Arg list 254 EX_INVARG Invalid argument 253 EX_INVNAM Invalid name of option 249 EX_UNWOPT Unknown option 252 EX_UNWCOD Unknown function code 238 EX_UNWCMD Unknown command 230 EX_ERANGE Result t...

Страница 150: ...er 251 EX_ATTDBG Can t be attached to a Debug layer 250 EX_COMERR Can t be communicated with HORC Manager 255 EX_ENORMT No remote host alive for remote commands or Remote Raid Manager might be blocked sleeping on an existing I O 242 Resource Unrecoverable EX_ENOMEM Not enough core 245 Table 2 8 Common Error Messages for Horctakeover Paircurchk Paircreate Pairsplit Pairresync Pairevtwait Pairvolchk...

Страница 151: ... 227 EX_ENOUNT No such RAID unit 219 EX_INVMUN Invalid mu with HORC or HOMRCF 220 EX_ERPERM Permission denied with the RAID 211 EX_ENOSUP Micro code not supported 210 Command I O to RAID Recoverable EX_CMDIOE Control command I O error Control command I O error or rejected 237 EX_OPTINV A specified option is invalid 248 EX_INVMOD Invalid RAID command mode 241 EX_INVCMD Invalid RAID command 240 Comm...

Страница 152: ...nc EX_INVSTP Invalid pair status 228 paircurchk horctakeover EX_VOLCUR S VOL currency error 225 horctakeover EX_VOLCUE Local Volume currency error 224 horctakeover EX_VOLCRE Local and Remote Volume currency error 223 pairsplit pairevtwait EX_EWSUSE Pair suspended at WAIT state 234 paircreate EX_ENQSIZ Unmatched volume size for pairing 212 EX_EWSTOT SVOL denied due to be disabling 209 raidvchkset E...

Страница 153: ...esync restore Table 2 11 shows data assurance and the method for recovering the pair Table 2 11 Data Assurance and Recovery Methods State before PSUE Data Assurance Action to be taken after PSUE Other than RCPY P VOL Assured S VOL Not assured Resynchronize pairresync in the direction of P VOL to S VOL Note that the pair may have been split due to the drive s double malfunction in either or both vo...

Страница 154: ...Pair Status Verification After the pair status is verified turn the protection function OFF restart HORCM and then split the pair to turn the protection function OFF delete the environment variable HORCMPROMOD For details on the environment variable see Environment variables on page 1 3 ls dev rdsk inqraid find Group PairVol L R Port TID LU M Seq LDEV P S Status Seq P LDEV M horcl dev00 L CL2 A 0 ...

Страница 155: ...rred while restoring from V VOL to P VOL pairresync restore Table 2 12 shows data assurance and the method for recovering the pair Table 2 12 Data Assurance and Recovery Methods State before PSUE Data Assurance Action to be taken after PSUE Other than COPY RS R P VOL Assured V VOL Not assured Split the pair pairsplit S and then create a pair paircreate again Note that the pair may have been split ...

Страница 156: ...ion cannot be performed in the direction of S VOL to P VOL However when a pair was suspended status PSUE without a failure in the system once release the pair and create the pair again Please recover the pair following the procedure in Figure 2 3 on page 2 7 for TrueCopy or Figure 2 5 on page 2 12 for TCE NOTE In the case of TCE the resynchronization of the S VOL with the P VOL is required when th...

Страница 157: ... 3 1 Hitachi AMS 2000 Family Command Control Interface CCI Reference Guide 3 Maintenance log and tracing functions This chapter contains the following sections Log files Trace files How to read detailed error log codes Logging of a command ...

Страница 158: ...ings therefore users do not need to refer to the HORCM execution logs When an error occurs during the execution of a command data on the error is collected in the command log file Users may refer to the command log file if a command execution error occurs Figure 3 1 Logs and Traces The start up log error log trace and core files are stored as shown in Table 3 1 Specify the directories for the HORC...

Страница 159: ...e HORCM_LOG horcmlog_HOST horcc_PID_tr c txt Core HORCM core HORCM LOG core HOST PID core Command core HORCM LOG core HOST PID core HORCM core HORCM LOG core HOST PID core Command core HORCM LOG core HOST PID core NOTE Host denotes the host name of the corresponding machine PID denotes the process ID of that machine The location of the directory that contains the log file depends on you s command ...

Страница 160: ...eters of the trace control command Table 3 2 Log Directories Directory Name Definition HORCM LOG A directory specified using the environmental variable HORCM_LOG The HORCM log file trace file and core file as well as the command trace file and core file are stored in this directory If no environmental variable is specified HORCM log curlog is used HORCC LOG A directory specified using the environm...

Страница 161: ...ide or the secondary volume side When an error occurs during the execution of the command examine the error cause by looking at the error logs of both local instance an instance that has executed the command and the remote instance Examples of the decisions to which of the local instance and the remote instance the error log corresponding to the command log is output are shown in Table 3 4 The err...

Страница 162: ...ircreate L_CMD CREATEPAIR ERROR rc 35 18 18 08 a1eaa 03005 paircreate exit 221 EX_CMDRJE An order to the control command device was rejected Cause An order to the command control device failed or was rejected Action Please confirm the following items If this trouble doesn t resolve then collect HORCM error logs HORCM_LOG HORCM log0 curlog and trace data and send them to service personnel 1 Check i...

Страница 163: ...28 13 3f438 05247 pairsplit L_CMD ERASEPAIR ERROR rc 35 10 28 13 43af5 05247 pairsplit exit 221 EX_CMDRJE An order to the control command device was rejected Cause An order to the command control device failed or was rejected Action Please confirm the following items If this trouble doesn t resolve then collect HORCM error logs HORCM_LOG HORCM log2 curlog and trace data and send them to service pe...

Страница 164: ...ce was rejected Cause An order to the command control device failed or was rejected Action Please confirm the following items If this trouble doesn t resolve then collect HORCM error logs HORCM_LOG C HORCM log137 curlog and trace data and send them to service personnel 1 Check if the HORC or HOMRCF function is installed in the RAID 2 Check if the RCP and LCP are installed in the RAID 3 Check if th...

Страница 165: ...ck the status of the LU 2602 The environment has a problem Check the environment of CCI 2602 The retention term is beyond the limits of validity Check that the specified value that has been set is 0 to 21900 3180 The object LU is unformatted Check the status of the LU 9501 A command was received during execution of the pseudo deliberate shutdown Retry after the pseudo deliberate shutdown is comple...

Страница 166: ...re abnormal Check the status of the path 9576 0012 84 The specified P VOL is in a status other than COPY or PAIR Check the pair status of the LU 9576 0014 84 The current Array ID differs from the number that was set initially Check the Array ID 9576 0016 84 The number of the LU to be paired is different Check the specified LUN 9576 0017 84 The primary sequence number is different from the own Arra...

Страница 167: ...he Array ID Check the Array ID 9576 0030 84 The S VOL received the pairsplit E pair suspend command Check the pair status of the LU 9576 0031 84 The capacity is beyond the limits of support Split the unnecessary pairs 9576 0032 84 The P VOL is configured as RAID 0 Check the RAID level of the specified LU 9576 0033 84 The specified LU is an S VOL of ShadowImage and it is in a pair status other than...

Страница 168: ... of the LU 9576 0040 84 The volume is a P VOL of SnapShot It is being restored or in the PSUE status and cannot accept Read Write instructions Check the pair status of the LU 9576 0041 84 The number of unified LUs is 17 or more Check the number of unified LUs of the volume corresponding to the specified LU 9576 0042 84 The RAID level differs between the MainLU and SubLU Check that the RAID level o...

Страница 169: ...ace drives that compose the P VOL Format them after the replacement and then resynchronize them 9576 004D 84 The DM LU is not set Retry after setting the DM LU 9576 004E 84 The DM LU cannot be specified as P VOL Check the status of the LU 9576 004F 84 Validity of the license expired Purchase the license 9576 0052 84 The pairsplit mscas was issued in the TrueCopy environment The pairsplit mscas is ...

Страница 170: ...air with CTG Check the status of the LU 9576 005F 84 When the unit of CTG is specified there is an S VOL in the same CTG Check the CTG ID 9576 0060 84 When the unit of CTG is specified there is no pair which is in the PAIR PSUS or PSUE status in the same CTG Check the pair status of LU in the CTG 9576 0061 84 When the unit of CTG is specified the specified P VOL is not created pair with CTG Check ...

Страница 171: ...ich you are executing the command 9576 0072 84 The RAID group to which the specified LU belongs indicates a status other than Normal Retry after the status becomes Normal 9576 0073 84 An LU that belongs to the RAID group that indicates a status other than Normal is included in the data pool that is used by pairs in the specified group Retry after the RAID group status becomes Normal 9576 0077 84 T...

Страница 172: ...placed in the PAIR or PSUS status and whose S VOL is one of the S VOLs with the specified CTG numbers Otherwise the process of reconfigure memory is in progress on the remote array Check the pair status of the SnapShot Otherwise retry after the process of reconfigure memory is completed 9576 905F 94 There is no pair which is in the PAIR status in the target CTG Check the pair status of the LU 9576...

Страница 173: ...s between the P VOL and S VOL Equalize the capacities of the P VOL and S VOL 9576 x01A 94 The S VOL is a Cache Residency LU or has been set to the reserved Cache Residency LU Check the status of the LU 9576 x01C 94 The object LU is a command device Specify an LU other than a command device 9576 x01D 94 The change of the default owner controller is reserved for the object LU Cancel the reservation ...

Страница 174: ...RCPY or cannot accept Read Write instructions Check the pair status of the LU 9576 x041 94 The process is in progress Retry after waiting for a while 9576 x045 94 The stripe size of the object LU of the remote array is other than 64 kB Make the stripe size of the LU of the remote array 64 kB 9576 x046 94 The object LU of the remote array is being restored as a volume of SnapShot or cannot accept R...

Страница 175: ...76 x056 94 The object LU of the remote array is a V VOL of SnapShot at the time of a resynchronizing swap Specify the LU of the remote array to a volume other than a V VOL of SnapShot 9576 x059 94 The license validity of the remote array is expired Otherwise the memory reconfiguration process is in progress on the remote array Purchase the license or retry after the memory reconfiguration process ...

Страница 176: ...cannot be set to an S VOL Check the pool LU status of the remote array 9576 x0A2 94 The LU status of the S VOL in the remote array is normal or other than regressed Check the pool LU status of the remote array 9576 x0A3 94 The pool LU in the remote array is undergoing the forced parity correction Check the pool LU status of the remote array and retry after waiting for a while 9576 x0A4 94 The S VO...

Страница 177: ...e remote array does not exist on the default owner controller and at the same time an ownership of LU to be changed is blocked Check the status of the remote array and retry after waiting for a while 9576 x0B8 94 The S VOL in the remote array cannot change an ownership of LU and at the same time it is using the sequential buffer Check the status of the remote array and retry after waiting for a wh...

Страница 178: ...ion specifying an LU other than the reserved LU for the S VOL 9576 x0CA 94 The specified S VOL is undergoing the migration Re execute the migration after splitting the pair 9576 x0CB 94 The specified S VOL is the reserved LU Re execute the migration specifying an LU other than the reserved LU for the S VOL 9576 x0CF 94 The disk drives that configure a RAID group to which a target LU in the remote ...

Страница 179: ...troller is recovered 9576 x0E3 94 The LU will be specified as an S VOL in the remote array The RAID group to which the LU belongs indicates a status other than Normal Retry when the status becomes Normal 9576 x0E9 94 The specified S VOL is a volume of ShadowImage pair that includes the LU created in DP pool Confirm the S VOL and the ShadowImage pair that the specified S VOL is part of 9576 x0F1 94...

Страница 180: ...sive Check the status of the LU 9608 0006 84 The pair status of the P VOL is other than SMPL or a V VOL does not exist Check the pair status of the LU 9608 0007 84 The pair status is other than SMPL Check the pair status of the LU 9608 0008 84 The specified P VOL is a V VOL Check the pair status of the LU 9608 0009 84 The specified V VOL is a P VOL Check the pair status of the LU 9608 000A 84 The ...

Страница 181: ...s an object of the batch suspension is in a status other than PAIR Group ID suspension Check the pair status of the LU 9608 0020 84 The process is in progress Retry after waiting for a while 9608 0021 84 The process is in progress Retry after waiting for a while 9608 0022 84 The pair status of the V VOL is illegal Check the pair status of the LU 9608 0023 84 The object LUN is not the same as the e...

Страница 182: ... to SMPL and create the pair again 9608 0035 84 The MU number is other than 0 to 2 Make sure of the specified MU number 9608 0036 84 The MU number is other than 0 to 2 Make sure of the specified MU number 9608 0037 84 The MU number is other than 0 Make sure of the specified MU number 9608 0038 84 The V VOL is a volume of TrueCopy and in a status other than SMPL Check the status of the TrueCopy pai...

Страница 183: ...tatus of the TCE pair is PSUS and writing to the S VOL is prohibited at the time of restoration Check the status of the LU 9608 0054 84 The specified P VOL is an S VOL of TCE and the status of the TCE pair is SSWS R at the time of restoration Check the status of the LU 9608 0056 84 The specified P VOL is an S VOL of TCE and the status of the TCE pair is PSUS and reading from writing to the S VOL i...

Страница 184: ... while 9608 0063 84 Though the specified P VOL requires a change of an ownership of LU the directory structure is being changed Check the status of the LU 9608 0064 84 Though the specified P VOL requires a change of an ownership of LU a time out occurred in the ownership of LU changed Check the status of the LU 9608 0065 84 The disk drives that configure a RAID group to which the specified P VOL b...

Страница 185: ...LU of a unified LU which includes an LU with a capacity smaller than 1 GB Check the status of the LU 9608 0073 84 The specified P VOL has been set to the current Cache Residency LU Check the status of the LU 9608 0074 84 The specified P VOL has been set to the reserved Cache Residency LU Check the status of the LU 9608 0075 84 The specified P VOL is the LU for which a change of the cache partition...

Страница 186: ...mits Confirm the capacity of all SnapShot P VOLs all P VOLs and S VOLs of TCE pairs and data pools less than or equal to the supported capacity for the installed cache memory 9608 0086 84 The process is in progress Retry after waiting for a while 9608 0087 84 It is exceeded the total allowable maximum number of TCE and SnapShot pairs Delete the unnecessary pairs 9608 0088 84 The specified P VOL is...

Страница 187: ...e to insufficient capacity of the DP pool for the LU specified for data pool of a pair in the same group Check the capacity of the DP pool 9608 00AB 84 The V VOL of the specified pair is the P VOL of a TrueCopy or TCE Retry after deleting the TrueCopy or TCE pair 9608 00AC 84 Access attribute has been set to the V VOL of the specified SnapShot pair Change the attribute to Read Write and reset S VO...

Страница 188: ...recovered 9608 00FB 84 The RAID group to which the target LU belongs indicates a status other than Normal Retry after the status becomes Normal 9608 x000 84 The controller that controls the LU cannot be changed because pinned data exits Retry after eliminating pinned data 9608 x001 84 The controller that controls the LU cannot be changed temporarily Retry after waiting for a while 9608 x002 84 The...

Страница 189: ... out Retry after waiting for a while 9609 0060 94 The path of the local array is abnormal Check the status of the path 9609 0061 94 The path of the local array is abnormal Check the status of the path 9609 0062 94 The path of the local array is abnormal Check the status of the path 9609 0063 94 The path of the local array is abnormal Check the status of the path 9609 0065 84 Since the specified P ...

Страница 190: ...heck the pair status of the LU the status of the RAID group to which the target LU belongs and reconfigure memory status Retry after the RAID group status becomes Normal in case that the RAID group indicate a status other than Normal Retry after the process of reconfigure memory is completed if it is in progress 9609 x022 94 The process is in progress Retry after waiting for a while 9609 x022 94 T...

Страница 191: ...undefined Check the attribute of the LU 9609 x031 94 The WWN of the remote array is illegal Check the array WWN 9609 x032 94 The remote array is executing a command of CCI Retry after waiting for a while 9609 x033 94 The remote array is undergoing hot replacement of the firmware Retry after waiting for a while 9609 x034 94 A command error occurred Retry after waiting for a while 9609 x035 94 The o...

Страница 192: ...is receiving a command Retry after waiting for a while 9609 x041 94 The S VOL of the remote array is doing a duplicate writing Retry after waiting for a while 9609 x042 94 The capacity is beyond the limits of supported Delete unnecessary pairs of the remote array 9609 x058 94 The ShadowImage P VOL of the remote array is in the PSUE S VOL Switch status Contact the service personnel 9609 x086 94 The...

Страница 193: ...e conditions of cascading with a SnapShot pair Check the status of the LU in the remote array 9609 x08E 94 The S VOL in the remote array has created a ShadowImage pair The TCE and ShadowImage volumes cannot be cascaded with each other Check the LU status of the remote array 9609 x091 94 The serial number of the S VOL in the remote array is wrong Check the serial number of the remote array 9609 x09...

Страница 194: ... x09F 94 This operation cannot be executed due to lack of resources within the remote array Retry after waiting for a while Check the pool LU status of the remote array 9609 x0A0 94 The remote array has no pool LU Make a pool LU for the remote array 9609 x0A1 94 The LU specified as the S VOL in the remote array is a pool LU The pool LU cannot be set to an S VOL Check the pool LU status of the remo...

Страница 195: ... has been started Check the status of the remote array and retry after waiting for a while 9609 x0B6 94 The S VOL in the remote array does not exist on the default owner controller and it has started an ownership of LU change Check the status of the remote array and retry after waiting for a while 9609 x0B7 94 The S VOL in the remote array does not exist on the default owner controller and at the ...

Страница 196: ...le 9609 x0C5 94 The cycle time that has been set for the remote array is less than the minimum interval Check the cycle time that has been set for the remote array 9609 x0D9 94 The status of the remote array is in an inappropriate condition to operate the TrueCopy pair Check the Array ID pair status of local and remote replication status of the RAID group to which the target LU belongs and reconfi...

Страница 197: ... target LU and data pools the same value 960A The illegal operation was specified to a data pool LU Check the attribute of the LU 9611 0001 84 The object LU is an invalidated one Check the status of the LU 9611 0002 84 The object LU is a SubLU of a unified LU Check the status of the LU 9611 0003 84 The S VOL Disable was specified for the S VOL of ShadowImage Check the pair status of the LU 9611 00...

Страница 198: ...k the attribute of the LU 9611 0013 84 The specified LU is an S VOL of TCE that status is other than SMPL or PSUS Check the attribute of the LU 9611 0014 84 The specified LU is an S VOL of Volume Migration Check the status of the LU 9611 0015 84 The specified LU is the reserve LU Check the status of the LU 9611 0016 84 The data migration status is data is being copied data copy fails or data copy ...

Страница 199: ...g the forced restoration by means of parity at the time of a restoration Retry after the restoration by means of parity is completed 9618 0003 84 The S VOL is undergoing the forced restoration by means of parity Retry after making the restoration by means of parity 9618 0011 84 The P VOL has not undergone the forced restoration by means of parity Retry after making the restoration by means of pari...

Страница 200: ...he LU 961C 000B 84 The P VOL is a Sub LU of a unified LU Check the status of the LU 961C 000C 84 The S VOL is a Sub LU of a unified LU Check the status of the LU 961C 000E 84 The P VOL is a Cache Residency LU Check the status of the LU 961C 000F 84 The S VOL is a Cache Residency LU Check the status of the LU 961C 0010 84 The P VOL is reserved as a Cache Residency LU Check the status of the LU 961C...

Страница 201: ... The status of the S VOL is other than normal or regressive Check the status of the LU 961C 0023 84 The P VOL is a Sub LU of a unified LU Check the status of the LU 961C 0024 84 The S VOL is a Sub LU of a unified LU Check the status of the LU 961C 0026 84 The P VOL has been set to the current Cache Residency LU Check the status of the LU 961C 0027 84 The S VOL has been set to the current Cache Res...

Страница 202: ...hat service personnel replace the drives that compose the P VOL Format them after the replacement then resynchronize them 961C 0039 84 The specified pair is in the PSUE S VOL Switch status Request that service personnel replace the drives that compose the P VOL Format them after the replacement then resynchronize them 961C 003A 84 The pair in the PSUE S VOL Switch status is undergoing resynchroniz...

Страница 203: ...he partitions had been reserved was specified as a P VOL Check the status of the LU 961C 0053 84 An LU for which a change of the cache partitions had been reserved was specified as a S VOL Check the status of the LU 961C 005E 84 The specified P VOL is a TCE pair Check the status of the LU 961C 005F 84 The specified S VOL is a TCE pair Check the status of the LU 961C 0060 84 The specified P VOL is ...

Страница 204: ...he pair attribute of the specified S VOL is not a S VOL Check the pair attribute of the LU 961C 006E 84 The specified MU and the MU of the specified S VOL are mismatched Check the specified MU number 961C 006F 84 The specified MU and the MU of the specified S VOL are mismatched Check the specified MU number 961C 0070 84 The specified MU is used within the specified P VOL Check the specified MU num...

Страница 205: ... the pair status of the LU 961C 0086 84 The disk drives that configure a RAID group to which the specified P VOL belongs have been spun down Check the status of the RAID group 961C 0087 84 The disk drives that configure a RAID group to which the specified S VOL belongs have been spun down Check the status of the RAID group 961C 0088 84 The disk drives that configure a RAID group to which the speci...

Страница 206: ...tion status 961C 0097 84 The Migration status is other than unexecuted Check the Migration status 961C 0098 84 When the Inquiry Serial Number Conversion Mode is ON in the host group that the command device is mapped the serial number of the received remote side array is the normal specification Check the remote array type 961C 0099 84 When the Inquiry Serial Number Conversion Mode is ON in the hos...

Страница 207: ...ave been spun down Check the status of the RAID group 961C 00A6 84 The disk drives that configure a RAID group to which the specified S VOL belongs have been spun down Check the status of the RAID group 961C 00A7 84 A pair that is in a status other than PAIR PAIR IS or COPY is included in the specified group Check the LU pair status in the group 961C 00A8 84 A pair that shares the P VOL with anoth...

Страница 208: ...the specified group Retry after the RAID group status becomes Normal 961C 00B4 84 The specified pair is in a status other than PSUS or PSUE Check the pair status 961C 00B5 84 The LU that was specified as P VOL does not exist Check the specified LUN 961C 00B6 84 The LU that was specified as P VOL does not exist Check the specified LUN 961C 00B7 84 The LU that was specified as S VOL does not exist C...

Страница 209: ...ed Retry after waiting for a while 961C 00C6 84 Management information regarding DP is being updated Retry after waiting for a while 961C 00C7 84 Management information regarding DP is being updated Retry after waiting for a while 961C 00C8 84 Management information regarding DP is being updated Retry after waiting for a while 961C 00C9 84 The specified P VOL cannot be read due to insufficient cap...

Страница 210: ... VOL the same value 961C 00D9 84 The status of the SnapShot pair cascading with the specified ShadowImage pair is invalid Check the status of the SnapShot pair 961C 00DA 84 The status of a SnapShot pair cascading with the specified ShadowImage pair is PSUE where the SnapShot pair cannot accept Read Write instructions Check the pair status 961C 00DB 84 The specified LU is a V VOL Check the LU 961C ...

Страница 211: ...OL status is normal or other than regressed Check the status of the LU 9622 000F 84 The specified S VOL is not a pair target LUN Check the LUN of the S VOL 9622 0010 84 The accepted sequence number is different from the Array ID Check the Array ID 9622 0011 84 Both of the two paths are abnormal Check the status of the path 9622 0012 84 When the unit of pair is specified the pair status of the spec...

Страница 212: ...he type of the pairsplit command is other than Drain ordinary splitting Check the command line 9622 0027 84 The S VOL received an instruction Check the pair attribute of the LU 9622 0029 84 The S VOL received an instruction Check the pair attribute of the LU 9622 002A 84 The P VOL received an instruction Check the pair attribute of the LU 9622 002B 84 When the unit of pair is specified the pair st...

Страница 213: ... 84 When the unit of pair is specified the pair status of the specified pair is PSUS no reading or writing allowed Check the pair status 9622 0044 84 When the unit of CTG is specified there is one or more pairs placed in the PSUS status no reading or writing allowed in the CTG Check the pair status of each LU in the target CTG 9622 0045 84 When the unit of CTG is specified there is no pair that is...

Страница 214: ...t supported Check the specified value 9622 0055 84 When the unit of pair is specified the internal status of the pair of the specified P VOL is under pair splitting Check the pair status of the LU It is required to wait until the process is completed 9622 0057 84 When the unit of pair is specified the internal status of the pair of the specified P VOL is under execution of the pairsplit mscas comm...

Страница 215: ...laced in the SMPL status by the pair ending pairsplit R command for only S VOL and its pair status became inconsistent Check the pair status of the specified S VOL 9622 0074 84 The suspension command was accepted with a specification of the unit of pair The specification of the unit of pair is not supported 9622 0075 84 The specified P VOL is a unified LU whose component LUs include an LU for whic...

Страница 216: ...heck the pair status of each LU in the target CTG 9622 0084 84 When a pair is created in the new CTG the cycle time that has been set is less than 30 x number of CTGs seconds Check the cycle time that has been set 9622 0085 84 When the unit of pair is specified the S VOL of the target pair has not completed the resynchronization after it accepted the resync command Check the TCE pair status of the...

Страница 217: ...d try again 9622 0093 84 The LU whose pair status is not SSWS exists in the target CTG Check the pair status of each LU in the target CTG 9622 0094 84 The LU whose pair status is SSWS R exists in the target CTG Check the pair status of each LU in the target CTG 9622 0095 84 There is a pair that is a status of SSWS and also deleted just in the local array in the CTG Delete the pair that is a status...

Страница 218: ...622 00A1 84 The command cannot execute because the Auto Migration is undergoing Check the Migration status 9622 00A2 84 The command cannot execute because the Auto Migration is undergoing Check the Migration status 9622 00A3 84 The RAID group to which the specified LU belongs indicates a status other than Normal Retry after the status becomes Normal 9622 00A4 84 An LU that belongs to the RAID grou...

Страница 219: ...cted or Uncorrected 2 Skip the parity correction or execute the parity correction and wait for the completion of the correction Re execute it after performing the operation 9629 0006 84 The status of the parity correction of the specified S VOL is correcting waiting correction Uncorrected or Uncorrected 2 Skip the parity correction or execute the parity correction and wait for the completion of th...

Страница 220: ...ed S VOL is the DM LU Check the status of the LU 9629 001B 84 The DM LU is not set Retry after setting the DM LU 9629 001C 84 The specified P VOL has unwritten data Check the status of the LU 9629 001D 84 The pair cannot be allocated the differential bit map Split the unnecessary pairs 9629 001E 84 The specified P VOL is a SubLU of a unified LU Check the status of the LU 9629 001F 84 The specified...

Страница 221: ...l number Check the specified secondary sequence number 9629 0031 84 The pair concerned is the one that the instruction to start the migration was issued by Navigator 2 or HiCommand Check the owner ID of the specified pair 9629 0032 84 The disk drives that configure a RAID group to which the specified P VOL belongs have been spun down Check the status of the RAID group 9629 0033 84 The disk drives ...

Страница 222: ...onf file This file describes the HORCC_LOGSZ variable and the variable for masking the logging Specify the maximum size When the variable is not specified as the environmental variable the HORCC_LOGSZ variable described in this file is used When neither of them is specified the logging is done as a default operation only when an error occurs 9629 0039 84 The specified S VOL is an LU created in a D...

Страница 223: ...return value However the inqraid command and error codes are excluded For example when you script tests the return value of the pairvolchk command at regular intervals the log data may overflow In this case the logging can be masked through the specification of the HORCC_LOGSZ environmental variable as zero but the script must be changed as shown below For example masking pairvolchk on the script ...

Страница 224: ...one as a default operation only when an error occurs Example HORCM log directory Table 3 6 Relation Between the Environmental Variable and the HORCC_LOG horcc_HOST conf file HORCC_LOGSZ HORCC_HOST conf Operation HORCC_LOGSZ size It is not influenced specification The logging is valid in the specified script HORCC_LOGSZ 0 The logging is invalid in the specified script It is not specified HORCC_LOGS...

Страница 225: ...9a206 17514 ERROR cm_sndrcv rc 0 from HORCM 17 31 28 9b0a3 17514 pairdisplay exit 239 EX_ENOGRP No such group Cause The group name which was designated or the device name doesn t exist in the configuration file or the network address for remote communication doesn t exist Action Please confirm if the group name exists in the configuration file of the local and remote host For Example HORCC_LOGSZ 2...

Страница 226: ...3 70 Maintenance log and tracing functions Hitachi AMS 2000 Family Command Control Interface CCI Reference Guide ...

Страница 227: ...1 Hitachi AMS 2000 Family Command Control Interface CCI Reference Guide 4 Command options This chapter shows the command options that are available for SnapShot ShadowImage TrueCopy and TCE Command options for copy types ...

Страница 228: ...o No Yes Yes IM instance ISI instance Yes Yes No No q Yes Yes Yes Yes xh Yes Yes Yes Yes x command arg No No No g s group Yes Yes Yes Yes d s pair Vol Yes Yes Yes Yes d g s drive 0 N MU Yes Yes Yes Yes d g s seq LDEV MU Yes Yes Yes Yes nomsg Yes Yes Yes Yes vl or pvol Yes Yes Yes Yes vr os svol Yes Yes Yes Yes f fence CTGID No No Yes Yes fg fence CTGID No No Yes No jp PID js PID No No No Yes c siz...

Страница 229: ...es Yes Yes Yes d pair Vol Yes Yes Yes Yes d g drive 0 N MU Yes Yes Yes Yes d g seq LDEV MU Yes Yes Yes Yes nomsg Yes Yes Yes Yes r No No Yes Yes rw No No Yes Yes S Yes Yes Yes Yes R No No Yes Yes RS No No No No RB No No Yes No P No No Yes No l Yes Yes Yes Yes FHORC MU Yes Yes No No FMRCF MU No No Yes Yes ms Split Marker MU Yes Yes No No mscas Split Marker MU No No No Yes C size Yes Yes No No E Yes...

Страница 230: ... command arg No No No No g group Yes Yes Yes Yes d pair Vol Yes Yes Yes Yes d g drive 0 N MU Yes Yes Yes Yes d g seq LDEV MU Yes Yes Yes Yes nomsg Yes Yes Yes Yes c size Yes Yes Yes Yes cto o time c time r time No No No No l Yes Yes Yes Yes FHORC MU Yes Yes No No FMRCF MU No No Yes Yes swapp No No Yes Yes swaps No No Yes Yes restore Yes Yes No No fq mode No No No No f g fence CTGID No No No No Tab...

Страница 231: ...es Yes Yes Yes s status Yes Yes Yes Yes ss status Yes Yes Yes Yes t timeout interval Yes Yes Yes Yes l Yes Yes Yes Yes FHORC MU Yes Yes No No FMRCF MU No No Yes Yes pairsyncwait h No No No Yes z No No No Yes zx No No No Yes I instance No No No Yes IH instance ITC instance No No No Yes IM instance ISI instance No No No No q No No No Yes xh No No No Yes x command arg No No No No g group No No No Yes...

Страница 232: ... Yes Yes Yes s status Yes Yes Yes Yes pairvolchk h Yes Yes Yes Yes z Yes Yes Yes Yes zx Yes Yes Yes Yes I instance Yes Yes Yes Yes IH instance ITC instance No No Yes Yes IM instance ISI instance Yes Yes No No q Yes Yes Yes Yes xh Yes Yes Yes Yes x command arg No No No No g group Yes Yes Yes Yes d pair Vol Yes Yes Yes Yes d g drive 0 N MU Yes Yes Yes Yes d g seq LDEV MU Yes Yes Yes Yes nomsg Yes Ye...

Страница 233: ...es Yes Yes d pair Vol Yes Yes Yes Yes d g drive 0 N MU Yes Yes Yes Yes d g seq LDEV MU Yes Yes Yes Yes c Yes Yes Yes Yes l Yes Yes Yes Yes m mode Yes Yes Yes Yes f x Yes Yes Yes Yes f c Yes Yes Yes Yes f d Yes Yes Yes Yes f m No No No No f e Yes Yes Yes Yes f w Yes Yes Yes Yes f r No No No No CLI Yes Yes Yes Yes FHORC MU Yes Yes No No FMRCF MU No No Yes Yes v jnl t No No No No v ctg No No No No v ...

Страница 234: ...U No No Yes Yes d g seq LDEV MU No No Yes Yes nomsg No No Yes Yes horctakeover h No No Yes Yes z No No Yes Yes zx No No Yes Yes I instance No No Yes Yes IH instance ITC instance No No Yes Yes IM instance ISI instance No No No No q No No Yes Yes xh No No Yes Yes x command arg No No No No g group No No Yes Yes d pair Vol No No Yes Yes d g drive 0 N MU No No Yes Yes d g seq LDEV MU No No Yes Yes noms...

Страница 235: ...stance No No No No IM instance ISI instance No No No No q No No No No xh No No No No x command arg No No No No g s group No No No No d s pair Vol No No No No d g s drive 0 N MU No No No No d g s seq LDEV MU No No No No nomsg No No No No t timeout No No No No jp PID js PID No No No No Table 4 1 Command Options for Copy Types Continued Command Options Shadow Image Snap Shot True Copy TCE ...

Страница 236: ...s Yes pd g drive 0 N Yes Yes Yes Yes pi strings Yes Yes Yes Yes t targ Yes Yes Yes Yes l lun Yes Yes Yes Yes m mun Yes Yes Yes Yes s seq Yes Yes Yes Yes f f Yes Yes Yes Yes f x Yes Yes Yes Yes f g Yes Yes Yes Yes f d Yes Yes Yes Yes f e Yes Yes Yes Yes f r No No No No CLI Yes Yes Yes Yes find g Yes Yes Yes Yes find inst Yes Yes Yes Yes find verify Yes Yes Yes Yes find g conf Yes Yes Yes Yes find s...

Страница 237: ... count Yes Yes Yes Yes sm interval count Yes Yes Yes Yes p port targ lun Yes Yes Yes Yes pd g drive 0 N Yes Yes Yes Yes raidqry h Yes Yes Yes Yes z Yes Yes Yes Yes zx Yes Yes Yes Yes I instance Yes Yes Yes Yes IH instance ITC instance No No Yes Yes IM instance ISI instance Yes Yes No No q Yes Yes Yes Yes xh Yes Yes Yes Yes x command arg No No No No g Yes Yes Yes Yes l Yes Yes Yes Yes r group Yes Y...

Страница 238: ...Yes Yes Yes Yes num No No No No xh Yes Yes Yes Yes x command arg No No No No d Yes Yes Yes Yes c Yes Yes Yes Yes S Yes Yes Yes Yes D Yes Yes Yes Yes DI No No No No C Yes Yes Yes Yes u unitid Yes Yes Yes Yes ND Yes Yes Yes Yes NC Yes Yes Yes Yes g group No No No No l level Yes Yes Yes Yes b y n Yes Yes Yes Yes s size KB Yes Yes Yes Yes t type Yes Yes Yes Yes Table 4 1 Command Options for Copy Types...

Страница 239: ...o No vg type rtime Yes Yes Yes Yes vext size No No No No raidvchkdsp h Yes Yes Yes Yes z Yes Yes Yes Yes zx Yes Yes Yes Yes I instance Yes Yes Yes Yes IH instance ITC instance No No Yes Yes IM instance ISI instance Yes Yes No No q Yes Yes Yes Yes xh Yes Yes Yes Yes x command arg No No No No g group Yes Yes Yes Yes d pair Vol Yes Yes Yes Yes d g drive 0 N MU Yes Yes Yes Yes d g seq LDEV MU Yes Yes ...

Страница 240: ... Yes Yes Yes x command arg No No No No p port hgrp Yes Yes Yes Yes pd g drive 0 N Yes Yes Yes Yes t targ Yes Yes Yes Yes l lun Yes Yes Yes Yes s seq Yes Yes Yes Yes f x Yes Yes Yes Yes v gflag Yes Yes Yes Yes v pid PID No Yes No No v jnl t No No No No v pida No No No No v pids No No No No v pool No No No No v eflag No No No No v offset No No No No v aou No No No No v aoub No No No No Table 4 1 Com...

Страница 241: ...vinfex Yes Yes Yes Yes gplba gplbaex No No No No fv Yes Yes Yes Yes fp No No No No fl Yes Yes Yes Yes pin No No No No fg Yes Yes Yes Yes CLIB sort No No No No fh c No No No No CLI fn No No No No CLI export No No No No fr No No No No fe No No No No mkconf g group Yes Yes Yes Yes gg Yes Yes Yes Yes m mu Yes Yes Yes Yes i inst Yes Yes Yes Yes s service Yes Yes Yes Yes a Yes Yes Yes Yes c drive Yes Ye...

Страница 242: ...raidcom external_grp No No No No raidcom external_storage No No No No raidcom host_grp No No No No raidcom hba_wwn No No No No raidcom journal No No No No raidcom ldev No No No No raidcom lun No No No No raidcom path No No No No raidcom pool No No No No raidcom port No No No No raidcom parity_grp No No No No raidcom rcu No No No No raidcom rcu_path No No No No raidcom resource No No No No raidcom ...

Страница 243: ...mily Command Control Interface CCI Reference Guide raidcom spm_wwn No No No No raidcom spm_group No No No No raidcom snapshot No No No No Table 4 1 Command Options for Copy Types Continued Command Options Shadow Image Snap Shot True Copy TCE ...

Страница 244: ...4 18 Command options Hitachi AMS 2000 Family Command Control Interface CCI Reference Guide ...

Страница 245: ...ference Guide A B C D E F G H I J K L M N O P Q R S T U V W X Y Z Glossary This glossary provides definitions for replication terms as well as terms related to the technology that supports CCI and AMS Click the letter of the glossary section to display the related page ...

Страница 246: ...cks from the source volume to the target volume bps Bits per second The standard measure of data transmission speeds C cache A temporary high speed storage mechanism It is a reserved section of main memory or an independent high speed storage device Two types of caching are found in computers memory caching and disk caching Memory caches are built into the architecture of microprocessors and often...

Страница 247: ... storage systems Command devices are not used by ordinary applications Command devices can be shared between several hosts command line interface CLI A method of interacting with an operating system or software using a command line interpreter With Hitachi s Storage Navigator Modular Command Line Interface CLI is used to interact with and manage Hitachi storage and replication systems concurrency ...

Страница 248: ...ous update cycle is available at all times on the remote storage system A consistent copy of S VOL data is internally pre determined during each update cycle and maintained in the remote data pool When remote takeover operations are performed this reliable copy is restored to the S VOL eliminating any data discrepancies Data consistency at the remote site enables quicker restart of operations upon...

Страница 249: ...ume The data is updated from the differential data control status the pair volume is under the suspended status to the primary volume Differential Management Logical Unit DMLU The volumes used to manage differential data in a storage system In a TrueCopy Extended Distance system there may be up to two DM logical units configured per storage system For Copy on Write and ShadowImage the DMLU is an e...

Страница 250: ...imary volume to the secondary volume to make sure that both volumes are identical extent A contiguous area of storage in a computer file system that is reserved for writing or storing a file F failover The automatic substitution of a functionally equivalent system component for a failed one The term failover is most often applied to intelligent controllers connected to the same storage devices and...

Страница 251: ... update cycle Since only the differential data in the P VOL is transferred to the S VOL the size of data sent to S VOL is often the same as that of data written to the P VOL The amount of differential data that can be managed per write command is limited by the difference between the number of incoming host write operations inflow and outgoing data transfers outflow GUI Graphical user interface I ...

Страница 252: ...e opposite of logical is physical which refers to the real organization of a system A logical description of a file is that it is a quantity of data collected together in one place The file appears this way to users Physically the elements of the file could live in segments across a disk logical unit See logical unit number logical unit number LUN An address for an individual disk drive and by ext...

Страница 253: ...m where you mount your file systems or devices For a volume that is attached to an empty folder on an NTFS file system volume the empty folder is a mount point In some systems a mount point is simply a directory P pair Refers to two logical volumes that are associated with each other for data management purposes for example replication migration A pair is usually composed of a primary or source vo...

Страница 254: ... from a primary site the application site onto the volumes of a secondary site the recovery site point in time logical copy A logical copy or snapshot of a volume at a point in time This enables a backup or mirroring application to run concurrently with the system pool volume Used to store backup versions of files archive copies of files and files migrated from other storage primary or local site ...

Страница 255: ...The maximum desired time period allowed to bring one or more applications and associated data back to a correct operational state It defines the time frame within which specific business operations or data must be restored to avoid any business disruption remote or target site Maintains mirrored data from the primary site remote path A route connecting identical ports on the local storage system a...

Страница 256: ...ecture secondary volume S VOL A replica of the primary volume P VOL at the time of a backup and is kept on a standby storage system Recurring differential data updates are performed to keep the data in the S VOL consistent with data in the P VOL SMPL Simplex snapshot A term used to denote a copy of the data and data file organization on a node in a disk file system A snapshot is a replica of the d...

Страница 257: ... in which a view of the primary volume P VOL is maintained as it existed at the time of the last snapshot The V VOL contains no data but is composed of pointers to data in the P VOL and the data pool The V VOL appears as a full volume copy to any secondary host volume A disk array object that most closely resembles a physical disk from the operating environment s viewpoint The basic unit of storag...

Страница 258: ...is updated in the P VOL particularly when there are multiple write operations in one update cycle This feature is critical to maintain data consistency in the remote S VOL and is implemented by inserting sequence numbers in each update record Update records are then sorted in the cache within the remote system to assure write sequencing write workload The amount of data written to a volume over a ...

Страница 259: ...E status 2 31 2 33 displaying configuration information 1 51 displaying pair status 1 34 E environment variable ShadowImage command 1 4 environment variable subcommands 1 83 environment variables CCI command 1 4 1 86 CCI instance 1 4 HORCM etc horcmgr 1 3 error command error messages 2 21 common error messages 2 27 2 29 unique error messages 2 30 error reporting 2 19 F fence level 2 16 findcmdev 1...

Страница 260: ...airsplit E 1 16 pairsplit S 1 16 pairvolchk 1 31 port number 1 93 portscan 1 75 procedure for recovering data 2 31 2 33 protected volumes 1 3 protection function 2 32 R raidar 1 57 raidqry 1 58 raidscan 1 51 raidvchkdsp 1 62 raidvchkscan 1 66 raidvchkset 1 60 recovering data 2 31 2 33 recovering the pair 2 31 2 33 S sense codes 3 9 setting environment variables 2 16 3 2 special files 1 85 1 93 sta...

Страница 261: ...1 Hitachi AMS 2000 Family Command Control Interface CCI Reference Guide ...

Страница 262: ... 2845 Lafayette Street Santa Clara California 95050 2639 U S A www hds com Regional Contact Information Americas 1 408 970 1000 info hds com Europe Middle East and Africa 44 0 1753 618000 info emea hds com Asia Pacific 852 3189 7900 hds marketing apac hds com ...

Результаты поиска

Содержание AMS 2000 Series

Отзывы:

Бренды по названию

Популярные бренды

Hitachi AMS 2000 Series, Справочное руководство

Результаты поиска

Содержание AMS 2000 Series

Отзывы:

Бренды по названию

Популярные бренды