Hitachi Dynamic Link Manager Page 723 User Manual Download | Manualshive

Page: 723 / 746

background image

B. Troubleshooting Products That Use the Weak-Modules Script

699

For

device

, enter the device you determined in step 1.

In each of the following examples, the underlined part indicates the kernel

parameter added in this step:
Example when the boot loader is elilo and LVM is not used:

:

:

image=vmlinuz-2.6.18-92.el5

label=linux-HDLM

initrd=initrd-2.6.18-92.el5.img.hdlm

read-only

append="console=ttyS0,19200 rhgb quiet root=/dev/

sddlmaa2"

:

:

Example when the boot loader is grub and LVM is used:

:

:

title Red Hat Enterprise Linux Server

(2.6.18-92.el5-HDLM)

root (hd0,0)

kernel /vmlinuz-2.6.18-92.el5 ro rhgb quiet root=/

dev/VolGroup00/LogVol00

initrd /initrd-2.6.18-92.el5.img.hdlm

:

:

3.

Install other products that use the weak-modules script.
Perform installation according to the documentation for relevant products

(packages).

4.

Back up the currently used initial RAM disk image file for HDLM.

5.

Execute the

dlmmkinitrd

utility (utility for supporting a boot disk) with the

-f

parameter specified to create an initial RAM disk image file for HDLM.
For the parameter, specify the initial RAM disk image file name that is currently

«
...
721
722
723
724
725
...
»

Summary of Contents for Dynamic Link Manager

Page 1: ...Hitachi Dynamic Link Manager Software User s Guide for Linux R 3000 3 F04 60 E ...

Page 2: ... in the United States and other countries Solaris is either a registered trademark or a trademark of Oracle and or its affiliates SteelEye Technology SteelEye and LifeKeeper are registered trademarks of SteelEye Technology Inc Sun Microsystems is either a registered trademark or a trademark of Oracle and or its affiliates SUSE is a registered trademark of Novell Inc in the United States and other ...

Page 3: ...1 3 22 2 4 6 4 6 7 2 7 2 3 7 10 3 Appendix D The following messages have been added KAPL04053 W KAPL05712 I KAPL10948 W KAPL10949 E KAPL15001 I KAPL15002 E KAPL15064 I KAPL15065 E 2 12 1 8 4 8 5 8 10 8 14 Red Hat Enterprise Linux AS 4 9 and Red Hat Enterprise Linux ES 4 9 are now supported 3 1 1 3 1 3 It is now possible to specify the number of times the same path can be used for I O operations wh...

Page 4: ......

Page 5: ...overview of HDLM and describes its features 2 HDLM Functions Chapter 2 describes management targets and the system configuration of HDLM and the basic terms and functions for HDLM 3 Creating an HDLM Environment Chapter 3 describes the procedures for building an HDLM environment including installing and setting up HDLM and describes for canceling the settings 4 HDLM Operation Chapter 4 describes ho...

Page 6: ...e the weak modules script C Functional Differences Between Versions of HDLM Appendix C explains the differences in functionality between HDLM versions D Glossary This glossary explains terms used in this manual Related Publications Manuals related to this manual are listed below See these manuals when necessary Hitachi Global Link Manager Software Installation and Configuration Guide Hitachi Globa...

Page 7: ...Adaptable Modular Storage 500 Hitachi Adaptable Modular Storage 200 Hitachi Workgroup Modular Storage series Hitachi AMS2000 AMS WMS SMS series A generic term for Hitachi Adaptable Modular Storage 2000 series Hitachi Adaptable Modular Storage 1000 Hitachi Adaptable Modular Storage 500 Hitachi Adaptable Modular Storage 200 Hitachi Workgroup Modular Storage series Hitachi Simple Modular Storage seri...

Page 8: ...dition JRE JavaTM 2 Runtime Environment Standard Edition Lightning 9900V series A generic term for Lightning 9900V series HP XP128 HP XP1024 Linux Linux R LUKS Linux Unified Key Setup Oracle9i RAC Oracle9i Real Application Clusters Oracle Enterprise Linux 4 A generic term for Oracle Enterprise Linux 4 Update 5 Oracle Enterprise Linux 4 Update 6 Oracle Enterprise Linux 5 A generic term for Oracle E...

Page 9: ...nterprise Linux R ES 4 7 Red Hat Enterprise Linux R ES 4 8 Red Hat Enterprise Linux R ES 4 9 Red Hat Enterprise Linux 5 A generic term for Red Hat Enterprise Linux R 5 Red Hat Enterprise Linux R 5 Advanced Platform Red Hat Enterprise Linux R 5 1 Red Hat Enterprise Linux R 5 1 Advanced Platform Red Hat Enterprise Linux R 5 2 Red Hat Enterprise Linux R 5 2 Advanced Platform Red Hat Enterprise Linux ...

Page 10: ...INUX R Enterprise Server 9 SUSE LINUX R Enterprise Server 10 SUSE LINUX R Enterprise Server 11 SVS HP StorageWorks 200 Storage Virtualization System Thunder 9200 Hitachi Freedom Storage Thunder 9200 Universal Storage Platform V VM A generic term for Hitachi Universal Storage Platform V Hitachi Universal Storage Platform VM HP XP20000 HP XP24000 UNIX A generic term for AIX Solaris Linux HP UX VCS V...

Page 11: ...y 64 Technology EVMS Enterprise Volume Management System ext Extended File System FC Fibre Channel FC SP Fibre Channel Security Protocol FO Failover GMT Greenwich Mean Time GRUB GRand Unified Bootloader GUI Graphical User Interface HBA Host Bus Adapter HDev Host Device HLU Host Logical Unit HTTP Hypertext Transfer Protocol I O Input Output IA32 Intel Architecture 32 IDE Integrated Drive Electronic...

Page 12: ...Volume Manager md Multiple Devices NAS Network Attached Storage NIC Network Interface Card NTP Network Time Protocol OS Operating System P Port PCI Peripheral Component Interconnect RADIUS Remote Authentication Dial in User Service SAN Storage Area Network SCSI Small Computer System Interface SLPR Storage Logical Partition SMTP Simple Mail Transfer Protocol SNMP Simple Network Management Protocol ...

Page 13: ...symbol conventions are classified as General font conventions Conventions in syntax explanations These conventions are described below General Font Conventions The following table lists the general font conventions UUID Universally Unique Identifier VG Volume Group WWN World Wide Name Abbreviation Full name or meaning ...

Page 14: ...n Click the Cancel button In the Enter name entry box type your name Italics Italics are used to indicate a placeholder for some actual text provided by the user or system Italics are also used for emphasis For example Write the command as follows copy source file target file Do not delete the configuration file Code font A code font indicates text that the user enters without change or text such ...

Page 15: ...d is specified when all items are omitted One of the options enclosed in must be specified Only one of the options separated by a vertical bar can be specified at the same time An ellipsis indicates that the item or items enclosed in or immediately preceding the ellipsis may be specified as many times as necessary Parentheses indicate the range of items to which the vertical bar or ellipsis is app...

Page 16: ......

Page 17: ...vice Files for HDLM Devices 17 2 7 Distributing a Load Using Load Balancing 19 2 7 1 Paths To Which Load Balancing Is Applied 21 2 7 2 Load Balancing Algorithms 23 2 8 Performing Failovers and Failbacks Using Path Switching 25 2 8 1 Automatic Path Switching 25 2 8 2 Manual Path Switching 28 2 8 3 Path Status Transition 29 2 9 Monitoring Intermittent Errors Functionality When Automatic Failback Is ...

Page 18: ... When Using SUSE LINUX Enterprise Server 10 111 3 1 8 Related Products When Using SUSE LINUX Enterprise Server 11 118 3 1 9 Related Products When Using Oracle Enterprise Linux 4 120 3 1 10 Related Products When Using Oracle Enterprise Linux 5 121 3 1 11 Memory and Disk Capacity Requirements 124 3 1 12 Number of Paths Supported in HDLM 127 3 1 13 Virtual Environments Supported by HDLM 127 3 2 Flow ...

Page 19: ...7 3 10 Settings for LVM2 246 3 10 1 Notes on Using LVM2 246 3 10 2 When Using an HDLM Device to Create a New Logical Volume 246 3 10 3 When Moving a Logical Volume Created on a SCSI Device in a Single Path Environment to an HDLM Device 253 3 11 Settings for Xen 258 3 12 Settings for KVM 260 3 13 Settings for Heartbeat 262 3 14 Settings for Oracle RAC 263 3 15 Settings for the RHCM 266 3 15 1 Notes...

Page 20: ... the LUKS Settings 310 3 23 11 Uninstalling HDLM 311 3 23 12 Uninstalling Hitachi Network Objectplaza Trace Library HNTRLib2 326 4 HDLM Operation 329 4 1 Notes on Using HDLM 330 4 1 1 Notes Common to OSs 330 4 1 2 Notes When Using Red Hat Enterprise Linux AS4 ES4 or Oracle Enterprise Linux 4 332 4 1 3 Notes When Using Red Hat Enterprise Linux 5 Red Hat Enterprise Linux 6 or Oracle Enterprise Linux...

Page 21: ...adding a BladeSymphony I O drawer 385 5 Troubleshooting 387 5 1 Information Collected by the DLMgetras Utility for Collecting HDLM Error Information 388 5 2 Checking Error Information in Messages 389 5 3 What To Do for a Path Error 391 5 3 1 Examining the Messages 392 5 3 2 Obtain Path Information 392 5 3 3 Identifying the Error Path 393 5 3 4 Narrowing Down the Hardware That Might Have Caused the...

Page 22: ...68 7 3 dlmcfgmgr Utility for Managing the HDLM Configuration 489 7 3 1 Format 489 7 3 2 Parameters 489 7 4 dlmmkinitrd Utility for Supporting a Boot Disk 500 7 4 1 Format 500 7 4 2 Parameters 500 7 5 dlmpr Utility for Clearing HDLM Persistent Reservation 503 7 5 1 Format 503 7 5 2 Parameters 503 7 6 dlmsetopt Utility for Setting HDLM Driver Options 506 7 6 1 Format 506 7 6 2 Parameters 506 7 7 dlm...

Page 23: ...13 KAPL13001 to KAPL14000 662 8 14 KAPL15001 to KAPL16000 677 8 15 Return Codes for Hitachi Command Suite Common Agent Component 684 Appendixes 691 A Notes on Linux Commands and Files 692 A 1 Notes on the proc partitions File 692 A 2 Notes on Linux Commands 692 A 3 Notes on the iostat Command 693 A 4 Notes on the mkfs Command 694 A 5 Notes on the fdisk Command 694 A 6 Notes on the sar Command 695 ...

Page 24: ...nctional Differences Between Version 5 8 or Later and Versions Earlier Than 5 8 704 C 8 Functional Differences Between Version 5 7 1 or Later and Versions Earlier Than 5 7 1 705 C 9 Functional Differences Between Version 5 7 0 01 or Later and Versions Earlier Than 5 7 0 01 705 C 10 Functional Differences Between Version 5 7 or Later and Versions Earlier Than 5 7 705 C 11 Functional Differences Bet...

Page 25: ...ystem HDLM is designed to distribute loads across multiple paths and will switch a given load to another path if there is a failure in the path that is currently being used thus improving system reliability This chapter gives an overview of HDLM and describes its features 1 1 What is HDLM 1 2 HDLM Features ...

Page 26: ...s paths to these storage systems HDLM provides the ability to distribute loads across multiple paths and switch to another path if there is a failure in the path that is currently being used thus improving system availability and reliability Figure 1 1 Between Hosts and Storage Systems illustrates the connections between various hosts and storage systems A server on which HDLM is installed is call...

Page 27: ...1 Overview of HDLM 3 Lightning 9900V series Thunder 9500V series Universal Storage Platform V VM Virtual Storage Platform ...

Page 28: ...acks Using Path Switching The ability to bring a path that has recovered from an error back online This is also known as performing a failback If a path is recovered from an error HDLM can bring that path back online This enables the maximum possible number of paths to always be available and online which in turn enables HDLM to better distribute the load across multiple paths Failbacks can be per...

Page 29: ...es load distribution across paths and path switching 2 1 Devices Managed by HDLM 2 2 System Configuration 2 3 LU Configuration 2 4 Program Configuration 2 5 Position of the HDLM Driver and HDLM Device 2 6 Logical Device Files for HDLM Devices 2 7 Distributing a Load Using Load Balancing 2 8 Performing Failovers and Failbacks Using Path Switching 2 9 Monitoring Intermittent Errors Functionality Whe...

Page 30: ... target devices The following devices of the storage systems listed in Section 1 1 What is HDLM SCSI devices Boot disks Non HDLM management target devices SCSI devices other than those of the storage systems listed in Section 1 1 What is HDLM Devices other than disks such as tape devices Command devices of the storage systems listed in Section 1 1 What is HDLM For example Hitachi RAID Manager comm...

Page 31: ... that connects a host and an LU is called a physical path and a route that connects a host and a Dev is called a path When an LU has been divided into multiple Devs the number of paths set to the LU is equal to the number that is found by multiplying the number of physical paths by the number of Devs in the LU HDLM assigns an ID to a physical path and manages the paths on a physical path basis Whe...

Page 32: ...BA A host bus adapter This serves as a cable port on the host FC SAN A dedicated network that is used for data transfer between the host and storage systems CHA A channel adapter P A port on a CHA This serves as a cable port on a storage system LU A logical unit a logical volume defined on the storage system This serves as the target of input or output operations from the host Dev An area partitio...

Page 33: ...cal path and a route that connects a host and a Dev is called a path When an LU has been divided into multiple Devs the number of paths set to the LU is equal to the number that is found by multiplying the number of physical paths by the number of Devs in the LU HDLM assigns an ID to a physical path and manages the paths on a physical path basis When you use HDLM there is no need to consider the d...

Page 34: ...tion NIC A network interface card that serves as a cable port on a host The NIC is referred to as the HBA in HDLM commands Sometimes it is also just simply called an HBA in this manual IP SAN A data transfer network that connects hosts and storage systems by using the iSCSI standard CHA A channel adapter P A port on a CHA This serves as a cable port on a storage system LU A logical unit a logical ...

Page 35: ...h the OS NICs For details on the applicable NICs see HDLM Release Notes Storage system The storage system applicable for an IP SAN is a Hitachi AMS2000 series storage system Restrictions on using HDLM in an IP SAN environment The following restrictions apply when using HDLM in an IP SAN environment Use of HDLM in cluster configurations or boot disk environments is not supported The kdump function ...

Page 36: ...in the storage system are also recognized as a single LU regardless of the number of paths In addition to the one that indicates the entire LU a logical device file for the HDLM device is created for each partition An LU recognized by a host after HDLM installation is called a host LU HLU The areas in a host LU that correspond to the Dev partition in a storage system LU are called host devices HDe...

Page 37: ...Components Components Description HDev A Dev partition in an LU that the host recognizes via the HDLM driver It is called a host device One host device is recognized for one Dev in the storage system HLU An LU that the host recognizes via the HDLM driver It is called a host LU Regardless of how many paths exist only one host LU is recognized for each LU in the storage system ...

Page 38: ...M operation it is important to understand the name and purpose of each program along with how they are all interrelated Figure 2 4 Configuration of the HDLM Programs shows the configuration of the HDLM programs Figure 2 4 Configuration of the HDLM Programs Table 2 4 Functionality of HDLM Programs lists and describes the functions of these programs ...

Page 39: ... the installation of HDLM Re register HDLM information Collect information about errors that occurred during the installation of HDLM Install HDLM HDLM manager Provides the HDLM manager which enables you to Configure the HDLM operating environment Request path health checks and automatic failbacks to be performed Collect error log data HDLM alert driver Reports the log information collected by the...

Page 40: ... the SCSI driver Each application on the host uses the HDLM device logical device file created by HDLM to access LUs in the storage system Figure 2 5 Position of the HDLM Driver and HDLM Devices shows the position of the HDLM driver and HDLM device Figure 2 5 Position of the HDLM Driver and HDLM Devices ...

Page 41: ... Application Accesses the LU The logical device file name of an HDLM device has the following format dev sddlm aa pap 1 15 About alphabetic letters used in the logical device file name For the first 256 LUs two alphabetic letters are assigned The specifiable values for the first two characters are in the range from a to p For the 257th and subsequent LUs three alphabetic letters are assigned The s...

Page 42: ... name 1 15 indicates a partition number in the applicable LU For example if the logical device file name of an HDLM device is sddlmaa1 it indicates partition 1 on sddlmaa To specify the entire LU simply use sddlmaa Note that HDLM creates block device files The system dynamically selects the major number of the block device that this file uses ...

Page 43: ...operations managed by HDLM can be distributed to each path while others cannot Therefore even though load balancing function is used I O operations might not be equally allocated to each path Figure 2 7 Flow of I O Data When the Load Balancing Function Is Not Used shows the flow of I O data when the load balancing function is not used Figure 2 8 Flow of I O Data When the Load Balancing Function Is...

Page 44: ... Data When the Load Balancing Function Is Not Used When the load balancing function is not used I O operations converge onto a single path A The load on that one path A will cause a bottleneck which might cause problems with system performance ...

Page 45: ...alancing Is Applied This subsection describes for each type of storage system the paths to which the load balancing function is applied 1 When Using the Thunder 9500V Series or Hitachi AMS WMS series HDLM performs load balancing between owner paths or between non owner paths An owner path is a path that passes through the CHA This path is set on the owner controller of the storage system LU Since ...

Page 46: ...e non owner paths For the example in Figure 2 9 Overview of Load Balancing suppose that in the owner controller of LU0 is CHA0 When the LU is accessed the load is balanced between the two paths A and B which are both owner paths When one of the paths A cannot be used then the LU is accessed from the only other owner path B When both of the owner paths A and B cannot be used the load is then balanc...

Page 47: ...r of I Os are issued The path that is used is determined by the following Round Robin The paths are simply selected in order from among all the connected paths Least I Os The path that has the least number of I Os being processed is selected from among all the connected paths Least Blocks The path that has the least number of I O blocks being processed is selected from among all the connected path...

Page 48: ...when HDLM is first installed When an upgrade installation of HDLM is performed the algorithm that is currently being used is inherited Select the load balancing algorithm most suitable for the data access patterns of your system environment However if there are no recognizable data access patterns we recommend using the default algorithm the Extended Least I Os algorithm You can specify the load b...

Page 49: ...nnot receive I Os A path will go into the offline status for the following reasons An error occurred on the path A user executed the HDLM command s offline operation For details on the offline operation see 6 4 offline Places Paths Offline For details on path statuses and the transitions of those statuses see 2 8 3 Path Status Transition 2 8 1 Automatic Path Switching The following describes the a...

Page 50: ...e switching destination is the other path connected to CHA0 B If an error also occurs on that path B then the next possibility for a path comes from one of the two paths C or D connected to CHA1 When the Lightning 9900 series Lightning 9900V series Hitachi USP Universal Storage Platform V VM Virtual Storage Platform Hitachi AMS2000 series or Hitachi SMS is being used all the paths are owner paths ...

Page 51: ...sis When using the Thunder 9500V series or Hitachi AMS WMS series HDLM will select the next path to be used first from among the online owner paths and then from the online non owner paths As a result if an owner path recovers from an error and then HDLM automatically places the recovered path online while a non owner path is in use the path will be automatically switched over from the non owner p...

Page 52: ... of some reason such as a loose cable connection 2 8 2 Manual Path Switching You can switch the status of a path by manually placing the path online or offline Manually switching a path is useful for example when system maintenance needs to be done You can manually place a path online or offline by doing the following Execute the dlnkmgr command s online or offline operation For details on the onl...

Page 53: ...2 8 Performing Failovers and Failbacks Using Path Switching is further subdivided into two statuses The following explains the two online path statuses and the two offline statuses 1 The Online Path Status The online path statuses are as follows Online I Os can be issued normally Online E An error has occurred on the path but none of the other paths that access the same LU are in the Online status...

Page 54: ...the status transitions of a path Figure 2 11 Path Status Transitions Legend Online operation Online operation performed by executing the dlnkmgr command s online operation Offline operation Offline operation performed by executing the dlnkmgr command s offline operation 1 When the following conditions are satisfied a path that has been determined to have an intermittent error also becomes subject ...

Page 55: ...available online path for an LU the status of the path will change to Online E If you are using the automatic failback function after the path has recovered from the error HDLM will automatically place the path online When you are using intermittent error monitoring the path in which the intermittent error occurred is not automatically placed online when the path recovers from the error In such a ...

Page 56: ...not subject to auto failback status 2 9 1 Checking Intermittent Errors You can check the paths in which intermittent errors have occurred by viewing the execution results of the HDLM command s view operation For details on the view operation see 6 7 view Displays Information 2 9 2 Setting Up Intermittent Error Monitoring When you enable the intermittent error monitoring function specify the follow...

Page 57: ...onitoring will finish and the path is determined to have an intermittent error upon which the path is removed from those subject to automatic failbacks The path that is removed will remain in the error status until the online operation is performed However if the path satisfies certain conditions see Figure 2 11 Path Status Transitions it will be subject to automatic failbacks and change to the On...

Page 58: ...t error if the error occurs three or more times in 30 minutes The events that occur are described by using the time arrows Figure 2 13 What Will Happen When an Intermittent Error Does Not Occur on a Path As shown in Figure 2 13 What Will Happen When an Intermittent Error Does Not Occur on a Path normally the count for the number of times that an error occurs is started after the path is first reco...

Page 59: ...n the conditions for an intermittent error are changed during error monitoring For this example the conditions have been changed from 3 or more errors in 30 minutes to 3 or more errors in 40 minutes The events that occur are described by using the time arrows Figure 2 14 What Will Happen When Conditions Are Changed During Error Monitoring 2 9 4 When a User Changes the Intermittent Error Informatio...

Page 60: ... Reset 2 Inherited Turning intermittent error monitoring on by executing the set operation but not changing the conditions while intermittent error monitoring is being performed Changing the intermittent error monitoring conditions while intermittent error monitoring is not being performed Not applicable Not counted Inherited Changing the automatic failback settings Turning off Reset Reset Changin...

Page 61: ...ntermittent error monitoring function off change the target paths to Offline C 2 The number of errors and the time passed since error monitoring had started are both reset to 0 and then monitoring restarts from the time the setting change is made in accordance with the changed monitoring conditions 3 The number of errors and the time passed since error monitoring had started are both reset to 0 an...

Page 62: ...ing function switches the status of that path to Offline E or Online E You can use the dlnkmgr command s view operation to check the path error For example in a normal state I O operations are not performed on the paths coming from the standby host in the cluster configuration or on non owner paths that is some of the paths that access a Thunder 9500V series and Hitachi AMS WMS series storage syst...

Page 63: ...formation for troubleshooting into log files HDLM can also filter error information according to the error level when collecting the information Figure 2 15 Flow of Data When Collecting Error Information shows the flow of data when collecting error information ...

Page 64: ...2 HDLM Functions 40 Figure 2 15 Flow of Data When Collecting Error Information Logs might be collected in layers below HDLM such as for the SCSI driver For more details see the Linux documentation ...

Page 65: ...e following is the trace file name var opt DynamicLinkManager log hdlmtr 1 64 log Error log Error information is collected for the user defined level By default HDLM collects all error information HDLM Manager logs var opt DynamicLinkManager log dlmmgr 1 16 log Hitachi Command Suite Common Agent Component logs var opt DynamicLinkManager log dlmwebagent 1 N log The value N depends on the setting in...

Page 66: ...ssage IDs In syslog the HDLM messages on or above the level set by the user configured in syslogd settings file are collected It is recommended that you set the information to be output at the Information level or higher Note that all the facilities when HDLM outputs messages in syslog are user The error information in error logs and trace files are collected based on a user defined collection lev...

Page 67: ...imultaneously collect all the information required for analyzing errors information such as error logs process specific trace information files trace files definition files core files and libraries You can use the collected information when you contact your HDLM vendor or maintenance company if there is a maintenance contract for HDLM For details on the DLMgetras utility see 7 2 DLMgetras Utility ...

Page 68: ...te products Failure An abnormal hardware or software event including Hardware errors Software errors such as memory errors LinkStatus An event indicating the linkage status between devices Link up or link down ExternalService An event indicating the result of communication between a Hitachi storage related product and an external service including Communication with a RADIUS server LDAP server NTP...

Page 69: ...n event indicating that a permitted operation performed by the administrator has terminated normally or failed including Viewing or updating configuration information Updating account settings such as adding and deleting accounts Setting up security Viewing or updating audit log settings Maintenance An event indicating that a maintenance operation has terminated normally or failed including Adding...

Page 70: ...ccessful 6 KAPL150 62 I Processing of the dlmstart utility failed 3 KAPL150 63 E Authentication Administrator or end user authentication Permission has not been granted to execute the HDLM command 4 KAPL151 11 W Permission has not been granted to execute HDLM utilities 4 KAPL150 10 W Permission has not been granted to start or stop the HDLM manager 4 KAPL154 04 W ConfigurationAccess Viewing or upd...

Page 71: ...gement target information failed 3 KAPL151 10 E Processing of the dlmpr k command was successful 6 KAPL150 01 I Processing of the dlmpr k command failed 3 KAPL150 02 E Processing of the dlmpr c command was successful 6 KAPL150 64 I Processing of the dlmpr c command failed 3 KAPL150 65 E Processing of the dlmcfgmgr r command was successful 6 KAPL150 40 I Processing of the dlmcfgmgr r command failed...

Page 72: ...ssful 6 KAPL150 48 I Processing of the dlmcfgmgr u command failed 3 KAPL150 49 E Processing of the dlmmkinitrd command was successful 6 KAPL150 50 I Processing of the dlmmkinitrd command failed 3 KAPL150 51 E Processing of the dlmsetopt r command was successful 6 KAPL150 52 I Processing of the dlmsetopt r command failed 3 KAPL150 53 E Processing of the dlmsetopt inqt command was successful 6 KAPL1...

Page 73: ...LM command s set operation However audit log data might still be output regardless of the above conditions if for example an HDLM utility is executed from external media The following audit log data is output Categories StartStop Authentication and ConfigurationAccess Severity 6 Critical Error Warning or Informational Destination syslog facility value user Notes Processing of the dlmsetopt inqr co...

Page 74: ...ively for audit log data For example to change the output destination of audit log data to usr local audlog specify the following two settings Specify the following setting in the etc syslog conf file local0 info usr local audlog Use the HDLM command s set operation to specify local0 for the audit log facility You can also filter the audit log output by specifying a severity level and type for the...

Page 75: ...tion common identifier common specification revision number serial number mes sage ID date and time entity affected location affected audit event type aud it event result subject ID for audit event result hardware identification infor mation location information location identification information FQDN redu ndancy identification information agent information host sending request po rt number sendi...

Page 76: ...ormation Hardware model name or serial number Location information Hardware component identification information Location identification information Location identification information FQDN Fully qualified domain name Redundancy identification information Redundancy identification information Agent information Agent information Host sending request Name of the host sending a request Port number se...

Page 77: ...uccessful CELFSS 1 1 0 KAPL15109 I 2008 04 09T10 18 40 6 09 00 HDLMCo mmand hostname moon ConfigurationAccess Success uid root Information about HDLM management targets was successfully displayed Command Line opt DynamicLinkManager bin dlnkmgr view path Reserved area This field is reserved No data is output here Message text Data related to the audit event is output Item Explanation ...

Page 78: ...ation for multiple instances of HDLM and reduce operational load In addition you can switch the operational status of paths to perform system wide load balancing and centrally manage the system by collecting HDLM failure information in Global Link Manager Global Link Manager collects and manages information about paths from instances of HDLM installed on multiple hosts Even if multiple users manag...

Page 79: ...2 HDLM Functions 55 Figure 2 16 Example System Configuration Using HDLM and Global Link Manager ...

Page 80: ...nterprise Linux 5 1 Cluster Software Supported by HDLM If an FC SAN Is Used in 3 1 5 Related Products When Using Red Hat Enterprise Linux 6 1 Cluster Software Supported by HDLM in 3 1 6 Related Products When Using SUSE LINUX Enterprise Server 9 1 Cluster Software Supported by HDLM in 3 1 7 Related Products When Using SUSE LINUX Enterprise Server 10 or 1 Cluster Software Supported by HDLM in 3 1 10...

Page 81: ...stall HDLM 3 5 Notes on Creating an HDLM Environment 3 6 Installing HDLM 3 7 Installing HDLM for Managing Boot Disks 3 8 Settings for LUKS 3 9 Settings for md Devices 3 10 Settings for LVM2 3 11 Settings for Xen 3 12 Settings for KVM 3 13 Settings for Heartbeat 3 14 Settings for Oracle RAC 3 15 Settings for the RHCM 3 16 Settings for VCS 3 17 Checking the Path Configuration 3 18 Setting Up HDLM 3 ...

Page 82: ...n Table 3 1 Requirements for Applicable Hosts Table 3 1 Requirements for Applicable Hosts 1 HDLM is compatible with Hyper Threading technology 2 The disk capacity required for installation You can install HDLM on a host on which an OS listed in Table 3 2 Red Hat Enterprise Linux AS4 ES4 Kernels Supported by HDLM Table 3 3 Red Hat Enterprise Linux 5 Kernels Supported by HDLM Table 3 4 Red Hat Enter...

Page 83: ... using cat proc cpuinfo processor 0 vendor_id AuthenticAMD cpu family 15 model 37 model name AMD Opteron tm Processor 252 stepping 1 Check the vendor_id line AuthenticAMD is displayed for AMD CPUs and GenuineIntel is displayed for Intel CPUs Note If an IP SAN is used to connect HDLM with a storage system HDLM is supported on the following OSs Red Hat Enterprise Linux 5 6 Red Hat Enterprise Linux 5...

Page 84: ... 2 EL 2 6 9 34 0 2 ELsmp 2 6 9 34 0 2 ELhugemem 2 6 9 42 EL 2 6 9 42 ELsmp 2 6 9 42 ELhugemem 2 6 9 42 0 3 EL 2 6 9 42 0 3 ELsmp 2 6 9 42 0 3 ELhugemem 2 6 9 55 EL 2 6 9 55 ELsmp 2 6 9 55 ELhugemem 2 6 9 67 EL 2 6 9 67 ELsmp 2 6 9 67 ELhugemem 2 6 9 78 EL 2 6 9 78 ELsmp 2 6 9 78 ELhugemem 2 6 9 89 EL 2 6 9 89 ELsmp 2 6 9 89 ELhugemem 2 6 9 100 EL 2 6 9 100 ELsmp 2 6 9 100 ELhugemem IPF 3 2 6 9 11 ...

Page 85: ...Lsmp 2 6 9 34 EL 2 6 9 34 ELsmp 2 6 9 34 ELlargesmp 2 6 9 34 0 2 EL 2 6 9 34 0 2 ELsmp 2 6 9 34 0 2 ELlargesmp 2 6 9 42 EL 2 6 9 42 ELsmp 2 6 9 42 ELlargesmp 2 6 9 42 0 3 EL 2 6 9 42 0 3 ELsmp 2 6 9 42 0 3 ELlargesmp 2 6 9 55 EL 2 6 9 55 ELsmp 2 6 9 55 ELlargesmp 2 6 9 67 EL 2 6 9 67 ELsmp 2 6 9 67 ELlargesmp 2 6 9 78 EL 2 6 9 78 ELsmp 2 6 9 78 ELlargesmp 2 6 9 89 EL 2 6 9 89 ELsmp 2 6 9 89 ELlarg...

Page 86: ...is installed on a system that uses an Intel CPU or AMD Opteron CPU In an EM64T AMD64 environment the RPM Red Hat Package Manager packages listed below are required Install these RPM packages before installing HDLM libstdc RPM package version i386 rpm libgcc RPM package version i386 rpm glibc RPM package version i686 rpm RPM package version depends on the OS version you are using Table 3 3 Red Hat ...

Page 87: ... CPU or AMD Opteron processor 3 2 6 18 128 el5 2 6 18 128 el5PAE 2 6 18 164 el5 2 6 18 164 el5PAE 2 6 18 194 el5 2 6 18 194 el5PAE 2 6 18 238 el5 2 6 18 238 el5PAE IPF 3 2 6 18 8 el5 2 6 18 53 el5 2 6 18 92 el5 2 6 18 128 el5 2 6 18 164 el5 2 6 18 194 el5 2 6 18 238 el5 EM64T AMD64 4 2 6 18 8 el5 2 6 18 53 el5 2 6 18 92 el5 2 6 18 128 el5 2 6 18 164 el5 2 6 18 194 el5 2 6 18 238 el5 Kernel archite...

Page 88: ...s on the OS version you are using Table 3 4 Red Hat Enterprise Linux 6 Kernels Supported by HDLM 1 Only kernels that are provided by OS distributors in binary format are supported 2 HDLM supports an environment where an IA32 kernel is installed on a system that uses an Intel CPU or AMD Opteron processor 3 Note the following in an EM64T AMD64 environment HDLM supports an environment where an EM64T ...

Page 89: ...ionality An HDLM device that applies EVMS functions is not supported You cannot use DRBD functions in an environment where HDLM is installed You cannot use HDLM in a User Mode Linux environment 1 Only kernels that are provided by OS distributors in binary format are supported 2 HDLM supports an environment where an IA32 kernel is installed on a system that uses an Intel CPU or AMD Opteron processo...

Page 90: ... 16 21 0 8 default 3 2 6 16 21 0 8 smp 3 2 6 16 21 0 8 bigsmp 3 2 6 16 46 0 14 default 4 2 6 16 46 0 14 smp 4 2 6 16 46 0 14 bigsmp 4 2 6 16 60 0 21 default 5 2 6 16 60 0 21 smp 5 2 6 16 60 0 21 bigsmp 5 2 6 16 60 0 21 xenpae 5 2 6 16 60 0 54 5 default 6 2 6 16 60 0 54 5 smp 6 2 6 16 60 0 54 5 bigsmp 6 2 6 16 60 0 54 5 xenpae 6 2 6 16 60 0 85 1 default 7 2 6 16 60 0 85 1 smp 7 2 6 16 60 0 85 1 big...

Page 91: ...environment 1 Only kernels that are provided by OS distributors in binary format are supported 2 HDLM supports an environment where an IA32 kernel is installed on a system that uses an Intel CPU or AMD Opteron processor 3 A gdb package of version 6 5 21 2 or later must be installed EM64T AMD64 9 2 6 16 21 0 8 default 3 2 6 16 21 0 8 smp 3 2 6 16 46 0 14 default 4 2 6 16 46 0 14 smp 4 2 6 16 60 0 2...

Page 92: ...on a system that uses an Intel CPU 9 HDLM supports an environment where an EM64T AMD64 kernel is installed on a system that uses an Intel CPU or AMD Opteron CPU Table 3 7 SUSE LINUX Enterprise Server 11 Kernels Supported by HDLM Note This subsection describes the operating environment common to SUSE LINUX Enterprise Server 11 Kernel architecture 1 Kernel IA32 2 2 6 27 21 0 1 default 2 6 27 21 0 1 ...

Page 93: ...r AMD Opteron processor 3 HDLM supports an environment where an IPF kernel is installed on a system that uses an Intel CPU 4 HDLM supports an environment where an EM64T AMD64 kernel is installed on a system that uses an Intel CPU or AMD Opteron CPU Table 3 8 Oracle Enterprise Linux 4 Kernels Supported by HDLM 1 Only kernels that are provided by OS distributors in binary format are supported Kernel...

Page 94: ...es before installing HDLM libstdc RPM package version i386 rpm libgcc RPM package version i386 rpm glibc RPM package version i686 rpm RPM package version depends on the OS version you are using Table 3 9 Oracle Enterprise Linux 5 Kernels Supported by HDLM 1 Only kernels that are provided by OS distributors in binary format are supported 2 HDLM supports an environment where an IA32 kernel is instal...

Page 95: ...e using 3 1 2 Storage Systems Supported by HDLM The following shows the storage systems that HDLM supports 1 Storage Systems The following storage systems are supported by HDLM If an FC SAN is used Hitachi AMS2000 AMS WMS SMS series Hitachi NSC55 Hitachi TagmaStore Universal Storage Platform 100 Hitachi TagmaStore Universal Storage Platform 600 Hitachi TagmaStore Universal Storage Platform 1100 Hi...

Page 96: ...Hat Enterprise Linux 5 4 Boot Disk Environments Supported by HDLM If an FC SAN Is Used in 3 1 5 Related Products When Using Red Hat Enterprise Linux 6 4 Boot Disk Environments and BladeSymphony Environments Supported by HDLM in 3 1 7 Related Products When Using SUSE LINUX Enterprise Server 10 3 Boot Disk Environments Supported by HDLM in 3 1 8 Related Products When Using SUSE LINUX Enterprise Serv...

Page 97: ...inux AS4 ES4 IPF and Table 3 13 Cluster Software When Using Red Hat Enterprise Linux AS4 ES4 EM64T AMD64 list related programs used when you configure a cluster Table 3 10 Cluster Software When Using Red Hat Enterprise Linux AS4 IA32 Usable kernels Cluster software 2 6 9 11 EL 2 6 9 11 ELsmp 2 6 9 11 ELhugemem LifeKeeper v6 LifeKeeper v6 Update1 LifeKeeper v6 Update2 LifeKeeper v6 Update3 LifeKeep...

Page 98: ...g Release 2 10 2 0 4 0 5 Oracle RAC 11g Release 1 11 1 0 6 0 6 Oracle RAC 11g Release 1 11 1 0 7 0 7 RHCM 1 0 4 0 2 6 9 34 0 2 EL 2 6 9 34 0 2 ELsmp 2 6 9 34 0 2 ELhugemem LifeKeeper v6 LifeKeeper v6 Update1 LifeKeeper v6 Update2 LifeKeeper v6 Update3 LifeKeeper v6 Update4 LifeKeeper v7 LifeKeeper v7 Update1 LifeKeeper v7 Update2 LifeKeeper v7 Update3 Oracle RAC 10g Release 2 10 1 0 5 0 2 Oracle R...

Page 99: ... Release 2 10 2 0 4 0 5 Oracle RAC 11g Release 1 11 1 0 6 0 6 Oracle RAC 11g Release 1 11 1 0 7 0 7 RHCM 1 0 11 0 2 6 9 42 0 3 EL 2 6 9 42 0 3 ELsmp 2 6 9 42 0 3 ELhugemem LifeKeeper v6 LifeKeeper v6 Update1 LifeKeeper v6 Update2 LifeKeeper v6 Update3 LifeKeeper v6 Update4 LifeKeeper v7 LifeKeeper v7 Update1 LifeKeeper v7 Update2 LifeKeeper v7 Update3 Oracle RAC 10g Release 2 10 1 0 5 0 2 Oracle R...

Page 100: ...Lsmp 2 6 9 67 ELhugemem 2 6 9 78 EL 2 6 9 78 ELsmp 2 6 9 78 ELhugemem LifeKeeper v6 Update4 LifeKeeper v7 LifeKeeper v7 Update1 LifeKeeper v7 Update2 LifeKeeper v7 Update3 Oracle RAC 10g Release 2 10 1 0 5 0 2 Oracle RAC 10g Release 2 10 2 0 2 0 8 Oracle RAC 10g Release 2 10 2 0 3 0 4 Oracle RAC 10g Release 2 10 2 0 4 0 5 Oracle RAC 11g Release 1 11 1 0 6 0 6 Oracle RAC 11g Release 1 11 1 0 7 0 7 ...

Page 101: ...orage Management ASM function the ASMLib kernel driver ASMLib is used and Cluster Ready Service CRS For details see 3 14 Settings for Oracle RAC 4 The following configurations are supported Configurations that include the Automatic Storage Management ASM function raw devices used and Cluster Ready Service CRS Configurations that include the Automatic Storage Management ASM function the ASMLib kern...

Page 102: ...Oracle Clusterware Configurations that include the Automatic Storage Management ASM function raw devices used and Oracle Clusterware For details see 3 14 Settings for Oracle RAC 8 The following configurations are supported Configurations that include raw devices and Cluster Ready Service CRS Configurations that include the Automatic Storage Management ASM function raw devices used and Cluster Read...

Page 103: ...2 10 2 0 3 0 3 Oracle RAC 10g Release 2 10 2 0 4 0 4 Oracle RAC 11g Release 1 11 1 0 6 0 5 Oracle RAC 11g Release 1 11 1 0 7 0 6 RHCM 1 0 0 0 2 6 9 34 EL 2 6 9 34 ELsmp 2 6 9 34 ELhugemem LifeKeeper v6 LifeKeeper v6 Update1 LifeKeeper v6 Update2 LifeKeeper v6 Update3 LifeKeeper v6 Update4 LifeKeeper v7 LifeKeeper v7 Update1 LifeKeeper v7 Update2 LifeKeeper v7 Update3 Oracle RAC 10g Release 2 10 1 ...

Page 104: ...acle RAC 11g Release 1 11 1 0 7 0 6 RHCM 1 0 11 0 2 6 9 42 0 3 EL 2 6 9 42 0 3 ELsmp 2 6 9 42 0 3 ELhugemem 2 6 9 55 EL 2 6 9 55 ELsmp 2 6 9 55 ELhugemem LifeKeeper v6 LifeKeeper v6 Update1 LifeKeeper v6 Update2 LifeKeeper v6 Update3 LifeKeeper v6 Update4 LifeKeeper v7 LifeKeeper v7 Update1 LifeKeeper v7 Update2 LifeKeeper v7 Update3 Oracle RAC 10g Release 2 10 1 0 5 0 1 Oracle RAC 10g Release 2 1...

Page 105: ...d and Cluster Ready Service CRS For details see 3 14 Settings for Oracle RAC 2 6 9 78 EL 2 6 9 78 ELsmp 2 6 9 78 ELhugemem LifeKeeper v6 Update4 LifeKeeper v7 LifeKeeper v7 Update1 LifeKeeper v7 Update2 LifeKeeper v7 Update3 Oracle RAC 10g Release 2 10 1 0 5 0 1 Oracle RAC 10g Release 2 10 2 0 2 0 7 Oracle RAC 10g Release 2 10 2 0 3 0 3 Oracle RAC 10g Release 2 10 2 0 4 0 4 Oracle RAC 11g Release ...

Page 106: ...evices and Oracle Clusterware Configurations that include the Automatic Storage Management ASM function raw devices used and Oracle Clusterware Configurations that include the Automatic Storage Management ASM function the ASMLib kernel driver ASMLib is used and Oracle Clusterware Configurations that include the Oracle Cluster File System 2 and Oracle Clusterware For details see 3 14 Settings for O...

Page 107: ...elease 2 10 2 0 1 0 1 Oracle RAC 10g Release 2 10 2 0 2 0 1 Oracle RAC 10g Release 2 10 2 0 3 0 2 2 6 9 34 EL Oracle RAC 10g Release 2 10 2 0 1 0 1 Oracle RAC 10g Release 2 10 2 0 2 0 1 Oracle RAC 10g Release 2 10 2 0 3 0 2 RHCM 1 0 4 0 2 6 9 42 EL Oracle RAC 10g Release 2 10 2 0 1 0 1 Oracle RAC 10g Release 2 10 2 0 2 0 1 Oracle RAC 10g Release 2 10 2 0 3 0 2 RHCM 1 0 11 0 2 6 9 42 0 3 EL 2 6 9 5...

Page 108: ...s used and Cluster Ready Service CRS For details see 3 14 Settings for Oracle RAC Table 3 13 Cluster Software When Using Red Hat Enterprise Linux AS4 ES4 EM64T AMD64 Usable kernels Cluster software 2 6 9 11 EL 2 6 9 11 ELsmp LifeKeeper v6 LifeKeeper v6 Update1 LifeKeeper v6 Update2 LifeKeeper v6 Update3 LifeKeeper v6 Update4 LifeKeeper v7 LifeKeeper v7 Update1 LifeKeeper v7 Update2 LifeKeeper v7 U...

Page 109: ...Oracle RAC 11g Release 1 11 1 0 6 0 3 Oracle RAC 11g Release 1 11 1 0 7 0 4 RHCM 1 0 4 0 VCS 4 1 MP3 5 2 6 9 34 0 2 EL 2 6 9 34 0 2 ELsmp 2 6 9 34 0 2 ELlargesmp LifeKeeper v6 LifeKeeper v6 Update1 LifeKeeper v6 Update2 LifeKeeper v6 Update3 LifeKeeper v6 Update4 LifeKeeper v7 LifeKeeper v7 Update1 LifeKeeper v7 Update2 LifeKeeper v7 Update3 Oracle RAC 10g Release 2 10 2 0 2 0 1 Oracle RAC 10g Rel...

Page 110: ...racle RAC 11g Release 1 11 1 0 6 0 3 Oracle RAC 11g Release 1 11 1 0 7 0 4 RHCM 1 0 11 0 VCS 4 1 MP3 5 2 6 9 42 0 3 EL 2 6 9 42 0 3 ELsmp 2 6 9 42 0 3 ELlargesmp LifeKeeper v6 LifeKeeper v6 Update1 LifeKeeper v6 Update2 LifeKeeper v6 Update3 LifeKeeper v6 Update4 LifeKeeper v7 LifeKeeper v7 Update1 LifeKeeper v7 Update2 LifeKeeper v7 Update3 Oracle RAC 10g Release 2 10 2 0 2 0 1 Oracle RAC 10g Rel...

Page 111: ...1 0 6 0 3 Oracle RAC 11g Release 1 11 1 0 7 0 4 RHCM 1 0 17 0 2 6 9 67 EL 2 6 9 67 ELsmp 2 6 9 67 ELlargesmp 2 6 9 78 EL 2 6 9 78 ELsmp 2 6 9 78 ELlargesmp LifeKeeper v6 Update4 LifeKeeper v7 LifeKeeper v7 Update1 LifeKeeper v7 Update2 LifeKeeper v7 Update3 Oracle RAC 10g Release 2 10 2 0 2 0 1 Oracle RAC 10g Release 2 10 2 0 3 0 2 Oracle RAC 10g Release 2 10 2 0 4 0 2 Oracle RAC 11g Release 1 11 ...

Page 112: ...sterware Configurations that include the Automatic Storage Management ASM function raw devices used and Oracle Clusterware Configurations that include the Automatic Storage Management ASM function the ASMLib kernel driver ASMLib is used and Oracle Clusterware Configurations that include the Oracle Cluster File System 2 and Oracle Clusterware For details see 3 14 Settings for Oracle RAC 4 The follo...

Page 113: ...nel architecture Kernel Volume Manager IA32 2 6 9 11 EL 2 6 9 11 ELsmp 2 6 9 11 ELhugemem LVM2 01 08 1 0 RHEL4 2 6 9 34 EL 2 6 9 34 ELsmp 2 6 9 34 ELhugemem LVM2 02 01 1 3 RHEL4 LVM2 02 21 5 el4 2 6 9 34 0 2 EL 2 6 9 34 0 2 ELsmp 2 6 9 34 0 2 ELhugemem LVM2 02 01 1 3 RHEL4 2 6 9 42 EL 2 6 9 42 ELsmp 2 6 9 42 ELhugemem LVM2 02 06 6 0 RHEL4 2 6 9 42 0 3 EL 2 6 9 42 0 3 ELsmp 2 6 9 42 0 3 ELhugemem 2...

Page 114: ... el4 LVM2 02 37 3 el4 2 6 9 89 EL 2 6 9 89 ELlargesmp LVM2 02 42 5 el4 2 6 9 100 EL 2 6 9 100 ELlargesmp LVM2 02 42 9 el4 EM64T AMD64 2 6 9 11 EL 2 6 9 11 ELsmp LVM2 01 08 1 0 RHEL4 2 6 9 34 EL 2 6 9 34 ELsmp 2 6 9 34 ELlargesmp LVM2 02 01 1 3 RHEL4 LVM2 02 21 5 el4 2 6 9 34 0 2 EL 2 6 9 34 0 2 ELsmp 2 6 9 34 0 2 ELlargesmp LVM2 02 01 1 3 RHEL4 2 6 9 42 EL 2 6 9 42 ELsmp 2 6 9 42 ELlargesmp LVM2 0...

Page 115: ...ny When Using Red Hat Enterprise Linux AS4 ES4 For details on OSs kernels that each BladeSymphony model supports see the BladeSymphony documentation For details on OSs kernels that each storage system model supports see the storage system documentation 2 6 9 67 EL 2 6 9 67 ELsmp 2 6 9 67 ELlargesmp LVM2 02 27 2 el4 2 6 9 78 EL 2 6 9 78 ELsmp 2 6 9 78 ELlargesmp LVM2 02 21 5 el4 LVM2 02 37 3 el4 2 ...

Page 116: ...IA32 Table 3 17 Operating Environments for Boot Disks When Using Red Hat Enterprise Linux AS4 ES4 IPF and Table 3 18 Operating Environments for Boot Disks When Using Red Hat Enterprise Linux AS4 ES4 EM64T AMD64 Kernel architecture Kernel HBA Supported storage systems IA32 2 6 9 11 ELsmp hitachi Hitachi AMS2000 AMS WMS SMS series Hitachi USP 1 Lightning 9900V series 1 2 Thunder 9500V series Univers...

Page 117: ...s Universal Storage Platform V VM Virtual Storage Platform 2 6 9 34 EL 2 6 9 34 ELsmp 2 6 9 34 ELhugemem 2 6 9 34 0 2 EL 2 6 9 34 0 2 ELsmp 2 6 9 34 0 2 ELhugemem 2 6 9 42 EL 2 6 9 42 ELsmp 2 6 9 42 ELhugemem 2 6 9 42 0 3 EL 2 6 9 42 0 3 ELsmp 2 6 9 42 0 3 ELhugemem 2 6 9 55 EL 2 6 9 55 ELsmp 2 6 9 55 ELhugemem Emulex QLogic 2 6 9 67 EL 2 6 9 67 ELsmp 2 6 9 67 ELhugemem 2 6 9 78 EL 2 6 9 78 ELsmp ...

Page 118: ... 9 67 EL 2 6 9 67 ELlargesmp 2 6 9 78 EL 2 6 9 78 ELlargesmp 2 6 9 89 EL 2 6 9 89 ELlargesmp 2 6 9 100 EL 2 6 9 100 ELlargesmp Kernel HBA Supported storage systems 2 6 9 11 EL 2 6 9 11 ELsmp QLogic Hitachi AMS2000 AMS WMS SMS series Hitachi USP Lightning 9900V series Thunder 9500V series Universal Storage Platform V VM Virtual Storage Platform 2 6 9 34 EL 2 6 9 34 ELsmp 2 6 9 34 ELlargesmp 2 6 9 3...

Page 119: ...is not supported 2 6 9 78 EL 2 6 9 78 ELsmp 2 6 9 78 ELlargesmp 2 6 9 89 EL 2 6 9 89 ELsmp 2 6 9 89 ELlargesmp 2 6 9 100 EL 2 6 9 100 ELsmp 2 6 9 100 ELlargesmp Kernel architecture Kernel HBA Supported storage systems IA32 2 6 9 11 ELsmp hitachi HitachiAMS2000 AMS WMS SMS series Hitachi USP Thunder 9500V series Universal Storage Platform V VM Virtual Storage Platform 2 6 9 34 ELsmp 2 6 9 55 ELsmp ...

Page 120: ...products when Red Hat Enterprise Linux 5 is used 1 Cluster Software Supported by HDLM If an FC SAN Is Used When you use HDLM in a cluster configuration you must install the same version of HDLM on all the nodes that comprise the cluster If different versions of HDLM are installed the cluster system may not operate correctly If the HDLM Version and Service Pack Version which are displayed by execut...

Page 121: ...2 6 18 53 el5 2 6 18 53 el5PAE LifeKeeper v6 Update2 LifeKeeper v6 Update3 LifeKeeper v6 Update4 LifeKeeper v7 LifeKeeper v7 Update1 LifeKeeper v7 Update2 LifeKeeper v7 Update3 Oracle RAC 10g Release 2 10 2 0 4 0 1 Oracle RAC 11g Release 1 11 1 0 6 0 2 Oracle RAC 11g Release 1 11 1 0 7 0 3 RHCM 2 0 73 1 2 6 18 92 el5 2 6 18 92 el5PAE LifeKeeper v6 Update3 LifeKeeper v6 Update4 LifeKeeper v7 LifeKe...

Page 122: ... ASM function the ASMLib kernel driver ASMLib is used and Oracle 2 6 18 128 el5 2 6 18 128 el5PAE LifeKeeper v6 Update4 LifeKeeper v7 LifeKeeper v7 Update1 LifeKeeper v7 Update2 LifeKeeper v7 Update3 Oracle RAC 10g Release 2 10 2 0 4 0 1 Oracle RAC 11g Release 1 11 1 0 6 0 2 Oracle RAC 11g Release 1 11 1 0 7 0 3 Oracle RAC 11g Release 2 11 2 0 1 0 4 Oracle RAC 11g Release 2 11 2 0 2 0 4 RHCM 2 0 9...

Page 123: ...ib kernel driver ASMLib is used and Oracle Clusterware Configurations that include the Oracle Cluster File System 2 and Oracle Clusterware For details see 3 14 Settings for Oracle RAC 4 Only configurations that include the Automatic Storage Management ASM function raw devices are used and Oracle Clusterware are supported The HDLM device name can be specified directly for ASM For details see 3 14 S...

Page 124: ...se 2 10 2 0 1 0 1 Oracle RAC 10g Release 2 10 2 0 3 0 2 Oracle RAC 10g Release 2 10 2 0 4 0 3 Oracle RAC 11g Release 1 11 1 0 6 0 4 Oracle RAC 11g Release 1 11 1 0 7 0 5 RHCM 2 0 60 1 2 6 18 53 el5 LifeKeeper v6 Update2 LifeKeeper v6 Update3 LifeKeeper v6 Update4 LifeKeeper v7 LifeKeeper v7 Update1 LifeKeeper v7 Update2 LifeKeeper v7 Update3 Oracle RAC 10g Release 2 10 2 0 1 0 1 Oracle RAC 10g Rel...

Page 125: ...2 LifeKeeper v7 Update3 Oracle RAC 10g Release 2 10 2 0 1 0 1 Oracle RAC 10g Release 2 10 2 0 3 0 2 Oracle RAC 10g Release 2 10 2 0 4 0 3 Oracle RAC 11g Release 1 11 1 0 6 0 4 Oracle RAC 11g Release 1 11 1 0 7 0 5 Oracle RAC 11g Release 2 11 2 0 1 0 6 Oracle RAC 11g Release 2 11 2 0 2 0 7 RHCM 2 0 98 1 2 6 18 164 el5 LifeKeeper v6 Update4 LifeKeeper v7 LifeKeeper v7 Update1 LifeKeeper v7 Update2 L...

Page 126: ...Ready Service CRS Configurations that include raw devices and Cluster Ready Service CRS Configurations that include the Automatic Storage Management ASM function the ASMLib kernel driver ASMLib is used and Cluster Ready Service CRS Configurations that include the Automatic Storage Management ASM function raw devices used and Cluster Ready Service CRS For details see 3 14 Settings for Oracle RAC 4 ...

Page 127: ...e specified directly for ASM For details see 3 14 Settings for Oracle RAC 7 The following configurations are supported Configurations that include the Automatic Storage Management ASM function raw devices used and Oracle Clusterware The HDLM device name can be specified directly for ASM Configurations that include the Automatic Storage Management ASM function the ASMLib kernel driver ASMLib is use...

Page 128: ...8 194 el5PAE LVM2 02 56 8 el5 2 6 18 238 el5 2 6 18 238 el5PAE LVM2 02 74 5 el5 IPF 2 6 18 8 el5 LVM2 02 16 3 el5 2 6 18 53 el5 LVM2 02 26 3 el5 2 6 18 92 el5 LVM2 02 32 4 el5 2 6 18 128 el5 LVM2 02 40 6 el5 2 6 18 164 el5 LVM2 02 46 8 el5 2 6 18 194 el5 LVM2 02 56 8 el5 2 6 18 238 el5 LVM2 02 74 5 el5 EM64T AMD64 2 6 18 8 el5 LVM2 02 16 3 el5 2 6 18 53 el5 LVM2 02 26 3 el5 2 6 18 92 el5 LVM2 02 3...

Page 129: ...ed with the OS 2 6 18 164 el5 2 6 18 164 el5PAE 2 6 18 194 el5 2 6 18 194 el5PAE 2 6 18 238 el5 2 6 18 238 el5PAE IPF 2 6 18 8 el5 ext2 supplied with the OS ext3 supplied with the OS 2 6 18 53 el5 2 6 18 92 el5 2 6 18 128 el5 ext2 supplied with the OS ext3 supplied with the OS GFS2 supplied with the OS 2 6 18 164 el5 2 6 18 194 el5 2 6 18 238 el5 EM64T AMD64 2 6 18 8 el5 ext2 supplied with the OS ...

Page 130: ...orts see the storage system documentation Table 3 25 Operating Environments for BladeSymphony When Using Red Hat Enterprise Linux 5 The XP series is not supported HDLM supports boot disks in any of the environments listed in Table 3 26 Operating Environments for Boot Disks When Using Red Hat Enterprise Linux 5 Kernel architecture Kernel HBA Supported storage systems IA32 2 6 18 53 el5PAE hitachi H...

Page 131: ...torage Platform V VM Virtual Storage Platform 2 6 18 53 el5 2 6 18 53 el5PAE Brocade Emulex QLogic 2 6 18 92 el5 2 6 18 92 el5PAE 2 6 18 128 el5 2 6 18 128 el5PAE 2 6 18 164 el5 2 6 18 164 el5PAE 2 6 18 194 el5 2 6 18 194 el5PAE 2 6 18 238 el5 2 6 18 238 el5PAE IPF 2 6 18 8 el5 Emulex 2 6 18 53 el5 2 6 18 92 el5 2 6 18 128 el5 2 6 18 164 el5 Brocade Emulex 2 6 18 194 el5 2 6 18 238 el5 EM64T AMD64...

Page 132: ...XP series is not supported Notes on using HDLM in a BladeSymphony environment When HDLM is used in a BladeSymphony environment the following functions cannot be used 2 6 18 194 el5 2 6 18 238 el5 Kernel architecture Kernel HBA Supported storage systems IA32 2 6 18 53 el5PAE hitachi HitachiAMS2000 AMS WMS SMS series Hitachi USP Thunder 9500V series Universal Storage Platform V VM Virtual Storage Pl...

Page 133: ...t comprise the cluster If different versions of HDLM are installed the cluster system may not operate correctly If the HDLM Version and Service Pack Version which are displayed by executing the following command are the same the versions of HDLM are the same opt DynamicLinkManager bin dlnkmgr view sys Use RHCM to build a cluster configuration 2 Volume Managers Supported by HDLM Table 3 28 Volume M...

Page 134: ...ng describes related products when SUSE LINUX Enterprise Server 9 is used 1 Cluster Software Supported by HDLM When you use HDLM in a cluster configuration you must install the same version of HDLM on all of the nodes that make up the cluster If different versions of HDLM are installed the cluster might not operate correctly If HDLM Version and Service Pack Version which you can display by executi...

Page 135: ... not need to enter information for the IOCTL when installing HDLM because HDLM devices are not SCSI devices HDLM rejects the IOCTL request and assumes that the IOCTL processing has failed The error message KAPL05023 E is output to the syslog but HDLM operations are not affected This message is also output in the following cases but HDLM operations are not affected You execute the utility for colle...

Page 136: ...8 bigsmp Oracle RAC 10g Release 2 10 2 0 3 0 1 2 6 16 46 0 14 default 2 6 16 46 0 14 smp 2 6 16 46 0 14 bigsmp Heartbeat 2 0 8 0 19 2 Oracle RAC 10g Release 2 10 2 0 3 0 1 Oracle RAC 11g Release 1 11 1 0 6 0 3 2 6 16 60 0 21 default 2 6 16 60 0 21 smp 2 6 16 60 0 21 bigsmp Heartbeat 2 1 3 0 9 2 Novell Open Enterprise Server 2 SP1 2 6 16 60 0 21 xenpae Heartbeat 2 1 3 0 9 2 2 6 16 60 0 54 5 default...

Page 137: ...lated programs when using a volume manager Table 3 32 Volume Managers When Using SUSE LINUX Enterprise Server 10 EM64T AMD64 2 6 16 21 0 8 default 2 6 16 21 0 8 smp Oracle RAC 10g Release 2 10 2 0 3 0 1 2 6 16 46 0 14 default 2 6 16 46 0 14 smp Heartbeat 2 0 8 0 19 2 Oracle RAC 10g Release 2 10 2 0 3 0 1 2 6 16 60 0 21 default 2 6 16 60 0 21 smp Heartbeat 2 1 3 0 9 2 Novell Open Enterprise Server ...

Page 138: ... 1 bigsmp 2 6 16 60 0 85 1 xenpae LVM2 02 17 7 30 1 IPF 2 6 16 21 0 8 default LVM2 02 02 11 2 2 6 16 46 0 14 default LVM2 02 17 7 9 2 6 16 60 0 21 default LVM2 02 17 7 19 2 6 16 60 0 54 5 default LVM2 02 17 27 8 2 6 16 60 0 85 1 default LVM2 02 17 7 30 1 EM64T AMD64 2 6 16 21 0 8 default 2 6 16 21 0 8 smp LVM2 02 02 11 2 2 6 16 46 0 14 default 2 6 16 46 0 14 smp LVM2 02 17 7 9 2 6 16 60 0 21 defau...

Page 139: ...age is also output in the following cases but HDLM operations are not affected You execute the utility for collecting HDLM error information DLMgetras The system is started You execute the utility for supporting a boot disk dlmmkinitrd 3 File Systems Supported by HDLM When using a file system the related programs are as follows ext2 supplied with the OS ext3 supplied with the OS Raisers supplied w...

Page 140: ... 6 16 46 0 14 smp hitachi Hitachi AMS2000 AMS WMS SMS series Hitachi USP 1 Lightning 9900V series 1 2 Thunder 9500V series Universal Storage Platform V VM 1 Virtual Storage Platform 1 Kernel architecture Kernel HBA Supported storage systems IA32 2 6 16 46 0 14 default 2 6 16 46 0 14 smp 2 6 16 46 0 14 bigsmp QLogic Hitachi AMS2000 AMS WMS SMS series Hitachi USP Lightning 9900V series Thunder 9500V...

Page 141: ...he following functions cannot be used HotPlug SystemManager linkage IPF 2 6 16 60 0 21 default Brocade 2 6 16 60 0 54 5 default EM64T AMD64 2 6 16 46 0 14 default 2 6 16 46 0 14 smp QLogic 2 6 16 60 0 21 default 2 6 16 60 0 21 smp Brocade QLogic 2 6 16 60 0 21 xen QLogic 2 6 16 60 0 54 5 default 2 6 16 60 0 54 5 smp 2 6 16 60 0 54 5 xen Brocade QLogic 2 6 16 60 0 85 1 default 2 6 16 60 0 85 1 smp ...

Page 142: ... Using SUSE LINUX Enterprise Server 11 Notes on using a volume manager Note the following when using a volume manager Although disk partitioning and system backup functions are supported for disks in a YaST2 system the combination of YaST2 and LVM is not supported When you execute an LVM related command such as pvscan or vgscan a CD ROM IOCTL command might be sent to each device in the OS The IOCT...

Page 143: ... execute the utility for collecting HDLM error information DLMgetras The system is started 2 File Systems Supported by HDLM When using a file system the related programs are as follows ext2 supplied with the OS ext3 supplied with the OS ReiserFS supplied with the OS 3 Boot Disk Environments Supported by HDLM HDLM supports boot disks in any of the environments listed in Table 3 37 Operating Environ...

Page 144: ...Hitachi AMS2000 AMS WMS SMS series Hitachi USP Lightning 9900V series Thunder 9500V series Universal Storage Platform V VM Virtual Storage Platform 2 6 27 21 0 1 xen QLogic 2 6 32 12 0 7 default 2 6 32 12 0 7 pae 2 6 32 12 0 7 xen Brocade QLogic IPF 2 6 32 12 0 7 default Brocade EM64T AMD64 2 6 27 21 0 1 default Brocade QLogic 2 6 27 21 0 1 xen QLogic 2 6 32 12 0 7 default 2 6 32 12 0 7 xen Brocad...

Page 145: ...r Software Supported by HDLM When you use HDLM in a cluster configuration you must install the same version of HDLM on all of the nodes that make up the cluster If different versions of HDLM are installed the cluster system might not operate correctly If HDLM Version and Service Pack Version which you can display by executing the following command are the same then the HDLM versions are also the s...

Page 146: ...nterprise Linux 5 lists and describes the related programs when using a volume manager Table 3 41 Volume Managers When Using Oracle Enterprise Linux 5 Kernel architecture Usable kernels Cluster software IA32 2 6 18 53 el5 2 6 18 53 el5PAE Oracle RAC 11g Release 1 11 1 0 6 0 RHCM 2 0 73 1 2 6 18 164 el5 2 6 18 164 el5PAE Oracle RAC 11g Release 2 11 2 0 2 0 2 6 18 194 el5 2 6 18 194 el5PAE None EM64...

Page 147: ...s kernels that each storage system model supports see the storage system documentation EM64T AMD64 2 6 18 53 el5 LVM2 02 26 3 el5 2 6 18 164 el5 LVM2 02 46 8 el5 2 6 18 194 el5 LVM2 02 56 8 el5 Kernel architecture Kernel File system IA32 2 6 18 53 el5 2 6 18 53 el5PAE ext2 supplied with the OS ext3 supplied with the OS 2 6 18 164 el5 2 6 18 164 el5PAE ext2 supplied with the OS ext3 supplied with t...

Page 148: ...s for a Host lists the disk capacity requirements for a host Table 3 45 Disk Capacity Requirements for a Host Kernel architecture Kernel HBA Supported storage systems IA32 2 6 18 53 el5 2 6 18 53 el5PAE QLogic Hitachi AMS2000 AMS WMS SMS series Hitachi USP Lightning 9900V series Thunder 9500V series Universal Storage Platform V VM Virtual Storage Platform 2 6 18 164 el5 2 6 18 164 el5PAE Emulex QL...

Page 149: ...rmula q t x n 1024 MB Where t is the trace file size unit KB default value 9900 and n is the number of trace files default value 4 The result is rounded up to MB 3 The size of the process specific trace information file 4 The size of the log file for inquiry information u is obtained by using the following formula u 2500 bytes x number of paths 1024 1024 MB The result is rounded up to MB 5 The def...

Page 150: ...tained by using the following formula v w x 2 1024 MB Where w is the size of the log files for the dlmcfgmgr utility unit KB default value 1024 The result is rounded up to MB 7 This is an approximate value when the default values are used for the HDLM functions and when the number of paths is 256 For details on the values of the HDLM functions see Table 3 57 The Recommended and Default Values of E...

Page 151: ...ollowing virtual environments HVM where the server virtualization mechanism is mounted on a BladeSymphony blade server Xen If you choose to use Xen make sure that HDLM is installed in domain0 Target Supported number Number of paths per LU Red Hat Enterprise Linux Oracle Enterprise Linux 4 Oracle Enterprise Linux 5 1 to 64 SUSE LINUX Enterprise Server 1 to 32 Number of LUs for one port in a storage...

Page 152: ... LINUX Enterprise Server 10 IA32 2 6 16 60 0 21 xenpae xen 3 2 0_16718_14 0 4 2 6 16 60 0 54 5 xenpae xen 3 2 3_17040_16 0 4 9 2 6 16 60 0 85 1 xenpae xen 3 2 3_17040_34 0 7 EM64T AMD64 2 6 16 60 0 21 xen xen 3 2 0_16718_14 0 4 2 6 16 60 0 54 5 xen xen 3 2 3_17040_16 0 4 9 2 6 16 60 0 85 1 xen xen 3 2 3_17040_34 0 7 SUSE LINUX Enterprise Server 11 IA32 2 6 27 21 0 1 xen xen 3 3 1_18546_12 3 1 2 6 ...

Page 153: ... 2 Flow for Creating an HDLM Environment Set up the environment to use HDLM as shown in the following diagram If you are going to use volume management software the procedure for building a file system shown in the figure is not required ...

Page 154: ...3 Creating an HDLM Environment 130 Figure 3 1 Flow of HDLM Environment Setup ...

Page 155: ...stalling HDLM on a server on which HDLM has not been installed is called a new installation of HDLM Upgrade installation of HDLM Installing a new version of HDLM without uninstalling the existing old version is called an upgrade installation of HDLM Re installation of HDLM Installing the same version of HDLM to restore the existing version without first uninstalling that version is called a re ins...

Page 156: ...ducts When Using SUSE LINUX Enterprise Server 10 3 Boot Disk Environments Supported by HDLM in 3 1 8 Related Products When Using SUSE LINUX Enterprise Server 11 3 Boot Disk Environments Supported by HDLM in 3 1 9 Related Products When Using Oracle Enterprise Linux 4 or 4 Boot Disk Environments Supported by HDLM in 3 1 10 Related Products When Using Oracle Enterprise Linux 5 HDLM outputs the log in...

Page 157: ...orage system by using a fibre channel switch If the host starts while the path between the fibre channel switch and the storage system is disconnected the target ID of the path might be changed after the host restarts At that time the disconnected path might not be recoverable while the host is running Also when you execute the HDLM command to display the path status the target ID of the path befo...

Page 158: ...and to re create an initial RAM disk image 3 5 2 Notes on Linux Install and uninstall HDLM in a multi user mode environment Note that if the var directory is set up on a different partition than the root directory no logs will be output to the var log messages file until the var directory has been mounted during the OS start process If multiple OSs exist on a disk that differs physically or logica...

Page 159: ...g in the etc init d boot localfs file the etc init d boot md file or the etc init d lvm2 file Confirm that the HDLM information is missing by executing the following commands grep Required Start etc init d boot localfs grep Required Start etc init d boot md grep Required Start etc init d boot lvm If the information in boot hdlm is not output after command execution HDLM information is missing For ...

Page 160: ...n service command to check the HAL daemon status If the daemon is running running will appear sbin service haldaemon status If the daemon is not running stopped will appear 2 Check the result of step 1 If the HAL daemon is running stop the daemon Execute the sbin service command to stop the HAL daemon Note that it might take a while to stop the daemon completely sbin service haldaemon stop 3 Make ...

Page 161: ...ense key file or entered by the user For information on license key types and the set operation see 6 6 set Sets Up the Operating Environment The HDLM manager is stopped during an upgrade installation Therefore when you perform an upgrade installation stop any applications that require HDLM manager operations such as a log output operation Because the HDLM manager is stopped during an upgrade inst...

Page 162: ...3 Creating an HDLM Environment 138 ...

Page 163: ...ed see 3 9 3 Using HDLM in an md Device Environment 3 6 1 Preparations for a New Installation of HDLM This section describes the preparations required before newly installing HDLM This includes backing up devices to be managed by HDLM and setting up the hardware and volume management software 1 Operations Required for Devices to Be Managed by HDLM If any devices to be managed by HDLM are operating...

Page 164: ...ing command on this SCSI device to unmount it umount mntpt 5 If the disks are set to be mounted automatically when the host starts delete this setting from the etc fstab file An example of how to edit the etc fstab file is shown in Figure 3 3 Example of How to Edit the etc fstab File Figure 3 3 Example of How to Edit the etc fstab File Comment out the shaded portions by placing a hash mark at the ...

Page 165: ...cal volume This subsection describes how to check whether this condition exists The logical volume is unmounted The following explains how to check whether the above condition exists when the volume group vg02 consists of either one physical volume or two physical volumes Note that dev sde and dev sdu are assumed to be the logical device files of SCSI devices defined for the same device to be mana...

Page 166: ...3 Creating an HDLM Environment 142 Figure 3 4 Result of Executing vgdisplay v When There Is One Physical Volume Check the shaded portion and confirm that vg02 consists of dev sde ...

Page 167: ...ed by HDLM 3 Setting in the syslogd Settings File The log upon executing the installation is output to syslog In Red Hat Enterprise Linux check the syslogd settings file system log configuration definition file and make sure that it specifies that messages with an Error level or higher are to be output Figure 3 6 Example of the Contents of the syslogd Settings File In Red Hat Enterprise Linux show...

Page 168: ...prise Linux 6 a DVD ROM is not automatically mounted Create the media cdrom directory beforehand 5 Checking the Partition Confirm that the etc opt directory is located on the same partition as the root directory Create the etc opt directory in advance when configuring the OS 6 Xen Settings If Xen is being used make sure that domainU has been stopped If domainU has been set to automatically start w...

Page 169: ... DynamicLinkManager dlm lic_key 3 Insert the DVD ROM and mount it If the DVD ROM was not automatically mounted execute the mount command to mount the DVD ROM to the fixed mount point The following shows an example of command execution when the mount point is media cdrom mount dev cdrom media cdrom For details about the fixed mount point for each distribution see Table 3 49 Mount Point for Each Dis...

Page 170: ...id The following shows an execution example for when media volume id is VOL01234 volname dev cdrom VOL01234 4 Check the version of HDLM Execute installux sh or the HDLM installation utility installhdlm stored on the HDLM DVD ROM to check the version of HDLM that will be installed The following example shows how to execute the command when the mount point for the DVD ROM is media cdrom SUSE LINUX E...

Page 171: ...o start installation The following shows an installation execution example for when the DVD ROM mount point is media cdrom When executing installux sh media cdrom installux sh When executing the installhdlm utility media cdrom HDLM_Linux installhdlm 6 The KAPL09093 I message is displayed to confirm that you want to perform a new installation Check the HDLM version and if it is correct enter y The ...

Page 172: ... want to install HDLM with restarting the host then go to step 12 11 Execute the dlmstart utility for starting HDLM For details see 7 7 dlmstart Utility for Starting HDLM 12 Add opt DynamicLinkManager bin in the environment variable PATH in the environment setup file for the shell used by the root user Add the following code to the PATH environment variable in the environment settings file for the...

Page 173: ...es LUKS If HDLM manages a SCSI device that has been configured to use LUKS the LUKS settings must be migrated from the SCSI device to an HDLM device For details on setting up LUKS see 3 8 Settings for LUKS 16 Specify the settings required for using md devices If you want to use md devices create them in a multi path environment For details about the md device settings see 3 9 Settings for md Devic...

Page 174: ...heck the HDLM settings and status of each program The following is an example of executing the command opt DynamicLinkManager bin dlnkmgr view sys HDLM Version x x x xx Service Pack Version Load Balance on extended lio Support Cluster Elog Level 3 Elog File Size KB 9900 Number Of Elog Files 2 Trace Level 0 Trace File Size KB 1000 Number Of Trace Files 4 Path Health Checking on 30 Auto Failback on ...

Page 175: ... installation or re installation of HDLM For details on how to re install HDLM see 3 6 4 Performing a Re installation of HDLM For details on how to upgrade install HDLM see 3 6 5 Performing an Upgrade Installation of HDLM 1 Operations Required for Devices to Be Managed by HDLM Before performing an upgrade installation or re installation of HDLM you must unmount the HDLM devices that correspond to ...

Page 176: ... the following example the logical volume subject to the move belongs to the vg01 volume group vgchange an vg01 0 logical volume s in volume group vg01 now active 4 Setting Up Xen If Xen is being used make sure that domainU has been stopped If domainU has been set up to automatically start whenever domain0 starts temporarily change the setting so that domainU will not start automatically 3 6 4 Per...

Page 177: ...ynamicLinkManager directory When the license key file is not found during installation the following message appears and the process continues KAPL09090 W This operation will now be continued without updating the license For details about how to create the license key see 3 6 2 Performing a New Installation of HDLM For details about the license key see 6 6 2 Parameters 3 Insert the DVD ROM and mou...

Page 178: ...O 9660 file systems Use the volname command to check media volume id The following shows an execution example for when media volume id is VOL01234 volname dev cdrom VOL01234 Distribution Mount point Red Hat Enterprise Linux AS4 ES4 For a CD R DVD R CD ROM or DVD ROM media cdrom For a CD RW DVD RW or DVD RAM media cdrecorder Red Hat Enterprise Linux 5 Red Hat Enterprise Linux 6 media cdrom SUSE LIN...

Page 179: ...installux sh v When executing the installhdlm utility media cdrom HDLM_Linux installhdlm v A command execution example is described below x x x xx is the version of HDLM KAPL09177 I HDLM version x x x xx 5 Perform the installation Execute installux sh or the installhdlm utility stored on the HDLM DVD ROM to start installation The following shows an installation execution example for when the DVD R...

Page 180: ...rmed this step go to step 11 9 When you want to install HDLM without restarting the host go to step 10 When you want to install HDLM with restarting the host then go to step 11 10 Execute the dlmstart utility for starting HDLM For details see 7 7 dlmstart Utility for Starting HDLM 11 Add opt DynamicLinkManager bin in the environment variable PATH in the environment setup file for the shell used by...

Page 181: ...d in HDLM Do not use this functionality An example of how to edit the etc fstab file is shown in the following figure Add the shaded line shown in the above figure 14 Specify the settings required for using LUKS Perform this step if your host OS uses LUKS If HDLM manages a SCSI device that has been configured to use LUKS the LUKS settings must be migrated from the SCSI device to an HDLM device For...

Page 182: ... the volume management software go to step 22 For details on other settings for the volume management software see 3 10 Settings for LVM2 18 Activate the volume group In the following example the logical volume on the HDLM device belongs to the vg01 volume group vgchange ay vg01 vgchange volume group vg01 successfully activated 19 Mount the logical volume on the HDLM device In the following exampl...

Page 183: ...s for an Upgrade Installation or Re installation of HDLM A license key is required if you perform an upgrade installation of HDLM from a version earlier than 5 4 or if you install HDLM 5 4 or a later version after the valid license period has expired To perform an upgrade installation of HDLM 1 Log on to Linux as the root user 2 Prepare the license key Use either of the following methods to store ...

Page 184: ... the DVD ROM to a directory with the same name as the mount point noted above If the file permissions or the directory structure differs HDLM cannot be installed Distribution Mount point Red Hat Enterprise Linux AS4 ES4 For a CD R DVD R CD ROM or DVD ROM media cdrom For a CD RW DVD RW or DVD RAM media cdrecorder Red Hat Enterprise Linux 5 Red Hat Enterprise Linux 6 media cdrom SUSE LINUX Enterpris...

Page 185: ...HDLM that will be installed The following example shows how to execute the command when the mount point for the DVD ROM is media cdrom When executing installux sh media cdrom installux sh v When executing the installhdlm utility media cdrom HDLM_Linux installhdlm v A command execution example is described below x x x xx is the version of HDLM KAPL09177 I HDLM version x x x xx 5 Perform the install...

Page 186: ...ion between the host and the storage system change iscsi_boot n written in the etc opt DynamicLinkManager hdlm conf file to iscsi_boot y 9 When you want to set the HDLM driver options run the dlmsetopt utility for setting HDLM driver option For details on this utility see 7 6 dlmsetopt Utility for Setting HDLM Driver Options If you performed this step go to step 12 10 When you want to install HDLM...

Page 187: ...and the HDLM manager will start 14 If you have edited the etc fstab file as described in 1 Operations Required for Devices to Be Managed by HDLM in 3 6 1 Preparations for a New Installation of HDLM add the line show below to change the setting from a SCSI device specification to an HDLM device specification The Linux functionality that adds LABEL to a SCSI device is not supported in HDLM Do not us...

Page 188: ...HDLM devices are displayed 18 Specify the settings required for using the volume management software If you performed the operations described in 3 Deactivating the Volume Group in 3 6 3 Preparations for an Upgrade Installation or Re installation of HDLM perform the following steps to activate the volume group If you did not perform step 13 Go to step 19 If you performed step 13 Go to step 20 If y...

Page 189: ...HCM or 3 16 Settings for VCS 3 6 6 Unattended Installation of HDLM When you perform a new installation re installation or upgrade installation of HDLM you can choose an unattended installation An unattended installation enables a user to install HDLM without entering information The procedure for performing an unattended installation of HDLM is described below Note that preparations before install...

Page 190: ...stribution see Table 3 52 Mount Point for Each Distribution Table 3 52 Mount Point for Each Distribution Note 1 HDLM cannot be installed if the DVD ROM is mounted to a mount point other than the above Distribution Mount point Red Hat Enterprise Linux AS4 ES4 For a CD R DVD R CD ROM or DVD ROM media cdrom For a CD RW DVD RW or DVD RAM media cdrecorder Red Hat Enterprise Linux 5 Red Hat Enterprise L...

Page 191: ...execution example for when media volume id is VOL01234 volname dev cdrom VOL01234 4 Check the version of HDLM Execute installux sh or the HDLM installation utility installhdlm stored on the HDLM DVD ROM to check the version of HDLM that will be installed The following example shows how to execute the command when the mount point for the DVD ROM is media cdrom When executing installux sh media cdro...

Page 192: ...he installhdlm utility see 7 10 3 Editing an Installation Information Settings File 6 Perform the installation Execute installux sh or the installhdlm utility stored on the HDLM DVD ROM to start installation The following shows an installation execution example for when the DVD ROM mount point is media cdrom When executing installux sh media cdrom installux sh f any directory installation informat...

Page 193: ...er This makes executing the HDLM commands and HDLM utilities easier When the BourneAgain shell or Korn shell is used PATH PATH opt DynamicLinkManager bin export PATH When the C shell is used set path path opt DynamicLinkManager bin If the PATH environment variable is not set specify an absolute path to execute commands and utilities 10 If you have edited the etc fstab file as described in 1 Operat...

Page 194: ... Volume Group in 3 6 3 Preparations for an Upgrade Installation or Re installation of HDLM perform the following steps to activate the volume group If you did not edit the installation information settings file in step 5 so that the host is restarted Go to step 14 If you edited the installation information settings file in step 5 so that the host is restarted Go to step 15 If you do not use the vo...

Page 195: ... 3 1 13 Virtual Environments Supported by HDLM For details on how to set up a virtual environment see 3 11 Settings for Xen or 3 12 Settings for KVM 17 Specify the settings required for operations in a cluster configuration For a cluster configuration change the logical device file names of SCSI devices specified in the cluster to logical device file names of HDLM devices For details on setting th...

Page 196: ...dump When Red Hat Enterprise Linux SUSE LINUX Enterprise Server 10 or SUSE LINUX Enterprise Server 11 is used HDLM supports environments that use LVM2 as a boot disk When Red Hat Enterprise Linux SUSE LINUX Enterprise Server 10 or SUSE LINUX Enterprise Server 11 is used HDLM does not support an environment that uses an md device as a boot disk If you changed the configuration during startup or if ...

Page 197: ...rectory is dev sda1 3 Using an editor such as vi change the LABEL specification to an sd device specification before LABEL ext3 defaults 1 1 LABEL boot boot ext3 defaults 1 2 after dev sda2 ext3 defaults 1 1 dev sda1 boot ext3 defaults 1 2 4 Install HDLM 5 After configuring the HDLM device execute the dlmcfgmgr o command to exclude the HDLM device that corresponds to the boot disk as a management ...

Page 198: ...he kernel package in 4 2 Updating Kernel Packages and Applying OS Update Packages When using Red Hat Enterprise Linux AS4 ES4 or SUSE LINUX Enterprise Server You must first uninstall HDLM before updating the kernel package and then re install it after the update Note that uninstalling and re installing HDLM might change the correspondence between HDLM devices and SCSI devices To update the kernel ...

Page 199: ...ot Disk After completing the above procedure you can perform a new installation of HDLM in a boot disk environment that uses a SCSI device 2 Upgrade Installation in an Environment Where an HDLM Device Is Used as a Boot Disk To perform an upgrade installation of HDLM in a boot disk environment that uses a SCSI device for details see 3 7 4 Upgrade Installation in an Environment Where an HDLM Device ...

Page 200: ...e can be used as a boot disk After editing the configuration file restart the host to activate the setting See steps 11 to 27 in 3 7 5 Settings for Using a Logical Volume LVM2 on an HDLM Device as a Boot Disk After completing the above procedure you can migrate to a multi path boot disk environment that uses a logical volume on an HDLM device 4 Upgrade Installation in an Environment Where a Logica...

Page 201: ...ed from an HDLM device see 3 7 7 Countermeasures for Unsuccessful Startup of the OS from an HDLM Device The name of the boot loader configuration file used in these procedures differs depending on the boot loader and OS The names of the boot loader configuration files are listed in Table 3 53 Names of Boot Loader Configuration Files Table 3 53 Names of Boot Loader Configuration Files To install HD...

Page 202: ... Hypervisor Operating Environments Supported by HDLM title XEN root hd0 0 kernel xen pae gz module vmlinuz 2 6 16 60 0 54 5 xenpae root dev disk by id scsi SFUJITSU_MAS3735NC_A050P360007N part6 vga 0x317 resume dev disk by id scsi SFUJITSU_MAS3735NC_A050P3600077 part2 splash silent showopts multipath off module initrd 2 6 16 60 0 54 5 xenpae multipath off is set in the underlined section When GRUB...

Page 203: ... 5599c284d79b ext4 defaults 1 1 UUID 33ef8ca1 595a 4fbf 8567 76f70760d743 boot ext4 defaults 1 2 If the OS is SUSE LINUX Enterprise Server 10 or SUSE LINUX Enterprise Server 11 also check whether the device names udev names starting with the dev disk directory are specified as shown in the following underlined parts dev disk by id scsi 1HITACHI_D60H03750019 part2 swap swap defaults 0 0 dev disk by...

Page 204: ... following underlined part below title Red Hat Enterprise Linux 2 6 32 71 el6 i686 root hd0 0 kernel vmlinuz 2 6 32 71 el6 i686 ro root UUID 55574d05 07dc 4c94 a585 5599c284d79b rd_NO_LUKS rd_NO_LVM rd_NO_MD rd_NO_DM LANG ja_JP UTF 8 KEYBOARDTYPE pc KEYTABLE jp106 crashkernel auto rhgb quiet initrd initramfs 2 6 32 71 el6 i686 img If the OS is SUSE LINUX Enterprise Server 10 or SUSE LINUX Enterpri...

Page 205: ...dence between the SCSI device and LABEL that you checked in steps 3 and 4 You will need this information to remove the LABEL setting mount dev sda2 on type ext2 rw dev sda1 on boot type ext2 rw dev sda4 on tmp type ext2 rw dev sda5 on var type ext2 rw dev sda6 on usr type ext2 rw none on dev shm type tmpfs rw Check the underlined section 6 If Red Hat Enterprise Linux SUSE LINUX Enterprise Server 1...

Page 206: ...000c50fffecb6ae0 part2 8 Back up the etc fstab file 9 Edit the etc fstab file and delete the LABEL setting Comment out all lines for which LABEL is used as checked in step 3 by adding a hash mark to the start of each of those lines and then add a line specifying the SCSI device as follows given the correspondence between LABEL and the SCSI device as checked in step 5 LABEL ext2 defaults 1 1 dev sd...

Page 207: ...oot xen gz module boot vmlinuz 2 6 16 60 0 21 xen root dev disk by id scsi 1HITACHI_D60H03750027 part2 vga 0x31a resume dev sda1 splash silent showopts module boot initrd 2 6 16 60 0 21 xen When GRUB is used as the boot loader with non Xen kernels For details on kernels supported by HDLM see 3 1 1 Hosts and OSs Supported by HDLM title Red Hat Enterprise Linu Linux 2 6 18 194 el5 root hd0 0 kernel ...

Page 208: ... label linux sd 13 Change the specification for root contained in the boot loader configuration file from LABEL to the SCSI device based on the LABEL and SCSI device correspondence checked in step 5 Change the specification for root contained in the configuration that you copied in step 11 If any options have been specified to suit the user environment take care not to delete those options When GR...

Page 209: ... HDLM configuration definition utility dlmcfgmgr with the v parameter specified to check the correspondence between the SCSI device and the HDLM device dlmcfgmgr v HDevName Management Device Host Channel Target Lun dev sddlmaa configured dev sda 0 0 0 0 KAPL10302 I sbin dlmcfgmgr completed normally The HDevName column indicates the HDLM device and the Device column indicates SCSI device 19 Execute...

Page 210: ...2 ext2 defaults 1 1 LABEL tmp tmp ext2 defaults 1 2 dev sda4 tmp ext2 defaults 1 2 dev sddlmaa4 tmp ext2 defaults 1 2 22 Back up the boot loader configuration file 23 Copy the configuration contained in the boot loader configuration file which was used for startup from the SCSI device in step 14 24 Change the name of the configuration contained in the boot loader configuration file Change the name...

Page 211: ...created in step 19 For details on Xen kernels see Table 3 47 Xen Hypervisor Operating Environments Supported by HDLM Keep in mind that the specification method for initrd differs depending on the boot loader If any options have been specified to suit the user environment take care not to delete those options 27 If SUSE LINUX Enterprise Server 10 or SUSE LINUX Enterprise Server 11 is used delete th...

Page 212: ...on usr type ext2 rw none on dev shm type tmpfs rw Check the underlined section 34 If Red Hat Enterprise Linux SUSE LINUX Enterprise Server 10 or SUSE LINUX Enterprise Server 11 is used make sure that the HDLM device is allocated to the swap partition Make sure that the HDLM device name is displayed in the Filename column of the proc swaps file 3 7 4 Upgrade Installation in an Environment Where an ...

Page 213: ...tc fstab file Make sure that the mount points for the following HDLM management target devices are defined so that the HDLM device will be mounted When ELILO is used as the boot loader Root directory boot efi tmp usr var swap When GRUB is used as the boot loader Root directory boot tmp usr var swap When LILO is used as the boot loader Root directory tmp usr var swap The following shows an example ...

Page 214: ...cation by placing a hash mark at the beginning of each line and then add the SCSI device specification as shown below based on the correspondence between the SCSI device and the HDLM device as checked in step 3 dev sddlmaa2 ext2 defaults 1 1 dev sda2 ext2 defaults 1 1 dev sddlmaa4 tmp ext2 defaults 1 2 dev sda4 tmp ext2 defaults 1 2 5 Copy the configuration contained in the boot loader configurati...

Page 215: ...k_size 18958 option initrd initrd hdlm 2 6 18 194 el5 gz When LILO or ELILO is used as the boot loader image boot vmlinuz 2 6 18 194 el5 label HDLM_194 EL initrd boot initrd hdlm 2 6 18 194 el5 gz read only append option ramdisk_size 18958 option 6 Change the name of the configuration contained in the boot loader configuration file Change the name of the configuration that you copied in step 5 You...

Page 216: ...LILO or ELILO is used as the boot loader Add root SCSI device as the last line of the configuration 8 Specify the initial RAM disk image file for the SCSI device for initrd contained in the boot loader configuration file Change the initrd specification in the configuration that you copied in step 5 If you are using a Xen kernel change the initrd file name specified in module to the initial RAM dis...

Page 217: ...lti path configuration to a single path configuration 13 Start the host 14 Execute the mount command to make sure that the SCSI device is mounted The following shows an execution example for when GRUB is used as the boot loader mount dev sda2 on type ext2 rw dev sda1 on boot type ext2 rw dev sda4 on tmp type ext2 rw dev sda5 on var type ext2 rw dev sda6 on usr type ext2 rw none on dev shm type tmp...

Page 218: ...ile for HDLM If the initial RAM disk image file to be created already exists and you are using Red Hat Enterprise Linux specify the f parameter to overwrite this file If you are using SUSE LINUX Enterprise Server 10 or SUSE LINUX Enterprise Server 11 this file is overwritten even if you do not specify the parameter For details on the dlmmkinitrd utility see 7 4 dlmmkinitrd Utility for Supporting a...

Page 219: ...orted by HDLM Keep in mind that the specification method for initrd differs depending on the boot loader If any options have been specified to suit the user environment take care not to delete those options 23 In the boot loader configuration file edit the settings to be used during a boot When GRUB is the boot loader Change the default number so that a boot can be performed using the configuratio...

Page 220: ...aults 1 1 dev sda2 ext2 defaults 1 1 dev sddlmaa2 ext2 defaults 1 1 dev sddlmaa4 tmp ext2 defaults 1 2 dev sda4 tmp ext2 defaults 1 2 dev sddlmaa4 tmp ext2 defaults 1 2 26 Shut down the host Execute the following command to shut down the host shutdown h now 27 Change the configuration from a single path configuration to a multi path configuration 28 Start the host 29 Execute the mount command to m...

Page 221: ...the procedure assumes that you are using GRUB or ELILO as the default boot loader in Red Hat Enterprise Linux SUSE LINUX Enterprise Server 10 or SUSE LINUX Enterprise Server 11 To migrate a single path boot disk environment that uses a logical volume LVM2 on a SCSI device to a multi path boot disk environment that uses a logical volume on an HDLM device 1 Log in to Linux as a user with root permis...

Page 222: ...en pae gz module vmlinuz 2 6 16 60 0 54 5 xenpae root dev disk by id scsi SFUJITSU_MAS3735NC_A050P360007N part6 vga 0x317 resume dev disk by id scsi SFUJITSU_MAS3735NC_A050P3600077 part2 splash silent showopts multipath off module initrd 2 6 16 60 0 54 5 xenpae multipath off is set in the underlined section When GRUB is used as the boot loader with non Xen kernels For details on kernels supported ...

Page 223: ...you use IPF that uses ELILO as the boot loader the mount point is displayed as boot efi instead of boot in the line where boot is coded and the file system type is displayed as vfat instead of ext3 If LABEL is not used in the etc fstab file go to step 10 and install HDLM If LABEL is used in the etc fstab file perform steps 4 to 8 to check the mounted file system and then remove the LABEL setting 4...

Page 224: ... with UUID are also sometimes set If a block device name is set replace LABEL with the block device name starting with UUID and follow the procedure for when LABEL is used If a block device name starting with UUID is set go to step 5 If one is not set go to step 6 If you are using SUSE LINUX Enterprise Server 10 or SUSE LINUX Enterprise Server 11 the device name udev name might have been specified...

Page 225: ...k directory for n udevinfo q name n dev disk by id scsi 2000c50fffecb6ae0 part1 sda1 The sda1 value output is the SCSI device name corresponding to dev disk by id scsi 2000c50fffecb6ae0 part1 6 Edit the etc fstab file to remove the LABEL setting The detailed procedure is explained in steps 7 and 8 Figure 3 10 Example of Editing etc fstab file shows an example of editing the etc fstab file Figure 3...

Page 226: ...perform steps 2 to 12 to create an HDLM device You will also need to perform step 13 if you are only restarting the host Note that the procedure differs depending on whether the host is restarted after installation In steps 12 to 27 that follow you will edit the configuration file to change the definition so that the OS starts with HDLM specified 11 Execute the HDLM configuration definition utilit...

Page 227: ...for supporting a boot disk to create an initial RAM disk image file for HDLM For the initial RAM disk image file specified in the parameter assign a name that is different from all currently used names For details on the dlmmkinitrd utility see 7 4 dlmmkinitrd Utility for Supporting a Boot Disk The following examples show how to execute the dlmmkinitrd utility when you are using Red Hat Enterprise...

Page 228: ...ing examples show how to execute the dlmmkinitrd utility when you are using SUSE LINUX Enterprise Server 10 or SUSE LINUX Enterprise Server 11 opt DynamicLinkManager bin dlmmkinitrd KAPL12329 I The utility for supporting the boot disk started KAPL12344 I A compressed initial ramdisk image boot initrd 2 6 16 46 0 14 default hdlm was created KAPL12330 I The utility for supporting the boot disk compl...

Page 229: ...Editing etc grub conf file Figure 3 13 Example of Editing boot grub menu lst file When using a kernel that supports Xen and Figure 3 14 Example of Editing etc elilo conf file If you are using SUSE LINUX Enterprise Server 10 or SUSE LINUX Enterprise Server 11 check the boot grub menu lst file instead of the etc grub conf file The detailed procedure is explained in steps 17 to 22 Figure 3 12 Example...

Page 230: ... boot grub menu lst file When using a kernel that supports Xen Edit the shaded portion Figure 3 14 Example of Editing etc elilo conf file Edit the shaded portion 17 If necessary back up the file 18 Copy the configuration that was used for startup from the SCSI device ...

Page 231: ...ted in step 13 When an option that depends on the user environment is specified be careful not to delete the option If you are using SUSE LINUX Enterprise Server 10 or SUSE LINUX Enterprise Server 11 and resume is specified for the kernel parameter then delete the resume setting 22 Specify the configuration that will be used for booting When GRUB is the boot loader Specify the position of the vali...

Page 232: ...lumes This may take a while Found volume group VolGroup00 using metadata type lvm2 27 Check the relationship between the volume group and HDLM devices Execute the following command to make sure that the physical volumes that make up the volume group are HDLM devices ...

Page 233: ...nstallation in an Environment Where a Logical Volume LVM2 on an HDLM Device Is Used as a Boot Disk This subsection describes how to perform an upgrade installation of HDLM in a multi path boot disk environment that uses a logical volume LVM2 on an HDLM ...

Page 234: ...fi instead of boot in the line where boot is coded and the file system type is displayed as vfat instead of ext3 3 Execute the HDLM configuration definition utility dlmcfgmgr with the v parameter specified to check the correspondence between the HDLM device and the SCSI device dlmcfgmgr v HDevName Management Device Host Channel Target Lun dev sddlmaa configured dev sda 0 0 0 0 KAPL10302 I sbin dlm...

Page 235: ... to update the information about the volume group vgscan Reading all physical volumes This may take a while Found volume group VolGroup00 using metadata type lvm2 6 Check the relationship between the volume group and HDLM devices Execute the following command to make sure that the physical volumes that make up the volume group are HDLM devices ...

Page 236: ... Environment 212 7 Edit the etc lvm lvm conf file so that the LVM2 recognizes the SCSI device not the HDLM device Figure 3 15 Example of Editing etc lvm lvm conf file shows an example of editing the etc lvm lvm conf file ...

Page 237: ...f Editing etc grub conf file Figure 3 17 Example of Editing boot grub menu lst file When using a kernel that supports Xen and Figure 3 18 Example of Editing etc elilo conf file If you are using SUSE LINUX Enterprise Server 10 or SUSE LINUX Enterprise Server 11 check the boot grub menu lst file instead of the etc grub conf file The detailed procedure is explained in steps 9 to 12 Figure 3 16 Exampl...

Page 238: ...n HDLM Environment 214 Figure 3 16 Example of Editing etc grub conf file Edit the shaded portion Figure 3 17 Example of Editing boot grub menu lst file When using a kernel that supports Xen Edit the shaded portion ...

Page 239: ...fy root as the name of the device mounted to in the etc fstab file If you are using a kernel that supports Xen add the root device by using the definition conventions for the boot loader configuration file 12 In initrd specify the initial RAM disk image file for the SCSI device If you are using a kernel that supports Xen change the initrd file name specified in module to the initial RAM disk image...

Page 240: ...the mount command to check that the SCSI device is mounted in boot The following shows an execution example for when GRUB is used as the boot loader mount dev sda1 on boot type ext3 rw Check the underlined section 18 Update the information about the volume group Execute the following command to update the information about the volume group vgscan Reading all physical volumes This may take a while ...

Page 241: ...ade installation of HDLM To perform an upgrade installation of HDLM see 3 6 5 Performing an Upgrade Installation of HDLM perform steps 2 to 12 to create an HDLM device You will also need to perform step 13 if you are only restarting the host Note that the ...

Page 242: ... dlmcfgmgr completed normally The HDevName column indicates the HDLM device and the Device column indicates the SCSI device 22 Edit the etc lvm lvm conf file so that the LVM2 recognizes the HDLM device not the SCSI device Figure 3 19 Example of Editing etc lvm lvm conf file shows examples of editing the etc lvm lvm conf file Figure 3 19 Example of Editing etc lvm lvm conf file Comment out the exis...

Page 243: ... Used opt DynamicLinkManager bin dlmmkinitrd boot initrd hdlm 2 6 9 11 EL gz uname r KAPL12329 I The utility for supporting the boot disk started KAPL12344 I A compressed initial ramdisk image boot initrd hdlm 2 6 9 11 EL gz was created KAPL12330 I The utility for supporting the boot disk completed Example of Executing the dlmmkinitrd Utility When IPF with ELILO as the Boot Loader Is Used opt Dyna...

Page 244: ...on by placing a hash mark at the beginning of each line and then add the HDLM device specification as shown below based on the correspondence between the HDLM device and the SCSI device as checked in step 21 dev sda1 boot ext3 defaults 1 2 dev sddlmaa1 boot ext3 defaults 1 2 This example assumes that IA32 uses GRUB as the boot loader When you use IPF that uses ELILO as the boot loader the mount po...

Page 245: ...lained in steps 27 to 31 Figure 3 20 Example of Editing etc grub conf file Figure 3 21 Example of Editing boot grub menu lst file When using a kernel that supports Xen and Figure 3 22 Example of Editing etc elilo conf file show examples of editing the configuration file Figure 3 20 Example of Editing etc grub conf file Edit the shaded portion ...

Page 246: ...3 Creating an HDLM Environment 222 Figure 3 21 Example of Editing boot grub menu lst file When using a kernel that supports Xen Edit the shaded portion ...

Page 247: ...LM device 28 Assign a name to the copied configuration that indicates that the configuration is used for specifying the HDLM device after update If you will use GRUB as the boot loader Change title If you will use ELILO as the boot loader Change label 29 Delete the root specification If you are using a kernel that supports Xen delete the root device specification in module ...

Page 248: ...tle for default When ELILO is the boot loader Specify label for default 32 Shut down the host Execute the following command to shut down the host shutdown h now 33 Change the configuration from a single path configuration to a multi path configuration 34 Start the host 35 Execute the mount command to make sure that the HDLM device is mounted on boot The following shows an execution example for whe...

Page 249: ...ound volume group VolGroup00 using metadata type lvm2 37 Check the relationship between the volume group and HDLM devices Execute the following command to make sure that the physical volumes that make up the volume group are HDLM devices ...

Page 250: ...3 7 7 Countermeasures for Unsuccessful Startup of the OS from an HDLM Device This subsection explains what actions you should take if the OS cannot be started from an HDLM device If startup of the OS fails either of the following happens ...

Page 251: ...itial RAM disk image file is corrupted Cause 3 The startup disk was no longer recognized first because the system environment configuration was modified If the startup disk is not found due to the changes in the system environment configuration the following message appears To correct the above error 1 Restart the host 2 In the window for setting information about boot loader startup select the op...

Page 252: ...or Starting Maintenance Appears and the OS Stops The probable causes of this error are as follows Startup from a SCSI device was selected in the boot loader configuration but etc fstab file was defined to mount an HDLM device To correct the above error 1 Enter the root user password 2 Execute mount o remount rw to mount the root directory again 3 In the etc fstab file change the mount destination ...

Page 253: ...n environment where an HDLM device is used as a boot disk To set up LUKS on an HDLM device execute the sbin cryptsetup command which is the same way as setting up LUKS on SCSI devices When using LUKS on an HDLM device enter the HDLM device s device file name in the etc crypttab file s second field 3 8 2 Using HDLM in an LUKS Environment This subsection describes how to migrate LUKS from a SCSI dev...

Page 254: ...ile s second field Before editing luks volume1 dev sdh etc cryptpassword1 After editing luks volume1 dev sddlmaa etc cryptpassword1 If the device name is specified in UUID format go to step 3 3 Execute the following command to check the correspondence between the UUID and the device name blkid t UUID 050f9901 3ab8 4556 a091 9c6e4a404f09 l o device dev sdh If you have an HDLM device name as the out...

Page 255: ... the SCSI device from the dev mapper luks volume1 device cryptsetup luksClose luks volume1 5 Map the device used by device mapper to the HDLM device The following shows an example of mapping dev mapper luks volume1 that was unmapped at step 4 to the HDLM device when using a key file etc cryptpassword1 cryptsetup d etc cryptpassword1 luksOpen dev sddlmaa luks volume1 key slot 0 unlocked Command suc...

Page 256: ...e created in HDLM cannot be used in a boot disk environment If an md device has been applied to a directory that cannot be unmounted while the system is operating such as opt tmp or var HDLM cannot be applied to that md device You cannot use the disk partition type RAID fd In mdadm package versions 1 6 0 2 or earlier you cannot manage devices whose major or minor number is 256 or greater Use mdadm...

Page 257: ...f SCSI devices to the md devices that are made up of HDLM devices Figure 3 24 Example of Correctly Configured md Devices shows an example when this migration is performed Figure 3 24 Example of Correctly Configured md Devices 3 9 2 Creating an md Device This subsection explains the procedure for creating a new md device in a multi path environment in which HDLM has been installed ...

Page 258: ...d Device on an HDLM Device To create an md device 1 Create a disk partition Specify the disk partition type 83 when you create a disk partition The following example shows how to execute the fdisk command to create a disk partition fdisk dev sddlmaa Command m for help n Command action e extended p primary partition 1 4 p Partition number 1 4 1 First cylinder 1 1018 default 1 Using default value 1 ...

Page 259: ...ng example RAID1 mirroring is used for the md device mdadm C dev md0 l1 n2 dev sddlmaa1 dev sddlmab1 mdadm dev sddlmaa1 appears to contain an ext2fs file system size 5238592K mtime Fri Jan 25 19 26 25 2008 mdadm dev sddlmab1 appears to contain an ext2fs file system size 5238592K mtime Fri Jan 25 19 27 07 2008 Continue creating array y mdadm array dev md0 started 3 Make sure that the md device has ...

Page 260: ...ile cat etc mdadm conf DEVICE dev sddlmaa1 dev sddlmab1 ARRAY dev md0 level raid1 num devices 2 UUID e39a6b15 32e48a5d ca05f4db 25bc8af9 For details about the contents of the configuration file see the Linux documentation or use the man command 6 Edit the configuration file created in step 5 Edit the etc mdadm conf file to add auto yes to the ARRAY line DEVICE dev sddlmaa1 dev sddlmab1 ARRAY dev m...

Page 261: ...tion Is Not Being Used for md Devices The following explains the procedure to use HDLM in an md device environment where the MULTIPATH function is not being used The example below assumes that the RAID functionality is being used for md devices In this procedure the device dev md0 on dev sdh1 and dev sdi1 is migrated to the device dev md0 on dev sddlmaa1 and dev sddlmab1 Use the following procedur...

Page 262: ... up that configuration file cp pr etc mdadm conf etc mdadm conf backup 6 Execute the following command to create a configuration file Even if a configuration file had already been used in step 5 you still need to create a configuration file so that the md device will be managed by HDLM echo DEVICE dev sdh1 dev sdi1 etc mdadm conf mdadm detail scan grep w dev md0 etc mdadm conf For sdh1 and sdi1 sp...

Page 263: ...db 25bc8af9 ARRAY dev md0 level linear num devices 1 UUID 426a9f1c 9cfa6310 6aa9a80b 11ea2102 8 If you have already used a configuration file etc mdadm conf edit the DEVICE lines If the existing DEVICE lines include SCSI devices that are specified in the DEVICE lines created in step 6 edit the DEVICE lines to exclude the SCSI devices The following are examples of editing the lines Before the corre...

Page 264: ...cified dlmcfgmgr v HDevName Management Device Host Channel Target Lun dev sddlmaa configured dev sdh 1 0 0 0 dev sddlmab configured dev sdi 1 0 0 1 KAPL10302 I sbin dlmcfgmgr completed normally The HDevName and Device columns display HDLM devices and SCSI devices respectively 14 Edit the configuration file Based on the correspondence between the HDLM devices and SCSI devices checked in step 13 cha...

Page 265: ...83 Linux Command m for help p Disk dev sddlmaa 5368 MB 5368709120 bytes 166 heads 62 sectors track 1018 cylinders Units cylinders of 10292 512 5269504 bytes Device Boot Start End Blocks Id System dev sddlmaa1 1 1018 5238597 83 Linux Command m for help w The partition table has been altered Calling ioctl to re read partition table Syncing disks Also perform the above operation for dev sddlmab 16 Ex...

Page 266: ...he MULTIPATH function is being used To use HDLM you need to disable md device s MULTIPATH function The example below explains how to migrate an md device for which the MULTIPATH function is used to an md device for which the LINEAR function is used In this procedure the device dev md0 on dev sdo1 and dev sdh1 is migrated to the device dev md0 on dev sddlmaa1 Use the following procedure to configur...

Page 267: ... and then install HDLM Perform steps 5 to 12 in 1 When the MULTIPATH Function Is Not Being Used for md Devices 6 Check the correspondence with HDLM device Execute the HDLM configuration definition utility dlmcfgmgr with the v parameter specified dlmcfgmgr v HDevName Management Device Host Channel Target Lun dev sddlmaa configured dev sdh 1 0 0 0 dev sdo 2 0 0 1 KAPL10302 I sbin dlmcfgmgr completed...

Page 268: ...6b2ec21b 06d0f50b bbf04d32 1e00b09a auto yes ARRAY dev md0 level linear num devices 1 UUID 426a9f1c 9cfa6310 6aa9a80b 11ea2102 For details about the contents of the configuration file see the Linux documentation or use the man command 9 If the configuration file etc mdadm conf has been recreated delete the unnecessary ARRAY line in that configuration file Delete the ARRAY line that includes the sa...

Page 269: ...artition numbers 12 Execute the following command to deactivate the md device mdadm Ss dev md0 13 Make sure that the md device has been deactivated In the following example the LINEAR function is used for the md device cat proc mdstat Personalities linear multipath unused devices none Make sure that md0 active is not displayed Although multipath will be displayed until the host is restarted there ...

Page 270: ...and an HDLM device concurrently as LVM2 physical volumes edit the etc lvm lvm conf file so that SCSI devices which are managed by HDLM are not recognized by LVM2 The following shows an editing example when both a SCSI device dev sda and an HDLM device are used as LVM2 physical volumes filter a sddlm a p a p a dev sda 1 9 r dev sd In the above filter line the underlined portion enables LVM2 to reco...

Page 271: ...g a Logical Volume on an HDLM Device To create a new logical volume on an HDLM device 1 Stop all processes and services that are using the HDLM device 2 Create a disk partition on the HDLM device and change the system ID from Linux 83 in hexadecimal representation to Linux LVM 8e in hexadecimal representation The following shows an example of how to create two partitions in dev sddlmad HDLM device...

Page 272: ...3 Creating an HDLM Environment 248 Example of executing the parted command IA32 IPF or EM64T AMD64 ...

Page 273: ...the blockdev command after the parted command 3 Edit the etc lvm lvm conf file Edit the device section in the file as shown below to disable the SCSI device configuration and enable the HDLM device configuration Adding and deleting filter entry information Add the following line and comment out all other filter entry information filter a sddlm a p a p r dev sd ...

Page 274: ...the following line types sddlmfdrv 16 Make sure that types fd 16 was commented out Figure 3 29 Example of Editing the etc lvm lvm conf File shows an example of editing the file when the OS is SUSE LINUX Enterprise Server 9 The shaded section shows the portion to be edited ...

Page 275: ...e of Editing the etc lvm lvm conf File 4 Create the physical volumes The following example shows how to define dev sddlmad1 and dev sddlmad2 as physical volumes pvcreate dev sddlmad1 Physical volume dev sddlmad1 successfully created pvcreate dev sddlmad2 ...

Page 276: ...o use the mke2fs command to create a file system on the lvol1 logical volume mke2fs dev vg01 lvol1 Filesystem label OS type Linux Block size 1024 log 0 Fragment size 1024 log 0 25688 inodes 102400 blocks 5120 blocks 5 00 reserved for the super user First data block 1 13 block groups 8192 blocks per group 8192 fragments per group 1976 inodes per group Superblock backups stored on blocks 8193 24577 ...

Page 277: ...ingle Path Environment to an HDLM Device This subsection explains the procedure for moving a logical volume created on a SCSI device in a single path environment to an HDLM device in a multi path environment Use the following procedure to configure the environment in Figure 3 30 Device Configuration When a Logical Volume on a SCSI Device Is Moved to an HDLM Device Figure 3 30 Device Configuration ...

Page 278: ...the LU is a single path dlmcfgmgr v HDevName Management Device Host Channel Target Lun dev sddlmaa configured dev sda 2 0 0 0 dev sddlmab configured dev sdb 2 0 0 1 KAPL10302 I sbin dlmcfgmgr completed normally 3 Stop all processes and services that are using the SCSI and HDLM devices 4 Unmount the logical volume to be moved In the following example the logical volume subject to the move has been ...

Page 279: ...ntry information Add the following line and comment out all other filter entry information filter a sddlm a p a p r dev sd Adding types entry information Add the following line types sddlmfdrv 16 Make sure that types fd 16 was commented out Figure 3 31 Example of Editing the etc lvm lvm conf File shows an example of editing the file when the OS is SUSE LINUX Enterprise Server 9 The shaded section ...

Page 280: ... etc lvm lvm conf File 8 Execute the VG scan To re create the volume group on the HDLM device execute the vgscan command as shown in the following example vgscan Reading all physical volumes This may take a while Found exported volume group vg01 using metadata type lvm2 ...

Page 281: ... MB 368 00 MB free PV dev sddlmad2 VG vg01 lvm2 548 00 MB 548 00 MB free Total 2 1016 00 MB in use 2 1016 00 MB in no VG 0 0 11 Activate the volume group In the following example the logical volume subject to the move belongs to the vg01 volume group vgchange ay vg01 1 logical volume s in volume group vg01 now active 12 Add a path to the LU Add a path to an existing LU by carrying out the procedur...

Page 282: ...tion 1 Check the correspondence between the HDLM and SCSI devices Execute the HDLM configuration definition utility dlmcfgmgr with the v parameter sbin dlmcfgmgr v HDevName Management Device Host Channel Target Lun dev sddlmaa configured dev sda 2 0 0 0 dev sddlmab configured dev sdb 2 0 0 1 KAPL10302 I sbin dlmcfgmgr completed normally HDLM devices are listed in the HDevName column and SCSI devic...

Page 283: ...ly 4 Specify the settings so that SCSI devices are not used in domainU Disable the block device settings from domainU For details see the Linux documentation 5 Specify the settings so that HDLM devices are used in domainU Set export the block devices to domainU For details see the Linux documentation Make sure that you specify the settings based on the correspondence between the HDLM and SCSI devi...

Page 284: ...p the guest OS see the OS documentation 3 To register a new HDLM device register the HDLM device into the hardware configuration file The following example shows how to register the HDLM device dev sddlmac as the IDE device dev hdb into the guest OS disk type block device disk source dev dev sddlmac target dev hdb bus ide disk For details on the values that can be specified for disk type target de...

Page 285: ... HDLM devices see 4 3 5 Displaying Corresponding Information About an HDLM Device SCSI Device and LDEV 5 Execute the following command to enable the settings in the hardware configuration file virsh define etc libvirt qemu domK xml 6 Start the guest OS For details on how to start the guest OS see the OS documentation ...

Page 286: ...eartbeat stop 2 Migrate the SCSI devices used by Heartbeat to HDLM devices If a SCSI device that is subordinate to an HDLM device is being used as a file system resource edit the settings as shown in the following example host1 172 26 4 321 Filesystem dev sda mnt point ext3 host1 172 26 4 321 Filesystem dev sddlmaa mnt point ext3 In this example the line that defines the SCSI device dev sda is com...

Page 287: ...onnected to Oracle Cluster file System 2 x 30 seconds 2 1 When a host and an Oracle RAC voting disk are connected by multiple paths HDLM performs failover processing for those paths in the same way as for normal paths when an I O timeout occurs for one of the paths Note that depending on the settings of Oracle RAC Oracle RAC might determine that a node error has occurred before the failover proces...

Page 288: ... to their original values Therefore make a note of the original values of MISSCOUNT and DISKTIMEOUT before changing them Storage system type Formula for obtaining the value of MISSCOUNT Lightning 9900 series Lightning 9900V series Hitachi USP Universal Storage Platform V VM Virtual Storage Platform number of paths connected to the voting disk x 60 seconds Hitachi AMS2000 AMS WMS SMS series Thunder...

Page 289: ...nfiguration file After installing ASMLib do the following for each node 1 Execute the following command to create the ASMLib configuration file etc init d oracleasm configure 2 Open the ASMLib configuration file etc sysconfig oracleasm 3 Change the ORACLEASM_SCANORDER line as follows ORACLEASM_SCANORDER sddlm If an ASM disk defined in an HDLM device already exists perform this procedure and then r...

Page 290: ...mand if the service is running service rgmanager stop service cman stop service ccsd stop 2 Change the SCSI device being used by RHCM to an HDLM device Edit as shown below if the lower SCSI device dev sda of the HDLM device dev sddlmaa is being used as dev raw raw1 dev raw raw1 dev sda dev raw raw1 dev sddlmaa Comment out dev sda and add dev sddlmaa 3 Restart the rawdevices service to apply the ch...

Page 291: ...sddlmaa is being used as dev raw raw1 ACTION add KERNEL sda RUN bin raw dev raw raw1 N ACTION add KERNEL sddlmaa RUN bin raw dev raw raw1 N Comment out KERNEL sda and add KERNEL sddlmaa 3 If you will restart the host go to step 4 If you will not restart the host go to step 5 4 Restart the host to apply the changes made in step 2 Execute the following command to restart the host shutdown r now RHCM...

Page 292: ... is installed in an environment that uses VCS For details on how to operate the VCS GUI see the VCS documentation 1 Stop the cluster service of VCS 2 Change the SCSI device used by VCS to an HDLM device Change the Block Devices parameter of the Mount resource from the SCSI device to an HDLM device 3 Start the cluster service of VCS ...

Page 293: ... LU being accessed by a path A path can be identified by PathName The LU that is accessed by a path can be identified by both DskName and iLU Make sure that all the paths are online Make sure that PathStatus is Online If a path is not online Reduced will be displayed Make sure that for each path the combination of the CHA port ChaPort through which multiple paths are accessing the same LU and the ...

Page 294: ...3 Creating an HDLM Environment 270 see whether the HDLM device corresponding to the SCSI device has been created ...

Page 295: ...t Cluster Elog Level 3 Elog File Size KB 9900 Number Of Elog Files 2 Trace Level 0 Trace File Size KB 1000 Number Of Trace Files 4 Path Health Checking on 30 Auto Failback on 1 Reservation Status Intermittent Error Monitor off KAPL01001 I The HDLM command completed normally Operation name view completion time yyyy mm dd hh mm ss To check the current audit log settings execute the following command...

Page 296: ...cking on 30 minute check interval on The recommended checking interval depends on the operating environment Automatic failback on 1 minute check interval The recommended checking interval depends on the operating environment Intermittent Error Monitor off off Reservation level Not specifiable Not specifiable Logging level 3 Collects all the error information for the Information level or higher 3 C...

Page 297: ...e When you specify on you can use the intvl parameter to specify the checking interval The value that was specified previously will be applied if the checking interval is not specified For example specify the path health check as off after specifying the checking interval as 15 minutes and executing Then when executing after specifying the path health check as on without specifying the checking in...

Page 298: ...that you monitor intermittent errors when automatic failback is enabled When intermittent error monitoring is enabled you can specify intermittent error conditions The default value for the intermittent error monitoring interval is 30 The default value for the number of error occurrences is 3 The system assumes that an intermittent error has occurred if the specified number of times that the error...

Page 299: ... Values for the Error Log Collection Level Setting If an error occurs you might have to change the collection level to 1 or higher to collect any log information The higher this value is set the more information that will be output As the amount of log information to be output increases it will take less time to overwrite the old error log information with the new information The following is an e...

Page 300: ...itten The following is an example of using a command to set the trace level opt DynamicLinkManager bin dlnkmgr set systflv 1 Specify the trace level as a number 7 Setting the Error Log File Size The error log file size the HDLM manager log dlmmgrn log n indicates a file number from 1 to 16 can be set You can specify a value in KB from 100 to 2000000 for the error log file size The specified value ...

Page 301: ...gth of a trace file is fixed regardless of how much trace information is actually in the file For the trace file size you can specify a value in kilobytes from 100 to 16000 If you specify a value smaller than the setting value the KAPL01097 W message will be displayed to confirm the execution and the trace file will be temporarily deleted When all the trace files become full the oldest file is ove...

Page 302: ...es the values that indicate audit log data collection levels An audit log data collection level is a severity level The default is 6 Table 3 60 Values Indicating Audit Log Data Collection Levels Table 3 61 Values Indicating Audit Log Data Categories describes the values that indicate audit log data categories The default is all Table 3 61 Values Indicating Audit Log Data Categories Value severity ...

Page 303: ... data If you want to specify the output destination for audit log data first specify the audit log facility by using the dlnkmgr set audfac command Next define the output destination of the facility in the etc syslog conf file Table 3 62 Values Indicating Audit Log Facility describes the values that indicate audit log facility The default is user Table 3 62 Values Indicating Audit Log Facility ca ...

Page 304: ... Service Pack Version Load Balance on extended lio Support Cluster Elog Level 2 Elog File Size KB 1000 Number Of Elog Files 5 Trace Level 1 Trace File Size KB 2000 Number Of Trace Files 10 Path Health Checking on 10 Auto Failback on 10 Reservation Status Intermittent Error Monitor on 2 20 KAPL01001 I The HDLM command completed normally Operation name view completion time yyyy mm dd hh mm ss After ...

Page 305: ...ic trace Information Files shows the setting values for the process specific trace information files Table 3 63 Setting Values for the Process specific trace Information Files The setting values cannot be modified 3 19 1 Notes on Using the Hitachi Network Objectplaza Trace Library Note the following when using Hitachi Network Objectplaza trace library If a different Hitachi product is using HNTRLi...

Page 306: ... using an udev rule file is not deleted when the host is restarted 3 20 1 When Using Red Hat Enterprise Linux 5 or Red Hat Enterprise Linux 6 Use the udev rule file to create a character type device file To create a character type device file by using an udev rule file 1 Edit the etc udev rules d 60 raw rules file For example you might edit the file as follows ACTION add KERNEL sddlmaa RUN bin raw...

Page 307: ...reating an HDLM Environment 283 Figure 3 32 Executing the raw Command In this example the command creates dev raw raw1 as a character type device file for dev sddlmaa major number of 253 minor number of 0 ...

Page 308: ...2 Note that the file systems supported by HDLM are ext2 ext3 ReiserFS and VxFS For details about creating a file system see 3 21 2 Creating a File System 2 Create a directory on which to mount the file system mkdir mnt hdlm In this example the command creates mnt hdlm to be used for the mount point 3 Mount the file system Execute a command such as the following mount dev sddlmaa mnt hdlm In this e...

Page 309: ...3 Creating an HDLM Environment 285 Figure 3 33 Example of Creating an ext2 File System ...

Page 310: ...automatically when Linux is started The Linux functionality that adds LABEL to a SCSI device is not supported in HDLM Do not use this functionality The following subsections describe the tasks that are required for using HDLM 3 22 1 Setting the HDLM Device for the First Time To mount an HDLM managed device automatically by setting a new HDLM device 1 Identify the name of the logical device file of...

Page 311: ...f the logical device file of the HDLM device For IP SAN environments specify _netdev for the mount option 3 Restart the host or manually mount the HDLM device HDLM managed devices are mounted by using the logical device file name of the HDLM device 3 22 2 Migrating from an Environment Where a SCSI Device Is Already Set To move an already set SCSI device to an HDLM device 1 Identify the name of the...

Page 312: ...e to that for the HDLM device that you confirmed in step 1 The following is an example of editing the etc fstab file For FC SAN environments dev sda mnt sda ext2 defaults 0 0 dev sddlmaa mnt sda ext2 defaults 0 0 For IP SAN environments dev sda mnt sda ext2 defaults 0 0 dev sddlmaa mnt sda ext2 _netdev 0 0 This example comments out the line for dev sda logical device file name of the SCSI device a...

Page 313: ...3 Creating an HDLM Environment 289 option 3 Restart the host or manually mount the HDLM device The HDLM managed device is mounted using the logical device file name of the HDLM device ...

Page 314: ...stalling HDLM 1 Back up all HDLM managed devices as required for example using a tape backup 2 Collect all information on the correspondence between logical device file names for the HDLM devices and LU numbers of the LUs in the storage system This step enables you to keep the correspondence between LUs and the logical device file names for SCSI devices once uninstallation is complete 3 Cancel HDL...

Page 315: ...VM settings see 3 23 7 Canceling the KVM Settings 6 Unmount the HDLM device If HDLM managed devices have been mounted by specifying HDLM devices unmount them Also if the disks are set to be mounted automatically when the host starts delete this setting in the etc fstab file For details on how to cancel the setting see 1 Operations Required for Devices to Be Managed by HDLM in 3 6 1 Preparations fo...

Page 316: ... a SCSI device that is subordinate to an HDLM device is being used as a file system resource edit the settings as shown in the following example host1 172 26 4 321 Filesystem dev sddlmaa mnt point ext3 host1 172 26 4 321 Filesystem dev sda mnt point ext3 In this example the HDLM device dev sddlmaa is commented out and the SCSI device dev sda is added 3 Start the Heartbeat service in the cluster Ex...

Page 317: ... be executed in order to change to an environment that uses a character type device of a SCSI device 1 When Using Red Hat Enterprise Linux AS4 ES4 To cancel the settings for RHCM 1 Stop the cluster service of RHCM If the RHCM service is running stop the service by executing the following command service rgmanager stop service cman stop service ccsd stop 2 Replace the HDLM device used by RHCM with ...

Page 318: ...the SCSI device dev sda which is the lower SCSI device of the HDLM device dev sddlmaa as dev raw raw1 ACTION add KERNEL sddlmaa RUN bin raw dev raw raw1 N ACTION add KERNEL sda RUN bin raw dev raw raw1 N Comment out KERNEL sddlmaa and add KERNEL sda 3 If you will restart the host go to step 4 If you will not restart the host go to step 5 4 Restart the host to apply the changes made in step 2 Execu...

Page 319: ...M device settings in an environment in which Xen is being used The following is the procedure for migrating a domainU environment that uses the HDLM device dev sddlmaa in a multi path configuration to an environment that uses the SCSI device dev sda in a single path configuration 1 Check the correspondence between the HDLM and SCSI devices Execute the HDLM configuration definition utility dlmcfgmg...

Page 320: ...en set to automatically start when domain0 starts temporarily change the setting so that domainU will not start automatically 4 Change the multi path configuration to a single path configuration 5 Specify the settings so that HDLM devices are not used in domainU Disable the block device settings from domainU For details see the Linux documentation 6 Specify the settings so that the SCSI devices ar...

Page 321: ...e 1 domK running The underlined part indicates the domain name 2 If the guest OS is running stop it For details on how to stop the guest OS see the OS documentation 3 If necessary delete the HDLM device from the hardware configuration file If you want to delete the HDLM device dev sddlmac delete the following lines disk type block device disk source dev dev sddlmac target dev hdb bus ide disk 4 To...

Page 322: ... Canceling the Settings for LVM2 This section explains how to change from an environment where HDLM devices are used as LVM physical volumes to an environment where SCSI devices are used as LVM physical volumes This section provides the procedure for moving a logical volume on an HDLM device in a multipath configuration to a SCSI device in a single path configuration when using LVM2 To create the ...

Page 323: ...2 sdc2 and sdd2 indicate the same LU sddlmaa1 and sddlmaa2 indicate the HDLM devices corresponding to each LU To move the logical volume to a SCSI device 1 Stop all processes and services that are using the SCSI and HDLM devices 2 Unmount the logical volume to be moved In the following example the logical volume subject to the move has been mounted on mnt lvol1 umount mnt lvol1 3 Deactivate the vo...

Page 324: ...escription about mounting the target logical volume comment out the description Also stop the applications that access the target logical volume 6 Edit the etc lvm lvm conf file Edit the device section in the file as shown below to enable the SCSI device configuration and disable the HDLM device configuration Adding and deleting the filter entry information Add the following line filter r sddlm a ...

Page 325: ...vm conf File shows an example of editing the file by adding and commenting out lines In this example SUSE LINUX Enterprise Server 9 is used as the OS The shaded parts show the locations that were edited Figure 3 38 Example of Editing the etc lvm lvm conf File 7 Execute the vgscan command ...

Page 326: ...2 548 00 MB 548 00 MB free Total 2 1016 00 MB in use 2 1016 00 MB in no VG 0 0 10 Activate the volume group In the following example the logical volume subject to the move belongs to the vg01 volume group vgchange ay vg01 1 logical volume s in volume group vg01 now active 11 If the etc fstab file was edited a section was commented out in step 5 return the commented out section to its original stat...

Page 327: ...SCSI device by using an example where the RAID functionality is used for the md devices In this procedure the device dev md0 on dev sddlmaa1 and dev sddlmab1 is migrated to the device dev md0 on dev sdh1 and dev sdi1 Use the following procedure to configure the environment shown in Figure 3 39 Device Configuration When an md Device on an HDLM Device Is Moved to a SCSI Device An Environment that Us...

Page 328: ...e sure that the md device has been deactivated In the following example RAID1 mirroring is used for the md device cat proc mdstat Personalities raid1 unused devices none Make sure that md0 active is not displayed 9 Check the correspondence between the HDLM devices and SCSI devices Execute the HDLM configuration definition utility dlmcfgmgr with the v parameter specified dlmcfgmgr v HDevName Manage...

Page 329: ...ing example shows how to execute the fdisk command to change the disk partition type to fd fdisk dev sddlmaa Command m for help p Disk dev sddlmaa 5368 MB 5368709120 bytes 166 heads 62 sectors track 1018 cylinders Units cylinders of 10292 512 5269504 bytes Device Boot Start End Blocks Id System dev sddlmaa1 1 1018 5238597 83 Linux Command m for help t Selected partition 1 Hex code type L to list c...

Page 330: ...vices for which the MULTIPATH Function Is Used This section describes the procedure for migrating an environment where md devices were created on an HDLM device to an environment where the md devices were created on a SCSI device The example below describes how to migrate the md devices created on the HDLM device for which the LINEAR function is used to the md devices created on the SCSI device fo...

Page 331: ...ULTIPATH Function Is Not Used 2 Check the status of the md device Execute the following command to check the configuration of the md device cat proc mdstat Personalities linear md0 active linear sddlmaa1 0 5238528 blocks 2 2 UU unused devices none Make sure that md0 active and the HDLM devices are displayed 3 Execute the following command to deactivate the md device mdadm Ss dev md0 4 Make sure th...

Page 332: ...n step 5 create an md device When you specify a device name you must also specify the partition number that is displayed in step 2 Specify all SCSI devices that correspond to HDLM devices mdadm C dev md0 lmp n2 dev sdh1 dev sdo1 mdadm dev sdh1 appears to contain an ext2fs file system size 5238528K mtime Wed Feb 6 20 02 45 2008 mdadm dev sdh1 appears to be part of a raid array level 1 devices 1 cti...

Page 333: ...lete the ARRAY line that includes the same name as the md device name md0 created in step 7 In the following example the underlined lines are to be deleted cat etc mdadm conf DEVICE dev sddlmaa1 ARRAY dev md0 level linear num devices 1 UUID 426a9f1c 9cfa6310 6aa9a80b 11ea2102 auto yes ARRAY dev md0 level multipath num devices 2 UUID 8db667ff e7472a25 3a84b801 025a6a57 9 Edit the etc mdadm conf fil...

Page 334: ...linear will be displayed until the host is restarted there are no operational problems 13 Activate the md device Perform steps 11 to 14 in 1 Migrating to md Devices for which the MULTIPATH Function Is Not Used Note that in step 13 in 1 Migrating to md Devices for which the MULTIPATH Function Is Not Used linear will be displayed until the host is restarted However there are no operational problems ...

Page 335: ...ollowing command to check the correspondence between the UUID and the SCSI device name In this command specify the SCSI device name checked in step 2 cryptsetup luksUUID dev sdh 050f9901 3ab8 4556 a091 9c6e4a404f09 4 In the etc crypttab file s second field change the setting to the UUID output executed in step 3 Before luks volume dev sddlmaa etc cryptpassword After luks volume UUID 050f9901 3ab8 ...

Page 336: ...stall HDLM 1 Log on to Linux as a root user 2 Stop all processes and services that are using HDLM managed paths Stop all DBMS various application processes and services that are using a path managed by HDLM If Xen is being used make sure that domainU has been stopped If domainU has been set to automatically start whenever domain0 starts temporarily change the setting so that domainU will not start...

Page 337: ...at domainU will not automatically start in step 2 restore the previous settings 2 Uninstalling HDLM When an HDLM Device Is Used as a Boot Disk This subsection explains how to uninstall HDLM from a multi path boot disk environment that uses an HDLM device and to change the environment to a boot disk environment that uses a SCSI device Note that if settings are incorrect the OS might not start When ...

Page 338: ... shows an example of the etc fstab file dev sddlmaa2 ext2 defaults 1 1 3 Execute the HDLM configuration definition utility dlmcfgmgr with the v parameter specified to check the correspondence between the HDLM device and the SCSI device If the SCSI device name has been changed by using the udev function specify the udev parameter also Figure 3 41 Example of Executing the dlmcfgmgr Utility with the ...

Page 339: ...existing HDLM device specification by placing a hash mark at the beginning of each line and then add the SCSI device specification as shown below based on the correspondence between the HDLM device and SCSI device as checked in step 3 dev sddlmaa2 ext2 defaults 1 1 dev sda2 ext2 defaults 1 1 For Red Hat Enterprise Linux 6 a block device name starting with UUID instead of a SCSI device name can be ...

Page 340: ...74d05 07dc 4c94 a585 5599c284d79b In the execution result disk by uuid 55574d05 07dc 4c94 a585 5599c284d79b indicates the device name udev name that corresponds to dev sda2 If you specify a block device name starting with UUID instead of a SCSI device name use UUID 55574d05 07dc 4c94 a585 5599c284d79b for the SCSI device you checked in step 3 dev sda2 For SUSE LINUX Enterprise Server 10 Check the ...

Page 341: ...he SCSI device dev sda2 checked in step 3 with dev disk by id scsi 2000c50fffecb6ae0 part2 If LVM2 is not used go to step 7 6 When LVM2 is used edit the etc lvm lvm conf file so that the LVM2 recognizes the SCSI device not the HDLM device Figure 3 43 Example of Editing etc lvm lvm conf file show examples of editing the etc lvm lvm conf file Figure 3 43 Example of Editing etc lvm lvm conf file Comm...

Page 342: ...t option in the example of editing a setting file refers to any option that might be valid in the user s environment When the boot loader is LILO An example of editing the etc lilo conf file the underlined section is shown below After modifying the definition execute sbin lilo command to activate the new setting You can delete the configuration for specifying the HDLM device without causing any pr...

Page 343: ...INUX Enterprise Server 10 is used the underlined sections Make sure that the value specified in default is correct You can delete the configuration for specifying the HDLM device without causing any problems Example 1 Example of Editing etc grub conf file default 0 default 1 timeout 10 splashimage hd0 0 grub splash xpm gz title Red Hat Enterprise Linux HDLM 194 EL root hd0 0 kernel vmlinuz 2 6 18 ...

Page 344: ... boot vmlinuz 2 6 16 60 0 21 xen vga 0x31a splash silent showopts module boot initrd 2 6 16 60 0 21 xen hdlm title XEN sd root hd0 1 kernel boot xen gz module boot vmlinuz 2 6 16 60 0 21 xen root dev sda2 vga 0x31a splash silent showopts module boot initrd 2 6 16 60 0 21 xen When the boot loader is ELILO running on an IPF host An example of editing the etc elilo conf file the underlined sections i...

Page 345: ...nly append option ramdisk_size 18245 option image vmlinuz 2 6 18 194 el5 label 2 6 18 194 el5 sd initrd initrd 2 6 18 194 el5 img read only append option root dev sda2 When using LVM2 An example of editing the etc grub conf file the underlined sections is shown below default 0 default 1 timeout 5 splashimage hd1 0 grub splash xpm gz Hiddenmenu title Red Hat Enterprise Linux AS HDLM 2 6 9 11 EL roo...

Page 346: ... device you checked in step 3 If you are using a kernel that supports Xen on SUSE LINUX Enterprise Server 10 add the root device by using the definition conventions for the boot loader configuration file When LVM2 is used specify root as the name of the device mounted to in the etc fstab file If LVM2 is not used in Red Hat Enterprise Linux 6 a block device name starting with UUID can be used To ch...

Page 347: ...r the OS 12 Shut down the host Execute the following command to shut down the host shutdown h now 13 Change the configuration from a multi path configuration to a single path configuration 14 Start the host When LVM2 is used go to step 16 15 Make sure that the SCSI device is used by the file system and the swap partition Make sure of the following three things that the root directory is associated...

Page 348: ...Loader Is ELILO Refer to the proc swaps file to make sure that the specified SCSI device name is displayed in the Filename column Go to step 18 16 Update the information about the volume group Execute the following command to update the information about the volume group vgscan Reading all physical volumes This may take a while Found volume group VolGroup00 using metadata type lvm2 17 Check the re...

Page 349: ...3 Creating an HDLM Environment 325 18 Delete the initial RAM disk image file that was created with the dlmmkinitrd utility for supporting a boot disk To do this execute the following command ...

Page 350: ...drv 254092 0 If a value other than 0 is displayed for Used perform the operation described in 3 23 1 Operations on HDLM Managed Devices and then perform steps 2 and 3 in 1 Uninstalling HDLM so that the HDLM devices can no longer be used 21 Uninstall HDLM To uninstall HDLM execute the following command rpm e HDLM 22 Make sure that the uninstallation has been completed You must execute the following...

Page 351: ...appear Unsetup is complete If HNTRLib2 is being used by another program HNTRLib2 will not be uninstalled and the following message will appear Because a bundle PP name is registered I did not do the Uninstall If HNTRLib2 was not uninstalled execute the following command to check if any programs are using it opt hitachi HNTRLib2 etc hntr2getname If you are unable to complete uninstallation even whe...

Page 352: ......

Page 353: ...e HDLM manager and how to change the configuration of the operating environment 4 1 Notes on Using HDLM 4 2 Updating Kernel Packages and Applying OS Update Packages 4 3 HDLM Operations Using Commands 4 4 Starting and Stopping the HDLM Manager 4 5 HDLM Resident Processes 4 6 Reconfiguring the HDLM Operating Environment ...

Page 354: ...l switch and HBA Therefore if an error occurs in all the paths for a single LU this response time will be the total period of time required for the corresponding fibre channel switches and HBAs to detect a timeout for the I O requested for each path For details on the timeout values for fibre channel switches and HBAs see the appropriate manual for the device Figure 4 1 Overview of the Period Requ...

Page 355: ...ied for the path that uses SCSI device A and n2 indicates the timeout value specified for the path that uses SCSI device B When using HDLM in a cluster environment a node in the cluster may fail over before the path completes failover To avoid this when you set up the failover timeout value for the node by using cluster software make sure that you specify a period longer than the response time tha...

Page 356: ... an online operation Although the following messages are output when you load the alert driver and the filter driver respectively HDLM operations are not affected sddlmadrv unsupported module tainting kernel sddlmadrv module license Proprietary Contact Hitachi for any bugs taints kernel If you start the host when using an HDLM device as a boot disk the error message KAPL05023 E might be output to ...

Page 357: ...te a partition from an HDLM device LU first stop all applications that are using the target HDLM device LU so that the HDLM device LU is not being used If you add or delete a partition while an HDLM device LU is being used restart the host to reload the partition table This state is achieved when none of the partitions of the HDLM device LU are being used 4 1 3 Notes When Using Red Hat Enterprise ...

Page 358: ...t To avoid this execute the dlmcfgmgr utility with the u parameter specified For details on the dlmcfgmgr utility see 7 3 dlmcfgmgr Utility for Managing the HDLM Configuration 4 1 4 Notes When Using SUSE LINUX Enterprise Server 9 Note the following when your OS is SUSE LINUX Enterprise Server 9 Before you update the kernel package uninstall HDLM After you have updated the kernel package re install...

Page 359: ...r than the current value for the number of retries for allocating memory and then restart the system If a call trace is output even after the retry count is set to 1 consider adding memory and stopping unnecessary processes 4 1 5 Notes When Using SUSE LINUX Enterprise Server 10 Note the following when your OS is SUSE LINUX Enterprise Server 10 Before you update the kernel package uninstall HDLM Af...

Page 360: ...ue greater than the current value for the number of retries for allocating memory and then restart the system If a call trace is output even after the retry count is set to 1 consider adding memory and stopping unnecessary processes When a device is dynamically configured by using the udev function the messages shown below might be output to the console or syslog However HDLM operations are not af...

Page 361: ...is being executed In the dlmsetopt utility set 1 or a value greater than the current value for the number of retries for allocating memory and then restart the system If a call trace is output even after the retry count is set to 1 consider adding memory and stopping unnecessary processes When a device is dynamically configured by using the udev function the error message KAPL05023 E might be outp...

Page 362: ...4 HDLM Operation 338 A Fibre Channel switch s zone setting is changed ...

Page 363: ...tallation of HDLM 2 Update the kernel package or OS update package 3 Execute the dlmupdatesysinit utility for updating system scripts For details about this utility see 7 8 dlmupdatesysinit Utility for Updating System Scripts 4 Restart the host 4 2 2 Environment Where an HDLM Device Is Used as the Boot Disk To update a kernel package or apply an OS update package when an HDLM device is used as the...

Page 364: ... apply an OS update package when a logical volume LVM2 on an HDLM device is used as the boot disk 1 Perform the procedure in 3 6 4 Performing a Re installation of HDLM 2 Edit the configuration file by changing the OS startup definition so that the OS will start with a SCSI device specified Perform step 1 to 19 in 3 7 6 Upgrade Installation in an Environment Where a Logical Volume LVM2 on an HDLM D...

Page 365: ...display path information execute the dlnkmgr command s view operation with the path parameter specified The following example shows how to execute the command opt DynamicLinkManager bin dlnkmgr view path To display information only for the paths accessing the specified host device execute the dlnkmgr command s view operation with the path and hdev parameters specified The following example shows h...

Page 366: ...ame For details on how to specify paths see 6 5 online Places Paths Online For example if you want to place all the paths that pass through a specific HBA port online execute the dlnkmgr command s online operation with the hba parameter specified The following is an example of executing the command opt DynamicLinkManager bin dlnkmgr online hba 0010 0000 KAPL01057 I All the paths which pass the spe...

Page 367: ...f you want to place all the paths that pass through a specific HBA port offline execute the dlnkmgr command s offline operation with the hba parameter specified The following is an example of executing the command opt DynamicLinkManager bin dlnkmgr offline hba 0010 0000 KAPL01055 I All the paths which pass the specified HBA port will be changed to the Offline C status Is this OK y n y KAPL01056 I ...

Page 368: ...010 Online dev sdl 000015 Online 0004 sddlmab dev sdr 000001 Online dev sdw 000006 Online dev sdh 000011 Online dev sdm 000016 Online KAPL01001 I The HDLM command completed normally Operation name view completion time yyyy mm dd hh mm ss For details on the displayed items and their descriptions see 6 7 view Displays Information 4 3 5 Displaying Corresponding Information About an HDLM Device SCSI D...

Page 369: ...letion time yyyy mm dd hh mm ss For details on the displayed items and their descriptions see 6 7 view Displays Information 4 3 6 Initializing Statistical Information for Paths This section explains how to initialize statistical information I O counts and I O errors for all the paths managed by HDLM This procedure is useful when you want to check the number of I O operations and I O errors that ha...

Page 370: ...mand s view operation with the sys and sfunc parameters specified The following is an example of executing the command opt DynamicLinkManager bin dlnkmgr view sys sfunc HDLM Version x x x xx Service Pack Version Load Balance on extended lio Support Cluster Elog Level 3 Elog File Size KB 9900 Number Of Elog Files 2 Trace Level 0 Trace File Size KB 1000 Number Of Trace Files 4 Path Health Checking o...

Page 371: ...termittent error monitoring Error log collection level Trace level Error log file size Audit log data collection Audit log facility Number of times the same path can be used for load balancing For details on how to set up each function see 6 6 set Sets Up the Operating Environment For example to set up the log level execute the dlnkmgr command s set operation with the ellv parameter specified When...

Page 372: ...te the license To update the license execute the dlnkmgr command s set operation with the lic parameter specified When the confirmation message is displayed enter y to execute or n to cancel the command If the license key file does not exist a message asking you to enter the license key appears so enter the license key Note When you use the dlnkmgr command s set operation with the lic parameter to...

Page 373: ...rsion x x x xx Service Pack Version Load Balance on extended lio Support Cluster Elog Level 3 Elog File Size KB 1000 Number Of Elog Files 2 Trace Level 0 Trace File Size KB 1000 Number Of Trace Files 4 Path Health Checking on 30 Auto Failback on 1 Reservation Status Intermittent Error Monitor off HDLM Manager Ver WakeupTime Alive x x x xx yyyy mm dd hh mm ss HDLM Alert Driver Ver WakeupTime ElogMe...

Page 374: ...t Error Monitor off HDLM Manager Ver WakeupTime Alive x x x xx yyyy mm dd hh mm ss HDLM Alert Driver Ver WakeupTime ElogMem Size Alive x x x xx yyyy mm dd hh mm ss 1000 HDLM Driver Ver WakeupTime Alive x x x xx yyyy mm dd hh mm ss LicenseType Expiration Permanent KAPL01001 I The HDLM command completed normally Operation name view completion time yyyy mm dd hh mm ss Among the displayed items HDLM M...

Page 375: ...4 HDLM Operation 351 ...

Page 376: ...nager has stopped Dead is displayed when executing opt DynamicLinkManager bin dlnkmgr view sys msrv and then start it Even if the HDLM manager is running Dead might be displayed when you execute opt DynamicLinkManager bin dlnkmgr view sys msrv If this happens see 5 4 3 What To Do for the Program Error Important When stopping the HDLM manager even if a message indicating that the HDLM manager has s...

Page 377: ...er status command In this case see the execution results of the dlnkmgr command 4 4 2 Stopping the HDLM Manager To stop the HDLM manager log in to Linux as a user with root permissions and then execute the following command etc init d DLMManager stop Stopping DLMManager OK Lower case characters can be used for the command name dlmmanager etc init d dlmmanager stop Stopping DLMManager OK The stop s...

Page 378: ...te the following command to confirm that the HDLM manager is inactive etc init d DLMManager status dlmmgr is stopped Note If an error occurs the execution results of the dlnkmgr command s view operation might be different from those of the DLMManager status command In this case see the execution results of the dlnkmgr command ...

Page 379: ... resident processes in HDLM To monitor these processes use the names below Table 4 2 HDLM resident processes You only need to monitor this process when HDLM is linked to Global Link Manager Process Description dlmmgr_exe HDLM manager process hbsa_service Hitachi Command Suite Common Agent Component process ...

Page 380: ... Hat Enterprise Linux 5 Red Hat Enterprise Linux 6 The host allows HBA replacement and the new HBAs are of the same type as the HBAs you replace Multiple HBAs are used and the paths that pass through these HBAs are connected to the same LU Multiple paths to the LU are active For details on how to replace HBAs see 2 Procedure for replacing HBAs Note however that in a BladeSymphony environment you m...

Page 381: ...hp modules file as follows bin bash sbin modprobe acpiphp Save the changes to the file and then use the chmod OS command to set execution permissions as follows chmod 755 etc sysconfig modules acpiphp modules Finally after the chmod command has been executed confirm that the execution permissions have been set as indicated by the underlined portion below ls l etc sysconfig modules acpiphp modules ...

Page 382: ...ure is used for replacing HBAs To replace HBAs 1 Check the WWN information of the HBAs to be replaced The method used to check the WWN information differs depending on the operating environment This procedure assumes that the operating environment is BladeSymphony Execute the following command opt hitachi drivers hba hfcmgr g Time yyyy mm dd hh mm ss Model HFC0402 E Parts Number 3HAC82101 A Firmwa...

Page 383: ...he HBAs you want to replace See the port WWN information of the HBAs you checked in step 1 and HBAPortWWN displayed as the execution result to check the host port number and the bus number displayed in PathName In PathName the leftmost number is the host port number The number between the period to the right of the host port number and the next period is the bus number Specify the host port number...

Page 384: ...0 in the Offline C status opt DynamicLinkManager bin dlnkmgr offline hba 0000 0000 After you have executed the offline operation execute the view operation of the dlnkmgr command dlnkmgr view path hbaportwwn to confirm that all the paths passing through the HBAs being replaced are in Offline C status opt DynamicLinkManager bin dlnkmgr view path hbaportwwn 4 Replace the HBAs 5 Execute the dlmcfgmgr...

Page 385: ...on that were placed in Offline C status before the HBAs were replaced remains this information will be deleted in step 8 7 Execute the dlmcfgmgr utility dlmcfgmgr v to confirm that new SCSI devices have been added New SCSI devices that have been added are indicated by shading in the above figure Although the information about the old SCSI devices the underlined ...

Page 386: ... placed in Offline C status has been deleted opt DynamicLinkManager bin dlnkmgr view path hbaportwwn 10 Execute the dlmcfgmgr utility dlmcfgmgr v to confirm that all the old SCSI device information has been deleted dlmcfgmgr v HBA replacement has been completed If you have restarted the host after HBA replacement update the path information as described in 3 Updating the path information after the...

Page 387: ...tatus Because the paths existing when HBAs were replaced are in Offline E status a hyphen is displayed for Device 3 Execute the dlmcfgmgr utility dlmcfgmgr u to delete the old information about paths and SCSI devices In the u parameter specify an HDevName device for which a hyphen is displayed for Device in step 2 Note that you need to execute the utility for each ...

Page 388: ...firm that all the information about the paths that were placed in Offline E status has been deleted opt DynamicLinkManager bin dlnkmgr view path hbaportwwn 4 6 2 Replacing a Fiber Cable If there are multiple online paths for a device in an LU you can replace a desired fiber cable while running your applications by placing offline only the path that goes through the fiber cable to be replaced and u...

Page 389: ...es through the HBA to which the fiber cable is connected For example to place in Offline C status the path that goes through the HBA with host port number 0001 and bus number 0000 execute the following command opt DynamicLinkManager bin dlnkmgr offline hba 0001 0000 While the path that goes through the HBA with host port number 0001 is placed Offline the status of the path that goes through the HB...

Page 390: ...e HBA with host port number 0001 3 Place in Online status the path that goes through the replaced fiber cable that is the path that goes through the HBA connected to the fiber cable For example to place in Online status the path that goes through the HBA with host port number 0001 and bus number 0000 execute the following command opt DynamicLinkManager bin dlnkmgr online hba 0001 0000 4 Check the ...

Page 391: ...he path that goes through the Fibre Channel switch to be replaced and using other paths to continue accesses The following steps show an example procedure for replacing a Fibre Channel switch Note that this procedure only applies for replacing a Fibre Channel switch This example assumes the system configuration as below Figure 4 4 System Configuration for Replacing a Fibre Channel Switch Explained...

Page 392: ... following command opt DynamicLinkManager bin dlnkmgr offline hba 0001 0000 While the path that goes through the HBA with host port number 0001 is placed Offline the status of the path that goes through the HBA with host port number 0002 is Online Figure 4 5 When the Status of the Path That Goes Through the Fibre Channel Switch to Be Replaced Is Offline C 2 Replace the Fibre Channel switch for the...

Page 393: ... the manual provided with the storage system All the actions performed via the HDLM configuration definition utility dlmcfgmgr are logged in the var opt DynamicLinkManager log dlmcfgmgr1 log file By looking in this file you can examine the change s made to the configuration or the reason why the execution of the dlmcfgmgr utility failed For more information on the dlmcfgmgr utility log see also 2 ...

Page 394: ... stop the HAL daemon when executing the dlmcfgmgr utility For details on how to stop the HAL daemon see 3 5 3 Notes on Installing HDLM The HAL daemon detects hardware configuration changes for example when a USB device or CD ROM is inserted If you execute the dlmcfgmgr utility with the v parameter specified a hyphen might be displayed in the Device column as shown below dlmcfgmgr v HDevName Manage...

Page 395: ...ach LU in the storage system even if the LU configuration of the new storage system is the same as the LU configuration of the replaced storage system 2 Adding a New LU To add a new LU HDLM device to the host on which the HDLM is installed 1 Use the management program of the storage system to allocate an LU which is not yet allocated to the relevant host to a port of the storage system that has a ...

Page 396: ...X Enterprise Server and an Emulex HBA driver Red Hat Enterprise Linux 5 or Red Hat Enterprise Linux 6 and a Brocade HBA driver SUSE LINUX Enterprise Server and a Brocade HBA driver Execute the following command echo sys class scsi_host hostn scan Execute the following command to check whether the OS has recognized any devices cat proc scsi scsi If the OS has not recognized any devices execute the ...

Page 397: ...e of executing the dlmcfgmgr utility sbin dlmcfgmgr r 5 Restart the host on which the HDLM is installed If you performed step 3 and step 4 the host does not have to be restarted Go to step 6 While restarting the HDLM device mapped with the path configured in the above step 1 is added automatically 6 Refer to var opt DynamicLinkManager log dlmcfgmgr1 log or execute the dlmcfgmgr utility dlmcfgmgr v...

Page 398: ... or Deleting a SCSI Device to manually create a SCSI device 4 Execute the HDLM configuration definition utility dlmcfgmgr r Based on the SCSI device created in step 3 the path configured in step 1 is added as a path for the HDLM device The following is an example of executing the dlmcfgmgr utility sbin dlmcfgmgr r 5 Restart the host on which the HDLM is installed If you performed step 3 and step 4...

Page 399: ...the HDLM device the information about the SCSI device that was deleted in step 4 The following is an example of executing the dlmcfgmgr utility sbin dlmcfgmgr r 6 Restart the host on which HDLM is installed If you performed steps 4 and 5 you do not need to restart the host Go to step 7 7 Execute the dlmcfgmgr utility dlmcfgmgr v or the view operation dlnkmgr view drv Make sure that all the SCSI de...

Page 400: ...n you want to delete a path while restarting the host go to step 5 4 Delete the SCSI device for the path that was deleted in step 2 Since the host has not been restarted the SCSI device for the path that was deleted in step 2 was not deleted Execute the command for deleting the device shown in Table 4 3 Adding or Deleting a SCSI Device to manually delete the SCSI device 5 Restart the host on which...

Page 401: ... HDLM device exists for example when you change a multi path configuration to a single path configuration the KAPL10340 E message is output In this case take action according to this message and refer to the var opt DynamicLinkManager log dlmcfgmgrn log file where n is 1 or 2 If the KAPL10362 W message was output to the var opt DynamicLinkManager log dlmcfgmgrn log file HDLM operations are not aff...

Page 402: ...nger managed by HDLM The following is an example of executing the dlmcfgmgr utility sbin dlmcfgmgr v 7 Changing a Device Not Managed by HDLM Into One Managed by HDLM The following operation can be done without restarting the host To change a device not managed by HDLM into one managed by HDLM 1 Stop all accesses to the relevant LU 2 Execute the HDLM configuration definition utility dlmcfgmgr v to ...

Page 403: ...iguration definition utility dlmcfgmgr v or the view operation dlnkmgr view drv of the dlnkmgr command to check if the host was started while the path to the relevant HDLM device was in disconnected status The following are examples of executing the command or utility When executing the dlmcfgmgr utility with the v option sbin dlmcfgmgr v When executing the view operation with the drv option opt D...

Page 404: ...ion dlnkmgr view drv of the HDLM command to check if the host was started while the path to the relevant HDLM device was in disconnected status The following are examples of executing the command or utility When executing the dlmcfgmgr utility with the v option sbin dlmcfgmgr v When executing the view operation with the drv option opt DynamicLinkManager bin dlnkmgr view drv If the SCSI device name...

Page 405: ...e Server and an Emulex HBA driver Red Hat Enterprise Linux 5 or Red Hat Enterprise Linux 6 and a Brocade HBA driver SUSE LINUX Enterprise Server and a Brocade HBA driver Execute the following command echo sys class scsi_host hostn scan Execute the following command to check whether the OS has recognized any devices cat proc scsi scsi If the OS has not recognized any devices execute the following c...

Page 406: ...ed online The following is an example of executing the HDLM command opt DynamicLinkManager bin dlnkmgr online pathid AutoPATH_ID 5 Refer to var opt DynamicLinkManager log dlmcfgmgr1 log or execute the dlmcfgmgr utility dlmcfgmgr v to check if the path to the relevant HDLM device is restored The following is an example of executing the dlmcfgmgr utility sbin dlmcfgmgr v 10 Restoring the Path in Dis...

Page 407: ...and opt DynamicLinkManager bin dlnkmgr online pathid AutoPATH_ID The relevant path is placed online 6 Execute the dlmcfgmgr utility dlmcfgmgr v to check if the path to the relevant HDLM device is restored The following is an example of executing the dlmcfgmgr utility sbin dlmcfgmgr v 4 6 5 About Creating a New HDLM Device While restarting the host HDLM may detect a new path The HDLM device to be a...

Page 408: ...y allocated logical device file name of the HDLM device If the error message KAPL10357 E is displayed HDLM does not add an HDLM device even though a new LU was recognized In this case you must execute the HDLM configuration definition utility dlmcfgmgr u to delete the HDLM device s not in use or represented with a hyphen to release the available name s Allocation before restarting the host Allocat...

Page 409: ...wer When you restart the host after adding a BladeSymphony I O drawer and if you execute the HDLM configuration definition utility dlmcfgmgr v a hyphen might be displayed in the Device column of the execution results dlmcfgmgr v HDevName Management Device Host Channel Target Lun dev sddlmaa configured dev sde 2 0 0 1 0 0 0 0 dev sda 1 0 0 0 dev sddlmab configured 0 0 0 1 dev sdf 2 0 0 2 dev sdb 1 ...

Page 410: ......

Page 411: ...curred in HDLM The resolutions for path errors HDLM program errors and other types of errors are all described separately 5 1 Information Collected by the DLMgetras Utility for Collecting HDLM Error Information 5 2 Checking Error Information in Messages 5 3 What To Do for a Path Error 5 4 What To Do for a Program Error 5 5 What To Do for Other Errors ...

Page 412: ... error occurs execute the DLMgetras utility for collecting HDLM error information since restarting the machine might delete error information before the information is collected by DLMgetras For details about the DLMgetras utility and the error information it collects see 7 2 DLMgetras Utility for Collecting HDLM Error Information ...

Page 413: ... E Error in path occurred A path error occurred ErrorCode aa aa PathID bb bb PathName cc cc dd dd ee ee ff ff DNum gg gg HDevName hh hh The message elements are explained below ErrorCode The error number generated when Linux detects a path error PathID The ID assigned to a path This ID is called the AutoPATH_ID AutoPATH_IDs are re assigned every time the host is restarted When you want to add a ne...

Page 414: ... value is fixed to 0 This is the same as the DNum that is displayed by the view operation For details on the view operation see 6 7 view Displays Information HDevName The name of the host device The logical device file name of the HDLM device to which access is made by way of the path minus the partition number is displayed in the format sddlm aa pap for example sddlmaa or sddlmaaa For details on ...

Page 415: ... indicates that an error has occurred in the components that make up the path Figure 5 1 Error Location When the KAPL08022 E Message Is Output indicates these components Figure 5 1 Error Location When the KAPL08022 E Message Is Output Figure 5 2 Troubleshooting Procedure When a Path Error Occurs shows the troubleshooting procedure when the KAPL08022 E message is output ...

Page 416: ...ages If the KAPL08022 E message is output view the message to check the path in which the error has occurred For details on each item displayed in messages see 5 2 Checking Error Information in Messages 5 3 2 Obtain Path Information Obtain path information to narrow down the hardware in which an error has occurred Execute the following command opt DynamicLinkManager bin dlnkmgr view path iem hbapo...

Page 417: ...r Use the Windows and hardware management tools to identify the error location and then resolve the problem For hardware maintenance contact your hardware vendor or maintenance company if there is a maintenance contract 5 3 6 Placing the Path Online After the path has recovered from the error use the dlnkmgr command s online operation to place the path back online For details on the online operati...

Page 418: ...n error occurs in an HDLM program a message other than KAPL08xxx is output to syslog Examine the content of the message Messages with error level E Error or higher require corrective action 5 4 2 Obtaining Program Information Obtain the information that you need to report to your HDLM vendor or maintenance company Use the DLMgetras utility to collect the error information For details on this utili...

Page 419: ... Could not connect the HDLM manager Operation name view In this situation start the HDLM manager For details about how to do this see 4 4 1 Starting the HDLM Manager If the KAPL01013 E message appears as a result of executing the command The following shows the KAPL01013 E message KAPL01013 E An error occurred in internal processing of the HDLM command Operation name view details aa aa aa aa are c...

Page 420: ... error nor an HDLM program error execute the DLMgetras utility and then report the collected information to the HDLM vendor or maintenance company if there is a maintenance contract for HDLM For details about the DLMgetras utility and the information it collects see 7 2 DLMgetras Utility for Collecting HDLM Error Information ...

Page 421: ...s operations 6 1 Overview of the HDLM Command dlnkmgr 6 2 clear Returns the Path Statistics to the Initial Value 6 3 help Displays the Operation Format 6 4 offline Places Paths Offline 6 5 online Places Paths Online 6 6 set Sets Up the Operating Environment 6 7 view Displays Information ...

Page 422: ...ns of the dlnkmgr Command Operation Functions clear Initializes 0 the statistics I O count and I O errors of all paths managed by the HDLM system For details see 6 2 clear Returns the Path Statistics to the Initial Value help Displays the format of the operations used for HDLM For details see 6 3 help Displays the Operation Format offline Places offline an online path or paths For details see 6 4 ...

Page 423: ...6 Command Reference 399 Notes Execute the command as a user with root permissions To specify a value that contains a space in its parameter enclose the entire value in double quotes ...

Page 424: ...ors of all paths managed by HDLM to the initial value 0 Example opt DynamicLinkManager bin dlnkmgr clear pdst KAPL01049 I Would you like to execute the operation Operation name clear y n y KAPL01001 I The HDLM command completed normally Operation name clear completion time yyyy mm dd hh mm ss s Executes the command without displaying a message asking for confirmation of command execution from the ...

Page 425: ...clear Operation help Displays the format of the clear operation Example opt DynamicLinkManager bin dlnkmgr clear help clear Format dlnkmgr clear pdst s KAPL01001 I The HDLM command completed normally Operation name clear completion time yyyy mm dd hh mm ss ...

Page 426: ...fy one of the following operations clear help online offline set view If you do not specify any operations the help operation displays all operations available for the HDLM command Examples Example 1 The following example shows how to display all the operations available in the HDLM command opt DynamicLinkManager bin dlnkmgr help dlnkmgr Format dlnkmgr clear help offline online set view KAPL01001 ...

Page 427: ... cha pathid AutoPATH_ID s dlnkmgr offline path pathid AutoPATH_ID s dlnkmgr offline path device SCSI_Device_Name s Valid value AutoPATH_ID 000000 999999 Decimal help Format dlnkmgr help clear offline online set view KAPL01001 I The HDLM command completed normally Operation name help completion time yyyy mm dd hh mm ss Example 3 The following example shows how to display the operations that can be ...

Page 428: ...Information 6 4 1 Format 1 To place paths offline opt DynamicLinkManager bin dlnkmgr offline path hba host port number bus number cha pathid AutoPATH_ID pathid AutoPATH_ID device SCSI device name s 2 To Display the Format of the offline Operation opt DynamicLinkManager bin dlnkmgr offline help 6 4 2 Parameters 1 To place paths Offline path Indicates that the target of the operation is a path manag...

Page 429: ...laced Offline C 0 path s were not Operation name offline cha pathid AutoPATH_ID Use this parameter to place offline at one time all the paths that pass through a specific CHA port The command will place offline all the paths that pass through the CHA port to which the path with the specified AutoPATH_ID is connected Specify the current AutoPATH_ID of the target path which is displayed by using the...

Page 430: ...d 000001 and 1 indicate the same AutoPATH_ID however when the target AutoPATH_ID is 000000 enter 000000 or 0 for the parameter value AutoPATH_IDs are re assigned every time the host is restarted When you want to add a new LU without restarting the host AutoPATH_IDs are re assigned to each path of the LU when you execute the dlmcfgmgr utility for managing the HDLM configuration Always make sure tha...

Page 431: ...onfirmation message for example when you want to execute the command in a shell script or batch file Example The following example shows how to place a path whose AutoPATH_ID is 000001 offline without asking for confirmation of command execution from the user opt DynamicLinkManager bin dlnkmgr offline pathid 1 s KAPL01061 I 1 path s were successfully placed Offline C 0 path s were not Operation na...

Page 432: ...ne all the paths connected to a specific HBA port or CHA port Example 1 The following example shows how to filter and display the information on all paths that pass through the HBA port whose host port number is 0004 and bus number is 0000 opt DynamicLinkManager bin dlnkmgr view path grep 0004 0000 The above command will display information on all the paths that pass through the specified HBA port...

Page 433: ...f the operation is a path managed by HDLM This parameter is optional because online is always used for paths so it is assumed Make sure that you specify the path to be taken online by using the hba cha pathid or device parameter If you do not specify any of these parameters the command will place all the offline paths online If there is a path that cannot be placed online a message asking whether ...

Page 434: ...the paths that pass through the CHA port to which the path with the specified AutoPATH_ID is connected Specify the current AutoPATH_ID of the target path which is displayed by using the view operation For details about the view operation see 6 7 view Displays Information Leading zeros can be omitted 000001 and 1 indicate the same AutoPATH_ID however when the target AutoPATH_ID is 000000 enter 0000...

Page 435: ... the current AutoPATH_ID of the target path before executing the online operation device SCSI device name Use this parameter to place online a path connected to the specified SCSI device For SCSI device name specify the value of Device displayed by executing the view operation as follows opt DynamicLinkManager bin dlnkmgr view lu For details on how to execute the view operation and display the SCS...

Page 436: ...ows how to display the format of the online operation opt DynamicLinkManager bin dlnkmgr online help online Format dlnkmgr online path s dlnkmgr online path hba HBAPortNumber BusNumber s dlnkmgr online path cha pathid AutoPATH_ID s dlnkmgr online path pathid AutoPATH_ID s dlnkmgr online path device SCSI_Device_Name s Valid value AutoPATH_ID 000000 999999 Decimal KAPL01001 I The HDLM command comple...

Page 437: ...number is 0000 opt DynamicLinkManager bin dlnkmgr view path grep 0004 0000 The above command will display information on all the paths that pass through the specified HBA port Example 2 The following example shows how to filter and display the information on all paths that pass through the CHA port 0A of the Thunder 9500V series opt DynamicLinkManager bin dlnkmgr view path stname grep 9500V grep 0...

Page 438: ...files pchk on intvl checking interval off afb on intvl checking interval off iem on intvl error monitoring interval iemnum number of times error is to occur off lic audlog on audlv audit log data collection level category ss a ca all off audfac facility value lbpathusetimes number of path use times s 2 To Display the Format of the Set Operation opt DynamicLinkManager bin dlnkmgr set help 6 6 2 Par...

Page 439: ...n level and higher 3 Collect error information for the Information level and higher Error log file size 9900 KB 9900 KB Number of error log files 2 2 Trace level 0 Do not output any trace 0 Do not output any trace Trace file size 1000 KB 1000 KB Number of trace files 4 4 Path health checking on Interval is 30 minutes on The recommended checking interval depends on the operating environment Automat...

Page 440: ... Error Log Collection Levels shows the values of the error log collection level If an error occurs you may have to set the error log collection level to 1 or higher to collect log information Table 6 3 Values of the Error Log Collection Levels The higher the error log collection level value the more log information will be output As the amount of log information that is output increases the amount...

Page 441: ...file number from 1 to 16 Specify a value from 2 to 16 By specifying both the error log file size and the number of error log files you can collect up to 32 000 000 KB approximately 30 GB of error logs in total systflv trace level Specify the trace output level Log files for which the trace level can be set are hdlmtrn log where n is a value from 1 to 64 Table 6 4 Trace Level Values shows the value...

Page 442: ...number of trace log files By specifying both the trace file size and the number of trace files you can collect up to 1 024 000 KB of trace data in total If you specify a value smaller than the set value the KAPL01097 W message is displayed to confirm execution and the trace file is temporarily deleted Trace files for which the number of files can be set are hdlmtrn log where n is a value from 1 to...

Page 443: ...matically place paths online that were intentionally placed offline for example paths placed offline for maintenance work When intermittent errors occur in paths or storage systems path status alternates between the online and offline status frequently so I O performance might deteriorate Automatic failbacks are performed on the following types of paths Paths where an error occurred and for which ...

Page 444: ...sage will be output and an error will occur If this happens change any of the following settings the checking interval for automatic failbacks the intermittent error monitoring interval or the number of times that the error is to occur When you set the number of times that the error is to occur to 1 the above condition does not need to be satisfied When you changed the error monitor interval durin...

Page 445: ...r monitoring interval or the number of times that the error is to occur has not been specified before The intermittent error monitoring interval is set to 30 minutes and the number of times that the error is to occur is set to 3 When the intermittent error monitoring interval or the number of times that the error is to occur has been specified before The values specified from the last time are use...

Page 446: ...ues are from 1 to 99 The default is 3 During intermittent error monitoring if you change the number of times that the error is to occur in order for the system to determine that an intermittent error has occurred the number of errors and the time that has passed since intermittent error monitoring has started are reset to 0 The changed setting will take effect immediately and intermittent error mo...

Page 447: ...ations for those functions Table 6 5 Relationship Between the Setting for the Automatic Failback Function and Intermittent Error Monitoring and the Executable Operations Setting Available operation Result of operation AFB IEM on on Set AFB to on The operations of AFB and IEM do not change Change the AFB setting AFB is performed under the new settings 1 Set AFB to off AFB and IEM are disabled The e...

Page 448: ...n Operation name set y n y KAPL01001 I The HDLM command completed normally Operation name set completion time yyyy mm dd hh mm ss Set IEM to off IEM is disabled The error count elapsed monitoring time and information about paths not subject to automatic failbacks are cleared off Set AFB to on The operations of AFB and IEM do not change Change the AFB setting AFB operates using new settings Set AFB...

Page 449: ...on the license key type described in the license key file For a temporary license key or emergency license key the expiration period is also displayed KAPL01071 I KAPL01072 I Table 6 6 License Key Types lists the license key types Table 6 6 License Key Types A temporary license key cannot be installed by using the dlnkmgr command s set operation Example 1 The following example shows how to update ...

Page 450: ...ory ss a ca all off Specifies whether to collect audit log data on Audit Log data is collected off Audit Log data is not collected audlv audit log data collection level Specifies the severity level of audit log data to be collected Table 6 7 Values Indicating Audit Log Data Collection Levels describes the values that indicate audit log data collection levels The default is 6 Table 6 7 Values Indic...

Page 451: ...e Audit Log Facility lbpathusetimes number of path use times Specifies the number of times the same path can be used for I O operations when the Round Robin rr Least I Os lio or Least Blocks lbk algorithm is used Value Explanation ss Audit log events of the StartStop category are collected a Audit log events of the Authentication category are collected ca Audit log events of the ConfigurationAcces...

Page 452: ...skip the response to the confirmation message for example when you want to execute the command in a shell script or batch file 2 To Display the Format of the Set Operation help Displays the format of the set operation Example opt DynamicLinkManager bin dlnkmgr set help set Format dlnkmgr set lb on lbtype rr exrr lio exlio lbk exlbk lb off ellv ElogLevel elfs ElogFileSize elfn Number Of ElogFiles s...

Page 453: ...ize 100 2000000 KB Default Value 9900 Number Of ElogFiles 2 16 Files Default Value 2 TraceLevel 0 1 2 3 4 Default Value 0 TraceFileSize 100 16000 KB Default Value 1000 Number Of TraceFiles 2 64 Files Default Value 4 Interval Time 1 1440 Minute Default Value 30 pchk Interval Time 1 1440 Minute Default Value 1 afb Error Monitor Interval 1 1440 Minute Default Value 30 Number Of Times 1 99 Times Defau...

Page 454: ...e user local0 local7 Default Value user Facility Number 1 16 23 Default Value 1 Number Of PathUseTimes 0 999999 Times Default Value 32 KAPL01001 I The HDLM command completed normally Operation name set completion time yyyy mm dd hh mm ss ...

Page 455: ... sfunc msrv adrv pdrv lic audlog lbpathusetimes t 2 To Display Path Information To display path information opt DynamicLinkManager bin dlnkmgr view path hdev host device name stname iem srt pn lu cp hbaportwwn t To display path information by selecting a display item opt DynamicLinkManager bin dlnkmgr view path item pn dn lu cp type ic ie dnu hd iep hbaportwwn hdev host device name stname srt pn l...

Page 456: ... c t To display a summary of LU information by adding items to be displayed opt DynamicLinkManager bin dlnkmgr view lu c item slpr t 4 To display corresponding information about an HDLM device SCSI device and LDEV opt DynamicLinkManager bin dlnkmgr view drv t 5 To Display the Format of the view Operation opt DynamicLinkManager bin dlnkmgr view help 6 7 2 Parameters To display program information T...

Page 457: ...formation t Does not display the title for each information item Table 6 10 Displayed Program Information Parameter and program information to be displayed Item Description sfunc Information about the HDLM function settings HDLM Version HDLM version number Service Pack Version HDLM SP version number This item is blank if no SP is present Load Balance Settings for load balancing Setting status on E...

Page 458: ... 2 Outputs a summary of program operation 3 Outputs details of program operation 4 Outputs all information Trace File Size KB Trace file size in kilobytes Number Of Trace Files Number of trace files Path Health Checking Settings for path health checking on Enabled off Disabled Checking interval When the setting of the path health checking is on the checking interval of path health checking is disp...

Page 459: ...he format is number of times error is to occur monitoring interval The time is in minutes msrv Information about the HDLM manager HDLM Manager Status of the HDLM manager Alive Normal Dead Stopped Ver Version number of the HDLM manager WakeupTime Startup time of the HDLM manager adrv Information about the HDLM alert driver HDLM Alert Driver Status of the HDLM alert driver Alive Normal Dead Stopped ...

Page 460: ...et is displayed within the parentheses following on The collection level indicates a severity level A value from 0 to 7 is displayed as the collection value Audit Log Category The categories of audit log data to be output are displayed When more than one category is displayed commas are used as separators ss StartStop a Authentication ca ConfigurationAccess If all the above categories are specifie...

Page 461: ... Level 0 Trace Files Size KB 1000 Number Of Trace Files 4 Path Health Checking on 30 Auto Failback on 1 Reservation Status Intermittent Error Monitor off KAPL01001 I The HDLM command completed normally Operation name view completion time yyyy mm dd hh mm ss Example 2 The following example shows how to display information about the HDLM manager opt DynamicLinkManager bin dlnkmgr view sys msrv HDLM ...

Page 462: ... The following example shows how to display information about the HDLM license opt DynamicLinkManager bin dlnkmgr view sys lic License Type Expiration Permanent KAPL01001 I The HDLM command completed normally Operation name view completion time yyyy mm dd hh mm ss Example 6 The following example shows how to display information about the audit log settings opt DynamicLinkManager bin dlnkmgr view s...

Page 463: ...nd displays information for all the paths in order of increasing AutoPATH_IDs For details on what is displayed in each item see Table 6 12 Path Information AutoPATH_IDs displayed by the path parameter depend on the sequence in which HDLM detects the paths after a host is started up Because of this make sure that you use the path name PathName to identify a path The sub parameters are as follows hd...

Page 464: ...e specified by the srt parameter and the third sorting key is AutoPATH_ID The available parameter values to specify the second sorting key are pn Path name lu LU number of the storage system cp Port number of the CHA When the srt parameter is omitted the path information is listed in ascending order of AutoPATH_IDs hbaportwwn Displays port WWN information for the HBAs connected to the storage syst...

Page 465: ... view path item command and the parameter values for displaying each item Table 6 11 Correspondence between the items displayed by the dlnkmgr view path item command and the values of the item parameter Because both PathID and Status are always displayed you do not have to specify any parameters In the sub parameters following path item you can list the paths hdev and sort the list srt If you omit...

Page 466: ...ails about the information to be displayed for product IDs see Table 6 14 Product ID displayed by the view path operation When you use this parameter DskName is displayed by default It is not necessary to specify dn for the item parameter srt pn lu cp Use this parameter to sort the path information in ascending order according to the specified sorting key The sorting keys are as follows the first ...

Page 467: ...formation by abbreviating the list items path c When you specify the path parameter together with the c parameter the command selects certain items to be displayed and shortens the contents of each item so that the information about each path fits into a single line on the screen The items that are displayed are PathID DskName iLU CP Status and Type For details on what is displayed for each item s...

Page 468: ...n about product IDs see Table 6 14 Product ID displayed by the view path operation srt lu cp Use this parameter to sort the path information in ascending order according to the specified sorting key The sorting keys are as follows the first sorting key is the name of the storage system DskName the second sorting key is the value specified by the srt parameter and the third sorting key is AutoPATH_...

Page 469: ...2 Path Information Displayed Item Description No summary displayed Summary displayed Paths Total number of displayed paths indicated by a decimal number OnlinePaths Number of online paths from within the displayed paths indicated by a decimal number When the value of Paths equals the value of OnlinePaths all paths are online If the value of OnlinePaths is less than that of Paths some paths are off...

Page 470: ...uration definition utility dlmcfgmgr PathName The path name which indicates a path When you modify the system configuration or replace a hardware item you should check the path names to identify the physical path that will be affected by the change Path name consists of the following four elements separated by periods Host port number hexadecimal number Bus number hexadecimal number Target ID hexa...

Page 471: ... Platform V VM and Hitachi Virtual Storage Platform indicated by a hexadecimal number The first two characters of iLU are the number of the logical DKC Disk Controller the middle two numbers are the CU number and the last two characters are the internal LU number within the CU ChaPort CP Port number of the CHA which identifies the CHA port that is mounted on the storage system You can identify an ...

Page 472: ...tistics to the Initial Value DNum Dev number where 0 fixed is displayed This item pertains to a partition number HDevName Host device name The name of the logical device file minus the partition number dev sddlm aa pap for the HDLM device For details on logical device files for HDLM devices see 2 6 Logical Device Files for HDLM Devices IEP Information about the intermittent error This item is disp...

Page 473: ...iguration Table 6 14 Product ID displayed by the view path operation Element Linux representation Host port number example 0000 Host ID host port number Bus number example 0000 Channel number bus number Target ID example 000000000000003A Target ID Host LU number example 0005 Lun host LU number Model names of storage systems Product ID Without the stname parameter With the stname parameter Displays...

Page 474: ...ion This section describes each Lightning 9900 series Emulation type 9910 9960 Lightning 9900V series 9970 9980 SVS SVS Hitachi NSC55 Hitachi Universal Storage Platform 100 Hitachi Universal Storage Platform 600 Hitachi Universal Storage Platform 1100 USP Hitachi Universal Storage Platform V Hitachi Universal Storage Platform VM USP_V Hitachi Virtual Storage Platform VSP P9500 P9500 HP XP128 XP128...

Page 475: ...e Displays information only for the paths accessing the specified host device Specify the name of the logical device file minus the partition number dev sddlm aa pap for the HDLM device For details on logical device files for HDLM devices see 2 6 Logical Device Files for HDLM Devices The host device name string is case sensitive pathid AutoPATH_ID Use this parameter to display only the information...

Page 476: ... with the item option are displayed among with those displayed by the lu option When the value of the item parameter is omitted or all is specified all the items that can be displayed are displayed Table 6 15 Correspondence between the items displayed by the dlnkmgr view lu item command and the values of the item parameter shows the correspondence between the items that can be displayed by the dln...

Page 477: ...ls on logical device files for HDLM devices see 2 6 Logical Device Files for HDLM Devices The host device name string is case sensitive pathid AutoPATH_ID Use this parameter to display only the information about the LU that is connected to the path with that specified AutoPATH_ID t Omits the title for each information item Example The following example shows how to display LU information by using ...

Page 478: ...r pathid parameter For details on the contents of each display item see Table 6 17 LU Information t Omits the title for each information item Example The following example shows how to display a summary of LU information without selecting items to be displayed opt DynamicLinkManager bin dlnkmgr view lu c Product S N LUs iLU HDevName Paths OnlinePaths 9500V 0115 5 0000 sddlmac 4 4 0001 sddlmad 4 4 ...

Page 479: ...he parameter value for displaying the item Table 6 16 Correspondence between the item displayed by the dlnkmgr view lu c item command and the value of the item parameter The sub parameter is t Omits the title for each information item Example The following example shows how to display a summary of LU information and selecting the items to be displayed Execute the following command to display SLPR ...

Page 480: ...characters of iLU are the CU number and the last two characters are the internal LU number within the CU The first character of a CU number is 0 For the Thunder 9500V series and Hitachi AMS2000 AMS WMS SMS series indicated by a decimal number The entire value of iLU is the internal LU number within the storage system You can identify an actual LU by referencing iLU from the storage system manageme...

Page 481: ...should check the path names to identify the path that will be affected by the change Path name consists of the following four elements separated by periods Host port number hexadecimal number Bus number hexadecimal number Target ID hexadecimal number Host LU number hexadecimal number For details about each element of the path name and its representation in Linux see Table 6 13 Elements of a path n...

Page 482: ...1 4294967295 If the total I O count reaches the maximum value it is reset and the count is re started from 0 To reset the IO Count value to 0 execute the dlnkmgr command s clear operation Executing the clear operation also resets the number of I O errors IO Errors to 0 For details about the clear operation see 6 2 clear Returns the Path Statistics to the Initial Value IO Errors 1 Total I O error c...

Page 483: ...A value of at least 0 Indicates the number of errors that occurred during intermittent error monitoring Indicates that an intermittent error occurred automatic failback does not check the path HCTL 1 SCSI device configuration information The following information is shown in a b c d format a Host port number hexadecimal number b Bus number hexadecimal number c Target ID hexadecimal number d Host L...

Page 484: ...s added and the host has not been restarted AutoPATH_ID is re assigned to each path of the LU when you execute the HDLM configuration definition utility dlmcfgmgr HDevName Host device name The name of the logical device file minus the partition number dev sddlm aa pap for the HDLM device For details on logical device files for HDLM devices see 2 6 Logical Device Files for HDLM Devices Device SCSI ...

Page 485: ...0 9980 15001 05B5 000008 sddlmah dev sdx 9970 9980 15001 05B6 KAPL01001 I The HDLM command completed normally Operation name view completion time yyyy mm dd hh mm ss 5 To display the format of the view operation help Use this parameter to display the view operation format Example The following example shows how to display the format of the view operation opt DynamicLinkManager bin dlnkmgr view hel...

Page 486: ...t dlnkmgr view lu item slpr pn cp clpr type ic ie dnu iep hctl all hdev HostDeviceName pathid AutoPATH_ID t dlnkmgr view lu c t dlnkmgr view lu c item slpr t dlnkmgr view drv t KAPL01001 I The HDLM command completed normally Operation name view completion time yyyy mm dd hh mm ss ...

Page 487: ... 4 dlmmkinitrd Utility for Supporting a Boot Disk 7 5 dlmpr Utility for Clearing HDLM Persistent Reservation 7 6 dlmsetopt Utility for Setting HDLM Driver Options 7 7 dlmstart Utility for Starting HDLM 7 8 dlmupdatesysinit Utility for Updating System Scripts 7 9 installgetras Utility for Collecting HDLM Installation Error Information 7 10 installhdlm Utility for Installing HDLM 7 11 installux sh U...

Page 488: ...rting a Boot Disk The dlmpr utility for clearing HDLM persistent reservation If the persistent reservation of the LU is not canceled for some reason this utility clears the reservation key to cancel the persistent reservation For details on the dlmpr utility see 7 5 dlmpr Utility for Clearing HDLM Persistent Reservation The dlmsetopt utility for setting HDLM driver option This utility changes the ...

Page 489: ...nstallation upgrade installation or re installation of HDLM For details on the installhdlm utility see 7 10 installhdlm Utility for Installing HDLM For details about how to perform an unattended installation see 3 6 Installing HDLM The installux sh utility for HDLM Common Installer HDLM will be installed on and installs the corresponding version of HDLM from the DVD ROM This utility can also perfo...

Page 490: ...ormation For details about the information that is stored in each file see 7 2 3 List of Collected Error Information When you want to collect information other than that in 7 2 3 List of Collected Error Information define the information to collect in the information collection definition file Information defined in information collection definition file is compressed into getras tar gz When the h...

Page 491: ...follows the OS files that are not collected by the DLMgetras utility by default and the PostgreSQL files when PostgreSQL is an upper level application program Figure 7 1 Coding Example of a File that Defines the Information to Be Collected Rules for coding a file that defines the information to be collected Use an absolute path to specify a directory or file whose information is to be collected If...

Page 492: ...nything other than y instructs the utility to terminate without executing In the latter case you can either rename the existing directory before re executing the utility or you can execute the utility with a different directory name specified If you execute the DLMgetras utility while running SUSE LINUX Enterprise Server or Red Hat Enterprise Linux AS4 ES4 EM64T AMD64 an error message KAPL05023 E ...

Page 493: ...4 Information Stored in the getras tar gz File which Is Recorded by the OS and HDLM Commands When the DLMgetras Utility Is Executed lists and describes the detailed information stored in the getras tar gz file which is recorded by the OS and HDLM commands when the DLMgetras utility is executed Table 7 3 Information Stored in the getras tar gz File lists the collected information with or without sp...

Page 494: ...2 VCS log Executed command Files Explanation bin rpm qlv clumanager or bin rpm qlv rgmanager RHCM_rpm qlv txt RHCM package file information when using Red Hat Enterprise Linux bin rpm qlv heartbeat HA_rpm qlv txt HeartBeat package file information bin rpm qlv VRTSvcs VCS_rpm qlv txt VCS package file information etc init d heartbeat status HA_status txt HeartBeat cluster status information when usi...

Page 495: ... VCS node information opt VRTSvcs bin hasys state VCS_hasys state txt VCS node status information sbin cluconfig l RHCM_cluconfig l txt RHCM cluster configuration information when using Red Hat Enterprise Linux sbin clustat RHCM_clustat txt RHCM cluster status information when using Red Hat Enterprise Linux sbin clustonith L RHCM_Clustonith L txt RHCM utility information when using Red Hat Enterpr...

Page 496: ...nfiguration file when using Red Hat Enterprise Linux IA32 EM64T AMD64 etc crypttab Block device information encrypted using LUKS when using Red Hat Enterprise Linux 5 or Red Hat Enterprise Linux 6 drbd conf DRBD settings file exports File system information exported to the network file system evms conf Default value information file when using SUSE LINUX Enterprise Server fstab Auto mount informat...

Page 497: ...and files cron file etc hotplug blacklist Information about modules that have not been loaded by a hot plug etc init d boot Script for starting and initializing when using SUSE LINUX Enterprise Server boot Script for starting and initializing when using SUSE LINUX Enterprise Server halt Shutdown script etc init d boot d all subdirectories and files Script for starting and initializing when using S...

Page 498: ...managed disks dlmmgr xml Manager setting information dlmwebagent propert ies Hitachi Command Suite Common Agent Component settings file hdlm conf iSCSI system configuration information file hdlmboot log HDLM boot log hdlm_kernel_version Information about the kernel version used when HDLM was installed hdlm_utillog conf HDLM utility log settings file etc sysconfig boot Boot process information file...

Page 499: ...itrd related file when using Red Hat Enterprise Linux 5 etc sysconfig network scripts ifcfg eth NIC network information etc syslog ng syslog ng conf syslog ng settings file when using SUSE LINUX Enterprise Server 10 or SUSE LINUX Enterprise Server 11 etc udev udev conf udev configuration file 2 udev rules udev rule file when using SUSE LINUX Enterprise Server 9 etc udev rules d rules file udev rul...

Page 500: ...MA related information drbd DRBD status information filesystems File system list interrupts Information about interruption to a processor iomem I O memory map information ioports I O port information kallsyms Kernel symbol information loadavg Information about average load time locks File lock information mdstat md device information meminfo Memory information misc MISC Driver information modules ...

Page 501: ...eter information proc sys vm All subdirectories and files Virtual memory parameter information proc xen balloon Xen related information when using SUSE LINUX Enterprise Server 10 or SUSE LINUX Enterprise Server 11 capabilities sys class fc_host All subdirectories and files Fibre Channel switch information when using Red Hat Enterprise Linux SUSE LINUX Enterprise Server 10 or SUSE LINUX Enterprise ...

Page 502: ... LINUX Enterprise Server 11 var log boot Startup log and message information when using SUSE LINUX Enterprise Server boot log Boot log when using Red Hat Enterprise Linux cron Cron log file when using Red Hat Enterprise Linux messages Syslog file including the cluster logs rpmpkgs Package information when using Red Hat Enterprise Linux AS4 ES4 or Red Hat Enterprise Linux 5 var log xen All subdirec...

Page 503: ... Common Agent Component log files dlminquiry log Inquiry information log dlmcfgmgr1 log dlmcfgmgr2 log dlmcfgmgr utility log dlmomtrace1 log dlmomtrace2 log dlmomtrace5 log On memory trace log dlnkmgr1 log dlnkmgr2 log Process specific trace information file hdlmtr1 log hdlmtr64 log Trace file var opt DynamicLinkManager log mmap dlnkmgr mm Process specific trace related file hdlmtr mm Trace manage...

Page 504: ... raw dev_raw txt List of disks to be handled as a character type device bin ls altR etc rc d rc txt List of script files when using Red Hat Enterprise Linux bin ls altR etc init d init txt List of script files when using SUSE LINUX Enterprise Server bin ls altR opt DynamicLinkManager DLMfilelist txt List of files in the opt DynamicLinkManager directory bin ls altRZ dev dev_dsk_security t xt List o...

Page 505: ... information displayed in the LWD column bin ps elT ps elT txt Thread information displayed in the SPID column bin ps elm ps elm txt Thread information displayed after process information bin ps elZ ps elZ txt Process information that contains security context information when using Red Hat Enterprise Linux bin rpm qai rpm qai txt List of installed packages bin rpm qlv HDLM HDLM_rpm qlv txt HDLM p...

Page 506: ...r lu all txt HDLM LU information all items including the number of times an intermittent error occurred opt DynamicLinkManager bin dlnkmgr view path dlmmgr path txt HDLM path information opt DynamicLinkManager bin dlnkmgr view path hbaportwwn dlmmgr path txt HDLM path information including information about the port WWN on the HBA opt DynamicLinkManager bin dlnkmgr view path iem dlmmgr path iem tx...

Page 507: ...DLM program information sbin blkid blkid txt Block device attribute information when using Red Hat Enterprise Linux 5 or Red Hat Enterprise Linux 6 sbin chkconfig list chkconfig txt Service settings sbin cryptsetup luksDump device file cryptsetup luksDum p txt LUKS header information of SCSI or HDLM device files when using Red Hat Enterprise Linux 5 or Red Hat Enterprise Linux 6 sbin cryptsetup st...

Page 508: ...g IA32 EM64T or AMD64 sbin ifconfig a ifconfig a txt Information about all NICs sbin iscsiadm m session P 3 iscsi_m_session tx t Session information at iSCSI when using Red Hat Enterprise Linux 5 or Red Hat Enterprise Linux 6 sbin iscsiadm m fw iscsi_m_fw txt Firmware information at iSCSI when using Red Hat Enterprise Linux 5 or Red Hat Enterprise Linux 6 sbin lilo t lilo t txt Boot loader informa...

Page 509: ...NUX Enterprise Server IPF sbin pvs pvs txt Physical volume information when using Red Hat Enterprise Linux 6 or SUSE LINUX Enterprise Server sbin pvscan pvscan txt Physical volume information sbin raw qa raw qa txt Character type device information when using SUSE LINUX Enterprise Server 11 sbin runlevel runlevel txt Run level information sbin sysctl A sysctl txt Kernel parameter information sbin ...

Page 510: ...m build number dlnkmgr dlmmgr DLMgetras libdlm so libhdlmhcc libhdlmhccmp dlmcfgmgr sddlmadrv ko and sddlmfdrv ko usr bin iostat iostat txt Device statistics usr bin iostat p iostat p txt Block device statistics information usr bin lsdev lsdev txt List of drivers when using SUSE LINUX Enterprise Server usr bin procinfo procinfo txt Machine information when using SUSE LINUX Enterprise Server usr bi...

Page 511: ... e udevadminfo e txt The udev database information when using Red Hat Enterprise Linux 6 or SUSE LINUX Enterprise Server 11 usr bin virsh list all virsh list txt KVM guest OS information when using Red Hat Enterprise Linux 5 or Red Hat Enterprise Linux 6 usr sbin clvmd V clvmd V txt clvmd version usr sbin crm_resource L crm_resource L txt Pacemaker resource list usr sbin getsebool a getsebool a tx...

Page 512: ...txt SELinux information when using Red Hat Enterprise Linux usr sbin vgdisplay v vgdisplay v txt Volume group information when using Red Hat Enterprise Linux AS4 ES4 or Red Hat Enterprise Linux 5 usr sbin vgs vgs txt Volume group information when using Red Hat Enterprise Linux AS4 ES4 or Red Hat Enterprise Linux 5 usr sbin xm info xm info txt Information about domain0 when using SUSE LINUX Enterpr...

Page 513: ...e the dlmcfgmgr utility is executed 7 3 1 Format sbin dlmcfgmgr s r o logical device file name of the HDLM device all i logical device file name of the HDLM device all v udev u logical device file name of the HDLM device all logfs dlmcfgmgr utility log file size 7 3 2 Parameters The following table lists and describes each parameter name and its functionality Table 7 5 Functionality of the Paramet...

Page 514: ...definition for example when changing the configuration of the storage system for example add or delete an LU or the host side hardware configuration The path definition information registered in HDLM is inherited even though the path is disconnected when the host starts If the SCSI device of the new path that HDLM detected is already registered that is when the path between the host and an LU of t...

Page 515: ...e time If the error message KAPL10357 E is displayed HDLM does not add an HDLM device even though a new LU was recognized In this case execute the dlmcfgmgr utility with the u parameter to delete the unused HDLM device This releases a usable name and you can create a logical device file for the HDLM device for a new LU Even if you execute the dlmcfgmgr utility dlmcfgmgr r to add a path to an dev s...

Page 516: ...pecified HDLM device is in use If the specified HDLM device is in use an error occurs You can use this parameter to exclude the HDLM devices that are no longer required to be managed by HDLM The excluded HDLM devices are not displayed with the dlnkmgr command s view operation and the HDLM device files for these devices are not created Therefore these devices become unavailable to the user i logica...

Page 517: ... Use this parameter to delete the paths displayed as hyphens in the Device column of HDLM device configuration information that is displayed by specifying the v parameter You can specify one or more logical device file names of an HDLM device dev sddlm aa pap as a value of the u parameter For details on logical device files for HDLM devices see 2 6 Logical Device Files for HDLM Devices Specifying ...

Page 518: ...ing this utility with the v parameter logfs dlmcfgmgr utility log file size Use this parameter to change the size of the dlmcfgmgr utility log file dlmcfgmgr 1 2 log For dlmcfgmgr utility log file size specify a value in the range from 1024 to 999999 in KB If the number of LUs to be managed by HDLM is 65 or more or the number of paths to be managed by HDLM is 129 or more we recommend that you spec...

Page 519: ... the path information from HDLM after confirming the execution of the utility In response to the confirmation message enter y to execute the utility and n not to execute the utility Example 4 To display the management status and configuration information of an HDLM device Table 7 7 Information for the Management Status and Configuration Information of an HDLM Device lists and describes the items d...

Page 520: ...aged unconfigured indicates that the HDLM device is excluded from being managed Device Indicates the paths associated with the HDLM device The logical device file of the SCSI device is indicated The path whose allocation to an LU is canceled or path that was disconnected at boot time is temporarily registered into HDLM and indicated by a hyphen This problem might also occur when the OS is SUSE LIN...

Page 521: ... as a higher level program product of HDLM accesses that HDLM device without recognizing that the LDEV was changed This might result in data corruption Check that the HDLM device name you previously used is nowhere to be found before deallocating the LDEV You cannot execute multiple instances of the dlmcfgmgr utility at the same time You cannot execute the dlmcfgmgr utility while the dlmstart util...

Page 522: ... I O error counts for existing paths displayed when the HDLM command dlnkmgr view path is executed are initialized to 0 If you execute the dlmcfgmgr utility with the r parameter specified while one or more HDLM devices are mounted an error message KAPL05023 E is output to the syslog However HDLM operations are not affected If an HDLM device that is managed on the active host is changed to be manag...

Page 523: ...device once again 3 Execute the online operation to place the device path online 4 Execute the dlmcfgmgr utility with the r parameter specified If you execute the dlmcfgmgr utility with the r parameter specified while all paths connecting to the HDLM device are disconnected the HDLM partition information will be lost from proc partitions To restore the HDLM partition information follow these steps...

Page 524: ...ry h 7 4 2 Parameters 1 For Red Hat Enterprise Linux v Specify this parameter to output a log to the console during execution of the dlmmkinitrd utility f Specify this parameter to create an initial RAM disk image file that has the same name as an existing file If you execute the dlmmkinitrd utility with this option specified the created initial RAM disk image file will be overwritten fstab fstab ...

Page 525: ...ersion hdlm Example The name of the initial RAM disk image file for the vmlinuz 2 6 16 46 0 14 bigsmp kernel is initrd 2 6 16 46 0 14 bigsmp hdlm i initrd image Specify the name of the initial RAM disk image file to be created by using the dlmmkinitrd utility This parameter is used to create an initial RAM disk image file with a name other than the default file name initrd version hdlm If you spec...

Page 526: ...ecify the path for the location in which the initial RAM disk image file is to be created This parameter is used to create an initial RAM disk image file in a directory other than the default directory boot h Displays the format of the dlmmkinitrd utility ...

Page 527: ...ayed when the k parameter is specified Reservation Key If the reservation key is not set 0x0000000000000000 is displayed Regist Key The registered keys are displayed Key Count The number of registered keys is displayed c Specify this parameter to clear the reservation key sdn Specify the SCSI device sdn for which you want to display or clear the reservation key You can specify more than one SCSI d...

Page 528: ...vation Key 0x0000000000000000 sdf Reservation Key 0x0000000000000000 Regist Key 0xaaaaaaaaaaaaaaaa Key Count 1 Regist Key 0xbbbbbbbbbbbbbbbb Key Count 1 2 Execute the dlmpr utility to clear the reservation key opt DynamicLinkManager bin dlmpr c sdb sdc 3 The confirmation message appears Enter y to clear Otherwise enter n KAPL10641 I Reservation Key will now be cleared Is this OK y n y KAPL10642 I ...

Page 529: ...ear persistent reservation specifying the SCSI device 2 Execute the dlmpr utility with the k parameter specified to display the PersistentReserve information for a SCSI device associated with a different path If the above display error occurs re execute the dlmpr utility with the k parameter specified ...

Page 530: ...ies at intervals of 0 05 seconds If retrying for a long time results in I O not being executed set an appropriate retry count If that retry count is exceeded and memory allocation fails the KAPL05708 E message is output to syslog and to the HDLM manager log file retrycount Specify a numeric value from 1 to 2 147 483 646 1 The system retries until memory is allocated This is the initial value of th...

Page 531: ...ies specified by using the inqr parameter only applies to the SCSI INQUIRY command executed from HDLM This value has no effect on the SCSI INQUIRY command executed from another application InquiryRetry Specify a numeric value in the range from 1 to 2 147 483 646 1 This sets the number of retries to 1 which is HDLM s default value 0 The system does not retry 1 to 2 147 483 646 The system retries th...

Page 532: ...7 8 conf files used by the dlmsetopt utility Table 7 8 conf files used by the dlmsetopt utility If you use the dlmsetopt utility in an environment where an HDLM device is used for the boot disk after you change the filter driver settings you must re create the initial RAM disk image file by executing the dlmmkinitrd utility If you change the name of the initial RAM disk image file change the setti...

Page 533: ...Setting file names for boot loaders Boot loader File Name LILO etc lilo conf GRUB For Red Hat Enterprise Linux etc grub conf For SUSE LINUX Enterprise Server 10 or SUSE LINUX Enterprise Server 11 boot grub menu lst ELILO etc elilo conf ...

Page 534: ...u cannot execute the dlmstart utility while the dlmcfgmgr utility is executing If you execute the dlmstart utility while one or more HDLM devices are mounted an error message KAPL05023 E is output to the syslog However HDLM operations are not affected If you execute the dlmstart utility the I O and I O error counts for existing paths displayed when the HDLM command dlnkmgr view path is executed ar...

Page 535: ...the this utility see 3 5 2 Notes on Linux 7 8 1 Format opt DynamicLinkManager bin dlmupdatesysinit Examples Example 1 In this example the HDLM information is lost in an environment that uses Red Hat Enterprise Linux In the following execution example the utility re registers the HDLM information in the rc sysinit file opt DynamicLinkManager bin dlmupdatesysinit KAPL13501 I The utility for update s...

Page 536: ...rmation is output Specify the output directory for the information collected by installgetras The collected information is compiled in the installgetras tar gz file and output to the specified directory You cannot specify the root directory for the directory to which collected information is output 7 9 3 Error Information To Be Collected The following shows the information collected when HDLM is b...

Page 537: ...eated in directory to which collected information is output specified when the installgetras utility was executed var tmp hdlminstlog All subdirectories and files Log information created during HDLM installation Output directory File Description ...

Page 538: ...lays the format of the installhdlm utility f installation information settings file name Specify this parameter when performing an unattended installation of HDLM Specify the installation information settings file for this parameter For details about the installation information settings file see 7 10 3 Editing an Installation Information Settings File 7 10 3 Editing an Installation Information Se...

Page 539: ...latio n Upgrade installatio n or re install ation licensekeyfile 1 Specify the absolute path name of a license key file that is provided in plk format The default is var tmp hdlm_license If you perform an upgrade installation or re installation without updating the license delete the licensekeyfile key and value Optional 2 Optional 2 1024 licensekey 1 Specify the absolute path name of a license ke...

Page 540: ... licensekeyfile key the specified file will not be deleted after the installhdlm utility is executed If you do not specify a value for either key the license key file var tmp hdlm_license or the file in which the license key is described etc opt DynamicLinkManager dlm lic_key will be deleted after the installhdlm utility is executed 2 When you perform a new installation of HDLM or when you perform...

Page 541: ...charac ters New installat ion Upgrad e installat ion or re insta llation load_balance Specify one of the following values to indicate whether to enable or disable the load balancing function on Enabled default off Disabled Optional Optional 3 load_balance_type Specify one of the following values to indicate the load balancing algorithm rr The Round Robin algorithm exrr The Extended Round Robin alg...

Page 542: ...le_size Set the size of the trace files hdlmtr 1 64 log in kilobytes You can set a size from 100 to 16000 The default is 1000 Optional Optional 5 trace_file_number Set the number of trace files hdlmtr 1 64 log You can set a value from 2 to 64 The default is 4 Optional Optional 2 path_health_check Specify one of the following values to indicate whether to enable or disable the path health check fun...

Page 543: ...ished until the time the next path status check started You can specify a check interval from 1 to 1440 The default is 1 Optional Optional 4 intermittent_error_m onitor 3 Specify one of the following values to indicate whether to enable or disable intermittent error monitoring on Enabled off Disabled default Optional Optional 3 intermittent_error_m onitor_interval Specify the interval in minutes t...

Page 544: ...ing shows an example of an edited installation information settings file INSTALLATION_SETTINGS licensekeyfile var tmp hdlm_license licensekey etc opt DynamicLinkManager dlm lic_key driver_config y restart n ENVIRONMENT_SETTINGS load_balance on load_balance_type exlio load_balance_same_path_use_times 32 error_log_level 3 error_log_size 9900 error_log_number 2 trace_level 0 trace_file_size 1000 trac...

Page 545: ...ded installation for HDLM Specify an installation information settings file for this parameter For details about installation information settings files see 7 10 3 Editing an Installation Information Settings File 7 11 3 Log file The installux sh utility outputs execution information to the log file var tmp hdlm_installux_sh log If the hdlm_installux_sh log log file already exists the utility appe...

Page 546: ......

Page 547: ...odes for Hitachi Command Suite Common Agent Component 8 1 Before Viewing the List of Messages 8 2 KAPL01001 to KAPL02000 8 3 KAPL03001 to KAPL04000 8 4 KAPL04001 to KAPL05000 8 5 KAPL05001 to KAPL06000 8 6 KAPL06001 to KAPL07000 8 7 KAPL07001 to KAPL08000 8 8 KAPL08001 to KAPL09000 8 9 KAPL09001 to KAPL10000 8 10 KAPL10001 to KAPL11000 8 11 KAPL11001 to KAPL12000 8 12 KAPL12001 to KAPL13000 8 13 K...

Page 548: ...Message ID KAPLnnnnn l 8 1 2 Terms Used in Messages and Message Explanations The following shows the terms that may appear in messages and message explanations Table 8 2 Terms Used in the Messages and Message Explanations 8 1 3 Components That Output Messages to syslog Some messages for the following components are output to syslog HDLM manager Format Meaning KAPL Indicates that the message is an ...

Page 549: ...8 Messages 525 HDLM driver filter component HDLM alert driver HDLM management target ...

Page 550: ...ration name aa aa Details The HDLM command was executed aa aa clear offline online set or view Action None KAPL01003 W No operation name is specified Details An operation name is missing Action Specify the operation name and then retry KAPL01004 W The operation name is invalid Operation name aa aa Details aa aa Specified operation name Action Execute the help operation of the HDLM command dlnkmgr ...

Page 551: ...not contain the necessary parameter aa aa clear set offline or view Action Execute help operation name of the HDLM command dlnkmgr to check the parameter Specify the correct parameter and then retry For details on the help operation see 6 3 help Displays the Operation Format KAPL01007 W A duplicate parameter is specified Operation name aa aa parameter bb bb Details aa aa clear offline online set o...

Page 552: ...ration of the HDLM command dlnkmgr to check whether the HDLM manager has started Start the HDLM manager if it has not started and then retry the HDLM command For details on the view operation see 6 7 view Displays Information KAPL01013 E An error occurred in internal processing of the HDLM command Operation name aa aa details bb bb Details An error unrelated to a user operation occurred during com...

Page 553: ...lue displayed in PathName Use the two leftmost digits of PathName for the relevant HBA port and then retry For details on the view operation see 6 7 view Displays Information KAPL01016 W The target CHA port was not found Operation name aa aa Details The path ID indicated by pathid and required by the cha parameter is not an object of HDLM management aa aa offline or online Action Execute the view ...

Page 554: ...offline online operation Use the view operation of the HDLM command dlnkmgr to check the settings and then retry For details on the view operation see 6 7 view Displays Information view operation Refer to3 Creating an HDLM Environment Creating an HDLM Environment or 4 6 Reconfiguring the HDLM Operating Environment and then configure any paths that exist If the same message appears again execute th...

Page 555: ...ters bb bb Details aa aa clear offline online set or view bb bb Parameters that cannot be specified at the same time Action Execute help operation of the HDLM command dlnkmgr to check which parameters can be specified at the same time and then retry For details on the help operation see 6 3 help Displays the Operation Format KAPL01036 E The Offline path cannot be placed online PathID aa aa Details...

Page 556: ...ter y or n Action Enter y or n KAPL01041 E The entered value is invalid The operation stops Operation name aa aa Details Command processing will be aborted because an incorrect value was entered three times in a row for a request aa aa clear offline online or set Action Check the correct value and then re execute the HDLM command KAPL01044 W A duplicate parameter value is specified Operation name ...

Page 557: ...ils on the help operation see 6 3 help Displays the Operation Format KAPL01049 I Would you like to execute the operation Operation name aa aa y n Details The clear set operation will be started To continue the operation enter y To cancel the operation enter n aa aa clear or set Action If you want to execute the operation enter y If you want to terminate processing enter n For details on the clear ...

Page 558: ...operation of the HDLM command dlnkmgr to check the path status For details on the view operation see 6 7 view Displays Information For details on the online operation see 6 5 online Places Paths Online KAPL01052 I The currently selected paths will be changed to the Offline C status Is this OK y n Details The offline operation will be started To continue the offline operation enter y To cancel the ...

Page 559: ...er n For details on the offline operation see 6 4 offline Places Paths Offline KAPL01055 I All the paths which pass the specified aa aa will be changed to the Offline C status Is this OK y n Details Multiple paths will be collectively set to Offline C because the hba or cha parameter was specified To collectively set multiple paths to Offline C enter y To cancel the operation enter n aa aa CHA por...

Page 560: ...ate processing enter n KAPL01058 W The specified parameter value is not needed Operation name aa aa parameter bb bb parameter value cc cc Details A parameter value was specified in a parameter that does not need a parameter value aa aa clear offline online set or view bb bb Parameter name cc cc Parameter value Action Execute help operation name of the HDLM command dlnkmgr to check the parameter an...

Page 561: ...not Operation name dd dd Details This message indicates the number of the paths processed in an online offline operation aa aa Number of paths where the online offline operation was successful decimal base 10 number bb bb Online or Offline C cc cc Number of paths where the online offline operation was unsuccessful decimal base 10 number dd dd online or offline Action None For details on the online...

Page 562: ...key will now be renewed Enter a license key Action None KAPL01069 W The entered license key is invalid Details The entered license key is invalid Action Enter a valid license key KAPL01070 E The entered license key is invalid Renewal of the license key will now stop Details The license key renewal processing will be aborted because an invalid license key was entered three times in a row Action Obt...

Page 563: ...ense has expired Register a permanent license Action Register a permanent license KAPL01074 E The emergency license expired Details The emergency license has expired Register a permanent license Action Register a permanent license KAPL01075 E A fatal error occurred in HDLM The system environment is invalid Details The license information file is missing Action Re install HDLM KAPL01076 I The perma...

Page 564: ...ing interval for automatic failbacks the error monitoring interval and the number of times the error needs to occur Action Set the intermittent error monitoring interval to a value that is equal to or greater than automatic failback checking interval x number of times error is to occur for intermittent error monitoring KAPL01081 E The license key file is invalid File name aa aa Details The format ...

Page 565: ...en re execute the HDLM command KAPL01084 W An attempt to delete the license key file has failed File name aa aa Details aa aa var tmp hdlm_license Action If the following license key file exists delete it var tmp hdlm_license KAPL01088 W The specified parameter values cannot be specified at the same time Operation name aa aa parameter bb bb parameter values cc cc Details aa aa view bb bb Parameter...

Page 566: ...nse for an upgrade or re installation KAPL01095 E An attempt to acquire the HDLM version information has failed details aa aa Details aa aa Code showing the reason for the error Action Re execute the command If the same error occurs again execute the DLMgetras utility for collecting HDLM error information acquire the error information and then contact your HDLM vendor or the company for which you ...

Page 567: ...ant to execute the operation anyway Operation name set y n Action If you want to change the load balancing algorithm for the system enter y If you want to terminate processing enter n KAPL01111 E The version of the kernel supported by the installed HDLM does not match the currently running kernel version Details The version of the kernel to which installed HDLM has adjusted and the kernel that is ...

Page 568: ...processing HDLM cannot be found Alternatively the content of a file is invalid aa aa Name of file where error was detected Action Reinstall an HDLM KAPL01114 W The audit log configuration file does not exist Restart the HDLM Manager and execute the dlnkmgr view sys audlog command and check the setting Details The audit log configuration file does not exist Action Restart the HDLM Manager and execu...

Page 569: ...rred during processing to read the audit log configuration file Details An internal error occurred while reading the audit log configuration file Action Contact your HDLM vendor or maintenance company if there is a maintenance contract for HDLM KAPL01118 W An error occurred during processing to output the audit log configuration file Details An internal parameter error when the audit log data was ...

Page 570: ...ty for Collecting HDLM Error Information KAPL01122 W The file does not exist File name aa aa Details aa aa etc DynamicLinkManager Path00 Action Reinstall HDLM KAPL01123 W You do not have read permission for the file File name aa aa Details aa aa etc DynamicLinkManager Path00 Action Execute the DLMgetras utility for collecting HDLM error information and then contact your HDLM vendor or the maintena...

Page 571: ... the maintenance company if there is a maintenance contract for HDLM For details on the DLMgetras utility see 7 2 DLMgetras Utility for Collecting HDLM Error Information KAPL01128 W HNTRLib2 initialization failed Trace per process information cannot be collected Details HNTRLib2 initialization failed Integrated trace information cannot be collected Action Execute the HDLM command as a user who has...

Page 572: ...e contract for HDLM For details on the DLMgetras utility see 7 2 DLMgetras Utility for Collecting HDLM Error Information KAPL03004 C A critical error occurred in the HDLM API aa aa Details This information is required for resolving problems aa aa API trace error information Action Execute the DLMgetras utility for collecting HDLM error information and then contact your HDLM vendor or the maintenan...

Page 573: ...s a maintenance contract for HDLM For details on the DLMgetras utility see 7 2 DLMgetras Utility for Collecting HDLM Error Information KAPL03008 E An error occurred during log input to the HDLM alert driver aa aa Details This information is required for resolving problems aa aa API trace error information Action Execute the DLMgetras utility for collecting HDLM error information and then contact y...

Page 574: ...8 Messages 550 contract for HDLM For details on the DLMgetras utility see 7 2 DLMgetras Utility for Collecting HDLM Error Information ...

Page 575: ...ity see 7 2 DLMgetras Utility for Collecting HDLM Error Information KAPL04003 E The startup parameter is invalid Details The HDLM manager internal parameter is invalid Action Execute the DLMgetras utility for collecting HDLM error information and then contact your HDLM vendor or the maintenance company if there is a maintenance contract for HDLM For details on the DLMgetras utility see 7 2 DLMgetr...

Page 576: ...If the KAPL04033 W message is not output restart HDLM manager If the same error occurs re install HDLM For details on the view operation see 6 7 view Displays Information For details on the set operation see 6 6 set Sets Up the Operating Environment KAPL04010 E Could not open the error log file Details HDLM manager cannot start normally unable to open the error log file var opt DynamicLinkManager ...

Page 577: ...n HDLM command aa aa OS error code decimal base 10 number Action Execute the DLMgetras utility for collecting HDLM error information and then contact your HDLM vendor or the maintenance company if there is a maintenance contract for HDLM For details on the DLMgetras utility see 7 2 DLMgetras Utility for Collecting HDLM Error Information KAPL04014 E Output is impossible via the communication pipe R...

Page 578: ...arning information aa aa Details This information is required for resolving problems aa aa HDLM manager trace warning information Action Execute the DLMgetras utility for collecting HDLM error information and then contact your HDLM vendor or the maintenance company if there is a maintenance contract for HDLM For details on the DLMgetras utility see 7 2 DLMgetras Utility for Collecting HDLM Error I...

Page 579: ...ing HDLM Error Information KAPL04025 C A memory shortage occurred in the HDLM manager Details There was not enough memory to run the HDLM manager processes Action To increase the amount of free memory terminate unnecessary applications or restart the host KAPL04026 I The temporary license is valid The license expires in aa aa days on bb bb Details aa aa Expiration day bb bb The year of grace 4 num...

Page 580: ...error occurred in HDLM The system environment is invalid Details A part of the HDLM configuration file is missing Action Re install HDLM KAPL04033 W The option definition file was re created Details When an existing option definition file cannot be read a new option definition file will be re created by using the default values If some of the options can be read those values can be used As for any...

Page 581: ...w start Total number of paths aa aa Details aa aa Total number of paths Action None KAPL04036 I The path health check for the path aa aa was executed Number of error paths bb bb Details aa aa Number of paths targeted for path health checking bb bb Number of paths determined to have an error by path health checking Action None KAPL04042 I HDLM SNMP TRAP information aa aa Details All the paths that ...

Page 582: ...e aa aa Details aa aa etc DynamicLinkManager Path00 Action Execute the DLMgetras utility for collecting HDLM error information and then contact your HDLM vendor or the maintenance company if there is a maintenance contract for HDLM For details on the DLMgetras utility see 7 2 DLMgetras Utility for Collecting HDLM Error Information KAPL04049 W The file is invalid File name aa aa Details aa aa etc D...

Page 583: ...e the DLMgetras utility for collecting HDLM error information and then contact your HDLM vendor or the maintenance company if there is a maintenance contract for HDLM For details on the DLMgetras utility see 7 2 DLMgetras Utility for Collecting HDLM Error Information KAPL04053 W The option definition file was recovered from a work file Action Execute the dlnkmgr view sys command to check whether t...

Page 584: ... Action Execute the utility for setting HDLM driver option dlmsetopt and increase the number of retries for allocating memory For details on the dlmsetopt utility see 7 6 dlmsetopt Utility for Setting HDLM Driver Options Increase system memory Stop any unnecessary processes If the problem is not solved execute the DLMgetras utility for collecting HDLM error information and then contact your HDLM v...

Page 585: ...ed and registered as a path aa aa Address of table for managing the HDLM filter driver hexadecimal number bb bb Path ID hexadecimal number Action None KAPL05018 W The FO processing in the path aa aa failed bb bb cc cc Check the connection status of the path aa aa If there is no problem with the connection status execute the DLMgetras utility to collect error information and then contact your vendo...

Page 586: ...rocessing of IOCTL aa aa will now start Details An IOCTL request was received aa aa IOCTL code hexadecimal number Action None KAPL05021 I Processing of IOCTL aa aa completed normally Details The processing for the requested IOCTL operation was successful aa aa IOCTL code hexadecimal number Action None KAPL05023 E Could not process the IOCTL aa aa bb bb cc cc Check the message of the HDLM command o...

Page 587: ...ecuted by a user with root permission 2 The memory size is insufficient Stop the unnecessary process 3 Make sure that the IOCTL is not issued to the device management file KAPL05701 I HDLM version aa aa Build bb bb cc cc dd dd ee ee Details The version of HDLM is shown aa aa HDLM version character string bb bb HDLM build number decimal number cc cc Days and months A D character string dd dd Time i...

Page 588: ...ied to allocate memory aa aa times but the retries failed bb bb cc cc Details aa aa Memory allocation retry count decimal number bb bb File ID line number hexadecimal number cc cc Memory allocation size hexadecimal number Action Execute the utility for setting HDLM driver option dlmsetopt and increase the number of retries for allocating memory For details on the dlmsetopt utility see 7 6 dlmsetop...

Page 589: ...h in the message was skipped for usage as an I O issuing destination because the path is currently being initialized Another path will be used for the issuing of I Os aa aa Host ID host port number decimal number bb bb Channel number path number decimal number cc cc Target ID target ID decimal number dd dd LUN Host LU number decimal number Action None KAPL05819 I Data for maintenance aa aa bb bb c...

Page 590: ...8 Messages 566 dd dd Maintenance information hexadecimal number Action None ...

Page 591: ... maintenance company if there is a maintenance contract for HDLM and report the error and detail code For details on the DLMgetras utility see 7 2 DLMgetras Utility for Collecting HDLM Error Information KAPL06007 I IOCTL processing aa aa will now start Details The IOCTL request aa aa was accepted aa aa IOCTL code hexadecimal number Action None KAPL06008 I IOCTL processing aa aa completed normally ...

Page 592: ...cting HDLM Error Information KAPL06013 E Could not write log information into the log buffer aa aa bb bb Details Log information from the filter driver was destroyed without being written to a log buffer because the attempt to reserve memory for the log information failed aa aa Message code hexadecimal number bb bb Buffer size hexadecimal number Action Check whether any other error occurred The in...

Page 593: ...LMgetras utility for collecting HDLM error information and then contact your HDLM vendor or the maintenance company if there is a maintenance contract for HDLM For details on the DLMgetras utility see 7 2 DLMgetras Utility for Collecting HDLM Error Information KAPL06100 E The version of the kernel supported by the installed HDLM does not match the currently booting kernel version Details The versi...

Page 594: ...8 Messages 570 aa aa Name of file where error was detected Action Reinstall an HDLM ...

Page 595: ...ails This message is generated by the core logic for maintenance aa aa Detailed information 1 decimal base 10 number bb bb Internal function number of the core logic decimal base 10 number cc cc Detailed information 2 decimal base 10 number dd dd Detailed information 3 decimal base 10 number Action None ...

Page 596: ...00 fixed Action Check the path in which the error was detected KAPL08022 E A path error occurred ErrorCode aa aa PathID bb bb PathName cc cc dd dd ee ee ff ff DNum gg gg HDevName hh hh Details A physical or logical error occurred in the path aa aa OS error code hexadecimal number When a path error is detected by a path health checking or the online operation Displays 0x000F0000 Fixed When a path e...

Page 597: ... same as PathName of view path hexadecimal number cc cc Bus number same as PathName of view path hexadecimal number dd dd Target ID same as PathName of view path hexadecimal number ee ee HLU number same as PathName of view path hexadecimal number ff ff Device number same as DNum of view path decimal base 10 number gg gg Host Dev name same as HDevName of view path Action None KAPL08026 E An error o...

Page 598: ... that path aa aa Path ID same as PathID of view path decimal base 10 number Action An intermittent error has occurred Check the path for any possible problems For details on what to do see 5 3 What To Do for a Path Error and switch the path shown in the message into Online KAPL08032 I A path was recovered PathID aa aa Details The path has changed to an online status aa aa Path ID same as PathID of...

Page 599: ...d OSs Supported by HDLM and install HDLM in a supported OS system KAPL09005 E Could not stop the HDLM manager Stop it manually and then try the installation program or the uninstallation program again Details An attempt to stop the HDLM manager service failed Action Stop the HDLM manager manually and then re execute the installation program or the uninstallation program KAPL09011 E Cannot find a l...

Page 600: ...twork Objectplaza Trace Library HNTRLib2 Action Manually cancel the registration of the bundle program product PP name and uninstall HNTRLib2 If the attempt to cancel the registration of the bundle PP name and to uninstall HNTRLib2 fails again contact your HDLM vendor or the maintenance company if there is a maintenance contract of HDLM KAPL09020 E An attempt to uninstall Hitachi Network Objectpla...

Page 601: ...problem Details An attempt to copy a file related to HDLM to the directory of Hitachi Command Suite products other than HDLM has failed Action Re execute the HDLM installation program KAPL09026 I Hitachi Network Objectpraza Trace Library 2 wasn t uninstalled because it was being used for other products Details Hitachi Network Objectplaza Trace Library 2 was not uninstalled because it was being use...

Page 602: ...xecute the etc init d DLMManager command with the start parameter to start the HDLM manager KAPL09037 E The status of the HDLM manager could not be checked If the HDLM manager does not start execute the etc init d DLMManager command with the start parameter to start the HDLM manager Details An attempt to acquire the status of the HDLM manager has failed Action If the HDLM manager does not start ex...

Page 603: ...ion utility dlmcfgmgr with the r parameter specified For details on the dlmcfgmgr utility see 7 3 dlmcfgmgr Utility for Managing the HDLM Configuration KAPL09040 E The file could not be edited File name aa aa Details An attempt to edit a file has failed aa aa File name Action Make sure you can edit the file aa aa KAPL09043 I The installation of aa aa completed successfully Details HDLM was install...

Page 604: ...re install HDLM Details Installation could not be executed because there was no RPM file in a suitable path Action Confirm that the installation medium is correct and then re install HDLM KAPL09047 E Downgrading from aa aa to bb bb is not supported Details Downgrade installation is not supported aa aa The version of HDLM bb bb The version of HDLM Action Uninstall HDLM and then re execute the insta...

Page 605: ...ontact of HDLM KAPL09051 E You do not have permission to execute the file File name aa aa Details Installation or uninstallation failed because there was no execution permission for a file aa aa File name Action Make sure you can execute the file shown in aa aa KAPL09076 I The permanent license was installed Details The permanent license was installed Action None KAPL09077 I The temporary license ...

Page 606: ...porary license has been installed The license expires on aa aa Details The temporary license has been installed aa aa Year 4 digits month 01 12 day 01 31 Action Install a permanent license by the expiration day KAPL09081 I The emergency license has been installed The license expires on aa aa Details The emergency license has been installed aa aa Year 4 digits month 01 12 day 01 31 Action Install a...

Page 607: ...ow terminate Obtain a valid license key and then re install HDLM Action Obtain a valid license key and then re install HDLM KAPL09090 W This operation will now be continued without updating the license Details This operation will continue without updating the license Action Install a permanent license at a later time KAPL09091 E A fatal error occurred in HDLM The system environment is invalid Cont...

Page 608: ...install aa aa aa aa The version of HDLM to be installed or the version of the HDLM SP to be installed Action Please enter y to install and n to abort the installation KAPL09094 W The entered value is invalid Re enter y n Details The message checks whether you want to correct an invalid value Action Please enter y or n KAPL09095 E The entered value is invalid The installation has been stopped Detai...

Page 609: ... and OSs Supported by HDLM KAPL09098 E An attempt to install aa aa has failed Code bb bb Details An attempt to install aa aa has failed aa aa Program name bb bb Code decimal number Action Please re install HDLM after checking the error information and resolving the problems KAPL09113 E There is no installable license key in the license key file File name aa aa Make sure that the license key file i...

Page 610: ...aa aa var tmp hdlm_license Action If a license key file exists delete it var tmp hdlm_license KAPL09116 W The command could not be installed command aa aa Details The output HDLM command cannot be used aa aa Command name Action The output command can be executed by using a different name If you want to use the output name use the output command to overwrite or re install KAPL09121 E aa aa is not p...

Page 611: ...wing operation Execution of the HDLM command s set lic operation simultaneously with an update of the license for an upgrade installation KAPL09142 E HDLM aa aa cannot be performed Wait a while and then perform aa aa again Error Code bb bb Details HDLM cannot be installed or uninstalled aa aa installation or uninstallation bb bb Internal code decimal base 10 number Action Wait a while and then rep...

Page 612: ...install HDLM KAPL09160 E HDLM does not support this kernel Install HDLM on a supported OS Details HDLM does not support the current kernel or it does not support the combination of the current CPU and the kernel Action Make sure the current kernel and the running server s CPU are of the correct type KAPL09163 E An HDLM package installable on this kernel was not found in the mount point Mount point...

Page 613: ... W The installation information settings file does not exist Details The installation information settings file specified for the second parameter does not exist Action Make sure that the path name of the installation information settings file is appropriate and then try again KAPL09199 E HDLM does not support this operating system Details HDLM does not support the currently running OS For details...

Page 614: ...9210 I aa aa will now start Details aa aa has just started aa aa installhdlm installhdlm_analysis ENVIRONMENT_SETTINGS driver_config_settings or dlmcfgmgr Action None KAPL09211 I aa aa completed successfully Details aa aa completed successfully aa aa installhdlm installhdlm_analysis ENVIRONMENT_SETTINGS driver_config_settings or dlmcfgmgr Action None KAPL09212 E aa aa ended abnormally Details aa a...

Page 615: ... installhdlm utility aa aa Error number decimal number that specifies the executed processing Action If the error code is 4 The var tmp directory does not have enough unused capacity or the user does not have write permission for it Make sure there is enough unused capacity and that the user has write permission for this directory and then try again If the error code is 6 The etc opt directory doe...

Page 616: ...bb bb Details An error occurred while reading the installation information settings file aa aa Error number decimal number that specifies the executed processing bb bb Return value decimal number of the executed processing Action If the error code is 9001 1 You do not have read permissions for the installation information settings file Make sure that you have access permissions If any other error ...

Page 617: ...error occurred in the installhdlm_analysis Error Code aa aa bb bb Details An internal error occurred in the installhdlm_analysis aa aa Error number decimal number that specifies the executed processing bb bb Return value decimal number of the executed processing Action Contact your HDLM vendor or the maintenance company if there is a maintenance contract for HDLM KAPL09220 W The composition of the...

Page 618: ...b bb line cc cc Details A key that does not exist is included aa aa Error number decimal number that specifies the executed processing bb bb Return value decimal number of the executed processing cc cc Line number decimal number of an installation information settings file Action Specify the revised installation information settings file and then retry the operation KAPL09228 W The definition of t...

Page 619: ...s a duplicated section name Error Code aa aa bb bb line cc cc Details A duplicated section name is included aa aa Error number decimal number that specifies the executed processing bb bb Return value decimal number of the executed processing cc cc Line number decimal number of an installation information settings file Action Specify the revised installation information settings file and then retry...

Page 620: ...n of the installation information settings file is too long Error Code aa aa bb bb line cc cc Details The length of a single line of the definition exceeds 1023 characters aa aa Error number decimal number that specifies the executed processing bb bb Return value decimal number of the executed processing cc cc Line number decimal number of an installation information settings file Action Specify t...

Page 621: ...ation settings file Action None KAPL09240 I There is no license key file File name aa aa If you want to update the HDLM license create a license key file referring to the HDLM installation instructions in the user s guide if necessary and then re execute the installation program Details There is no license key file aa aa dlm lic_key Action None KAPL09244 E Could not create file supporting driver u...

Page 622: ... read permission for the file File name aa aa Details aa aa etc DynamicLinkManager Path00 etc HBaseAgent Path00 Action Execute the DLMgetras utility for collecting HDLM error information and then contact your HDLM vendor or the maintenance company if there is a maintenance contract for HDLM For details on the DLMgetras utility see 7 2 DLMgetras Utility for Collecting HDLM Error Information KAPL092...

Page 623: ...rently being installed bb bb the version of HDLM or SP already installed Action An upgrade installation or re installation cannot be performed on an already installed HDLM or SP When installing HDLM First uninstall the installed HDLM or SP and then perform a new installation When installing a SP Obtain and then install an SP or corrected version that can be applied to the installed version of HDLM...

Page 624: ... message aa aa Directory name Action Download the installation file for the SP version again Then retry the installation KAPL09601 E Cannot install in this system Install HDLM on a supported OS Details HDLM cannot be installed on this system Action Execute the following command in place of installux sh DVD mount point HDLM_Linux installhdlm KAPL09602 E The installation will now stop because a file...

Page 625: ... not damaged If an installation is performed by using files copied from the DVD ROM re copy all of the DVD ROM files After that confirm the permission of the HDLM utility that caused the error When the output information is an OS command Confirm that the OS command exists and that you have the proper permission KAPL09604 E A system error occurred The installation will now stop command aa aa error ...

Page 626: ...r information and then retry For details on the DLMgetras utility see 7 2 DLMgetras Utility for Collecting HDLM Error Information KAPL10003 W The first parameter has not been set to a directory Value aa aa Details A value which is not a directory name is set for the first parameter The first parameter must be a directory to which collected information will be output aa aa First parameter Action Ch...

Page 627: ...to be collected does not exist or cannot be read Value aa aa Details The file for defining the information to be collected does not exist or the specified file exists but the permission to read the file is missing aa aa Name of the file for defining the information to be collected Action Check whether the specified file for defining the information to be collected exists and check whether you have...

Page 628: ...or press any other key to terminate the DLMgetras utility for collecting HDLM error information without executing it For details on the DLMgetras utility see 7 2 DLMgetras Utility for Collecting HDLM Error Information KAPL10010 W A root directory has been specified Line aa aa Details The root has been specified as a directory to be collected in the file for defining the information to be collected...

Page 629: ...Details The specified file or directory does not exist in the file for defining the where information is to be collected aa aa Line number of the file for defining which information to be collected decimal base 10 number bb bb Indicated contents of a line Action After the DLMgetras utility for collecting HDLM error information terminates check the contents of the file for defining the information ...

Page 630: ...ne Action After the DLMgetras utility for collecting HDLM error information terminates check the contents of the file for defining the information to be collected This file is shown in the message If the contents of the file are incorrect correct them and then try to collect error information again The DLMgetras will ignore the specified file and continue processing For details on the DLMgetras ut...

Page 631: ...ot permissions Action Re execute as a user with root permissions For details on the DLMgetras utility see 7 2 DLMgetras Utility for Collecting HDLM Error Information KAPL10020 I The file has been obtained successfully File aa aa Collection time bb bb GMT bb bb Details The file to be collected has been obtained aa aa Collected file name bb bb Year month day hour minute second Action None KAPL10021 ...

Page 632: ...ls on the DLMgetras utility see 7 2 DLMgetras Utility for Collecting HDLM Error Information KAPL10031 W The entered value is invalid Continue operation y n Details A value other than y or n has been entered for a y n request Enter y or n Action Enter y or n KAPL10032 W The entered value is invalid The utility for collecting HDLM error information stops Details Processing of the DLMgetras utility f...

Page 633: ...d Details aa aa Details Execution of the tar command failed aa aa tar command output message Action See the details in the message and then remove the cause of the error For information about the error collect the archive in the output directory specified at the time of execution and then contact your HDLM vendor or your maintenance company if you have a maintenance contract for HDLM KAPL10036 E A...

Page 634: ... information collection command aa aa Return value bb bb Execution time cc cc Details aa aa Executed command bb bb Return value of the executed command cc cc Year 4 digits month day hour minute second Action None KAPL10050 I The utility for collecting HDLM error information started Start time aa aa GMT aa aa Details aa aa Year 4 digits month day hour minute second Action None KAPL10301 I sbin dlmc...

Page 635: ...e maintenance company if there is a maintenance contract for HDLM For details on the DLMgetras utility see 7 2 DLMgetras Utility for Collecting HDLM Error Information KAPL10306 W The configuration definition file is invalid Refer to the Messages section of the HDLM User s Guide for instructions to correct this problem Details The configuration definition file etc opt DynamicLinkManager dlmfdrv con...

Page 636: ...xist Check the system configuration Details The HDLM management target device does not exist Action Check the system configuration KAPL10312 I HDLM has created an HDLM device special file Device aa aa Details A logical device file for an HDLM device has been created aa aa Logical device file name of HDLM device Action None KAPL10313 I HDLM has deleted an HDLM device special file Device aa aa Detai...

Page 637: ...l error occurred in the HDLM configuration definition utility dlmcfgmgr Code aa aa Errno bb bb cc cc Execute the DLMgetras utility to collect error information and then contact your vendor or maintenance company Details An internal error occurred in the HDLM configuration definition utility dlmcfgmgr aa aa Line number in which the error occurred decimal number bb bb Error number errno decimal numb...

Page 638: ...ity for collecting HDLM error information and then contact your HDLM vendor or maintenance company if you have a maintenance contract for HDLM For details on the DLMgetras utility see 7 2 DLMgetras Utility for Collecting HDLM Error Information For details on the dlmcfgmgr utility see 7 3 dlmcfgmgr Utility for Managing the HDLM Configuration KAPL10321 W The specified HDLM device is invalid Device a...

Page 639: ...ls on the DLMgetras utility see 7 2 DLMgetras Utility for Collecting HDLM Error Information KAPL10323 E The registration of the block device driver for HDLM failed All dynamic major numbers are exhausted Unload remove from the kernel an unnecessary driver and then execute the dlmcfgmgr utility again Details Registration of the block device driver of HDLM failed because all dynamic major numbers we...

Page 640: ...ility for Collecting HDLM Error Information KAPL10326 E You lack permission for executing the HDLM configuration definition utility Execute the dlmcfgmgr utility as a user with root permission Details The current user does not have authority to execute the HDLM configuration definition utility dlmcfgmgr Action Re execute the dlmcfgmgr utility as a user with root permission For details on the dlmcf...

Page 641: ...the HDLM User s Guide for instructions to correct this problem Details The file could not be opened aa aa File name bb bb Error number decimal number Action Confirm the existence of the file If there is no problem and then execute the DLMgetras utility for collecting HDLM error information and then contact your HDLM vendor or the maintenance company if there is a maintenance contract for HDLM For ...

Page 642: ...ndor or the maintenance company if there is a maintenance contract for HDLM For details on the DLMgetras utility see 7 2 DLMgetras Utility for Collecting HDLM Error Information KAPL10332 E The registering of the partition information for HDLM device s failed Errno aa aa Execute the DLMgetras utility to collect error information and then contact your vendor or maintenance company Details An attempt...

Page 643: ...tion and then contact your vendor or maintenance company Details An attempt to issue an IOCTL call has failed aa aa IOCTL name bb bb Error number decimal number Action Execute the DLMgetras utility for collecting HDLM error information and then contact your HDLM vendor or the maintenance company if there is a maintenance contract for HDLM For details on the DLMgetras utility see 7 2 DLMgetras Util...

Page 644: ...lete the file shown in File name KAPL10337 W A special device exists with a different major number The device will now be unlinked Device aa aa Details The HDLM device indicated by aa aa was deleted because the major number for its logical device file is invalid aa aa Logical device file name of the HDLM device Action None KAPL10338 W A directory cannot be deleted Directory aa aa Manually delete t...

Page 645: ...3 dlmcfgmgr Utility for Managing the HDLM Configuration KAPL10341 I The HDLM device configurations have been changed Details The configuration of a HDLM device was changed by execution of the HDLM configuration definition utility dlmcfgmgr Action None For details on the dlmcfgmgr utility see 7 3 dlmcfgmgr Utility for Managing the HDLM Configuration KAPL10343 I HDLM has detected and registered a ne...

Page 646: ...number Action None For details on the dlmcfgmgr utility see 7 3 dlmcfgmgr Utility for Managing the HDLM Configuration KAPL10345 I HDLM has unregistered the existing path to an HDLM device HDLM device aa aa Device bb bb Host cc cc Channel 0 ID dd dd Lun ee ee Details By executing the HDLM configuration definition utility dlmcfgmgr the existing path has been unregistered from the registered HDLM dev...

Page 647: ...ed from HDLM management aa aa Logical device file name of HDLM device Action None For details on the dlmcfgmgr utility see 7 3 dlmcfgmgr Utility for Managing the HDLM Configuration KAPL10348 I The HDLM device is now under management HDLM device aa aa Details By executing the HDLM configuration definition utility dlmcfgmgr the HDLM device has been placed under HDLM management aa aa Logical device f...

Page 648: ...e HDLM driver opt DynamicLinkManager bin dlminsadrv modprobe sddlmfdrv 2 Re execute the dlmcfgmgr utility For details on the dlmcfgmgr utility see 7 3 dlmcfgmgr Utility for Managing the HDLM Configuration KAPL10351 E The specified HDLM configuration definition utility is invalid Operation name aa aa Parameter bb bb Details An attempt to execute the HDLM configuration definition utility dlmcfgmgr f...

Page 649: ...tras utility to collect error information and then contact your vendor or maintenance company Details An error occurred during acquisition of the HDLM file aa aa backup aa aa File name Action Execute the DLMgetras utility for collecting HDLM error information and then contact your HDLM vendor or the maintenance company if there is a maintenance contract for HDLM For details on the DLMgetras utilit...

Page 650: ...d not be released Major number aa aa Refer to the Messages section of the HDLM User s Guide for instructions to correct this problem Details An attempt to release an intact major number aa aa has failed aa aa Major number decimal number Action Restart the host If the host does not recover execute the DLMgetras utility for collecting HDLM error information and then contact your HDLM vendor or the m...

Page 651: ...e execute the dlmcfgmgr utility For details on the dlmcfgmgr utility see 7 3 dlmcfgmgr Utility for Managing the HDLM Configuration KAPL10359 E Multiple instances of the HDLM configuration definition utility cannot be executed concurrently Wait until the running dlmcfgmgr utility ends and then try the dlmcfgmgr utility again Details An attempt to execute dlmcfgmgr failed because two or more instanc...

Page 652: ...LM device has been made inactive aa aa HDLM device name bb bb SCSI device name cc cc Host ID decimal number Channel Channel ID fixed value 0 decimal number dd dd Target ID decimal number ee ee LUN decimal number Action None For details on the dlmcfgmgr utility see 7 3 dlmcfgmgr Utility for Managing the HDLM Configuration KAPL10362 W HDLM has detected an active path that cannot be deleted HDLM devi...

Page 653: ...ntenance company Details When HDLM configuration Definition Utility dlmcfgmgr was executed a mismatch of HDLM device configuration information was detected aa aa Logical device file name of HDLM device Action Execute the DLMgetras utility for collecting HDLM error information and then contact your HDLM vendor or the maintenance company if there is a maintenance contract for HDLM For details on the...

Page 654: ...ition utility dlmcfgmgr with the v option and then check the configuration of the HDLM device For details on the dlmcfgmgr utility see 7 3 dlmcfgmgr Utility for Managing the HDLM Configuration KAPL10366 I Unsupported SCSI device was found Device aa aa Details The SCSI device output in this message is not supported aa aa Logical device file name of HDLM device Action None KAPL10641 I Reservation Ke...

Page 655: ...cute the dlmpr h utility to check the parameter and then retry execution For details on the dlmpr utility see 7 5 dlmpr Utility for Clearing HDLM Persistent Reservation KAPL10645 W A parameter value is invalid parameter aa aa Details An invalid parameter value has been specified for the dlmpr utility aa aa Specified parameter Action Specify the correct value for the parameter and then retry For de...

Page 656: ...s a maintenance contract for HDLM When the error code is 4 or 5 Make sure that the SCSI device file permissions permit reading and writing For details on the dlmpr utility see 7 5 dlmpr Utility for Clearing HDLM Persistent Reservation KAPL10649 E aa aa An attempt to perform Reservation Key clear processing has failed Details An attempt to perform reservation key clear processing has failed aa aa H...

Page 657: ...tent Reservation KAPL10653 W The entered value is invalid Please re enter it y n Details A value other than y or n has been entered for a y n request Action Enter y or n KAPL10665 I The dlmpr utility completed Details The dlmpr utility completed normally Action None For details on the dlmpr utility see 7 5 dlmpr Utility for Clearing HDLM Persistent Reservation KAPL10920 W Processing for HDLM Confi...

Page 658: ...ile necessary for processing HDLM cannot be found Alternatively the content of a file is invalid aa aa Name of file where error was detected Action Reinstall an HDLM KAPL10934 W A file could not be opened File name etc opt DynamicLinkManager hdlm_utillog conf Errno aa aa Refer to the Messages section of the HDLM User s Guide for instructions to correct this problem Details An attempt to open the s...

Page 659: ...tras utility see 7 2 DLMgetras Utility for Collecting HDLM Error Information KAPL10936 W The file format is invalid File name etc opt DynamicLinkManager hdlm_utillog conf Refer to the Messages section of the HDLM User s Guide for instructions to correct this problem Details The format of the settings file for the HDLM utility log etc opt DynamicLinkManager hdlm_utillog conf is invalid A maximum lo...

Page 660: ... in HDLM see 3 1 12 Number of Paths Supported in HDLM KAPL10938 I dlmcfgmgr Log File Size KB aa aa Details aa aa The setup value or default value of dlmcfgmgr Log File Size Action None KAPL10939 W An error occurred during processing to read a file File name aa aa Details An error occurred during processing to read a file aa aa File name Action Follow the instructions in the message that was output...

Page 661: ...d then contact your HDLM vendor or the maintenance company if there is a maintenance contract for HDLM For details on the DLMgetras utility see 7 2 DLMgetras Utility for Collecting HDLM Error Information KAPL10942 W Memory could not be allocated Size aa aa Errno bb bb Details Memory could not be allocated aa aa Size bb bb Errno Action Confirm that the configuration for HDLM devices is correct If i...

Page 662: ...LM For details on the DLMgetras utility see 7 2 DLMgetras Utility for Collecting HDLM Error Information KAPL10944 I Checking will now start Checking interval aa aa Check count bb bb Maximum wait time cc cc Details Checking will now start aa aa Checking interval bb bb Check count cc cc Maximum wait time Action None KAPL10948 W An invalid entry is registered in the file File name aa aa Details An in...

Page 663: ...8 Messages 639 iscsi_boot y KAPL10949 E A necessary file was not found File name aa aa Details A necessary file was not found aa aa File name Action Reinstall an HDLM ...

Page 664: ...ion Clear Data Get HDLM Manager Status Get HDLM Driver Status Get HDLM Alert Driver Status Get SNMP Trap Information Set SNMP Trap Information Set LU Load Balance Get Path Status Log Information Get Local Time Action None KAPL11902 I aa aa has started PathID bb bb Details The operation has started on the host aa aa Operation character string Online Offline bb bb The Path ID of the target path deci...

Page 665: ...Data Get HDLM Driver Status Get HDLM Manager Status Get HDLM Alert Driver Status Online Offline Get SNMP Trap Information Set SNMP Trap Information Set LU Load Balance Get Path Status Log Information Get Local Time Action None KAPL11904 E aa aa has completed abnormally Error status bb bb Details The operation has completed abnormally on the host aa aa Operation character string Get Path Informatio...

Page 666: ...ntract for HDLM For details on the DLMgetras utility see 7 2 DLMgetras Utility for Collecting HDLM Error Information KAPL11905 E An unexpected error occurred Details An exception occurred during processing on the host Action Execute the DLMgetras utility for collecting HDLM error information and then contact your HDLM vendor or the maintenance company if you have a maintenance contract for HDLM Fo...

Page 667: ...ils This information is required for resolving problems aa aa XML information character string Action None KAPL11908 I XML transmission aa aa Details This information is required for resolving problems aa aa XML information character string Action None ...

Page 668: ... necessary for processing HDLM cannot be found Alternatively the content of a file is invalid aa aa Name of file where error was detected Action Reinstall an HDLM KAPL12301 E This script can only be executed with the name dlmmkinitrd Action Please rename the script to dlmmkinitrd KAPL12302 E Multiple instances of the utility for supporting the boot disk cannot be executed concurrently Action Wait ...

Page 669: ...achi DynamicLinkManager When Red Hat Enterprise Linux 6 is being used lib modules 2 6 32 xxx extra hitachi DynamicLinkManager In the list shown below kernel version indicates the value displayed by the uname r command etc opt DynamicLinkManager dlmmkinitrd conf lib modules kernel version kernel drivers DynamicLinkManager sddlmfdrv o lib modules kernel version kernel drivers DynamicLinkManager sddl...

Page 670: ... being mounted Mount point aa aa Details aa aa Mount point to be used Action None KAPL12309 I Required files are being copied to the initial ramdisk Action None KAPL12310 I The linuxrc executable is being created Action None KAPL12311 I The fstab file for the initial ramdisk is being created Action None KAPL12312 I The directories for the initial ramdisk are being created Action None KAPL12313 I I...

Page 671: ...ion on which the root is mounted Action None KAPL12318 W For Red Hat Enterprise Linux Usage opt DynamicLinkManager bin dlmmkinitrd v f fstab fstab name initrd image kernel version For SUSE LINUX Enterprise Server 10 or SUSE LINUX Enterprise Server 11 Usage opt DynamicLinkManager bin dlmmkinitrd i initrd image b boot directory h Action Confirm the parameters specified when the dlmmkinitrd utility f...

Page 672: ...erwrite the file even if the f parameter is specified To overwrite the file it is necessary to delete the directory first KAPL12321 E An invalid root partition is specified in the file File name aa aa Details aa aa The name of the file containing the invalid root partition entry Action Change the root partition specified in the etc fstab file to a SCSI or HDLM device or specify settings so that HD...

Page 673: ...responding to the output command and then retry Re execute the dlmmkinitrd utility for supporting the boot disk after performing the next check according to the outputted command And if the error message is outputted before this message remove the cause of the error with reference to the contents of the message cp Confirm that there is enough unused capacity and that the user has write permission ...

Page 674: ...he user has write permission in the following directory etc opt DynamicLinkManager opt DynamicLinkManager The root directory mount Confirm that there is unused capacity in the loop device umount A temporary file remains so do the following 1 Unmount etc opt DynamicLinkManager tmp initrdmnt is a process ID 2 Remove the etc opt DynamicLinkManager tmp initrdmnt is a process ID file vol_id Confirm tha...

Page 675: ...me LVM2 on an HDLM Device Is Used as a Boot Disk filter types md_component_detection In the case of etc opt DynamicLinkManager dlmmkinitrd conf file Install an HBA driver which is supported as a boot disk by HDLM Or use an HBA which is supported as a boot disk by HDLM In the case of etc sysconfig kernel file The OS environment is incorrect Add the names of the HBA drivers that have to be included ...

Page 676: ...o the message is installed 2 In Red Hat Enterprise Linux confirm the kernel version specified as a parameter For the details of the parameter see 7 4 dlmmkinitrd Utility for Supporting a Boot Disk If the problem is not solved execute the DLMgetras utility for collecting HDLM error information and then contact your HDLM vendor or the maintenance company if there is a maintenance contract for HDLM F...

Page 677: ...Server 11 is used The line of INITRD_MODULES of a etc sysconfig kernel file Also make sure that the HBA driver has been installed KAPL12334 E Multiple root partition entries exist in the file File name aa aa Details aa aa The name of the file referenced by the dlmmkinitrd utility for supporting the boot disk Action Modify the fstab file specified in the fstab parameter of the boot disk support uti...

Page 678: ...ABEL information on the root partition were not able to be acquired Action Confirm UUID or LABEL is set to the root partition Set UUID or LABEL to the root partition when it is not set and re execute the dlmmkinitrd utility for supporting the boot disk KAPL12338 E The command does not exist or does not have executable permissions Command name aa aa Details There is no command or the user does not ...

Page 679: ...g the package of the kernel after installing HDLM Action Install HDLM that adjusts to the kernel that is running now KAPL12346 E The HDLM file is invalid File name aa aa Details A file necessary for processing HDLM cannot be found Alternatively the content of a file is invalid aa aa Name of file where error was detected Action Reinstall an HDLM KAPL12551 E The utility for setting HDLM driver optio...

Page 680: ... HDLM driver option has started Action None KAPL12555 I The utility for setting HDLM driver option completed normally Action None KAPL12556 I An attempt to execute the utility for setting HDLM driver option has failed Action Check the action recommended in the error message output before this message and take action accordingly KAPL12557 I The user stopped the utility for setting HDLM driver optio...

Page 681: ...lity for Setting HDLM Driver Options specify the correct argument and then re execute the dlmsetopt utility KAPL12561 E An invalid option was specified Option aa aa Details aa aa Option Action Refer to 7 6 dlmsetopt Utility for Setting HDLM Driver Options specify the correct argument and then re execute the dlmsetopt utility KAPL12562 E A necessary file or directory was not found File or directory...

Page 682: ...ile name aa aa Details aa aa Name of file to be updated Action Make sure there is enough free disk capacity and then re execute the utility for setting HDLM driver option dlmsetopt If this message still appears stop any unnecessary processes and then re execute the dlmsetopt utility KAPL12566 E The utility for setting HDLM driver option was executed and ended abnormally last time Action Compare th...

Page 683: ...es not match the currently running kernel version Details The version of the kernel to which installed HDLM has adjusted and the kernel that is running now is not corresponding There is a possibility of installing the package of the kernel after installing HDLM Action Install HDLM that adjusts to the kernel that is running now KAPL12568 E The HDLM file is invalid File name aa aa Details A file nec...

Page 684: ...ow is not corresponding There is a possibility of installing the package of the kernel after installing HDLM Action Install HDLM that adjusts to the kernel that is running now KAPL12852 E The HDLM file is invalid File name aa aa Details A file necessary for processing HDLM cannot be found Alternatively the content of a file is invalid aa aa Name of file where error was detected Action Reinstall an...

Page 685: ...kernel that is running now KAPL12902 E The HDLM file is invalid File name aa aa Details A file necessary for processing HDLM cannot be found Alternatively the content of a file is invalid aa aa Name of file where error was detected Action Reinstall an HDLM ...

Page 686: ...etras utility for collecting HDLM error information and then contact your HDLM vendor or the maintenance company if you have a maintenance contract for HDLM For details on the DLMgetras utility see 7 2 DLMgetras Utility for Collecting HDLM Error Information KAPL13206 W The file is invalid File name aa aa Details aa aa etc DynamicLinkManager Path00 etc HBaseAgent Path00 Action Reinstall HDLM KAPL13...

Page 687: ... utility for collecting HDLM install error information and then retry KAPL13403 E You lack write permission for the specified directory Value aa aa Details You do not have write permission for the specified directory or the creation of a subdirectory of the specified directory failed aa aa first parameter Action Check the following 1 Check whether you have access permission for the specified direc...

Page 688: ...ror information and then retry KAPL13406 E You lack privileges for executing the utility for collecting HDLM install error information Details The utility for collecting HDLM install error information must be executed by a root user Action Retry as a user with root permissions KAPL13407 I The file has been obtained successfully File aa aa Collection time bb bb GMT cc cc Details The file to be coll...

Page 689: ... A user terminated the utility for collecting HDLM install error information Details The processing of the utility for collecting HDLM install error information has been terminated as n was sent to a confirmation Action None KAPL13411 W The entered value is invalid Continue operation y n Details A value other than y or n has been entered for a y n request Enter y or n Action Enter y or n KAPL13412...

Page 690: ...k the system configuration KAPL13415 E An attempt to archive the install error information failed Details aa aa Details Execution of the tar command failed aa aa tar command output message Action See the details in the message and then remove the cause of the error For information about the error collect the archive in the output directory specified at the time of execution and then contact your H...

Page 691: ...ils The install error information does not exist Action After installing HDLM re execute the installgetras utility KAPL13418 E Too many parameters have been specified Details Two or more parameters have been specified Action Check the parameters of the utility for collecting HDLM install error information and then retry KAPL13501 I The utility for update system scripts started Action None KAPL1350...

Page 692: ...led File name aa aa Details aa aa File name of the system script that could not be modified Action Resolve the problem according to the message KAPL13521 E which was output just before this message KAPL13507 E Modification of a symbolic link has failed Symbolic link name aa aa Details aa aa Name of the file whose symbolic link could not be modified Action Resolve the problem according to the messa...

Page 693: ...y for Updating System Scripts KAPL13511 E The version of the kernel supported by the installed HDLM does not match the currently running kernel version Details The version of the kernel to which installed HDLM has adjusted and the kernel that is running now is not corresponding There is a possibility of installing the package of the kernel after installing HDLM Action Install HDLM that adjusts to ...

Page 694: ...stem Scripts KAPL13516 E A file required by HDLM not found File name aa aa Details aa aa file name Action Check for and if necessary restore the file indicated in the message Next execute the dlmupdatesysinit utility Refer to 7 8 dlmupdatesysinit Utility for Updating System Scripts KAPL13517 E A directory required by HDLM not found Directory name aa aa Details aa aa directory name Action Check for...

Page 695: ...a aa Details aa aa Directory name Action Reinstall an HDLM KAPL13521 E A command has failed Command aa aa Details bb bb Details aa aa Command that failed bb bb Message that the command output Action Remove the error cause described in the message output by the command indicated in the message KAPL134521 E Next re execute the dlmupdatesysinit utility Refer to 7 8 dlmupdatesysinit Utility for Updati...

Page 696: ...ails The audit log configuration file cannot be opened Action If the dlnkmgr view sys audlog command does not display a normal result contact your HDLM vendor or maintenance company if there is a maintenance contract for HDLM KAPL13603 W The audit log configuration file is invalid Restart the HDLM Manager and execute the dlnkmgr view sys audlog command and check the setting Details The audit log c...

Page 697: ...ance contract for HDLM KAPL13606 W An error occurred during processing to output the audit log configuration file Details An internal error occurred during output of the audit log data Action Contact your HDLM vendor or the maintenance company if there is a maintenance contract for HDLM KAPL13901 I The utility for HDLM start completed successfully Action None KAPL13902 I Alert driver had been load...

Page 698: ...r s loading dlmcfgmgr or DLMManager Action None KAPL13907 I aa aa completed successfully Details aa aa Alert driver s loading The process related to Alert driver Filter driver s loading dlmcfgmgr or DLMManager Action None KAPL13908 W An error occurred in processing of module Module aa aa Details In processing of the utility for HDLM start an error occurred at Module aa aa aa aa Module name at whic...

Page 699: ... abnormally Error Code aa aa Details aa aa Error number that identifies the executed processing decimal number Action When the error code is 1 When dev dlm sddlmadrv0 file or a file other than character device file delete it manually and then retry the execution When the error code is 2 sbin dlmcfgmgr file does not exist or does not have executable permissions Reinstall an HDLM When the error code...

Page 700: ...n modprobe Reinstall an HDLM When the command is bin mknod Remove the error cause described in the message output by the command indicated in the message KAPL13913 E Next re execute the utility for HDLM start if necessary Refer to 7 7 dlmstart Utility for Starting HDLM KAPL13914 E A file required by HDLM not found File name aa aa Details aa aa file name Action Reinstall an HDLM ...

Page 701: ... Line aa aa Details aa aa Name of the utility that the user executed KAPL15040 I Creation of the HDLM configuration file and addition of HDLM devices succeeded Command Line aa aa Details aa aa Name of the utility that the user executed KAPL15041 E An attempt to create an HDLM configuration file and add HDLM devices has failed Command Line aa aa Details aa aa Name of the utility that the user execu...

Page 702: ...utility that the user executed KAPL15047 E An attempt to display the management status and configuration information of HDLM devices has failed Command Line aa aa Details aa aa Name of the utility that the user executed KAPL15048 I The status of HDLM devices was checked and then the unusable devices were successfully removed Command Line aa aa Details aa aa Name of the utility that the user execut...

Page 703: ...ory has failed Command Line aa aa Details aa aa Name of the utility that the user executed KAPL15054 I The timeout value for the SCSI INQUIRY command was successfully set Command Line aa aa Details aa aa Name of the utility that the user executed KAPL15055 E An attempt to set the timeout value for the SCSI INQUIRY command has failed Command Line aa aa Details aa aa Name of the utility that the use...

Page 704: ...the user executed KAPL15061 I DLMgetras successfully executed Command Line aa aa Details aa aa Name of the utility that the user executed KAPL15062 I Processing to start HDLM was successful Command Line aa aa Details aa aa Name of the utility that the user executed KAPL15063 E Processing to start HDLM failed Command Line aa aa Details aa aa Name of the utility that the user executed KAPL15064 I Re...

Page 705: ...iled Command Line aa aa Details aa aa Command that the user executed KAPL15103 I aa aa path s were successfully placed bb bb cc cc path s were not Command Line dd dd Details aa aa Number of paths where online offline is successful bb bb Online or Offline C cc cc Number of paths where online offline is unsuccessful dd dd Command that the user executed KAPL15104 W aa aa path s were failed to place b...

Page 706: ...he user executed KAPL15109 I Information about HDLM management targets was successfully displayed Command Line aa aa Details aa aa Command that the user executed KAPL15110 E An attempt to display information about HDLM management targets has failed Command Line aa aa Details aa aa Command that the user executed KAPL15111 W The HDLM command was started or stopped by the user who does not have the a...

Page 707: ...8 Messages 683 KAPL15404 W The HDLM Manager was executed by the user who does not have the authority ...

Page 708: ... again 1003 Details No path was detected Action Check whether a path between the host and the storage system is connected If a path is connected check whether HDLM is configured correctly 1004 Details Memory required for HDLM internal processing could not be allocated Action Terminate unnecessary applications to increase free memory or restart the host 1006 Details An Offline path cannot be placed...

Page 709: ...e host information and then check the path status 1019 Details An error occurred during HDLM internal processing Action Execute the DLMgetras utility for collecting HDLM error information and then contact your HDLM vendor or the maintenance company if you have a maintenance contract for HDLM For details on the DLMgetras utility see 7 2 DLMgetras Utility for Collecting HDLM Error Information 1020 D...

Page 710: ...em was attempting to acquire the path information Action Refresh the host information check the path status and then perform the operation again 1027 Details The error monitoring interval and the number of times that the error needs to occur are conflicting with the automatic failback checking interval Action Set the intermittent error monitoring interval to a value that is equal to or greater tha...

Page 711: ...he command If the same error occurs again execute the DLMgetras utility for collecting HDLM error information and then contact your HDLM vendor or maintenance company if there is a maintenance contract for HDLM For details on the DLMgetras utility see 7 2 DLMgetras Utility for Collecting HDLM Error Information 1036 Details An attempt to acquire information about the HDLM version or SP version has ...

Page 712: ...information held by HDLM Action Refresh the host information check the path status and then perform the operation again 1045 Details A parameter is invalid Action Refresh the host information and then perform the operation again If the same error occurs even again execute the DLMgetras utility for collecting HDLM error information and then contact your HDLM vendor or maintenance company if you hav...

Page 713: ...8 Messages 689 utility see 7 2 DLMgetras Utility for Collecting HDLM Error Information ...

Page 714: ......

Page 715: ...691 Appendixes A Notes on Linux Commands and Files B Troubleshooting Products That Use the Weak Modules Script C Functional Differences Between Versions of HDLM D Glossary ...

Page 716: ...wing is an example of output statistics Figure A 1 Example of a Displayed proc partitions File A 2 Notes on Linux Commands When a host and storage system are connected by multiple paths HDLM uses all of these paths as HDLM devices Consequently with Open and Close system calls to the HDLM device open or close processing occurs on each of the multiple paths Linux commands that issue successive Open ...

Page 717: ... an HDLM device is displayed only when the HDLM device is specified for the iostat command in such case as iostat x dev sddlmaa The information CPU or I O statistics displayed for the HDLM device is always 0 and the actual value is displayed for each SCSI device that conforms to the HDLM device If you are going to obtain information about an HDLM device perform calculations by using the value of a...

Page 718: ...sk command with the name of a logical device file of the HDLM device specified Up to 15 partitions can be created just as for a SCSI device In addition by setting up partitions in an HDLM device partitions can be set up in a corresponding SCSI device at the same time However partitions for a device managed by HDLM will not be automatically created at the same time even when partitions are created ...

Page 719: ...ave been created on an HDLM device using the fdisk or parted command some of the partitions created by the fdisk command might not be visible to the parted command Likewise some of the partitions created by the parted command might not be visible to the fdisk command For this reason if partitions that are created using the fdisk command are modified using the parted command the partition informati...

Page 720: ...created on an md device you can rename a volume group or a logical volume by using the vgrename or lvrename command After renaming if the vgdisplay v D command vgscan or lvscan command is executed the information from the previous volume group or logical volume might be displayed To display information from after the change deactivate the volume group and then activate the volume group after resta...

Page 721: ...of product scripts grep weak modules If you do not know the package file name of the product that uses the weak modules script perform the procedures described in B 1 Installing Products That Use the Weak Modules Script or B 2 Uninstalling Products That Use the Weak Modules Script If no message is output after executing the above rpm command the product does not use the weak modules script You can...

Page 722: ...fstab dev VolGroup00 LogVol00 ext3 defaults 1 1 dev VolGroup00 LogVol02 tmp ext3 defaults 1 2 dev VolGroup00 LogVol04 usr ext3 defaults 1 2 dev VolGroup00 LogVol03 opt ext3 defaults 1 2 dev sda1 boot ext3 defaults 1 2 dev sddlmaa1 boot ext3 defaults 1 2 tmpfs dev shm tmpfs defaults 0 0 devpts dev pts devpts gid 5 mode 620 0 0 sysfs sys sysfs defaults 0 0 proc proc proc defaults 0 0 dev VolGroup00 ...

Page 723: ...ot loader is grub and LVM is used title Red Hat Enterprise Linux Server 2 6 18 92 el5 HDLM root hd0 0 kernel vmlinuz 2 6 18 92 el5 ro rhgb quiet root dev VolGroup00 LogVol00 initrd initrd 2 6 18 92 el5 img hdlm 3 Install other products that use the weak modules script Perform installation according to the documentation for relevant products packages 4 Back up the currently used initial RAM disk im...

Page 724: ...rget Lun dev sddlmaa configured dev sda 2 0 0 0 dev sdb 2 0 1 0 KAPL10302 I sbin dlmcfgmgr completed normally The HDevName column displays HDLM devices and the Device column displays SCSI devices If the HDLM device corresponds to more than one SCSI device specify the SCSI device that appears first In this example dev sda indicates a SCSI device 8 In the boot loader configuration file replace root ...

Page 725: ...when LVM is used The underlined portion is the volume group that indicates the root directory mount dev mapper VolGroup00 LogVol00 on type ext3 rw proc on proc type proc rw sysfs on sys type sysfs rw devpts on dev pts type devpts rw gid 5 mode 620 dev sddlmaa1 on boot type ext3 rw tmpfs on dev shm type tmpfs rw dev mapper VolGroup00 LogVol02 on tmp type ext3 rw dev mapper VolGroup00 LogVol04 on us...

Page 726: ...ipt To uninstall a product that uses the weak modules script 1 Add a parameter to the boot loader configuration file Perform steps 1 and 2 in B 1 Installing Products That Use the Weak Modules Script 2 Uninstall other products that use the weak modules script Perform uninstallation according to the documentation for relevant products packages 3 Create an initial RAM disk image file for HDLM and rep...

Page 727: ...orithm C 3 Functional Differences Between Version 6 0 or Later and Versions Earlier Than 6 0 The description of the HDLM version displayed as a result of executing HDLM commands or utilities has been changed In versions earlier than 6 0 the messages KAPL09210 I KAPL09211 I and KAPL09212 E will not be output when you install HDLM In versions 6 0 or later one of the above messages will be output whe...

Page 728: ...ng message will be output when you install HDLM Preparing packages for installation HDLM x xx x xxx xx The following shows an execution example in Red Hat Enterprise Linux AS4 media cdrom installhdlm KAPL09093 I HDLM xx xx will be installed Is this OK y n y Preparing packages for installation KAPL09076 I The permanent license was installed HDLM x xx x xxx xx KAPL09043 I The installation of HDLM x ...

Page 729: ...s placed in the Online E status In version 5 7 0 01 or later even if an I O request is sent to a path in the Online E status the status of the path does not change In the event of path recovery after all paths have failed the paths must be placed online by automatic failback or by using a command before you can access the data C 10 Functional Differences Between Version 5 7 or Later and Versions E...

Page 730: ...mission for the trace log directory var opt hitachi HNTRLib2 spool has been changed to 755 and the permission for the log file var opt hitachi HNTRLib2 spool hntr2X log has been changed to 644 License keys that worked with versions 04 00 05 02 and 05 03 are no longer valid with version 5 4 OS Required version of JRE or JDK Earlier than HDLM 5 4 2 HDLM 5 6 5 6 2 HDLM 5 6 3 Red Hat Enterprise Linux ...

Page 731: ...ffline Places Paths Offline AutoPATH_ID An ID that HDLM assigns to a path during the system startup Every path has a unique AutoPATH_ID See also path B boot disk environment An environment in which the startup disk is in a storage system instead of in the host C CHA Channel Adapter An adapter for controlling the channels of a storage system CLPR Cache Logical Partition A function supported by the ...

Page 732: ...et to 0 because HDLM manages Devs in units of LUs See also Dev domain An environment in which Xen is used to manage OSs The domain that has management privileges for Xen is called domain0 The other domains are called domainU E emulation type An LU type that is accessible from a host Since an HDLM host is an open system host such as a PC or a UNIX computer the HDLM host can access only the LUs that...

Page 733: ...n error detected by the HDLM driver and then reports the error information to the HDLM manager HDLM driver A program that controls all the HDLM functions manages paths and detects errors HDLM manager A program that manages error information The HDLM manager receives error information from the HDLM alert driver and then collects error logs host A generic term for both servers and clients host devic...

Page 734: ...es the Linux kernel itself as a hypervisor KVM uses QEMU to control guest OSs See also QEMU L LDEV Logical Device A combination of the storage system s product name serial number and an internal LU HDLM uses this value to identify a particular LU load balancing Functionality for distributing the load across the paths that access each area within an LU To distribute loads load balancing uses multip...

Page 735: ...er Non owner paths exist only in the Thunder 9500V series or Hitachi AMS WMS series See also owner path non owner controller O owner controller A controller that has been set as an owner controller for an LU Owner controllers are only in the Thunder 9500V series or Hitachi AMS WMS series A controller other than an owner controller is called a non owner controller When using Lightning 9900 series L...

Page 736: ...the path to the Offline E status Path health checking checks only those paths that have the Online status path name The path name consisting of the following four elements separated by periods Host port number hexadecimal number Bus number hexadecimal number Target ID hexadecimal number Host LU number hexadecimal number A path name is used to identify a physical path See also host LU number persis...

Page 737: ...f this load balancing is not possible See also persistent reservation S SAN Storage Area Network A high speed network connecting hosts to storage systems This network is independent of a LAN and is dedicated to data transfers A SAN provides faster access to storage systems and prevents the transfer of high volumes of data from deteriorating LAN performance SCSI device A SCSI disk device SLPR Stora...

Page 738: ......

Page 739: ...nterprise Server 10 115 116 117 when using SUSE LINUX Enterprise Server 11 119 120 boot loader configuration file 177 bus number 449 C canceling md device settings 302 canceling settings for HDLM 290 canceling settings for Heartbeat 292 canceling settings for KVM 297 canceling settings for LUKS 310 canceling settings for LVM2 298 canceling settings for Oracle RAC 292 canceling settings for RHCM 29...

Page 740: ...moving from HDLM management 377 diagram conventions ix directory to which collected information is output 466 Displayed program information 433 displaying information 431 path information by abbreviating the list items 431 path information by selecting a display item 431 path information without selecting items to be displayed 431 program information 431 433 Distributing a Load Using Load Balancin...

Page 741: ...le 467 filter 42 filter component 15 filtering of error information 42 font conventions ix format and meaning of the message ID 524 functions HDLM program 15 of HDLM 5 G GB meaning xi Global Link Manager 54 glossary 707 H handling path error 391 HBA 8 procedure for replacing 358 replacing 356 72 HBA Host Bus Adapter 709 HDev 13 HDevName 390 HDLM features 4 functions 5 installing 139 new installati...

Page 742: ...efined 515 installgetras 512 to collect HDLM installation error information 43 installhdlm 514 installing HDLM required knowledge 132 Installing HDLM for Managing Boot Disks 172 installux sh 521 integrated HDLM management 54 intended readers i intermittent error 710 definition 28 I O count 400 errors 400 iostat commands 693 IP SAN 9 10 710 IP SAN environment supported by HDLM 11 iSCSI 10 710 iSCSI...

Page 743: ...on 389 mkfs commands 694 mount point 145 mounting file system 284 N narrowing down hardware causing error 393 network interface card 9 NIC 72 node 711 non owner controller 22 711 non owner path 21 711 note adding BladeSymphony I O drawer 385 note on adding BladeSymphony I O drawer 385 Notes Using Hitachi Network Objectplaza Trace Library 281 notes LUKS 229 md device 232 using RHCM 266 notes on usi...

Page 744: ...ne 409 placing online path 393 port 7 9 position of the HDLM driver and HDLM device 16 process specific trace Information file 281 process specific trace information file 41 product ID 446 Product ID displayed by the view path operation 449 program error what to do for 394 395 program information obtaining 394 Q QEMU 713 R Red Hat Enterprise Linux 5 boot disk environment and BladeSymphony environm...

Page 745: ...ager 113 SUSE LINUX Enterprise Server 11 146 boot disk environment 119 file system 119 kernel 68 volume manager 118 SUSE LINUX Enterprise Server 9 146 kernel 65 symbol conventions ix syntax conventions x syslog 41 system configuration 7 9 T taking actions for hardware error 393 target ID 449 TB meaning xi Thunder 9200 vi trace file 41 trace files number of 418 size 418 trace level values 417 types...

Page 746: ... Red Hat Enterprise Linux 5 103 when using Red Hat Enterprise Linux 6 109 when using Red Hat Enterprise Linux AS4 ES4 89 when using SUSE LINUX Enterprise Serve 9 111 when using SUSE LINUX Enterprise Server 10 113 when using SUSE LINUX Enterprise Server 11 118 W Warning level errors 42 what to do for program error 394 395 X Xen 144 152 713 setting 144 152 258 Xen hypervisor operating environments s...

Reviews:

No comments

Related manuals for Dynamic Link Manager

GPSMAP GPSMAP 196

Brand: Garmin Pages: 4

Brand: Garmin Pages: 2

SECURITY MANAGEMENT CENTER 2.5

Brand: AVIRA Pages: 39

Brand: Sanford Pages: 122

Brand: Canon Pages: 40

Brand: Canon Pages: 97

ScanGear CS-S 4.3

Brand: Canon Pages: 109

CanoScan FS2700F

Brand: Canon Pages: 80

Digital Video Software (Windows)

Brand: Canon Pages: 89

Brand: Canon Pages: 98

Brand: Canon Pages: 88

Brand: Canon Pages: 168

Digital Camera Solution Disk V.27

Brand: Canon Pages: 130

Viewer for Pocket PC RV-P1.0

Brand: Canon Pages: 22

Brand: Canon Pages: 2

S830D - S Color Inkjet Printer

Brand: Canon Pages: 201

WEBVIEW LIVESCOPE 3.2

Brand: Canon Pages: 56

WebView Livescope MV Ver. 2.1 LE

Brand: Canon Pages: 24

Brands by name

0 1 2 3 4 5 6 7 8 9 A B C D E F G H I J K L M N O P Q R S T U V W X Y Z

Popular brands

Load more brands