IBM Hub/Switch Installation Manual Download

Page: 524 / 590

Appendix E Infrastructure Configuration Example

524

September 2002

HPSS Installation Guide

Release 4.5, Revision 2

Summary of Contents for Hub/Switch

Page 1: ...HPSS Installation Guide High Performance Storage System Release 4 5 September 2002 Revision 2...

Page 2: ...5000 with DOE and Lockheed Martin Energy Research Corpora tion Oak Ridge National Laboratory ORNL under Contract No DE AC05 96OR22464 with DOE The U S Government has certain reserved rights under its...

Page 3: ...rity Through Transaction Management 20 Multiple Hierarchies and Classes of Services 20 Storage Subsystems 21 Federated Name Space 21 1 3 HPSS Components 21 HPSS Files Filesets Volumes Storage Segments...

Page 4: ...ary for AIX 50 Prerequisite Summary for IRIX 50 Prerequisite Summary for Solaris 51 Prerequisite Summary for Linux and Intel 52 2 4 Hardware Considerations 53 Network Considerations 53 Tape Robots 54...

Page 5: ...iderations 91 Storage Class 93 Storage Hierarchy 101 Class of Service 102 File Families 105 2 10 HPSS Sizing Considerations 105 HPSS Storage Space 106 HPSS Metadata Space 106 System Memory and Disk Sp...

Page 6: ...laris IRIX 158 3 7 Setup Network Parameters 158 HPSS conf Configuration File 162 SP x Switch Device Buffer Driver Buffer Pools 174 3 8 Install and Configure Java and hpssadm 175 Introduction 175 Insta...

Page 7: ...10 Set Up Sammi License Key 213 Chapter 5 HPSS Infrastructure Configuration 215 5 1 Overview 215 Infrastructure Road Map 215 5 2 Verify the Prerequisite Software 215 5 3 Define the HPSS Environment Va...

Page 8: ...igure the Remote Site Policy 303 6 7 HPSS Storage Characteristics Configuration 305 Configure the Storage Classes 305 Configure the Storage Hierarchies 315 Configure the Classes of Service 318 File Fa...

Page 9: ...onfiguration 435 Introduction 435 Filesets 436 Configuration 444 Chapter 8 Initial Startup and Verification 463 8 1 Overview 463 8 2 Starting the HPSS Servers 463 8 3 Unlocking the PVL Drives 465 8 4...

Page 10: ...ing and or Modifying the Account Map 494 D 7 Accounting Reports 494 D 8 Accounting Intervals and Charges 495 Appendix E Infrastructure Configuration Example 497 E 1 AIX Infrastructure Configuration Ex...

Page 11: ...nfiguration for HACMP 548 Install HACMP 548 Setup the AIX Environment for HACMP 548 Initial HACMP Configuration 549 Configure DCE SFS and HPSS 558 G 5 Configure HA HPSS 558 HA HPSS Scripts 558 Finish...

Page 12: ...12 September 2002 HPSS Installation Guide Release 4 5 Revision 2...

Page 13: ...onfiguration Window 306 Figure 6 15 Tape Storage Class Configuration Window 307 Figure 6 16 Storage Subsystem Specific Thresholds window 313 Figure 6 17 Storage Hierarchy Configuration Window 316 Figu...

Page 14: ...re H 2 Adding a Cluster Definition 550 Figure H 3 Adding Cluster Nodes 551 Figure H 4 Adding an IP based Network 552 Figure H 5 Adding a Non IP based Network 552 Figure H 6 Adding an Ethernet Boot Ada...

Page 15: ...r Configuration Variables 266 Table 6 4 Migration Policy Configuration Variables 283 Table 6 5 Purge Policy Configuration Variables 288 Table 6 6 Accounting Policy Configuration Variables 291 Table 6...

Page 16: ...368 Table 6 30 Physical Volume Library Configuration Variables 372 Table 6 31 Physical Volume Repository Configuration Variables 380 Table 6 32 Storage Server Configuration Variables 397 Table 6 33 De...

Page 17: ...ed at a command line will be proceeded by a percent sign and be presented in a boldface courier font sample command Names of files variables and variable values will appear in a boldface courier font...

Page 18: ...18 September 2002 HPSS Installation Guide Release 4 5 Revision 2...

Page 19: ...nt requirements HPSS is scalable and designed to store up to petabytes 1015 of data and to use network connected storage devices to transfer data at rates up to multiple gigabytes 109 per second HPSS...

Page 20: ...forms HPSS has been implemented on the IBM AIX and Sun Solaris platforms In addition selected components have been ported to other vendor platforms The non DCE Client API and Mover have been ported to...

Page 21: ...a different Storage Subsystem For example the pathname JunctionToSubsys2 could lead to the root fileset managed by the Name Server in Storage Subsystem 2 Sites which do not wish to partition their HP...

Page 22: ...and a 64 bit integer Both identifiers are unique to a given DCE cell Junctions A junction is a Name Server object that is used to point to a fileset This fileset may belong to the same Name Server or...

Page 23: ...es Each virtual volume and its associated physical volumes belong to a single storage class in HPSS Storage classes in turn are grouped to form storage hierarchies see below An HPSS storage class is u...

Page 24: ...Chapter 1 HPSS Basics 24 September 2002 HPSS Installation Guide Release 4 5 Revision 2 Figure 1 1 Migrate and Stage Operations...

Page 25: ...sitory Mover Storage System Manager and Non DCE Client Gateway Figure 1 3 provides a simplified view of the HPSS system Each major server component is shown along with the basic control communications...

Page 26: ...ged as a single administrative unit Junctions are used to link filesets into the HPSS name space Bitfile Server BFS The BFS provides the abstraction of logical bitfiles to its clients A bitfile is ide...

Page 27: ...pe File Migration The purpose of tape file migration is to make a single additional copy of files in a tape storage class to a lower level in the hierarchy It is also possible to move files downwards...

Page 28: ...s take place Location Server LS The Location Server acts as an information clearinghouse to its clients through the HPSS Client API to enable them to locate servers and gather information from both lo...

Page 29: ...ttributes of storage system resources and storage system policy parameters Additionally SSM can request that specific operations be performed on resources within the storage system such as adding and...

Page 30: ...nfiguration and recovery purposes however it is desirable for all of the metadata files for a single subsystem to reside on a single SFS server This single SFS server may either be a single server whi...

Page 31: ...le reliable and portable storage system The HPSS infrastructure components common among servers that tie servers together are discussed below Distributed Computing Environment DCE HPSS uses the Open S...

Page 32: ...forcement audit and security management capabilities for the HPSS components Customer sites may use the default security policy delivered with HPSS or define their own security policy by implementing...

Page 33: ...II text file It is the responsibility of the individual site to sort and use this information for subsequent billing based on site specific charging policies For more information on the HPSS accountin...

Page 34: ...sults The Non DCE Client API has the same functionality as the standard Client API with the following exceptions it does not support ACL functions it does not support transactional processing and it i...

Page 35: ...In order to accommodate site specific policies HPSS has implemented flexible interfaces to its servers to allow local sites the freedom to tailor management operations to meet their particular needs H...

Page 36: ...will generate All servers can generate authentication records while only the Name and Bitfile Servers generate other object event records Accounting Policy The accounting policy provides runtime infor...

Page 37: ...requests 1 4 HPSS Hardware Platforms 1 4 1 Client Platforms The following matrix illustrates which platforms support HPSS interfaces The full function Client API can be ported to any platform that su...

Page 38: ...ection 2 3 Prerequisite Software Considerations on page 46 and must have sufficient processing power and memory to handle the work load needed by HPSS HPSS is a distributed system The main component t...

Page 39: ...haracteristics Considerations on page 91 HPSS Sizing Considerations on page 105 HPSS Performance Considerations on page 135 HPSS Metadata Backup Considerations on page 142 The planning process for HPS...

Page 40: ...her HPSS Movers in the case of internal HPSS data movement for migration and staging Refer to Section 2 4 for more discussions on the storage devices and networks supported by HPSS Identify the HPSS s...

Page 41: ...on page 106 for more information on the HPSS storage space considerations Identify the disk and tape media to be imported into HPSS to allow for the creation of the needed storage space 7 Define the...

Page 42: ...curity level The SSM security level defines what functions each SSM user can perform on HPSS through SSM Refer to Section 11 1 SSM Security on page 275 of the HPSS Management Guide for more informatio...

Page 43: ...tailed outline of what is required to bring an HPSS system online from an initial introduction and review of the customer environment to the time the system is ready for production use The deployment...

Page 44: ...ds To configure the system properly the growth rates of the various categories of storage as well as the growth rate of the number of files accessed and data moved in the various categories must be kn...

Page 45: ...ites may choose to log every client connection every bitfile creation deletion and open and every file management operation Other sites may choose to log only errors See the security information field...

Page 46: ...ite Identification fields from the remote site s Location Policy screen Similarly information from the Local site s Location Policy screen will be required by the Remote HPSS site in the Remote Site s...

Page 47: ...with DCE Kerberos authentication The following nodes do not require DCE Nodes that only run Non DCE Mover Nodes that only run FTP PFTP and NFS clients not using DCE authentication Nodes that run the...

Page 48: ...ncina Client component installed Nodes that run one or more HPSS servers with the exception of nodes that run only the non DCE Mover Nodes that run an end user client application that links with the H...

Page 49: ...solution of 1280 x 1024 pixels A mouse two or three buttons Specific Sammi product versions relative to specific versions of operating systems can be found in Sections 2 3 2 1 through 2 3 4 2 2 3 1 6...

Page 50: ...ble at release time 5 HPSS Server Sammi License Part Number 01 0002100 A version 4 6 3 5 5 for AIX 4 3 3 from Kinesix Corporation for each HPSS license which usually consists of a production and a tes...

Page 51: ...x Corpo ration for each HPSS license which usually consists of a production and a test system In addition an HPSS Client Sammi License Part Number 01 0002200 B version 4 7 is required for each additio...

Page 52: ...ctively acl 2 0 9 0 acl devel 2 0 9 0 attr 2 0 7 0 attr devel 2 0 7 0 dmapi 2 0 2 0 dmapi devel 2 0 2 0 xfsdump 2 0 1 0 xfsprogs 2 0 3 0 xfsprogs devel 2 0 3 0 4 HPSS Kernel Patch It will also be nece...

Page 53: ...cause of its distributed nature and high performance requirements an HPSS system is highly dependent on the networks providing the connectivity among the HPSS servers SFS servers and HPSS clients For...

Page 54: ...ocal IP network routing table The environment variable RPC_UNSUPPORTED_NETIFS may be used to direct DCE to ignore certain network interfaces especially if those interfaces are not accessible from othe...

Page 55: ...584 must be connected to the AIX workstation This workstation must be an HPSS node running the PVR The latest level of the AIX tape driver must be installed on this machine 2 4 2 3 STK The STK PVR and...

Page 56: ...SCSI attachment Sony GY 8240 devices are supported via Ultra Wide Differential SCSI attachment For platform and driver information for these drives see Section 6 9 2 Supported Platform Driver Tape Dr...

Page 57: ...tition and the raw device name must be used when creating the Mover Device configuration see Chapter 5 Managing HPSS Devices and Drives page 95 in the HPSS Management Guide for details on configuring...

Page 58: ...t of data to be transferred with each request The amount requested can have a considerable impact on system performance and the amount of metadata generated when writing directly to a tape storage cla...

Page 59: ...o supports the new HPSS Parallel FTP PFTP protocol which allows the PFTP client to utilize the HPSS parallel data transfer mechanisms This provides the capability for the client to transfer data direc...

Page 60: ...e greater than the time required for non HPSS NFS servers The HPSS NFS server implements caching mechanisms to minimize these delays but time out values timeo option and retransmission limits retrans...

Page 61: ...ly large DFS file system that performs at near native DFS speeds This option is well suited to sites with large numbers of small files However when using this option the files can only be accessed thr...

Page 62: ...permitted in the name space is limited by the number of SFS records allocated to the NS Refer to Section 2 10 2 4 for details on selecting the size of the name space With this release of HPSS provisio...

Page 63: ...ages the bitfile The BFS maps bitfiles to their underlying physical storage by maintaining mapping information that ties a bitfile to the storage server storage segments that contain its data These st...

Page 64: ...p its ability to manage disks as the number of disks increases As long as sufficient memory and CPU capacity exist threads can be added to the server to increase its throughput Additional Storage Subs...

Page 65: ...ilable in a storage class within its assigned storage subsystem by performing periodic migration and purge runs on that storage class Migration copies data from the storage class on which it runs to o...

Page 66: ...ecord to the queue and so files in the same storage class hierarchy and family tend to migrate in the order which they are written actually the order in which the write completes When a migration run...

Page 67: ...is selected for migration by MPS then all other segments belonging to the same file regardless of their location will be migrated during the same migration run If any of the segments in the file are a...

Page 68: ...e Storage Server within its configured subsystem These threads exist only for the duration of a disk or tape migration run Purge does not use any temporary threads MPS uses a single thread to monitor...

Page 69: ...per Server If a Gatekeeper Server is configured for the storage subsystem that the BFS is configured for then the BFS will query the Gatekeeper Server asking for the monitor types by calling a particu...

Page 70: ...perational To avoid letting the Location Server become a single point of failure consider replicating it preferably on a different machine If replicating the Location Server is not an option or desira...

Page 71: ...RAIT PVR The STK RAIT PVR cannot be supported at this time since STK has not yet made RAIT generally available The STK PVR and STK RAIT PVR communicate to the ACSLS server via STK s SSI software The S...

Page 72: ...by HPSS If multiple 3494 3495 robots are managed the PVRs must be configured to communicate with the correct dev lmcp device The PVRs can run on the same CPU or different CPUs as long as the proper d...

Page 73: ...time the kernel is built To enable asynchronous I O on the Mover machine follow the steps below 1 Update the kernel to level 2 4 18 2 Download the HPSS kaio 2 4 18 patch from the HPSS support Web site...

Page 74: ...ory update the lilo configuration and recycle the system For example cd boot cp usr src linux 2 4 18 arch i386 boot bzImage vmlinux 2 4 18 vi etc lilo conf sbin lilo shutdown Fr 0 9 If you need to reb...

Page 75: ...e of the native SCSI tape device driver st To enable the loading of the Linux native tape device uncomment the following lines in the config file and follow the procedure for rebuilding your Linux ker...

Page 76: ...an influence the number of Movers configured and the specific configuration of those Movers Each Mover executable is built to handle a single particular device interface e g IBM SCSI attached 3490E 35...

Page 77: ...initiated from the command line utility the central log file must be accessible from the node on which the command is being executed e g NFS mounted Refer to Section 1 16 2 Viewing the HPSS Log Messag...

Page 78: ...run on the same platform and the directory trees and filesets supported by each daemon should not overlap This is necessary because with overlapping directories it is possible for different users to b...

Page 79: ...r if all SSM components are running on the same host There can be only one SSM System Manager configured for an HPSS installation The System Manager is able to handle multiple SSM clients on different...

Page 80: ...ining a list of files that are candidates for being destroyed One of the logs called the zap log keeps track of files on archived aggregates and file systems while the other called the destroy log kee...

Page 81: ...her DES or simple hashing function for encryption of the DCE identity and password that is passed to the NDCG See Section 2 3 4 2 HPSS Non DCE Mover Client Machine on page 51 for more information on p...

Page 82: ...sk migration is controlled by several parameters The Last Update Interval is used to prevent files that have been written recently from being migrated Files that have been updated within this interval...

Page 83: ...and new data is always written at the end of the tape When data is deleted from the tape volume the space associated with the data cannot be reused The only way to reuse space on a tape is to copy al...

Page 84: ...ition the administrator can force a migration run to start via SSM The Migrate Volumes flag selects the tape volume migration algorithm The Migrate Volumes and Whole Files flag modifies the tape volum...

Page 85: ...urge lock is used to prevent a file from being purged from the highest level of a hierarchy Purge locks only apply to a hierarchy containing a disk on the highest level HPSS will not automatically unl...

Page 86: ...etails on using the Account Validation Editor If the Require Default Account field is enabled with Site style accounting and Account Validation a user will be required to have a valid default account...

Page 87: ...s to their interfaces based on permissions granted by the access control list attached to a Security object in the server s Cell Directory Service CDS directory Access to interfaces that change a serv...

Page 88: ...CK in the HPSS environments file hpss_env An option to specify mediation of user access to HPSS files by a credentials mapping is also provided Export entry options are described further in Section 7...

Page 89: ...log policy settings are defined from the HPSS Log Policies window If no Default Log Policy entry has been defined all record types except for Trace are logged All Alarm Event and Status messages gener...

Page 90: ...will determine which types of requests it wishes to monitor This query by the BFS will occur each time the BFS re connects to the Gatekeeper Server The BFS will need to re connect to the Gatekeeper w...

Page 91: ...example if a site is monitoring Authorized Caller and Open requests then the site gk_site_Open interface will be called for open requests from users and the gk_site_OpenStats interface will be called...

Page 92: ...cated for a file at multiple levels in the hierarchy the more recent data is at the higher level lowest level number in the hierarchy Each hierarchy level is associated with a single storage class Cla...

Page 93: ...ge class is identified by a storage class ID and its associated attributes For detailed descriptions of each attribute associated with a storage class see Section 6 7 1 Configure the Storage Classes p...

Page 94: ...be written on tape for each one of these writes which will waste data storage space and the Storage Server will build a separate storage segment for the data associated with each write which will wast...

Page 95: ...width or no striping at all Explanation For tape the situation is complex If writing to tape directly rather than via disk migration writing a file will usually result in all the tape volumes having...

Page 96: ...storage segment size will also be chosen as a power of 2 multiple of the Minimum Storage Segment Size parameter The smallest value that can be selected for the Minimum Storage Segment Size is the Clu...

Page 97: ...um Storage Size Selection disk only This parameter along with Storage Segment Size and Average Number of Storage Segments is used by the Bitfile Server to optimally choose a storage segment size for b...

Page 98: ...gth Explanation This field is advisory in nature in the current HPSS release In the future it may be used to determine buffer sizes Generally a good value for this field is the Stripe Length however i...

Page 99: ...Volume Block Size is the smallest block size value that should be used for the corresponding media type when physical volumes are combined to form a striped virtual volume A value smaller than that s...

Page 100: ...IT 6 2 678 KB 2048 120 GB StorageTek 9840 RAIT 8 1 1 MB 2048 160 GB StorageTek 9840 RAIT 8 2 1 MB 2048 160 GB StorageTek 9840 RAIT 8 4 1 MB 2048 160 GB StorageTek 9940 256 KB 1024 60 GB StorageTek 994...

Page 101: ...esigned to stream data to tape larger values of the Block Between Tape Mark parameter are recommended Estimated Physical Volume Size is the estimated size of the physical volumes to be set in the stor...

Page 102: ...nternal migration process If not adhered to can result in excessive storage segment creations Storage segment size on disk is an integral multiple of the stripe length on tape If this option is select...

Page 103: ...hest level in the storage hierarchy when the file is opened This field can be used via the COS Hints mechanism to affect COS selection The valid options are as follows Guideline 1 Select the No Stage...

Page 104: ...exists A warning that this has happened will appear in the SSM Alarms and Events window 2 9 3 4 Selecting Optimum Access Size This field is only advisory in nature however for later releases it may be...

Page 105: ...preted by the system as meaning that the file is not associated with a family The family designation has no effect on the placement of files on disk but does control the tape to which the file migrate...

Page 106: ...ge space to satisfy a user request results in the user receiving a NO SPACE error One important factor in storage space growth relates to how HPSS handles write requests The Bitfile Server always writ...

Page 107: ...ts nstext sspvdisk sspvtape storagemapdisk storagemaptape storagesegdisk storagesegtape vvdisk vvtape The following files are part of an HPSS system but are not associated with a particular subsystem...

Page 108: ...e STK RAIT PVR cannot be supported at this time since STK has not yet made RAIT generally available cos dmg dmgfileset filefamily gkconfig globalconfig hierarchy logclient logdaemon logpolicy lspolicy...

Page 109: ...ta Storage Subsystem Configurations storsubsysconfig Each storage subsystem defined in HPSS has a record describing its default COS associated Gatekeeper and allowed COS ids This file is small and wil...

Page 110: ...startup control arguments Zero or more GKs may be defined If the GK is going to be used for Account Validation Services then at least one GK must be defined If the GK is going to be used for Gatekeepi...

Page 111: ...ry in this configuration metadata file describing various startup control arguments Generally one disk SS and one tape SS will be defined DMAP Gateway Configurations This metadata file describes the s...

Page 112: ...cters or that has a comment will create records in the text overflow or extensions file In addition the symbolic link data of all symbolic link objects is placed in the text overflow file These text r...

Page 113: ...ill be only one disk segment record needed to map the file To arrive at the best estimate of the number of records you need in the bitfile disk segment bitfile tape segment and bitfile disk map files...

Page 114: ...ormance This file normally should be large enough to store a few thousand records Bitfile COS Changes The COS change file keeps track of bitfiles that have a pending COS change When the COS of a bitfi...

Page 115: ...ds If a system has more than one Disk Storage Server each server must have its own set of files Files must not be shared between servers SS Disk Storage Maps There will be as many disk storage map rec...

Page 116: ...one Tape Storage Server each server must have its own set of files Files must not be shared between servers SS Tape Storage Maps This metadata file is used to track the allocation of storage on tape v...

Page 117: ...Validation Metadata Editor see Section 12 2 23 hpss_avaledit Account Validation Editor on page 366 of the HPSS Management Guide for details 2 10 2 9 PVL Metadata The PVL is the primary user of the fo...

Page 118: ...file to store cartridge metadata 2 10 2 11 Mover Metadata The Mover is the primary user of one SFS metadata file the default SFS filename is shown in parentheses Mover Devices moverdevice Mover Device...

Page 119: ...Records The BFS in a storage subsystem uses this file to indicate to the MPS in the subsystem which disk files are migration candidates Each disk file in the subsystem which is a migration candidate r...

Page 120: ...se no other metadata files beyond the standard server configuration files 2 10 2 17 DMAP Gateway Metadata The DMAP Gateway is the primary user of one SFS metadata file the default SFS filename is show...

Page 121: ...the HPSS web site at https www4 clearlake ibm com hpss support ToolsRepository md43 xls To access the website an account is required To request an account use URL http www4 clearlake ibm com cgi bin h...

Page 122: ...Filesets The total number of filesets that will be managed by all Name Servers in a given DCE Cell Max Filesets Per DMAP Gateway This value is the maximum number of filesets that a DMAP Gateway can be...

Page 123: ...ntly impacts the overall metadata sizing estimate if the duplicate copy feature is used Max Accounting Log Records This value is the maximum number of log records that is expected at any given time wh...

Page 124: ...per disk virtual volume Since there are a maximum of 16 384 blocks per disk VV and each storage segment uses one or more VV blocks the number must be less than or equal to 16 384 This value can be de...

Page 125: ...tic Configuration Values Variable Description Total Subsystems The number of subsystems controlled by this HPSS instance Total Storage Classes The maximum number of storage classes that will be define...

Page 126: ...me SFS server or not The various columns in this worksheet are described below Subsystem Metadata File This column lists all the HPSS metadata files preceded by the acronym for the specific HPSS serve...

Page 127: ...ecords acctvalidate Total Number of Users Avg Number of Levels Per Hierarchy 1 BFS Classes of Service cos Total Classes of Service BFS Server Configs bfs Total BFS Servers BFS Storage Classes storagec...

Page 128: ...Cartridges Total PVR 3 Tape Cartridges PVL Server Configs pvl 1 PVR Cartridges 1 cartridge Total PVR 1 Tape Cartridges PVR Cartridges 2 cartridge Total PVR 2 Tape Cartridges PVR Cartridges 3 cartridge...

Page 129: ...Per Name Space Object SS Disk Maps storagemapdisk Total Disk Virtual Volumes SS Disk Physical Volumes sspvdisk Total Disk Physical Volumes SS Disk Storage Segments storagesegdisk Avg Storage Segments...

Page 130: ...indices on the same SFS volume So normally the SFS volume columns in the spreadsheet will contain the same logical SFS volume number for a given metadata file row If for performance or disk space lim...

Page 131: ...of a media failure on the transaction log disk it is important to mirror the transaction log on a separate physical disk The size of the transaction log is dependent on the volume of HPSS transaction...

Page 132: ...ups trb The TRB files should not be on the same disk as the MRA files Encina transaction log or Encina data files If you are limited by the number of physical volumes disk drives that are available fo...

Page 133: ...of these log files are also specified in its configuration usually 5 megabytes each 2 10 3 2 4 Disk Space Requirements for Running Log Client Each Log Client will create one local log file in the dir...

Page 134: ...cached directories is 10 File attribute memory requirements are determined by subtracting the number of cached directories from the maximum number of entries on the LRU list and multiplying the resul...

Page 135: ...MI clients on a machine will quickly consume available system memory For nodes that will only run Movers and no SFS server the amount of memory is dependent on the number and types of devices configur...

Page 136: ...on of a specific resolv conf file to be used by gdad 2 11 2 Encina Because all HPSS transactions update metadata information it is essential that SFS be optimized to access the database in an efficien...

Page 137: ...cern Storage Media Allocating storage for the log and data volume s should be carefully planned The log and data volumes need to be on separate sets of disk not only for data integrity in case of a me...

Page 138: ...FTP server is not a multiple of the virtual volume block size each buffer written will result in a distinct storage segment on the tape This will cause additional metadata to be stored in the system...

Page 139: ...sonable the standard FTP ports should be modified to something other than 20 21 on the system acting as the HPSS FTP Daemon The HPSS FTP Daemon should be set to use the 20 21 ports by default This red...

Page 140: ...Log Clients associated with those servers must be reinitialized 2 11 11 MPI IO API MPI IO client applications must be aware of HPSS Client API performance on certain kinds of data transfers see Sectio...

Page 141: ...the biggest gains were realized by altering the DFS client caching A large memory cache instead of a disk cache may improve performance dramatically if the client machine can spare memory for client c...

Page 142: ...urn this error directly to the Client API rather than performing a retry Errors other than these two or the special HPSS_ERETRY status will be retried several times by the BFS See either volume of the...

Page 143: ...easons mirroring should be done using separate physical devices as opposed to the AIX logical volume being mirrored to the same physical drive 2 12 1 Rules for Backing Up SFS Log Volume and MRA Files...

Page 144: ...ning and should be copied to at least two different tapes 2 12 3 Miscellaneous Rules for Backing Up HPSS Metadata Once a month a site must tell SFS to truncate old backups and retain backup informatio...

Page 145: ...operating system level on AIX oslevel To verify the current operating system level on non AIX platforms uname a Create appropriate HPSS Unix user accounts The hpss user ID and hpss group ID should be...

Page 146: ...e installed on all DCE HPSS SFS machines to alert administrators of full filesystems so appropriate action can be taken immediately The var hpss directory should also be a separate filesystem to prote...

Page 147: ...isks to be used and mirroring options Use the metadata sizing spreadsheet mdsizing xls to determine final amount of SFS data volume space to configure When completed this spreadsheet should be added t...

Page 148: ...imary copy For example suppose we have 8 physical disks to be used for SFS data volumes We create a volume group called sfsvg and put all 8 disks in this VG When creating a logical volume to be used a...

Page 149: ...current MRA file must never be manipulated moved copied or deleted since SFS may still be actively writing to it MRA files must be copied from disk to at least two 2 different tapes at least once per...

Page 150: ...vice in an LTO robot tapeutil f smc device filename inventory Look for addresses of drive devices in the output Refer to Section 6 8 13 2 LTO PVR Information on page 387 for more information 3 5 2 349...

Page 151: ...388 for more information 3 5 3 STK For an STK tape library If using an STK tape library configure the ACSLS and SSI software properly and verify that it is working correctly To test the ability to mou...

Page 152: ...rt indicates whether the available tape drives have variable length block size set To manually check whether variable block size is enabled the following should return a value of zero 0 lsattr E l tap...

Page 153: ...if dev null of dev rmt 0n bs 1024 count 1 If variable length block sizes are not enabled consult your driver documentation for procedures to enable it On each Tape Mover node verify that the raw read...

Page 154: ...e drives are at the expected levels Create one or more talbes documenting the results To measure uncompressed write performance see warning below on tps2d6 Note that specifying tps2d6nr will cause the...

Page 155: ...ontents of this tape will be overwritten so be sure to mount the correct tape cartridge 3 6 Setup Disk Drives Verify that Ultra SCSI is enabled for all SCSI devices via smit on AIX and by the appropri...

Page 156: ...y volumeGroup s partitionSize physicalDisk To create a logical volume use SMIT or the following mklv y logicalVolume traw volumeGroup numPartitions Note that there are additional options for specifyin...

Page 157: ...major 8 minor 2 Block devices can be mapped to raw devices at boot time by adding mapping information to the etc sysconfig rawdevices file To map the first partition of SCSI disk a to raw device raw1...

Page 158: ...erfaces and corresponding network connections Refer to IBM s internal network technologies home page for resources on configuring and tuning networks and TCP IP The network interfaces section of the l...

Page 159: ...nd et0 interfaces are not configured at the same time we recommend only using en0 unless the other machines in the network are all using the 802 3 et interface Configure the local name service with th...

Page 160: ...k Off en0 64k 64k Off en0 64k 32k Off ccs0 64k 64k On ccs0 64k 32k On Sender Table Interface Bsize Lsize RFC1323 Performance CPU utilization en0 16k 16k Off en0 16k 8k Off en0 64k 64k Off en0 64k 32k...

Page 161: ...formance has been experienced where options on one system do not match options on other remote systems There are also attributes that are specific to the individual network interface that may affect n...

Page 162: ...ent variable the directory var hpss etc or the directory usr local etc in that order except for when accessed by the Authentication Managers Realms to DCE Cell Mappings stanza If the file is not prese...

Page 163: ...COS value E g Default COS 99 Optional SubStanza specifying the default Class of Service if not explicitly specified by the user Use with caution standard procedure is to allow the Bitfile Server to d...

Page 164: ...and pput Some sites have reported degraded performance as a result of this substitution occurring with small file transfers To accommodate this problem the Auto Parallel Size value substanza may be sp...

Page 165: ...overriding specification so Storage Classes need careful specification to provide very large segments if the value associated with MAX Ptran Size is large An artificial limit of 250 GB is compiled in...

Page 166: ...de connection to the Mover s associated with the specific COS PFTP Client Interfaces Stanza Rules Source hostnames may contain one or more hostnames separated by white spaces subject to the 128 charac...

Page 167: ...Host water has 4 interfaces that can talk to the HPSS Movers associated with the PFTP Daemon Host water water clearlake ibm com water 192 94 47 227 192 175 14 35 192 222 197 1 192 2 1 1 water has ONLY...

Page 168: ...inetd conf and etc services to initiate the multinoded The sections may be either a simple section or a valued section A simple substanza is a single name Dot Notation IP Address to be used for both C...

Page 169: ...lt If the Data Node is different than the Control Node Enter the Data Node after the otherwise the Control and Data are the same Control and or Data may be dot notation OR string hostnames larry sneez...

Page 170: ...onf file The Network Options stanza allows different options to be specified based on Source IP address Local Interface Name s AND Destination IP Address es When the Parallel FTP Client Client API or...

Page 171: ...Section Compound Destination IP Address E g 100 101 102 0 Contains the dotted decimal address of the destination interface Only one address is allowed however networks and sub networks may be chosen...

Page 172: ...ero is entered for the value of this field is that the size of the write request is the size of the data buffer On some networks e g the SP x switch improved performance has been measured by using a s...

Page 173: ...may vary dramatically within any network configuration and may change with only very minor network configuration modifications Values provided below are not necessarily good numbers HPSS Network Opti...

Page 174: ...not be used by application developers Pipe File Local File Path PFTP Daemon PSI 3 7 2 SP x Switch Device Buffer Driver Buffer Pools IBM SP x systems provide the capability to tune the buffer pool all...

Page 175: ...ort hpssadm the Command Line SSM For more detailed information on the configuration procedure see the remainder of Section 3 8 These examples assume that SSMDS and hpssadm will be executed on differen...

Page 176: ...ty Look for the following lines List of providers and their preference orders see above security provider 1 sun security provider Sun security provider 2 com ibm crypto provider IBMJCA Add the followi...

Page 177: ...ure the HPSS_SSMDS_KEYSTORE_PASSWORD variable is set to PROMPT in the hpss_env file This is the recommended operational mode ii For low security mode the SSMDS will read the password to its keystore f...

Page 178: ...ed store on the hpssadm machine cd JAVA_HOME lib security cp cacerts cacerts orig JAVA_HOME bin keytool keystore cacerts import file var hpss ssm ds cer alias hpss_ssmds Type cacerts_password when pro...

Page 179: ...hpssadm k var hpss ssm keytabs keytab joe 4 Remember to update the SSMDS certificate when it expires See Section 3 8 3 Configuring SSL on page 183 for instructions 3 8 1 2 Using the No Java Version of...

Page 180: ...s Encryption of the connection over which the user s DCE password is transmitted to the Data Server is implemented with Secure Sockets Layer SSL JSSE Java Secure Sockets Extensions is the Java impleme...

Page 181: ...system then the JAVA_HOME directory is the jre subdirectory of the top level directory into which the SDK was installed If only the JRE Java Runtime Environment is installed on the system then the JAV...

Page 182: ...h Java 1 3 0 under AIX 5 1 Maintenance Level 2 and under Solaris 5 8 with Recommended Patch Cluster 73001 3 8 2 3 Setting the Password for the Certificate Trusted Store A trusted store of X 509 certif...

Page 183: ...n on using the keytool utility 3 8 3 Configuring SSL SSL Secure Sockets Layer must be configured for the Data Server even if the hpssadm utility is not executed because the Data Server reads its priva...

Page 184: ...f certificates which includes either the Data Server s certificate or the certificate of a certificate authority who has signed the Data Server s certificate If your site requires certificates to be s...

Page 185: ...necessary for the proper configuration of the Data Server The remaining steps in this section are necessary only for the configuration of the hpssadm utility 2 Obtain and record the fingerprint for th...

Page 186: ...ile must be stored in a file on the Data Server host This is one reason it is so important to secure this machine This file must be protected against access by any user except root and the Data Server...

Page 187: ...runtime By default these files are var hpss ssm java policy ds var hpss ssm java policy hpssadm on the machine where the Data Server or hpssadm utility is executing respectively These file names can...

Page 188: ...n According to the documentation and upheld by some of our testing you should not need an explicit SocketPermission in the policy file just to listen on public ports nor to connect to applications on...

Page 189: ...eytab file containing his dce username and password Keytab files can be created using rgy_edit This procedure works for creating a keytab file Perform these steps on each machine from which the hpssad...

Page 190: ...at if it is executed as root it will start the Data Server as root but the System Manager as user hpss If the start_ssm script is executed under any other userid it will start both the Data Server and...

Page 191: ...n Chapter 13 HPSS Problem Diagnosis and Resolution page 485 in the HPSS Management Guide 2 On the host where the Data Server executes delete the keystore ds file with the expired certificate cd var hp...

Page 192: ...a Anything encrypted with a symmetric key can be decrypted only by the same symmetric key If two parties have access to the same symmetric key they can use it to shared encrypted information Public ke...

Page 193: ...ty whose certificate is in the trusted store So long as the second program can find a certificate in the chain which is in his trusted store he can trust the certificate owner This chaining ability wa...

Page 194: ...er netscape com docs manuals security sslin contents htm For a description of the Java policy file see Default Policy Implementation and Policy File Syntax http java sun com products jdk 1 2 docs guid...

Page 195: ...Remake the dependencies make dep 8 Build a new kernel make bzImage 9 Copy the bzImage to boot add a new stanza to the etc lilo conf file and run sbin lilo cp arch i386 boot bzImage boot vmlinuz 2 4 1...

Page 196: ...time you should also configure the kernel to support your disk or tape devices If tape device access is required be sure to also enable the kernel for SCSI tape support 7 Remake the dependencies make...

Page 197: ...eview considerations Class of Service List File sizes Will COS be selected by file size If so do the sizes presented make sense is there overlap amongst the COS s that can be selected by file size Are...

Page 198: ...s to have the Virtual Volume Block Size values be the same so that with good power of two stripe widths we wind up with a decent set of Mover to Mover connections i e each Mover on one side does not h...

Page 199: ...h locked usually just means they were being used for something else at the time lshpss was run Server List Overall just make sure there aren t extra test entries lying around that don t need to be The...

Page 200: ...local file support Encryption Key Set This is not critical but the encryption key should be set This should ensure that there is proper security placed on the TCP IP connection to the Mover the one u...

Page 201: ...ead most likely is it unlikely that it will be read again anytime soon Typically something like 60 minutes seems to be reasonable Start Stop Space Used Thresholds Accounting Policy None Log Policy Lis...

Page 202: ...mount for every archived log file most likely Log Client List Logfile Max Size A larger log file allows for easier debugging too small a log file forces the investigator to run delogs which includes i...

Page 203: ...how Device Location Configuration Information Verify that the busses are reasonably well used e g one SCSI adapter isn t connected to two tape drives while another adapters is unused Tape Device Info...

Page 204: ...rmance Maximum number of concurrent requests System reliability given a specific loading profile over a specific period of time Interoperability with other software Test procedures to verify that when...

Page 205: ...ion of HPSS please see Chapter 14 Upgrading to HPSS Release 4 5 page 553 in the HPSS Management Guide 4 1 1 Distribution Media For the current release the HPSS software is available on one of the foll...

Page 206: ...Package Description AIX hpss_runtime 4 5 0 0 lpp 410 MB hpss core 210 MB All HPSS Components hpss hdm 18 MB HDM DFS Component hpss mvr 145 MB Mover Component hpss subsy 155 MB Storage Subsystem hpss...

Page 207: ...lation Target Directory Preparation The HPSS software is installed in the opt hpss directory For AIX usr lpp hpss is also used by the SMIT utility to store the HPSS package deinstallation information...

Page 208: ...re 2 Enter the INPUT device directory for software information 3 Set the following parameter values on the screen INPUT device directory for software data entered from step 2 SOFTWARE to install hpss...

Page 209: ...initiate the installation process inst f var spool pkg HPSSndapi r opt hpss 5 Issue the following commands from the Inst Menu Inst list HPSSndapi Inst go Inst quit 4 4 4 Linux Installation 4 4 4 1 In...

Page 210: ...as follows opt hpss sammi hpss_ssm rw rw hpss hpss The HPSS file permissions can be further restricted or relaxed according to the site s policy However this should be done carefully so that the new...

Page 211: ...mand 5 Issue make idl tidl command 4 5 2 1 2 Construct the HPSS HDM Component Source Tree The HPSS HDM component source tree can be extracted from the HPSS base source tree To construct the HPSS HDM c...

Page 212: ...macros and then relinking the dynamic executable The RUNLIBS_PATH macro specifies the run time top level directory of the HPSS tree It defaults to opt hpss The Gatekeeper Server and SSM Data Server de...

Page 213: ...Issue make clean command 5 Issue make command 6 If the HPSS binaries and libraries are to be installed in a location different from their build location copy them to the install tree 4 5 3 Set Up Sam...

Page 214: ...Chapter 4 HPSS Installation 214 September 2002 HPSS Installation Guide Release 4 5 Revision 2...

Page 215: ...talled In addition a DCE DFS cell has been fully configured 5 1 1 Infrastructure Road Map The steps required to configure the HPSS infrastructure are listed below Each step is discussed in more detail...

Page 216: ...vironment variables that most likely do not need to be modified Before running the mkhpss script on a node copy the hpss_env default file to hpss_env Review and edit it to ensure that the variables re...

Page 217: ...1 12 07 06 95 updated descriptions 3 1 08 08 95 multiple platform support 3 2 08 30 95 multiple hpss support 3 3 10 23 95 gen0038 3 4 11 21 95 r3 pftpd changes 3 5 02 16 96 r3 clean up 3 6 02 19 96 r...

Page 218: ...he University of California Lawrence Livermore National Laboratory LLNL under Contract No W 7405 ENG 48 with the U S Department of Energy DOE by the University of California Lawrence Berkeley National...

Page 219: ...a b l e s HPSS_SFS_ADMIN Principal name for administrating hpss in Encina SFS HPSS_SFS_SERVER Encina SFS server name with CDS prefix J A V A V a r i a b l e s JAVA_ROOT Top level directory where Java...

Page 220: ...e s export HPSS_SFS_ADMIN encina_admin export HPSS_SFS_SERVER encina sfs hpss J A V A V a r i a b l e s if HPSS_SYSTEM SunOS then export JAVA_ROOT usr j2se export JAVA_HOME JAVA_ROOT jre else export J...

Page 221: ...lf Tape NDCG 1 11 dus 11 02 98gen0111 Add HPSS_PRINCIPAL_CLIENT_API update copyright 1 12 pal 11 30 98 mps0113 Change HPSS_UNIX_MPS_REPORT 1 13 dus 12 03 98gen0111 Add HPSS_CONFIG_ACCOUNTNG 1 14 pal 0...

Page 222: ...Berkeley National Laboratory LBNL under Contract No DEAC03776SF00098 with DOE by the University of California Los Alamos National Laboratory LANL under Contract No W 7405 ENG 36 with DOE by Sandia Cor...

Page 223: ...AR Pathname for HPSS var directory HPSS_USER HPSS user name HPSS_USERROOT Root user id HPSS_PATH_SAMMI_BIN Pathname for SAMMI bin HPSS_PATH_SAMMI_DATA Pathname for SAMMI data HPSS_ROOT opt hpss HPSS_H...

Page 224: ...for PVR HPSS_PRINCIPAL_SS DCE Principal name for Storage Server HPSS_PRINCIPAL_SSM DCE Principal name for SSM HPSS_PRINCIPAL NULL HPSS_PRINCIPAL_BFS hpss_bfs HPSS_PRINCIPAL_CLIENT_API hpss_client_api...

Page 225: ...UID HPSS_PRINCIPAL_MOUNTD_UID HPSS_PRINCIPAL_MPS_UID HPSS_PRINCIPAL_MVR_UID HPSS_PRINCIPAL_NDCG_UID HPSS_PRINCIPAL_NFSD_UID HPSS_PRINCIPAL_NS_UID HPSS_PRINCIPAL_PFSD_UID HPSS_PRINCIPAL_PVL_UID HPSS_PR...

Page 226: ...BIN hpss_mnt HPSS_EXEC_MPS HPSS_PATH_BIN hpss_mps HPSS_EXEC_MVR HPSS_PATH_BIN hpss_mvr HPSS_EXEC_MVR_TCP HPSS_PATH_BIN hpss_mvr_tcp HPSS_EXEC_NDCG HPSS_PATH_BIN hpss_ndcg HPSS_EXEC_NFSD HPSS_PATH_BIN...

Page 227: ...T acct_report HPSS_UNIX_ACCT_COMMENTARY HPSS_PATH_ACCT acct_commentary NFS Unix files HPSS_PATH_NFS unix path name for NFS files HPSS_UNIX_NFS_EXPORTS exports file HPSS_UNIX_NFS_CREDMAP credmap file H...

Page 228: ...m configurations HPSS_CONFIG_COS Class of service HPSS_CONFIG_HIERARCHY Hierarchy HPSS_CONFIG_STORAGECLASS Storage class HPSS_CONFIG_SCLASS Old name for Storage class HPSS_CONFIG_SCLASSTHRESHOLD Stora...

Page 229: ...S_SUFFIX HPSS_CONFIG_PURGP HPSS_CONFIG_PURGEPOLICY HPSS_CONFIG_SERVER HPSS_SFS_SERVER serverconfig HPSS_SFS_SUFFIX Storage Subsystem SFS Files These SFS files are specific to a particular storage subs...

Page 230: ...ink HPSS_SFS_SUFFIX HPSS_CONFIG_NSACLS HPSS_SFS_SERVER nsacls HPSS_SFS_SUFFIX HPSS_CONFIG_NSFILESETATTRS HPSS_SFS_SERVER nsfilesetattrs HPSS_SFS_SUFFIX HPSS_CONFIG_NSOBJECTS HPSS_SFS_SERVER nsobjects...

Page 231: ...SFS Files HPSS_CONFIG_DMG DMG type specific HPSS_CONFIG_DMGFILESET DMG filesets HPSS_CONFIG_DMG HPSS_SFS_SERVER dmg HPSS_SFS_SUFFIX HPSS_CONFIG_DMGFILESET HPSS_SFS_SERVER dmgfileset HPSS_SFS_SUFFIX Ga...

Page 232: ...ERVER mps HPSS_SFS_SUFFIX Mover SFS Files HPSS_CONFIG_MVR Mover type specific HPSS_CONFIG_MVR HPSS_SFS_SERVER mover HPSS_SFS_SUFFIX Non DCE SFS Files HPSS_CONFIG_NDCG Gateway type specific HPSS_CONFIG...

Page 233: ...SS_SFS_SERVER pvr HPSS_SFS_SUFFIX HPSS_CONFIG_CART_AMPEX HPSS_SFS_SERVER cartridge_ampex HPSS_SFS_SUFFIX HPSS_CONFIG_CART_OPER HPSS_SFS_SERVER cartridge_operator HPSS_SFS_SUFFIX HPSS_CONFIG_CART_STK H...

Page 234: ...Server HPSS_CDS_SSMSM CDS name SSM System Manager HPSS_CDS_PREFIX hpss HPSS_CDS_BFS HPSS_CDS_PREFIX bfs HPSS_CDS_DMG HPSS_CDS_PREFIX dmg HPSS_CDS_GK HPSS_CDS_PREFIX gk HPSS_CDS_HPSSD HPSS_CDS_PREFIX...

Page 235: ..._STK_RAIT Descriptive name PVR STK RAIT HPSS_DESC_PVR_3494 Descriptive name PVR 3494 HPSS_DESC_PVR_3495 Descriptive name PVR 3495 HPSS_DESC_PVR_LTO Descriptive name PVR LTO HPSS_DESC_PVR_AML Descripti...

Page 236: ...ful connection seconds HPSS_SM_SRV_LIST_UPDATE_INTERVAL Frequency at which the SM sends updated server lists to the Data Server so that we don t flood the Data Server with updates seconds HPSS_SM_SRV_...

Page 237: ...ct attributes HPSS_NOTIFY_Q_LIST_SIZE_MAX Maximum queue size for notifications of changes to the server list drive list class of service list storage class list hierarchy list migration policy list or...

Page 238: ...ation of mobjects Java classes HPSS_SSMDS_CLASSPATH SSMDS search path for Java classes AIXTHREAD_MNRATIO required for JNI under Java 1 3 0 on AIX AIXTHREAD_SCOPE required for JNI under Java 1 3 0 on A...

Page 239: ...AIXTHREAD_MNRATIO 1 1 AIXTHREAD_SCOPE S AIXTHREAD_MUTEX_DEBUG OFF AIXTHREAD_RWLOCK_DEBUG OFF AIXTHREAD_COND_DEBUG OFF HDM Specific HPSS_HDM_SHMEM_KEY The HDM s shared memory key default 3789 HPSS_HDM_...

Page 240: ...v5srvtab HPSS_NDCL_KEY_CONFIG_FILE HPSS_PATH_ETC ndcl keyconfig Installation Miscellaneous RPC_SUPPORTED_PROTSEQS The RPC transport protocol used HPSS_PATH_ADM Pathname where HPSS administrative file...

Page 241: ...tion on how to configure Encina SFS For example outputs from a sample configuration session refer to either Section E 1 AIX Infrastructure Configuration Example on page 497 Section E 3 Solaris Infrast...

Page 242: ...file Although it is recommended that the mkhpss script be used only once per node to configure the HPSS infrastructure it can be run again to correct or modify the infrastructure configuration as need...

Page 243: ...y store The following steps are performed during the interactive process of configuring the server 1 Creation of encina_admin_group and encina_servers_group DCE groups as well as prin cipals account a...

Page 244: ...up FTP Daemon option is selected 1 Prompt the user for the port number to be used by the HPSS FTP 2 Add hpssftp and hpssftp data entries to the etc services file 3 Add the hpssftp entry to the etc ine...

Page 245: ...time 5 5 8 Re run hpss_env If requested the mkhpss script will re read the environment variable values defined in the hpss_env file and the hpss_env_defs h file 5 5 9 Un configure HPSS This option all...

Page 246: ...ABOUT TO UN CONFIGURE HPSS mkhpss WARNING LOCAL HPSS CONFIGURATION METADATA WILL BE DESTROYED mkhpss WARNING LOCAL HPSS CONFIGURATION METADATA WILL BE DESTROYED mkhpss WARNING LOCAL HPSS CONFIGURATION...

Page 247: ...er the DCE Registry holds only the randomized keys Periodically the HPSS administrator should change the passwords in the two HPSS keytab files The procedure to change the passwords is as follows 1 Li...

Page 248: ...he following ownership and permissions set krb5 hpss keytabs hpss hpss rw rw krb5 hpssclient keytab hpss hpss rw rw It is strongly recommended that both keytab files be generated on a single HPSS serv...

Page 249: ...e configuration have been completed 6 1 1 HPSS Configuration Roadmap The following steps summarize the configuration for the HPSS system It is very important that the steps be performed in the order l...

Page 250: ...SSM and or the HPSS servers 6 1 2 1 Server Maximum number of HPSS servers unlimited 6 1 2 2 Storage Policy Total Accounting Policies 1 Total Migration Policies 64 Total Purge Policies 64 6 1 2 3 Stor...

Page 251: ...the form of tables Each table lists the SSM window display field names and for each field gives a description of the variable acceptable values for the variable and the default value of the variable i...

Page 252: ...server For servers that have the ability to reinitialize without restarting i e the Metadata Monitor Log Daemon and Log Client this can be accomplished by using the Reinitialize Server feature in the...

Page 253: ...ed with the s start the System Manager only option or the d start the Data Server only option Once the SSM servers are up and running one or more SSM sessions can be started to manage HPSS Before star...

Page 254: ...The key bindings file is named motifbind and must be placed in the user s home directory on the host where the user will be displaying the SSM windows Refer to Section F 4 Customizing SSM and Sammi o...

Page 255: ...should never be done From the HPSS Health and Status window shown in Figure 6 1 on page 252 click on the Admin menu select the Configure HPSS option and click on the Global option The HPSS Global Con...

Page 256: ...Configuration Variables Figure 6 3 HPSS Global Configuration screen Table 6 1 lists the Global Configuration variables and provides specific recommendations for the Global Configuration Table 6 1 Glo...

Page 257: ...blank Once one or more Classes of Service have been created the Global Configuration window can be reopened to Update the record and a Default Class of Service can be selected If no Default Class of...

Page 258: ...e basic server configurations stored Any valid Encina filename encina sfs hpss serverconfig Location Server Policies Name of the SFS file where the location policy is stored Any valid Encina filename...

Page 259: ...om the popup list The window will be refreshed with the configuration data After modifying the data click the Update button to write the changes to the SFS file To delete an existing storage subsystem...

Page 260: ...lists the Storage Subsystem Configuration Variables and provides specific recommendations Table 6 2 Storage Subsystem Configuration Variables Display Field Name Description Acceptable Values Default V...

Page 261: ...he Gatekeeper server for this subsystem The descriptive name of any valid gatekeeper default none no gatekeeper specified Advice It is very likely that you will configure a subsystem before configurin...

Page 262: ...Before configuring the HPSS servers the planning guidelines for the HPSS servers as described in Section 2 6 HPSS Server Considerations on page 62 should be carefully considered The SSM System Manager...

Page 263: ...t values If the default data is not desired change the field with the desired value Click on the Add button to create the configuration entry To update an existing configuration select the desired ser...

Page 264: ...Chapter 6 HPSS Configuration 264 September 2002 HPSS Installation Guide Release 4 5 Revision 2 Figure 6 5 HPSS Servers Window...

Page 265: ...In addition each HPSS basic server configuration includes Security Information and Audit Policy fields that determine the server s security environment The security of the HPSS system will be a resul...

Page 266: ...e Descriptive Name is unique A server s descriptive name should be meaningful to local site administrators and operators in contrast to the server s corresponding UUID which has meaning for DCE and HP...

Page 267: ...his is not observed servers will have trouble contacting each other or will talk to different servers than anticipated 2 The directories must be writable by the process that uses them 3 It is useful t...

Page 268: ...erver s execution control configuration Server Configuration File SFS The name of the Encina SFS file containing configuration data for this server Any valid SFS filename Based on the selected server...

Page 269: ...ct Execute Hostname as is specified in the non DCE Mover s basic configuration Note The SSM does not check if the server or the Startup Daemon is actually running on the specified host It simply compa...

Page 270: ...f the server runs for more than an hour without failing the Startup Daemon will set its failure count for that server back to zero A negative value in this field will be interpreted as an infinite cou...

Page 271: ...FS 200 DMG 100 GK 200 Log Client 10 Log Daemon 10 LS 20 MMON 10 Mount Daemon 10 MPS 10 MVR 20 NDCG 20 NFS Daemon 20 NS 200 PVL 20 PVR 20 SS 20 SSM 100 Startup Daemon 10 Advice This value should be set...

Page 272: ...l to or larger than the value used for Maximum Connections The SSM System Manager does not use this field It uses the ENCINA_TPOOL _SIZE environment variable defined by the opt hpss config hpss_env sc...

Page 273: ...the Keytab Pathname field contains an entry for this principal otherwise authentication will fail Protection Level The amount of encryption that will be used in communication with peer applications D...

Page 274: ...ntication Service The authentication service to use in communications None Secret Public Default Secret Advice Secret provides for authenticated communications between HPSS components The authenticati...

Page 275: ...rently the only authentication services supported are none and dce NULL or any UNIX pathname that points to a key file krb5 hpss keytabs Advice If dce authentication is to be used and the Keytab Pathn...

Page 276: ...creation should set the CREAT field to ALL for Name Server LINK The Security Audit Policy for Name Server Hard Link Creation events If set security audit messages will be sent to the logging subsystem...

Page 277: ...t messages will be sent to the logging subsystem NONE FAILURE ALL FAILURE for Name Server NONE for other servers Advice Sites that must audit object creation should set the UNLINK field to ALL for Nam...

Page 278: ...e DMG Security object user HPSS_PRINCIPAL_FTPD r c user HPSS_PRINCIPAL_BFS r c user HPSS_PRINCIPAL_NDCG r c user HPSS_PRINCIPAL_NFSD r c user HPSS_PRINCIPAL_SSM rw c user cell_admin rwdtc any_other t...

Page 279: ...oup subsys dce cds admin rwdtc group subsys dce cds server rwdtc any_other t CDS Security object for the PVR Security object user HPSS_PRINCIPAL_PVL rwdt user HPSS_PRINCIPAL_SSM rwdtc group subsys dce...

Page 280: ...tton to write the new basic policy to the metadata file To configure a subsystem specific policy select an existing basic policy as described below Once the existing basic policy is displayed click on...

Page 281: ...Information window If the Migration Purge Servers are restarted the changes to the migration policy are applied to all storage classes which reference the policy If the policy is reread the changes a...

Page 282: ...1 1 Migration Policy Configuration Variables Table 6 4 lists the fields on the Migration Policy window and provides specific recommendations for configuring the Migration Policy for use by HPSS Note...

Page 283: ...The file must not have been read in the last interval minutes This applies to tape volume migration and tape file migration with purge only 0 1000000 one million 60 Advice Refer to Section 2 8 1 2 for...

Page 284: ...ape storage classes only ON OFF OFF Migrate Files Selects the tape file migration algorithm A duplicate copy of the tape files is made at the next lower level in the hierarchy Applies to tape storage...

Page 285: ...HPSS Health and Status window shown in Figure 6 1 on page 252 click on the Admin menu select the Configure HPSS option and click on the Purge Policies option The Purge Policy window will be displayed...

Page 286: ...n a purge policy is added to or removed from a storage class configuration the Migration Purge Servers must be restarted in order for purge to begin or end on this storage class It is not possible for...

Page 287: ...d operations available from the window Figure 6 8 Purge Policy Window 6 6 2 1 Purge Policy Configuration Variables Table 6 5 lists the fields on the Purge Policy window and provides specific recommend...

Page 288: ...he length of time specified by this field 0 1000000 one million 60 Start purge when space used reaches Purging will begin for a storage class when the amount of its space used exceeds this threshold U...

Page 289: ...change the default fields with the desired values and click on the Add button to create the configuration entry To update an existing policy modify the policy data and click on the Update button to w...

Page 290: ...Guide Release 4 5 Revision 2 Figure 6 9 Accounting Policy Window 6 6 3 1 Accounting Policy Configuration Variables Table 6 6 lists the fields on the Accounting Policy window and provides specific reco...

Page 291: ...ed in the report file Bytes Kilobytes Megabytes Gigabytes Terabytes Bytes Status Message Interval The number of seconds between status messages sent to SSM by the Accounting utility during an accounti...

Page 292: ...Only used if Account Validation has been enabled If this flag is disabled validation will only occur during required operations such as file creations file ownership changes and account change operat...

Page 293: ...u select the Configure HPSS option and click on the Logging Policies option Multiple changes to the logging policy list can be made at one time When all the changes are completed clicking on the Save...

Page 294: ...want to modify to change its state to on or off MOD will be displayed in the Mod column Repeat this sequence for each policy which you want to change When finished making all the changes to the list...

Page 295: ...ation Variables Display Field Name Description Acceptable Values Default Value Default Logging Policy The descriptive name of the default logging policy This policy will apply to all servers which do...

Page 296: ...Trace Status Values from the Default Logging Policy entry If no Default Logging Policy name the default is Alarm Event Request Security Accounting Debug Status Advice It is recommended that at least...

Page 297: ...he log and to SSM for displaying in the HPSS Alarms and Events window see Figure 1 5 on page 38 of the HPSS Management Guide SSM Types Record types that are to be sent to SSM for display Any combinati...

Page 298: ...exit processing flows Typically the policy would be to not send these messages to the log The Logging Policy can be created using the HPSS Logging Policies window After the Logging Policy is created i...

Page 299: ...vides Logging Policy configuration information Table 6 8 Logging Policy Configuration Variables Display Field Name Description Acceptable Values Default Value Name of Server to Which Policy Applies Th...

Page 300: ...the window s help file for more information on the individual fields and buttons as well as the supported operations available from the window Record Types to Log Record types that are to be logged fo...

Page 301: ...of the HPSS Management Guide can be used to reinitialize a running Location Server Figure 6 12 Location Policy Window 6 6 5 1 Location Policy Configuration Variables Table 6 9 lists the fields on the...

Page 302: ...cated to contact remote LSs concurrently Any positive integer value 5 Advice This value does not need to be changed unless there are defined remote sites and the system is experiencing timeout problem...

Page 303: ...on can be created and maintained using the Remote Sites window From the HPSS Health and Status window Figure 6 1 on page 252 click on the Admin menu select the Configure HPSS option and click on the R...

Page 304: ...on To clear out the fields on the screen in order to add a new Remote Site click on the Start New button Refer to the window s help file for more information on the individual fields and the buttons a...

Page 305: ...lass Figure 6 15 before modifying any other fields If the default data is not desired change the fields with the desired values Click on the Add button to create the configuration entry To update an e...

Page 306: ...ng and critical thresholds are set to default If this is not done one or more threshold records will remain in metadata and will become orphaned when the storage class configuration is deleted Refer t...

Page 307: ...ation Window 6 7 1 1 Storage Class Configuration Variables Table 6 11 lists the fields on the Storage Class Configuration window and provides specific recommendations for configuring the storage class...

Page 308: ...storage class Any configured migration policy name from the pop up list May be left blank if migration is not desired for this storage class Blank Advice Do not configure a migration policy for a sto...

Page 309: ...integer value Based on selected Media Type Advice See Section 2 9 1 10 for considerations on selecting a good value for PV Estimated Size PV Size The size of a disk PV in the storage class in bytes An...

Page 310: ...ape Marks field and use Seconds Between Tape Marks value for feedback on the resulting time interval or enter a value into the Seconds Between Tape Marks and let SSM calculate the Blocks Between Tape...

Page 311: ...e 10 Critical Threshold High threshold for the amount of space used in this storage class For disk this is the percentage of total space used For tape this is the number of free VVs remaining Alarms w...

Page 312: ...values in this field restrict files being written in the storage class to a small number of tapes reducing the number of tape mounts The number of tape drives used to write files in the storage class...

Page 313: ...tains a single line for each storage subsystem configured in the HPSS For each subsystem this line indicates the Warning and Critical Thresholds being used for that storage class The text default indi...

Page 314: ...urge Servers in all storage subsystems using the default thresholds for this storage class must be restarted If subsystem specific thresholds are added removed or changed the Migration Purge Servers f...

Page 315: ...selected storage hierarchy After modifying the data click on the Update button to write the changes to the SFS file Refer to Section 3 11 2 Changing Storage Hierarchy Definition page 80 in the HPSS Ma...

Page 316: ...the individual fields and buttons as well as the supported operations available from the window The following rules for creating valid storage hierarchies are enforced by the Storage Hierarchy Configu...

Page 317: ...erarchy ID Advice A hierarchy s descriptive name should be meaningful to local site administrators and operators Top Storage Class The name of the storage class associated with the top level in the hi...

Page 318: ...an existing class of service select the Load Existing button on the Class of Service Configuration window and select the desired class of service from the popup list The window will be refreshed with...

Page 319: ...iables Table 6 14 lists the fields on the HPSS Class of Service window and provides Class of Service configuration information Table 6 14 Class of Service Configuration Variables Display Field Name De...

Page 320: ...he appropriate stage code Minimum File Size The size in bytes of the smallest bitfiles supported by this COS Any positive 64 bit integer value Same as last configured COS Maximum File Size The size in...

Page 321: ...s of a COS Access Frequency The frequency on average for accessing files in this COS Hourly Daily Weekly Monthly Archive Daily Optimum Access Size The suggested number of bytes that should be written...

Page 322: ...y If the default data is not desired change the fields with the desired values Click on the Add button to create the configuration entry To update an existing file family select the Load Existing butt...

Page 323: ...ily Variables Display Field Name Description Acceptable Values Default Value Family ID An unsigned non zero integer which serves as a unique identifier for this file family A unique default value is p...

Page 324: ...n the Type specific button from the Configuration button group on the HPSS Servers window The Bitfile Server Configuration window will be displayed as shown in Figure 6 20 with default values If the d...

Page 325: ...25 Release 4 5 Revision 2 Figure 6 20 Bitfile Server Configuration Window 6 8 1 1 Bitfile Server Configuration Variables Table 6 16 lists the fields on the Bitfile Server Configuration window and prov...

Page 326: ...he open request is also counted This value should be set high enough to cover the maximum number of active and queued requests expected in the system This value cannot be higher than the maximum numbe...

Page 327: ...y forever is processed on a bitfile before the request to change the COS of the bitfile is rejected 0 2 32 1 0 Note A SIGUSR1 signal can be sent to the Bitfile Server to toggle emptying the COS change...

Page 328: ...ated to tape SFS Filenames The fields below list the names of the SFS files used by the BFS Bitfile Descriptors The file name of the SFS file where the bitfile descriptor information is stored Valid E...

Page 329: ...onfiguration button group The DMAP Gateway Configuration window will be displayed with the configured data After modifying the configuration click on the Update button to write the changes to the appr...

Page 330: ...es Default Value Server Name The descriptive name of the DMAP Gateway This name is copied over from the selected DMAP Gateway general configuration entry This field cannot be modified It is displayed...

Page 331: ...on group The Gatekeeper Server Configuration window will be displayed with the configured data After modifying the configuration click on the Update button to write the changes to the appropriate SFS...

Page 332: ...tekeeper Configuration Variables Table 6 18 Gatekeeper Configuration Fields on page 332 lists the fields on the Gatekeeper Server Configuration window and provides specific recommendations for configu...

Page 333: ...ill be displayed with the configured data After modifying the configuration click on the Update button to write the changes to the appropriate SFS file To delete an existing configuration select the L...

Page 334: ...ns for configuring a Log Client for use by HPSS Table 6 19 Log Client Configuration Variables Display Field Name Description Acceptable Values Default Value Server Name The descriptive name of the Log...

Page 335: ...the Log Daemon Local Logfile Unix The fully qualified path name of the Log Client formatted log file If Local LogFile is specified in the Log Messages To field those messages sent to this instance of...

Page 336: ...PSS Servers window and click on the Type specific button from the Configuration button group The Logging Daemon Configuration window will be displayed with the configured data After modifying the conf...

Page 337: ...s and buttons as well as the supported operations available from the window Figure 6 24 Logging Daemon Configuration Window 6 8 5 1 Log File Archival The Log Daemon can be configured to automatically...

Page 338: ...ng application The port value must be a different value than the port number in the Log Client configuration entries Log File Maximum Size The maximum size in bytes of the central log file Once this s...

Page 339: ...Add button to create the configuration entry Log Directory The name of the directory in which log files are stored Any valid UNIX path name The string length in bytes is limited to a minimum of the op...

Page 340: ...on select the Metadata Monitor entry on the HPSS Servers window and click on the Type specific button from the Configuration button group The Metadata Monitor Configuration window will be displayed wi...

Page 341: ...displayed for reference only The selected MMON descriptive name Server ID The UUID of the Metadata Monitor This ID is copied over from the MMON general configuration entry The UUID of the MMON This fi...

Page 342: ...and click on the Type specific button from the Configuration button group The Migration Purge Server Configuration window will be displayed with the configured data After modifying the configuration c...

Page 343: ...configuration entry This field cannot be modified It is displayed for reference only The selected MPS descriptive name Server ID The UUID of the MPS This ID is copied over from the selected MPS genera...

Page 344: ...information is stored Valid Encina file name encina sfs hpss mpchkpt BFS API Failures For both disk and tape migration MPS allows a consecutive number of BFS API failures up to the error limit config...

Page 345: ...ure 6 27 with default values If the default data is not desired change the fields with the desired values Click on the Add button to create the configuration entry To update an existing configuration...

Page 346: ...iguration window and provides specific recommendations for configuring the MVR for use by HPSS Table 6 23 Mover Configuration Variables Display Field Name Description Acceptable Values Default Value S...

Page 347: ...inefficient for small transfers e g if the mover buffer size is 4MB but client requests are 512KB the Mover will not achieve any double buffering benefit because the entire amount of the transfer fit...

Page 348: ...stname The name of the host interface used by the TCP IP listen process Valid host name for the network interfaces on the MVR machine Extracted from the MVR general configuration entry Advice If the M...

Page 349: ...ng in the Non DCE Mover s specific configuration TCP Path Name The pathname of the MVR TCP IP listen executable Fully qualified file name of the MVR TCP IP listen executable usr lpp hpss bin hpss_mvr_...

Page 350: ...he pathname to a file that will contain an ASCII representation of the configured encryption key for the Mover see the next section for further details For example hpss_mvr1 stream tcp nowait root opt...

Page 351: ...made to the non DCE Mover processes the encryption key configured in this Mover s specific configuration see section 6 8 8 is read from a file accessible from the local file system This file contains...

Page 352: ...er or non DCE Mover process on a Linux platform there are a number of system configuration parameters which may need to be modified before the Mover can be successfully run The values can be modified...

Page 353: ...of service which is valid for a Mover supporting the local file transfer option The Mover must be running as root If there are other Movers running on the same node they must also run as root to take...

Page 354: ...ted or deleted through the same window From the HPSS Health and Status window shown in Figure 6 1 click on the Admin menu select the Configure HPSS option and click on the Servers option The HPSS Serv...

Page 355: ...002 355 Release 4 5 Revision 2 Figure 6 28 Name Server Configuration Window 6 8 9 1 Name Server Configuration Variables Table 6 27 lists the fields on the Name Server Configuration window and provides...

Page 356: ...store metadata objects Any positive 64 bit integer value 1 000 000 Advice This limit must consider the maximum anticipated number of files and directories in the system the upper limit for SFS and the...

Page 357: ...n existing configuration select the NFS Daemon entry on the HPSS Servers window and click on the Type specific button from the Configuration button group The NFS Daemon Root Fileset Name The name to b...

Page 358: ...e To delete an existing configuration select the NFS Daemon entry on the HPSS Servers window and click on the Type specific button from the Configuration button group The NFS Daemon Configuration wind...

Page 359: ...Chapter 6 HPSS Configuration HPSS Installation Guide September 2002 359 Release 4 5 Revision 2 Figure 6 29 NFS Daemon Configuration Window left side...

Page 360: ...Chapter 6 HPSS Configuration 360 September 2002 HPSS Installation Guide Release 4 5 Revision 2 Figure 6 30 NFS Daemon Configuration window right side...

Page 361: ...his field cannot be modified It is displayed for reference only Extracted from the NFS Daemon general configuration entry Maximum RPC Threads The number of NFS requests that can be processed concurren...

Page 362: ...quest is correct ON OFF OFF Note Using the Cookie Verifier can introduce problems on clients where it is not supported Therefore this option should not be used if NFS V2 clients are used Credentials M...

Page 363: ...o change entries in the NFS credentials map other than their own Valid DCE principal name hpss_ssm Credentials Dump File Unix The name of a UNIX file to checkpoint the credentials map cache Valid full...

Page 364: ...ber of HPSS objects used through NFS at any one time LRU Maximum Length The maximum number of HPSS objects to cache Any positive 32 bit integer value 300 Advice This value should be equal to the numbe...

Page 365: ...Advice When multiplied by the Buffer Size this value represents the RAM used to hold cache entries while they are being worked on This value must be at least 3 Cache File Unix The name of a local UNI...

Page 366: ...ored when the Dirty Threshold is exceeded It is recommended that this value be greater than the number of seconds the NFS client cache holds on to dirty data Touch Weight The importance of writing bac...

Page 367: ...ype specific button from the Configuration button group The Non DCE Client Gateway Configuration window will be displayed with the configured data After modifying the configuration click on the Update...

Page 368: ...ble 6 29 lists the fields on the Non DCE Client Gateway Configuration window and provides specific recommendations for configuring the Non DCE Client Gateway for use by HPSS Table 6 29 Non DCE Client...

Page 369: ...an be connected to the Non DCE Client Gateway at a time Any positive 32 bit integer value 50 Thread Pool Size The size of the request thread pool for each request process If the number of simultaneous...

Page 370: ...the type of authentication mechanism it wishes to use By default the NDAPI supports the DCE and None mechanisms NDAPI Client Library and Gateway can be rebuilt to also support Kerberos authentication...

Page 371: ...indow and click on the Type specific button from the Configuration button group The PVL Server Configuration window will be displayed with the configured data After modifying the configuration click o...

Page 372: ...isplayed for reference only Extracted from the PVL general server configuration entry SFS Filenames The fields below list the names of the SFS files used by the PVL Server Volumes The name of the Enci...

Page 373: ...ndow will be displayed as shown in Figure 6 5 To add a new specific configuration select the PVR Server entry and click on the Type specific button from the Configuration button group on the HPSS Serv...

Page 374: ...Chapter 6 HPSS Configuration 374 September 2002 HPSS Installation Guide Release 4 5 Revision 2 Figure 6 33 3494 PVR Server Configuration Window...

Page 375: ...Chapter 6 HPSS Configuration HPSS Installation Guide September 2002 375 Release 4 5 Revision 2 Figure 6 34 3495 PVR Server Configuration Window...

Page 376: ...Chapter 6 HPSS Configuration 376 September 2002 HPSS Installation Guide Release 4 5 Revision 2 Figure 6 35 3584 LTO PVR Server Configuration Window...

Page 377: ...Chapter 6 HPSS Configuration HPSS Installation Guide September 2002 377 Release 4 5 Revision 2 Figure 6 36 AML PVR Server Configuration Window...

Page 378: ...Chapter 6 HPSS Configuration 378 September 2002 HPSS Installation Guide Release 4 5 Revision 2 Figure 6 37 STK PVR Server Configuration Window...

Page 379: ...Chapter 6 HPSS Configuration HPSS Installation Guide September 2002 379 Release 4 5 Revision 2 Figure 6 38 STK RAIT PVR Server Configuration Window...

Page 380: ...Server Configuration window and provides specific recommendations for configuring a PVR for use by HPSS Table 6 31 Physical Volume Repository Configuration Variables Display Field Name Description Ac...

Page 381: ...rtridge_rait for StorageTek RAIT PVRs ccartridge_operator for Operator PVRs If two robots of the same type are managed by two different PVRs be sure that each one has a different SFS file for cartridg...

Page 382: ...ed on this drive s controller The larger the number the harder the PVR will try to avoid mounting any two tapes on drives attached to the same controller See Advice below for more information Any posi...

Page 383: ...currently driving a minimum number of tapes So in an environment with many tape drives per controller the best performance will be achieved by minimizing the load on any one controller Shelf Tape Chec...

Page 384: ...try Mount Time Limit This field controls the mount behavior of the PVR If an error is encountered during a PVR mount operation the mount will pend and be retried every 5 minutes Setting a value in the...

Page 385: ...tive errors is exceeded Physical Drive Count The number of physical drives associated with the PVR s RAIT drive pool This value is read by the PVL on startup Alterations to the value this field will n...

Page 386: ...Client Name The name of the client requesting authorization from the Distributed Automated Media Library Server Any alphanumeric string of length 64 none Additional Info DAS software which executes o...

Page 387: ...ss the robot For AIX systems this file is usually named dev smc0 and can be created using the System Management Interface Tool SMIT or using cfgmgr The 3584 Library can be partitioned into multiple lo...

Page 388: ...e System Management Interface Tool SMIT For a BMUX connected robot the files can be defined to be a Command Port or an Asynchronous Async Port The HPSS PVR requires both By default the PVR will expect...

Page 389: ...S operator screen and HPSS will retry the eject operation periodically 6 8 13 3 4 Vendor Information 1 IBM 3494 Tape Library Dataserver Operator s Guide GA32 0280 02 2 Parallel and ESCON Channel Tape...

Page 390: ...ically polls all drives in its pool so these drives cannot be used by other tape management software when HPSS is running even if HPSS is not currently mounting tapes to those drives HPSS will use any...

Page 391: ...f the following probably 4 ACSLS Release Number Remote Host Version Number 5 x 4 5 Whether processes created should be listed Y or N specify either y or n 6 Whether t_cdriver should be started specify...

Page 392: ...are which consists of the Automated Media Library AML Client Interface ACI and the DAS server components The AMU is the host computer software by which the ADIC Storage System manages the archive data...

Page 393: ...ng new cartridges into HPSS the cartridges must be entered into the AML Insert Eject Foreign I E F port before any HPSS import operations are performed The HPSS AML PVR moves the cartridges into the t...

Page 394: ...Order no DOC F00 010 B 2 Reference Guide AMU Order no DOC E00 005 3 Interfacing Guide DAS Order no DOC F00 011 6 8 14 Configure the Storage Server Specific Information The Storage Server specific con...

Page 395: ...rver the statistics fields Total Virtual Volumes Total Allocated Volumes Total Bytes Used Bytes and Free Bytes in the Storage Server Configuration window will not be displayed These fields cannot be s...

Page 396: ...Chapter 6 HPSS Configuration 396 September 2002 HPSS Installation Guide Release 4 5 Revision 2 Figure 6 40 Disk Storage Server Configuration Window...

Page 397: ...rage Server Configuration window and provides specific recommendations for configuring a Storage Server for use by HPSS Table 6 32 Storage Server Configuration Variables Display Field Name Description...

Page 398: ...changed when the SS is not running See the documentation on the utility program settapestats for information about updating this value in established servers Total Allocated Volumes The number of vir...

Page 399: ...S will calculate and update the configuration file as storage segments are written shortened or deleted and as volume state change This value should only be changed when the SS is not running and only...

Page 400: ...me metadata Valid SFS file name The file must not be shared with other Storage Servers encina sfs hpss vvdisk for Disk SS encina sfs hpss vvtape for Tape SS Advice Use a name that is meaningful to the...

Page 401: ...then the corresponding PVR must also be shutdown SSM will enforce this restriction To set the devices to use variable blocks on an AIX platform use either the chdev command substituting the appropria...

Page 402: ...e Systems Information on page 392 as appropriate These sections provide additional vendor specific advice on robot and drive configuration A Device and Drive configuration entry can be created updated...

Page 403: ...the configuration entry To update an existing device and drive select the desired device and drive entry on the HPSS Devices and Drives window and click on the Configure button The Mover Device and P...

Page 404: ...Chapter 6 HPSS Configuration 404 September 2002 HPSS Installation Guide Release 4 5 Revision 2 Figure 6 43 Disk Mover Device and PVL Drive Configuration Window...

Page 405: ...rive Configuration Variables Table 6 33 lists the fields on the Mover Device and PVL Drive Configuration window Table 6 33 Device Drive Configuration Variables Display Field Name Description Acceptabl...

Page 406: ...ces only Mounted Volume The 8 character name of the volume mounted on the disk drive if any Valid 8 character name assigned to the disk volume None Advice This value is meaningful for disk devices onl...

Page 407: ...commended that the drives that are on the same adapter bus have the same Controller ID For drives in 3494 and 3495 robots the Controller ID must be a valid ID The valid IDs can be found in the Affinit...

Page 408: ...to rewind the drive upon close For other drives on IRIX the tpsXdYnsvc name should be used indicating that the driver allow compression and variable block sizes For Solaris systems SCSI attached tape...

Page 409: ...brary device number of the drive Determine the Library device number by running the command opt hpss bin GetESANumbers dev rmtX for each tape drive in the robot For operator mounted drives For manuall...

Page 410: ...provide a higher performance method to ensure that data has been safely written to the media This option is not used for the 3480 3490 3490E 3590 Timberline and Redwood devices provided the HPSS suppo...

Page 411: ...ver Tape Drive Combinations Platform Driver Device s AIX IBM 3490 3590 3590E 3590H 3580 AdvanTAPE Redwood Timberline 9840 9940 9940B RAIT 9840 RAIT 9940 Native 9840 9940 9840B 9940B Solaris IBM 3490 3...

Page 412: ...Chapter 6 HPSS Configuration 412 September 2002 HPSS Installation Guide Release 4 5 Revision 2...

Page 413: ...created by the Client API The default value is the default hostname of the machine on which the Client API is running This value can have a significant impact on data transfer performance for data tra...

Page 414: ...at no retries are to be performed and a value of 1 indicates that retries should be attempted until either the request succeeds or fails for another reason The default value is 3 The HPSS_BUSY_DELAY e...

Page 415: ...ess directories which are located in another DCE cell The default value is zero cross cell enabled The HPSS_DISABLE_JUNCTIONS environment variable is used to control junction traversal When junction t...

Page 416: ...ERS environment variable The default value is 8001 The HPSS_NDCG_SERVERS defines the name of the server on which the Non DCE Client Gateway resides Multiple servers may be separated by a colon If mult...

Page 417: ...debug messages By default these messages will go to the standard output stream If HPSS_DEBUGPATH is set however these messages will be directed to the file indicated by this environment variable Two...

Page 418: ...ce clearlake ibm com The HPSS_DMAP_WRITE_UPDATES environment variable is used control the frequency of cache invalidates that are issued to the DMAPI file system while writing to a file that is mirror...

Page 419: ...he ndcl keyconfig file See Section 7 2 1 Configuration Files on page 415 for more information Compile the client library ndcl with the DAUTH_TYPE_DCE flag enabled in the Makefile Make sure you link th...

Page 420: ...mappings for the various hosts in the kerberos cell At the very least it should have A mapping from the NDCG server host dopey clearlake ibm com to the realm name dopey_cell clearlake ibm com A mappin...

Page 421: ...ly domain qualified name Kerberos expects this The password represented as qwerty above should be any easily typed and easily remembered string because it is going to get changed in the next step None...

Page 422: ...a 1 Verifying the FTP Initial Configuration 2 Configuring the FTP Daemon Syslog 3 Defining the FTP Access 4 Creating FTP Users These steps are described in more detail in the paragraphs that follow St...

Page 423: ...syslog as much debug information as possible See the explanation below for the d option Table 7 1 Parallel FTP Daemon Options Option Description a Mandate Authentication with DCE Kerberos Credentials...

Page 424: ...the v option is 1 No v option required Future implementation may allow for increasing the value to either 2 or 3 to obtain additional Client API information This would be accomplished by specifying 1...

Page 425: ...om the ftpaccess file to specify an alternate site The string is the DCE cellname This should rarely be necessary P Read the hpss_option PRINC principal from the ftpaccess file to obtain the DCE princ...

Page 426: ...ation T he default syslog is LOG_DAEMON This is modifiable to other options using the s option on the startup line NOTE the precautions above Step 3 Defining the FTP Access The FTPBaseDir etc ftpacces...

Page 427: ...down message to current FTP users shutdown shutdown_info_pathname Send message to users possible on access to a directory message pathname when Display prompt to read a file possible on access to a di...

Page 428: ...roup Entry Mandatory hpss_option LS hpss ls group Define an alternative Site Name hpss_option SITE dce xyz abc Define the HPSS FTP Principal hpss_option PRINC hpss ftp Define the Maximum timeout in Se...

Page 429: ...he when clauses may be either login in which case the file is displayed when the user logs in or cwd directory_name in which case the file is displayed when the user changes to the named directory wit...

Page 430: ...d to specify a password file other than the default file var hpss ftp etc ftppasswd If the HPSS PFTP Daemon utilizes the DCE Registry for authentication S or X options the ftpaccess file is superfluou...

Page 431: ...an option to validate the network address of hosts attempting to mount HPSS directories The default configuration disables this check To enable this check define the variable HPSS_MOUNTD_IPCHECK in t...

Page 432: ...that fileset If the field is present the directory refers to the named fileset Directory Specifies the complete HPSS directory pathname relative to the fileset given by Fileset Option Specifies optio...

Page 433: ...granted root access Network names are not allowed for this option access Client Client Gives mount access to each client listed A client can be either a hostname or a network name Each client in the l...

Page 434: ...ed A site specific MPI IO must be generated using make in the src mpi directory after the appropriate configuration changes have been made in Makefile macros To enable MPI IO change the MPIO_SUPPORT i...

Page 435: ...and MPIO_FORTRAN_SUPPORT to off The following environment variables can also be used to amend the MPI IO API configuration The MPIO_LOGIN_NAME defines the DCE login name of the principal who will be...

Page 436: ...ous file system operations XDSM enables the DMAP to control disk storage by allowing the DMAP to move disk resident file data to tertiary storage systems and vice versa 7 6 2 Filesets DFS supports log...

Page 437: ...or when high performance I O rates are important use the HPSS interface 7 6 2 3 Architectural Overview To interface DFS with HPSS modifications to both DFS and HPSS were required The architecture use...

Page 438: ...plementation supported by Transarc is called the DFS Storage Management Toolkit DFS SMT It is fully compliant with the corresponding standard XDSM specification In addition it provides optional featur...

Page 439: ...is case the DMAP must retrieve the data from tertiary storage Hence Episode marks these file blocks as being off line in tertiary store instead of as a hole This allows the file server to handle parti...

Page 440: ...d However for archived filesets only create and destroy name space events are processed but no HPSS resources are utilized until the file is migrated to HPSS HDM receives data space events when a file...

Page 441: ...using the HPSS DFS interface Some of these limitations are the result of implementation decisions others are hardware dependent This section will address these limitations explain why they exist when...

Page 442: ...attributes but this can be done quickly approximately 60 per second Episode XDSM DMAPI changes have been discussed between HPSS and Transarc It is believed that with these changes the Episode XDSM DMA...

Page 443: ...5 Cloning Replication and Fileset Backup Aggregates managed by the Episode XDSM DMAPI do not support cloning Fileset replication and movement can not be done because they require cloning DFS recommend...

Page 444: ...he system administrator must consider what level of HDM DMG activity the core HPSS servers can support HPSS speed is limited by hardware SFS disk and tape speeds If HDM DMG activity causes millions of...

Page 445: ...to 1 causes a 4 second delay Configuring this parameter is described in the next section 7 6 3 2 Configuring DCE DFS DFS Only To avoid data and name space inconsistencies the HDM should be started be...

Page 446: ...he result that DFS will never start In this script be sure to set the delay parameter on cfgdmepi to 1 This parameter controls the maximum delay time between client retries after an operation fails In...

Page 447: ...unning exit 0 The pre_stop_dfs script is executed just before shutting down DFS As part of the shutdown procedure AIX will try to unexport or detach all DFS aggregates This ensures that they are left...

Page 448: ...top DFS using dfs clean since it does not handle HDM correctly 7 6 3 3 Configuring an HDM Server DFS XFS The HDM server is configured with five configuration files usually kept in var hpss hdm hdm id...

Page 449: ...Create it using the touch command 7 6 3 3 1 config dat File The basic configuration file config dat is a text file that defines the configuration of an HDM server It is recommended that the file be k...

Page 450: ...pecting that when the program exits the file will go away HDM must keep an entry for this file in the destroy log until the user s process exits This ties up destroy log entries For these reasons a fa...

Page 451: ...PTCPPort specifies the TCP port used by the HDM to listen for requests from the DMAP Gateway Conventionally this will be 6002 Check etc services to ensure that this port is not already being used by a...

Page 452: ...l event processing can not be done and HDM will return an error to the DFS SMT MaxFilesets specifies the maximum number of filesets HDM can support The number must be at least as large as the number o...

Page 453: ...ts such as mounting and unmounting file systems The value 2 is a good starting point NumDataProcesses specifies the number of HDM subprocesses that will be assigned to handle events involving data req...

Page 454: ...tor creates a large number of filesets at 10 00 AM on 4 1 99 when the operation is complete three files will be created a file named filesys 990401100000 containing a copy of the filesys dat that was...

Page 455: ...SS DFS filesys dat HDM filesys dat version 1 Sample filesys dat opt dcelocal var dfs aggrs bkup1 dev bkup1 2 archive delete wait run partial new bkup 0 292 0 We haven t specified this yet hpss bkup NO...

Page 456: ...taged will be at least the size of the data access or if the data access is small and the file is large a 16MB chunk of the file surrounding the data being accessed will be staged Following is a descr...

Page 457: ...tiple HDM Servers and DMAP Gateways are running they must use different TCP ports Following is a description of the parameters for an XFS filesystem Name specifies the name of the filesystem This is u...

Page 458: ...at in detail MPQueueSize specifies the number of entries the HDM will allocate in shared memory for tracking migration and purge candidates Refer to Section 7 6 2 8 1 Migration Purge Algorithms and th...

Page 459: ...t typically 6002 If the machine is an administrative machine use 0 for the port The encryption key is used to secure communications between HDM and DMAP Gateway The value is expressed as a 16 digit he...

Page 460: ...purge policy is specified by a line that begins with PurgePolicy The keyword is followed by the name of the policy being defined such as wait and run in the example The choice of policy names has no s...

Page 461: ...tly to keep up with the load The purge process should be run often enough to ensure that free space on the system is available In the example above UpperBound and LowerBound were chosen to keep betwee...

Page 462: ...that the HDM Security Server component will use RecoveryFile specifies the name of a UNIX file containing a copy of the Process Activation Group PAG records that the HDM Security Server maintains The...

Page 463: ...eating the Storage Server Resources on page 61 of the HPSS Management Guide 4 Create additional HPSS Users Section 8 5 Create Additional HPSS Users on page 465 5 Create File Families Section 8 6 Creat...

Page 464: ...to be manually started Invoke the etc rc hpss script as root to start the HPSS Startup Daemon As a default the rc hpss script will redirect all servers output to dev console The rc hpss script can als...

Page 465: ...uide for more information on creating HPSS storage space 8 5 Create Additional HPSS Users Refer to Section 8 1 1 Adding HPSS Users on page 215 of the HPSS Management Guide for more information on how...

Page 466: ...that the Allowed Classes of Service list has been filled in correctly Verify that a Name Server Bitfile Server Migration Purge Server and appropriate Disk and or Tape Storage Servers have been config...

Page 467: ...icy A storage class at the lowest level in a hierarchy must not be configured with a migration or purge policy To support repack and recover of tape volumes the stripe width of a each tape storage cla...

Page 468: ...performance The characteristics fields Transfer Rate Latency etc in the storage class and class of service definition should be updated to reflect actual performance results After the files are create...

Page 469: ...ined from their specification and by testing directly from the operating system For example using dd to read and write to each device Keep in mind that performance testing can often be limited by othe...

Page 470: ...Chapter 8 Initial Startup and Verification 470 September 2002 HPSS Installation Guide Release 4 5 Revision 2...

Page 471: ...odified to provide support for DFS filesets and access control lists AIX Advanced Interactive Executive alarm A log record message type used to log high level error conditions The default logging poli...

Page 472: ...ge Server Bitfile Server An HPSS server that provides a logical abstraction of bitfiles to its clients BMUX Block Multiplexer Channel bytes between tape marks The number of data bytes that are written...

Page 473: ...entral log records deregistration The process of disabling notification to SSM for a particular attribute change descriptive name A human readable name for an HPSS server device A physical piece of ha...

Page 474: ...the Alarm and Event window export An operation in which a cartridge and its associated storage space are removed from the HPSS system An export translates into a removal of a cartridge s storage space...

Page 475: ...site policy code Gatekeeping Site Policy The gatekeeping shared library code written by the site to monitor and throttle create open and or stage requests GB Gigabyte 230 GDA Global Directory Agent G...

Page 476: ...the HPSS system An import translates into an inject the physical introduction of a cartridge to a Physical Volume Repository followed by the addition of the cartridge s storage space to the HPSS syst...

Page 477: ...node that is responsible for sending log messages to the local log to the Log Daemon for central logging and to SSM to display messages in the Alarm and Event window Log Daemon An HPSS server responsi...

Page 478: ...ing the placement of data in the storage hierarchies based upon site defined migration and purge policies mirrored fileset A DFS fileset whose files are mirrored on HPSS These files appear in both the...

Page 479: ...SS server that provides access to the user calls of the HPSS Client Application Program Interface for Non DCE client applications Non DCE Client Application An HPSS library that offers the user calls...

Page 480: ...d PV Physical Volume PVL Physical Volume Library PVM Physical Volume Manager PVR Physical Volume Repository RAID Redundant Array of Independent Disks RAIT Redundant Array of Independent Tapes RAM Rand...

Page 481: ...ity related events e g authorization failures The default logging policy is to log security messages SFS Structured File Server SGI Silicon Graphics shelf tape A cartridge which has been physically re...

Page 482: ...and logical storage hierarchy An ordered collection of storage classes The hierarchy consists of a fixed number of storage levels numbered from level 1 to the number of levels in the hierarchy with t...

Page 483: ...d entry exit processing paths through HPSS server software The default logging policy is to not log trace message types transaction A programming construct that enables multiple data operations to pos...

Page 484: ...olume before switching to the next physical volume VV Virtual Volume XCT Cross Cell Trust XDSM The Open Group s Data Storage Management standard It defines APIs that use events to notify Data Manageme...

Page 485: ...Encina Administration Guide Volume 2 Basic Administration 9 Encina Administration Guide Volume 3 Server Administration 10 Encina Administration Guide Volume 4 Advanced Administration 11 HACMP for AIX...

Page 486: ...or AIX and Solaris DFS Administration Reference 32 IBM SCSI Device Drivers Installation and User s Guide GC35 0154 01 33 IBM Ultrium Device Drivers Installation and User s Guide GA32 0430 00 1 34 IBM...

Page 487: ...of the IEEE Computer Society Press 53 T W Tyler and D S Fisher Using Distributed OLTP Technology in a High Performance Storage System from the 1995 IEEE MSS Symposium courtesy of the IEEE Computer Soc...

Page 488: ...Appendix B References 488 September 2002 HPSS Installation Guide Release 4 5 Revision 2...

Page 489: ...ter for Atmospheric Research and Pacific Northwest Laboratory for their help with initial requirements reviews We also wish to acknowledge Cornell Information Technologies of Cornell University for pr...

Page 490: ...Appendix C Developer Acknowledgments 490 September 2002 HPSS Installation Guide Release 4 5 Revision 2...

Page 491: ...n per user Per account code Per group Some sites will need accounting totaled on a per user per Account Index basis This type of accounting is called Site style accounting There are many sites that wi...

Page 492: ...service is configured to stage bitfiles on open then all file accesses will occur in the storage class at the top of the hierarchy The total amount of data transferred Transferred into or out of this...

Page 493: ...Map entry that has the site information The following are examples of possible Account Maps Site style Account Map Acct User UID Charge Update_flag 12 dlk 3152 5A12x401 0 27 dlk 3152 5A12x501 0 341 dl...

Page 494: ...that set up and modify users and UIDs A basic set of site developed utilities are described in more detail below Add a user and account New entries can be made and the next available HPSS Account Ind...

Page 495: ...month An accounting run may take several minutes and the storage system will probably be active during the run The resource usage reported for each user will reflect the resources used by that user at...

Page 496: ...Appendix D Accounting Examples 496 September 2002 HPSS Installation Guide Release 4 5 Revision 2...

Page 497: ...m AIX mkhpss Status Host Name host clearlake ibm com mkhpss Status Start Time Fri Aug 10 11 36 58 CDT 2001 mkhpss Set up HPSS Special Directories and Links on Fri Aug 10 11 36 58 CDT 2001 mkhpss Infra...

Page 498: ...on keytab files mkhpss Perform Set up and Check Cell hpss_setup_and_check_cell Prompt Password for cell_admin hpss_setup_and_check_cell Status Found 1 Cell entries host_cell clearlake ibm com krbtgt...

Page 499: ...gure HPSS with DCE mkhpss 2 Configure SFS Server mkhpss 3 Create and Manage SFS Files mkhpss 4 Set Up FTP Daemon mkhpss 5 Set Up Startup Daemon mkhpss 6 Add SSM Administrative User mkhpss 7 Start SSM...

Page 500: ...config keytab hpss mkhpss Status Randomizing encina sfs hpss to keytab file mkhpss Prompt Password for cell_admin mkhpss Status Creating cds directory encina mkhpss Status Modifying ACLs for encina mk...

Page 501: ...IX logical volume name to use sfslvhpss LOGICAL VOLUME sfslvhpss VOLUME GROUP uservg LV IDENTIFIER 00010816dec98a62 13 PERMISSION read write VG STATE active complete LV STATE closed syncd TYPE raw WRI...

Page 502: ...khpss Status Checkpoint interval max_records to use 100000 mkhpss Status Thread pool user size to use 400 mkhpss Status Thread pool emergency size to use 20 mkhpss Prompt Do you want rc encina to be i...

Page 503: ...t SFS server 10 Select current SFS server 11 Add an SFS to work with 12 Remove an SFS from the list 13 Select current data volume 14 Change filename extension Select operation RETURN to exit 9 1 encin...

Page 504: ...s encina sfs hpss Currently selected SFS server encina sfs hpss Currently selected data volume dataVol Filename extension none 1 Create a file on current SFS 2 Create all global files on root SFS 3 Cr...

Page 505: ...elect operation RETURN to cancel 3 New file nsconfig created Creating nsglobalfilesets New file nsglobalfilesets created Creating logclient New file logclient created Creating logdaemon New file logda...

Page 506: ...the subsystem files as they are allocated Select operation RETURN to cancel 4 Creating files on volume dataVol on encina sfs hpss Creating acctlog 1 New file acctlog 1 created Creating bfmigrrec 1 Ne...

Page 507: ...ser ID mkhpss Status User root verified continue hpss_ftpd_config Status Perform HPSS FTP Daemon setup hpss_ftpd_config Prompt Do you wish to use the default port IDs control port 4021 data port 4020...

Page 508: ...Up Startup Daemon mkhpss 6 Add SSM Administrative User mkhpss 7 Start SSM Servers User Session mkhpss E Re run hpss_env mkhpss U Un configure HPSS mkhpss X Exit mkhpss Reply Select Option 1 7 E U X 6...

Page 509: ...ss U Un configure HPSS mkhpss X Exit mkhpss Reply Select Option 1 7 E U X 7 mkhpss Start SSM Session mkhpss Verify User ID mkhpss Status User root verified continue mkhpss Prompt Do you wish to start...

Page 510: ...s WARNING ALL HPSS CONFIGURATION and METADATA WILL BE DESTROYED mkhpss WARNING ALL HPSS CONFIGURATION and METADATA WILL BE DESTROYED mkhpss WARNING i e HPSS Server Principals Keytabs CDS Entries SFS F...

Page 511: ...tus Group hpss_server and hpss_client deleted hpss_dce_deregister Status DCE Deregister processing completed mkhpss Perform Undo Init Setup mkhpss Status undo_init_setup processing completed root host...

Page 512: ...s Creating HPSS CellId ERA hpss_setup_and_check_cell Status Creating hpss_cross_cell_members ERA hpss_setup_and_check_cell Status DCE group hpss_cross_cell_members Empty hpss_setup_and_check_cell Stat...

Page 513: ...tructure Configuration Option mkhpss 1 Configure HPSS with DCE mkhpss 2 Configure SFS Server mkhpss 3 Create and Manage SFS Files mkhpss 4 Set Up FTP Daemon mkhpss 5 Set Up Startup Daemon mkhpss 6 Add...

Page 514: ...ss mkhpss Status Randomizing encina sfs hpss to keytab file mkhpss Prompt Password for cell_admin mkhpss Status Creating cds directory encina mkhpss Status Modifying ACLs for encina mkhpss Status Crea...

Page 515: ...pt Enter disk name to use for data volume dev rdsk c0t8d0s3 mkhpss Prompt Enter physical volume name sfspvhpss mkhpss Prompt SFS data volume name to use dataVol mkhpss Prompt SFS chunk size to use 64...

Page 516: ...use 100000 mkhpss Status Thread pool user size to use 400 mkhpss Status Thread pool emergency size to use 20 mkhpss Prompt Do you want rc encina to be invoked at system restart y n y mkhpss Status SF...

Page 517: ...ration Policies Accounting Policy Purge Policies Account Summary Records Mount Daemon Configuration Account Snapshot Records Mover Configurations Account Validation Records Mover Devices BFS Configura...

Page 518: ...hange filename extension Select operation RETURN to exit 3 Type the number of the subsystem for which to create files 1 Tentative assignment of files to data volumes on encina sfs hpss dataVol Account...

Page 519: ...ent SFS server 11 Add an SFS to work with 12 Remove an SFS from the list 13 Select current data volume 14 Change filename extension Select operation RETURN to exit mkhpss Infrastructure Configuration...

Page 520: ...Re run hpss_env mkhpss U Un configure HPSS mkhpss X Exit mkhpss Reply Select Option 1 7 E U X 5 mkhpss Verify User ID mkhpss Status User root verified continue mkhpss Perform HPSS Startup Daemon Setup...

Page 521: ...s Enter Group hpss SSM Adding SSM User hpss SSM Hostname host Full hostname host clearlake ibm com Select SAMMI Security Level 1 User 2 Privileged User 3 Operator 4 Admin Enter Security Level 4 SSM Us...

Page 522: ...e Configuration Menu mkhpss Prompt Select Infrastructure Configuration Option mkhpss 1 Configure HPSS with DCE mkhpss 2 Configure SFS Server mkhpss 3 Create and Manage SFS Files mkhpss 4 Set Up FTP Da...

Page 523: ...sfs hpss from encina_admin_group mkhpss Status Remove encina sfs hpss from encina_servers_group mkhpss Status Remove encina sfs hpss from organzation none mkhpss Status Delete keytab file host_cell c...

Page 524: ...Appendix E Infrastructure Configuration Example 524 September 2002 HPSS Installation Guide Release 4 5 Revision 2...

Page 525: ...se Toggle buttons have a small square indicator on the left and are used to select one of two possible states When the indicator is red the button is ON otherwise the button is OFF Buttons may be dese...

Page 526: ...hics which look like something between parentheses and square brackets appear on either end of the field if there is any data beyond the visible edge of the field Enterable fields may be desensitized...

Page 527: ...e mouse cursor to any blank spot on the window hold down the Shift key and click the right mouse button A help browser window will open When finished click the DONE button at the bottom of the help br...

Page 528: ...a situation this window can be useful in tracking down which console may be causing the problem Many times such console problems can be cleared up by restarting the crashed SSM session F 4 Customizing...

Page 529: ...which is in the Sammi installation directory bin directory All command files are expected to be in that directory but they can be placed elsewhere by specifying the full path name of the file in user...

Page 530: ...ctory data keydefs dat also affects Sammi keyboard behavior This file is loaded into Sammi whenever it starts By default it contains keyboard data appropriate to the platform where Sammi is installed...

Page 531: ...Pages on page 293 of the HPSS Management Guide for more usage information Operations performed by hpssuser are summarized below 1 1 If the dce flag is specified hpssuser creates a DCE principal entry...

Page 532: ...s a logical_server line for ssm_ds which is the Data Server Edit the RPC address and the hostname on this line as appropriate for the non default Data Server Note that all concurrently running Data Se...

Page 533: ...s to create multiple user names for that user with hpssuser If you choose not to do this you must create completely separate Sammi execution environments for each concurrent session that a user may wa...

Page 534: ...Appendix F Additional SSM Information 534 September 2002 HPSS Installation Guide Release 4 5 Revision 2...

Page 535: ...ngle points of failure in the system The same functionality can be used to minimize the impact of regularly scheduled maintenance and or software upgrades The High Availability feature is only availab...

Page 536: ...rver crashes and the backup takes over there is no longer a backup node It will be necessary to correct the original failure in order to return the system to a Highly Available state G 1 1 Architectur...

Page 537: ...ed by HPSS administrators or operators with little HACMP background It is important that administrators understand the concepts presented in the HACMP for AIX Concepts and Facilities guide After revie...

Page 538: ...e same as the host name given to each node For instance the example worksheet lists hasvc as the service adapter s name In that case the host name as given by the hostname command for each node also n...

Page 539: ...orks Network Name _serial1___ Network Type _RS232____ Node Names _hanode1__ _hanode2__ Serial Network Adapter Worksheet node A Slot Number __________ Interface Name __________ Adapter Label __________...

Page 540: ...hanode1 Volume Group Name _rootvg___ Physical Volumes _hdisk0___ _hdisk1___ Logical Volumes __________ __________ __________ __________ Mirrored __________ __________ __________ __________ Non Shared...

Page 541: ...__________ __________ __________ __________ __________ __________ __________ __________ __________ __________ __________ Volume Group Name __________ Major Number __________ Log LV Name if any ______...

Page 542: ...___ _standby__ IP Address _192 94 47 244_ _192 94 48 145_ Network Name _ether1___ _ether1___ Network Attr _public___ _public___ Boot and Standby Adapters hanode2 IP Label _ha2boot__ _ha2stby__ Functio...

Page 543: ...el _ha2tty___ Network Name _serial1___ Shared SCSI 2 Differential or Differential Fast Wide Disks Worksheet bus1 Type of Bus _Ultra SCSI_ Node Name _hanode1_ _hanode2_ Slot Number _5________ _5_______...

Page 544: ...g___ Physical Volumes _hdisk0___ _hdisk1___ Logical Volumes _hd1 6 hd8 hd9var_ Mirrored _all are mirrored_ Shared Volume Groups Filesystems Volume Group Name _dcevg____ Major Number _51_______ Log LV...

Page 545: ...SCSI adapter in slot X of node 1 also attaches to the same port on the SCSI adapter in slot X of node 2 This will ensure that hdiskYY on node 1 is the same physical disk as hdiskYY on node 2 Route pow...

Page 546: ...SI Disk Drive Use the lsdev Cc adapter command and you will get something like lsdev Cc adapter scsi3 Available 20 58 SCSI Controller scsi4 Available 20 59 SCSI Controller scsi5 Available 20 60 SCSI C...

Page 547: ...that these be mirrored across busses as well since JFSs can t operate without their associated JFS logs To create your own JFS logs instead of using the LVs that AIX creates automatically do the follo...

Page 548: ...for each node in the cluster plus one entry for the loopback interface 127 0 0 1 If you have concerns about using the rhosts file refer to page 1 8 of the HACMP for AIX Administration Guide Version 4...

Page 549: ...it is installed One potential problem is an incompatibility between NetWare and HACMP NetWare will often keep a network interface busy which will cause attempted adapter swaps to fail An easy test for...

Page 550: ...g a Cluster Definition G 4 3 2 Define the two nodes in the cluster Now tell the HACMP the names of the nodes in the cluster These names do not have to be the same as the hostnames or adapters of the n...

Page 551: ...ter Topology Configure Networds Add an Network At this point you will be offered two options IP based Network and Non IP based Network Choose IP based Network to configure your ethernet network When t...

Page 552: ...vailability 552 September 2002 HPSS Installation Guide Release 4 5 Revision 2 Figure H 4 Adding an IP based Network Choose Non IP based Network to configure your RS232 network Figure H 5 Adding a Non...

Page 553: ...ddresses so that clients don t have to flush their ARP caches when it moves from one physical adapter to another Serial adapters have a field that says service but we don t call them service adapters...

Page 554: ...Appendix G High Availability 554 September 2002 HPSS Installation Guide Release 4 5 Revision 2 Figure H 6 Adding an Ethernet Boot Adapter Figure H 7 Adding an Ethernet Standby Adapter...

Page 555: ...Appendix G High Availability HPSS Installation Guide September 2002 555 Release 4 5 Revision 2 Figure H 8 Adding an Ethernet Service Adapter Figure H 9 Adding a Serial Adapter...

Page 556: ...nformation and it needs to be on both nodes So it s time to synchronize the cluster topology See Section G 10 4 1 Synchronize Topology on page 573 for instructions G 4 3 6 Define the resource groups T...

Page 557: ...e taken to ensure that all shared file systems and volume groups are listed it s usually easy if you use the F4 pick lists Figure H 11 Configuring a Resource Group G 4 3 8 Synchronize Cluster Resource...

Page 558: ...the active node the node with the service address shared volume groups and shared file systems 2 Move the HPSS resource group to the second node Refer to Section G 10 5 Move a Resource Group on page 5...

Page 559: ...ntaining these scripts This would be var hahpss in this example 3 Customize the script paths to the hpss_environment file Each script file must be able to find the hpss_environment file to pick up con...

Page 560: ...hpss globalconfig hpss_bfs krb5 hpss keytabs 2 hpss_mmon Metadata Monitor encina sfs hpss globalconfig hpss_mmon krb5 hpss keytabs 2 hpss_logc Log Client hanode1 encina sfs hpss globalconfig hpss_log...

Page 561: ...uotes around the server names 7 At the end of each line put a 8 Compare what you have now to the example above and it should be very similar 9 Now make sure that it s readable by root and synchronize...

Page 562: ...hacmp Cluster Configuration Cluster Resources Change Show Resources Attributes for a Resource Group HPSSResourceGroup There are only four fields that need to be filled in on this SMIT screen Service...

Page 563: ...bring down the cluster However HACMP doesn t yet know how to stop HPSS SFS and DCE it won t know that until the cluster is synchronized in the next step so you ll need to shut HPSS SFS and DCE down ma...

Page 564: ...ediately and all an administrator needs to do is start an SSM session to begin administering the system G 5 3 Define HA HPSS Verification Method HACMP has the capability to verify its own configuratio...

Page 565: ...to the hpss_notify ksh This can be done in two ways through AIX Error Notification and through HACMP Notify Events G 5 4 1 AIX Error Notification When configuring AIX Error Notification use the follo...

Page 566: ...5 4 2 HACMP Notify Events When some failures occur they generate events in HACMP These events can be configured to cause a notification to be sent before and after the event occurs using the hpss_clus...

Page 567: ...work_down network_up node_down node_up node_up_complete swap_adapter It may be necessary to setup these event notification on each node independently G 5 5 crontab Considerations Since crontab files a...

Page 568: ...ations on page 569 G 6 Monitoring and Maintenance G 6 1 clstat One quick way to get an overview of a cluster s current status is using usr sbin cluster clstat This utility will report on which nodes a...

Page 569: ...command and call the script from your crontab For example if your crontab entry normally looked like this 0 opt hpss tools sfs sfs_backup_util run run ksh Then create the a script stored on the local...

Page 570: ...count Addressing all these differences is beyond the scope of this document but it nonetheless very important It is an absolute necessity that administrators familiarize themselves with the HACMP for...

Page 571: ...each node independently to activate both Cluster Managers smitty hacmp Cluster Services Start Cluster Services Take the defaults and press Enter G 10 2 Shutdown the Cluster The procedure for shutting...

Page 572: ...in HACMP Section G 5 3 Define HA HPSS Verification Method on page 564 go to SMIT to verify your cluster smitty hacmp Cluster Configuration Cluster Verification Verify Cluster Figure H 19 Verifying th...

Page 573: ...Configuration Cluster Resources Synchronize Cluster Resources This will take you to the Synchronize Cluster Resources SMIT window Accept the defaults by pressing Enter and your resources should synchr...

Page 574: ...as HA HPSS is shutdown on the active node and brought up on the standby node but it is a convenient way to free up a node for maintenance To move a resource group to another node go to SMIT smitty hac...

Page 575: ...rastructure 31 maintaining modifying the Account Map 494 processing of HPSS accounting data 491 site accounting requirements 491 site accounting table 493 site style accounting 36 UNIX style accountin...

Page 576: ...guration 324 security policy 88 Bitfiles 22 26 bitfile Class of Service changes 114 bitfile disk allocation maps 113 bitfile disk segments 113 bitfile IDs 22 26 bitfile tape segments 114 metadata 113...

Page 577: ...ation 466 verifying prerequisite software 215 Configuring the HPSS Infrastructure on the installation node 240 COS see Class of Service Creating Configurations also see Configuration accounting policy...

Page 578: ...tion 435 445 Configuring on AIX 445 DMAP Gateway Server 441 filesets 436 HDM Server 440 HPSS modifications 440 kernel extension 445 mirrored filesets 436 XDSM implementation 438 Disk Storage Server 64...

Page 579: ...FTP Daemon configuration 422 set up FTP Daemon 244 FTP see File Transfer Protocol G Graphical User Interface GUI 29 35 storage system management 79 GUI see Graphical User Interface H Hardware Platform...

Page 580: ...497 configuration 215 configuring HPSS infrastructure on installation node 240 defining HPSS environment variables 216 distributed computing environment DCE 31 infrastructure configuration screen dis...

Page 581: ...derations 77 storage policy considerations 35 89 LTO 72 M Management 35 Mass Storage System Reference Model MSSRM 20 Media disk media 98 Encina media recovery archive files 131 recommended parameter v...

Page 582: ...see NFS Mount Daemon Mover MVR 29 configuration metadata 111 creating the Mover specific configuration 345 metadata 118 Mover devices 118 server considerations 72 MPI IO Application Programming Interf...

Page 583: ...111 Non DCE Client Gateway server considerations 81 NS see Name Server O Objects 22 23 bitfiles 22 class of service attributes 23 file families 22 Filesets 22 junctions 22 physical volumes 22 storage...

Page 584: ...PVR information 71 392 tape robots 54 types of PVRs provided 29 PIOFS see Parallel Input Output File System Policy Modules 35 accounting policy 85 logging policy 36 89 migration policy 35 purge policy...

Page 585: ...server configuration 110 262 HPSS metadata 106 HPSS server considerations 62 HPSS servers 25 platforms supported 37 specific server configuration 323 starting the HPSS servers 463 system memory and di...

Page 586: ...y configuration 279 storage policy considerations 81 Storage Segments 23 average number of storage segments selection 97 BFS metadata 112 BFS 26 bitfile disk allocation map 113 bitfile storage segment...

Page 587: ...92 cartridge import and export 390 configuration requirements 390 physical volume repository 28 server considerations 71 vendor information 392 vendor software requirements 389 Stripe Length optimum a...

Page 588: ...nsiderations 54 NFS 60 User Identifier UID HPSS policy modules for accounting 36 Name Server 62 site account apportionment table 493 site accounting requirements 491 site accounting table 493 User Int...

Page 589: ...n 255 HPSS Migration Purge Server Configuration 342 HPSS Storage Class 306 HPSS Storage Hierarchy 316 Logging Client Configuration 334 Logging Daemon Configuration 337 Logging Policy 299 301 Metadata...

Page 590: ...590 September 2002 HPSS Installation Guide Release 4 5 Revision 2...

Search results

Summary of Contents for Hub/Switch

Reviews:

Related manuals for Hub/Switch

Brands by name

Popular brands

IBM Hub/Switch, Installation Manual

Search results

Summary of Contents for Hub/Switch

Reviews:

Related manuals for Hub/Switch

Brands by name

Popular brands