background image

This book provides information about installing, configuring, and maintaining Red Hat GFS (Red

Hat Global File System) for Red Hat Enterprise Linux 4.7.

Global File System

Summary of Contents for GLOBAL FILE SYSTEM 4.7

Page 1: ...Global File System Red Hat Global File System 4 7 Global_File_System ISBN N A Publication date July 2008...

Page 2: ...This book provides information about installing configuring and maintaining Red Hat GFS Red Hat Global File System for Red Hat Enterprise Linux 4 7 Global File System...

Page 3: ...copyright holder Distribution of the work or derivative of the work in any standard paper book form for commercial purposes is prohibited unless prior permission is obtained from the copyright holder...

Page 4: ...Global File System...

Page 5: ...e Devices 10 6 Network Power Switches 11 7 Console Access 11 8 Installing GFS 11 3 Getting Started 13 1 Prerequisite Tasks 13 2 Initial Setup Tasks 13 4 Managing GFS 15 1 Making a File System 15 2 Mou...

Page 6: ...ending Activity on a File System 37 11 Displaying Extended GFS Information and Statistics 38 12 Repairing a File System 39 13 Context Dependent Path Names 40 A Upgrading GFS 43 Index 47 Global File Sy...

Page 7: ...e Linux refer to the following resources Red Hat Enterprise Linux Installation Guide Provides information regarding installation of Red Hat Enterprise Linux Red Hat Enterprise Linux Introduction to Sy...

Page 8: ...Provides information about the current release of Red Hat Cluster Suite Red Hat Cluster Suite documentation and other Red Hat documents are available in HTML and PDF versions online at the following l...

Page 9: ...of how critical the information is to you these items are marked as follows Note A note is typically information that you need to understand the behavior of the system Tip A tip is typically an altern...

Page 10: ...s Shared Data Clusters by Dilip M Ranade Wiley 2002 Provides detailed technical information on cluster file system and cluster volume manager design Storage Area Networks SANs Designing Storage Area N...

Page 11: ...Topic Reference Comment by E Marcus and H Stern Wiley 2000 Table 1 Recommended References Table Recommended References xi...

Page 12: ...xii...

Page 13: ...and economic needs of your storage environment This chapter provides some very basic abbreviated information as background to help you understand GFS It contains the following sections Section 1 Perfo...

Page 14: ...pplication node has equal access to all data files GFS supports over 300 GFS nodes Figure 1 1 GFS with a SAN 1 2 Performance Scalability Moderate Price Multiple Linux client applications on a LAN can...

Page 15: ...rformance Figure 1 3 GFS and GNBD with Directly Connected Storage shows how Linux client applications can take advantage of an existing Ethernet topology to gain shared access to all block storage dev...

Page 16: ...Volume management is managed through CLVM Cluster Logical Volume Manager For information about Red Hat Cluster Suite refer to Configuring and Managing a Red Hat Cluster For information about using CL...

Page 17: ...mmarizes the GFS Software subsystems and their components Software Subsystem Components Description GFS gfs ko Kernel module that implements the GFS file system and is loaded on GFS cluster nodes gfs_...

Page 18: ...use when GFS is used as a local file system only It plugs into the lock harness lock_harness ko and provides local locking Table 1 1 GFS Software Subsystem Components 4 Before Setting Up GFS Before y...

Page 19: ...des are needed Note the hostname and IP address of each GNBD server node for setting up GNBD clients later For information on using GNBD with GFS see the Using GNBD with Global File System document St...

Page 20: ...8...

Page 21: ...ts shows the platform requirements for GFS Operating System Hardware Architecture RAM Red Hat Enterprise Linux AS ES or WS Version 4 or later ia64 x86 64 x86 SMP supported 256 MB minimum Table 2 1 Pla...

Page 22: ...ts Note When a small number of nodes is used it may be possible to connect the nodes directly to ports on the storage device Note FC drivers may not work reliably with FC hubs Table 2 2 Fibre Channel...

Page 23: ...ake sure that you have console access to each GFS node Console access to each node ensures that you can monitor nodes and troubleshoot problems 8 Installing GFS Installing GFS consists of installing R...

Page 24: ...12...

Page 25: ...ed Hat Enterprise Linux distribution In addition if you are using GNBD multipath make sure that you understand GNBD multipath considerations For information on GNBD multipath see the document Using GN...

Page 26: ...ls BlockDevice 3 At each node mount the GFS file systems For more information about mounting a GFS file system refer to Section 2 Mounting a File System Command usage mount t gfs BlockDevice MountPoin...

Page 27: ...vity on a File System Section 11 Displaying Extended GFS Information and Statistics Section 12 Repairing a File System Section 13 Context Dependent Path Names 1 Making a File System Once a cluster is...

Page 28: ...uster Number Specifies the number of journals to be created by the gfs_mkfs command One journal is required for each node that mounts the file system More journals than are needed can be specified at...

Page 29: ...e Recognized cluster locking protocols include lock_dlm The standard locking module lock_gulm The locking module compatible with earlier versions of GFS lock_nolock May be used when GFS is acting as a...

Page 30: ...Managing a Red Hat Cluster After those requirements have been met you can mount the GFS file system as you would any Linux file system To manipulate file ACLs you must mount the file system with the o...

Page 31: ...ecific o option values that can be passed to GFS at mount time Option Description acl Allows manipulating file ACLs If a file system is mounted without the acl mount option users are allowed to view A...

Page 32: ...table to use with the file system oopses_ok This option allows a GFS node to not panic when an oops occurs By default a GFS node panics when an oops occurs causing the file system used by that node to...

Page 33: ...ing can allow users or groups to slightly exceed the set limit To minimize this GFS dynamically reduces the synchronization period as a hard quota limit is approached GFS uses its gfs_quota command to...

Page 34: ...e either a group name from the group file or the GID number Size Specifies the new value to limit or warn By default the value is in units of megabytes The additional k s and b flags change the units...

Page 35: ...playing Quota Limits for a Group gfs_quota get g Group f MountPoint Displaying Entire Quota File gfs_quota list f MountPoint User A user ID to display information about a specific user It can be eithe...

Page 36: ...command line Space allocated to GFS s hidden files can be left out of displayed values for the root UID and GID by adding the d option to the command line This is useful when trying to match the numbe...

Page 37: ...ode to the on disk quota file between the automatic updates performed by GFS Usage Synchronizing Quota Information gfs_quota sync f MountPoint MountPoint Specifies the GFS file system to which the act...

Page 38: ...istent across unmounts Usage gfs_tool settune MountPoint quota_enforce 0 1 MountPoint Specifies the GFS file system to which the actions apply quota_enforce 0 1 0 disabled 1 enabled Comments A value o...

Page 39: ...nt 0 1 MountPoint Specifies the GFS file system to which the actions apply quota_account 0 1 0 disabled 1 enabled Comments To enable quota accounting on a file system the quota_account parameter must...

Page 40: ...n a cluster All the other nodes sense that the expansion has occurred and automatically start using the new space To verify that the changes were successful use the gfs_grow command with the T test an...

Page 41: ...anding a GFS file system Option Description h Help Displays a short usage message q Quiet Turns down the verbosity level T Test Do all calculations but do not write any data to the disk and do not exp...

Page 42: ...s the directory where the GFS file system is mounted Comments Before running the gfs_jadd command Back up important data on the file system Run a gfs_tool df MountPoint command to display the volume u...

Page 43: ...l size is 128 megabytes The minimum size is 32 megabytes To add journals of different sizes to the file system the gfs_jadd command must be run for each size journal The size specified is rounded down...

Page 44: ...GFS direct I O attribute is attached to a file all I O operations must be done in block size multiples of 512 bytes The memory being read from or written to must also be 512 byte aligned One of the f...

Page 45: ...to a GFS directory Enabling the inherit_directio flag on a directory causes all newly created regular files in that directory to automatically inherit the directio flag Also the inherit_directio flag...

Page 46: ...rite the file data to the main file system Applications that rely on fsync to sync file data may see improved performance by using data journaling Data journaling can be enabled automatically for any...

Page 47: ...node status was changed mtime The last time the file or directory data was modified atime The last time the file or directory data was accessed If atime updates are enabled as they are by default on G...

Page 48: ...tween its system time and the time recorded in the inode It is required that system clocks of all GFS nodes in a cluster be synchronized If a node s system time is out of synchronization by a signific...

Page 49: ...ed gfs_tool gettune gfs1 In this example the atime update period is set to once a day 86 400 seconds for the GFS file system on mount point gfs1 gfs_tool settune gfs1 atime_quantum 86400 10 Suspending...

Page 50: ...ut GFS This section describes typical use of the gfs_tool command for displaying statistics space usage and extended status Usage Displaying Statistics gfs_tool counters MountPoint The counters flag d...

Page 51: ...ut file gfs datafile gfs_tool stat gfs datafile 12 Repairing a File System When nodes fail with the file system mounted file system journaling allows fast recovery However if a storage device loses po...

Page 52: ...her command options Usage gfs_fsck y BlockDevice y The y flag causes all questions to be answered with yes With the y flag specified the gfs_fsck command does not prompt you for an answer before makin...

Page 53: ...his string is not the name of an actual file or directory itself The real files or directories must be created in a separate step using names that correlate with the type of variable used LinkName Spe...

Page 54: ...hostnames n01 n02 and n03 Applications on each node uses directory gfs log but the administrator wants these directories to be separate for each node To do this no actual log directory is created inst...

Page 55: ...gement to DLM lock management during the upgrade to Red Hat GFS 6 1 However after the upgrade to GFS 6 1 you can change lock managers The following procedure demonstrates upgrading to Red Hat GFS 6 1...

Page 56: ...d run the lock_gulmd c command and start clvmd as shown in the following example ccsd lock_gulmd c Warning You didn t specify a cluster name before use_ccs Letting ccsd choose which cluster we belong...

Page 57: ...he following example mount t gfs o upgrade dev pool argus mnt gfs1 Note This step only needs to be done once on the first mount of the GFS file system Note If static minor numbers were used on pool vo...

Page 58: ...46...

Page 59: ...t dependent path names CDPNs 40 data journaling 34 direct I O 32 directory attribute 33 file attribute 32 O_DIRECT 32 growing 28 making 15 mounting 18 quota management 21 disabling enabling quota acco...

Page 60: ...laying quota limits 23 setting quotas 21 synchronizing quotas 24 R recommended references table x Red Hat Cluster Suite system requirements 9 references recommended x repairing a file system 39 S setu...

Reviews: