NEC Express5800/ftServer Administrator'S Manual Download Page 99 | Manualshive

Page: 99 / 156

background image

The

ftsmaint

Command

Using ftServer Fault-Tolerant Utilities and Software

7-11

-     1/23 0 0 0     ONLINE ONLINE - -
-     1/23/130 Internal Temp    -    NORMAL - -
-     1/23/150 +12V       -    NORMAL - -
-     1/130 Ambient Air Temp     -    NORMAL - -
-     1/140 Fan1       -    NORMAL - -
-     1/141 Fan2       -    NORMAL - -
-     1/150 +1.2V VTT    -    NORMAL - -
-     1/151 +1.8V VDD    -    NORMAL - -
-     1/152 +12V       -    NORMAL - -
AA-G90730 10     Combined CPU/IO     ONLINE DUPLEX - 0
-     10/0 Mass Storage Ctlr    ONLINE ONLINE - 0
-     05:00.0 Fast Track TX EIDE Ctlr ONLINE ONLINE - -
-     10/1 Mass Storage Ctlr    ONLINE DUPLEX - 0
-     05:01.0 PCI/PCI-X

SATA

Ctlr

ONLINE DUPLEX - -

-     10/2 Serial Bus Ctlrs     ONLINE ONLINE - 0
-     05:02.0 USB 1.0 Host Ctlr    ONLINE ONLINE - -
-     05:02.1 USB 1.0 Host Ctlr    ONLINE ONLINE - -
-     05:02.2 USB 2.0 Host Ctlr    ONLINE ONLINE - -
-     10/3 Display Ctlr     ONLINE DUPLEX - 0
-     05:03.0 ATI Rage Mobility    ONLINE DUPLEX - -
-     10/4 -        MISSING EMPTY   - -
-     10/5 Network Ctlr     ONLINE DUPLEX - 0
-     04:02.0 2-port 1GB Enet NIC ONLINE DUPLEX - -
-     eth000010 Network Interface    ONLINE DUPLEX - -
-     04:02.1 2-port 1GB Enet NIC ONLINE DUPLEX - -
-     eth000011 Network Interface    ONLINE DUPLEX - -
-     10/6 Bridge     ONLINE ONLINE - 0
-     10/7 Bridge     ONLINE ONLINE - 0
-     10/8 Misc       ONLINE ONLINE - 0
-     03:01.0 ftSwitch Core Logic ONLINE ONLINE - -
-     10/9 Network Ctlr     ONLINE ONLINE - 0
AA-U57500 04:01.0 2-port 1GB Copper Enet NIC ONLINE ONLINE - -
-     eth000008 Network Interface    BROKEN BROKEN - -
AA-U57500 04:01.1 2-port 1GB Copper Enet NIC ONLINE ONLINE - -
-     eth000009 Network Interface    BROKEN BROKEN - -
-     10/10 -        MISSING EMPTY   - -
-     10/11 -        MISSING EMPTY   - -
-     10/40 SATA Enclosure

- - - -

AA-D64200 10/40/1 160GB

S

ATA Disk Drive

ONLINE DUPLEX 3.00 -

AA-D64300 10/40/2 74GB

S

ATA Disk Drive

ONLINE ONLINE 33.0 -

-     10/120 Baseboard Management Ctlr ONLINE DUPLEX 4.0.0 -
-     10/140 Fan        -    NORMAL - -
-     10/150 -12V       -    NORMAL - -
-     10/151 +1.3V     -    NORMAL - -
-     10/152 +1.5V GB     -    NORMAL - -
-     10/153 +2.5V GB     -    NORMAL - -
-     10/154 +2.5V

S

ATA

- NORMAL - -

-     10/155 +2.5V VGA    -    NORMAL - -
-     10/156 +3V CLK    -    NORMAL - -
-     10/157 +3.3V     -    NORMAL - -
-     10/158 +3.3Vs     -    NORMAL - -
-     10/159 +3.3V GBE    -    NORMAL - -
-     10/160 +5V        -    NORMAL - -
-     10/161 +5Vs       -    NORMAL - -
-     10/162 +12V       -    NORMAL - -
AA-G90730 11     Combined CPU/IO     ONLINE DUPLEX - 0
-     11/0 Mass Storage Ctlr    ONLINE ONLINE - 0
-     7c:00.0 Fast Track TX EIDE Ctlr ONLINE ONLINE - -

«
...
97
98
99
100
101
...
»

Summary of Contents for Express5800/ftServer

Page 1: ...NEC Corporation of America 456 01730 000 Express5800 ftServer System Administrator s Guide for the Linux Operating System ...

Page 2: ...programming interfaces API developed by NEC and or its licensees Any undocumented features of these interfaces are intended solely for use by NEC personnel and are subject to change without warning This document is protected by copyright All rights are reserved No part of this document may be copied reproduced or translated either mechanically or electronically without the prior written consent of...

Page 3: ...onal Documentation and Resources 1 3 Red Hat Enterprise Linux 1 4 Express5800 ftServer Documentation 1 4 Linux and UNIX Documents 1 4 2 Installing the Operating System and Express5800 ftServer System Software 2 1 Installation Overview 2 2 Boot Media 2 3 Default System Setup 2 3 Linux Version Information 2 4 Storage Default Settings 2 4 Ethernet Default Configuration 2 5 USB and RS232C Default Sett...

Page 4: ...on Without a Kickstart File 2 18 Additional Documentation and Resources 2 19 3 Updating ftServer System Firmware 3 1 Updating the System BIOS 3 1 Updating BMC Firmware 3 5 4 Updating the Operating System and Express5800 ftServer System Software 4 1 General Upgrade Considerations 4 2 Upgrade Requirements 4 2 Related Considerations 4 2 Upgrading or Restoring the Linux Operating System 4 3 Express580...

Page 5: ...ode 5 20 Manually Creating Partitions on Blank Disks and Adding to RAID 1 Arrays 5 20 Replacing Defective Disks Interactively 5 21 Replacing Defective Disks Manually 5 21 The duplex_blank_disk Command 5 25 System Backup and Disaster Recovery 5 26 Ethernet Devices 5 26 Physical Device Naming 5 26 Monitoring and Configuring Channel Bonding Interfaces 5 28 Monitoring Channel Bonding Interfaces 5 28 C...

Page 6: ...Configuration File Updates 8 4 The snmpd conf File 8 5 The ftlsubagent conf and ftltrapsubagent conf Files 8 5 Configuring SNMP to Start at System Initialization 8 6 Configuring SNMP for Service Management 8 6 SNMP Foundations and Concepts 8 8 ftlSNMP Management Commands 8 9 The Basic Net SNMP Commands 8 10 MIBs 8 11 Some Objects Defined by Standard MIBs 8 12 SNMPv3 Support 8 14 SNMP s View of a N...

Page 7: ...Objects 8 32 SRA ftLinux MIB OID Values and Properties 8 32 Trap Filtering 8 33 Trap Filtering Capability 8 33 Activating and Deactivating Trap Filtering 8 33 Trap Filtering Examples 8 34 9 Troubleshooting ftServer Systems 9 1 LED and Visual Diagnostics 9 1 System Boot Problems 9 1 Normal Boot Sequence 9 2 Possible Boot Problems 9 3 Missing Drivers Prevent Booting 9 3 GRUB Problem 9 4 RAID Problem...

Page 8: ... 5 1 CPU I O Enclosures Front Panel with Drive Slots Fully Populated 5 3 Figure 7 1 ftServer Enclosures Locations of Major Enumerated Devices Front View 7 8 Figure 7 2 ftServer Enclosures Locations of Major Enumerated Devices Rear View 7 9 Figure 8 1 AgentX Enabled Extensions and Subagents 8 17 Figure 8 2 Operational State Management on ftServer Systems 8 25 ...

Page 9: ...r CPU I O Enclosures 5 27 Table 7 1 Device Paths of ftServer Devices 7 5 Table 8 1 Meaning of Duplex for ftServer System Components 8 26 Table 8 2 Operation State Values Names and Definitions 8 30 Table 8 3 Reason Codes Names and Definitions 8 31 Table 8 4 Set Operations Currently Implemented in ftlSNMP 8 32 ...

Page 10: ...he Running System Disk 5 25 Example 5 6 Default Configuration of Embedded Ethernet Devices 5 28 Example 7 1 Displaying System Status with the ftsmaint Command 7 10 Example 8 1 Traps that Can Occur for I O Element 11 When Trap Filtering Is Off 8 34 Example 8 2 Traps That Can Occur for I O Element 11 when Trap Filtering Is On 8 38 Example 8 3 Traps That Can Occur for When Trap Filtering Is Off 8 40 ...

Page 11: ...d Linux or UNIX and TCP IP network server and network administration technologies is assumed Revision Information This document is a revision This revision incorporates the following changes It documents the Express5800 ftServer Dual Core and Quad Core hardware platforms It documents the changed system software installation procedures It documents the internal storage SAS SATA disk drives It docum...

Page 12: ...For example Update the BIOS before you install or upgrade Express Builder The monospace font represents text that would appear on your display screen The monospace bold font represents text you must type in examples that contain both user input and system output The monospace italic font represents terms in command lines that are to be replaced by literal values For example To display the state of...

Page 13: ...ng shows two mutually exclusive but optional argurments command arg1 arg2 The following example shows two mutually exclusive argurments one of which is required command arg1 arg2 In either case you may use either arg1 or arg2 when you type the command Ellipsis indicates that you can specify the preceding argument as many times as you need to on a single command line For example command arg1 arg2 a...

Page 14: ...ing System VTM is not available with Express5800 ftServer for Linux systems Express Service Network is not available with Linux systems Although this guide may document modem functionality modems are not available for all systems Ask your sales representative about modem availability ...

Page 15: ...ing components process the same instructions at the same time In the event of a component malfunction the partner component acts as an active spare that continues normal operation preventing system downtime and data loss Internal Storage Mirrored RAID 1 Redundant arrays of inexpensive disks arrays Serial attached SCSI and Serial Advanced Technology Attachment SAS SATA disks prevent single disk fai...

Page 16: ...so that you can if necessary reinstall your ftServer system s software If you ordered a supported Linux distribution from a vendor other than NECAM the vendor can also provide you with distribution CDs for installing or reinstalling the system software You need to use the Express Builder CD with the CDs for the supported Linux distribution to achieve a fault tolerant ftServer system Before you ins...

Page 17: ...age that provides support for Express Service Network access using an attached modem This package allows the NEC Corporation of America Customer Support Center or your authorized NEC service representative to provide remote support for your system Your system comes with Express Service Network installed Network Management and Reporting Express Builder includes optional utilities to allow remote su...

Page 18: ... and UNIX Documents The following sources provide further information about the Linux and UNIX operating systems The Linux Documentation Project http www tldp org The System Administrator s Guide LDP v0 8 and the Network Administrators Guide LDP v2 0 are two freely redistributable publications available from the Linux Documentation Project Web site that you can use to supplement this Express5800 f...

Page 19: ...vailable tools and assemble an effective toolkit for managing servers and networks for example Open Source Network Administration by James Kretchmar copyright 2004 Prentice Hall PTR div of Pearson Education Inc http vig prenhall com catalog academic product 0 4096 0130462101 00 html This volume is a basic reference for common open source TCP IP network administration utilities and technologies inc...

Page 20: ...Additional Documentation and Resources 1 6 Express5800 ftServer System Administrator s Guide for the Linux Operating System ...

Page 21: ...ming an Installation Without a Kickstart File Additional Documentation and Resources The procedures described in this chapter are for a fresh installation or complete reinstallation of a supported Linux operating system and the Express5800 ftServer System Software for the Linux Operating System Express Builder on ftServer systems Chapter 4 describes an upgrade procedure and system and package rest...

Page 22: ...he necessary end user license agreements continue to Chapter 5 to begin configuring the ftServer system If you have a current installation that requires only minor upgrading review your Release Notes Express5800 ftServer for the Linux Operating System then see Chapter4 and if necessary Chapter 3 If some time has elapsed since your Express5800 ftServer system was delivered there may be updated docu...

Page 23: ...ta exists on the target system disks The installation and upgrade installation procedures will destroy existing data on the drives in the bottom slot labeled 1 of each CPU I O enclosure If you need to repair a corrupted system or update the system to a new release determine whether the upgrade procedure in Chapter 4 will meet your requirements before doing a full installation Boot Media The suppor...

Page 24: ...pm q lsb ft eula_display lsb ft eula_display 4 0 65 Storage Default Settings C A U T I O N C A U T I O N Prepare for installation by installing disk drives of identical size and geometry into the internal storage in the bottom slot the two slots labeled 1 sda and sdd of each CPU I O enclosure Remove all internal drives from the other four slots sdb sdc sde and sdf The installation process pairs th...

Page 25: ...formance on multi drive systems by using swap partitions on each installed drive pair However for fault tolerance always use mirrored swap partitions See Setting Up Internal Disk Storage on page 5 2 for more information The root partition comprises 32 GB The remainder of the space is an extended partition that includes 36 GB or more of unused space This extended partition can be further divided by...

Page 26: ...s required for your specific application Default User Environments Shells and Access Control The GRUB bootloader package supplied with the Linux distribution includes a restricted GRUB shell that can be entered at system boot for boot loader configuration and boot recovery operations See grub 1 for a discussion of this feature Make sure that GRUB requires root privilege and password protect this s...

Page 27: ...d Firmware The Linux operating system combined with Express Builder can be installed only on supported Express5800 ftServer Dual Core and Quad Core systems Do not attempt to install this software combination on an ftServer system that does not support it Express Builder interfaces with ftServer firmware that has been tuned to support fault tolerance Specific Express Builder releases may require co...

Page 28: ... comes with the distribution See Chapter 3 for details Use the CD ROM drive in the top CPU I O enclosure during the installation Do not use the drive in the lower CPU I O enclosure Verify that the top enclosure is the active enclosure Ensure that the keyboard mouse and console are attached to the system The installer uses a graphical user interface on the ftServer system console which consists of ...

Page 29: ...pper CPU I O enclosure is lit the lit LED indicates that it is the active primary enclosure If the upper CPU I O enclosure is not the active enclosure you must make it the active enclosure by performing the actions listed in step 2 of the installation procedure in Initial Linux Operating System and Express Builder Installation or Default Reinstallation on page 2 10 For security during installation...

Page 30: ...ble_t exec noauto managed 0 0 When you disable SELinux this parameter is added to the etc fstab file which causes the command to mount the CD ROM to fail Reinstalling Express Builder After a Failed Installation If the attempt to install Express Builder fails before again trying to install it perform the following steps to uninstall the requisite files and attempt to reinstall Express Builder in th...

Page 31: ...p 4 After the system boots from the CD and as soon as the boot prompt appears type the following line at the boot prompt and press ENTER boot linux rescue N O T E You must type something at least one character on the boot prompt line before its timeout period expires Otherwise the boot will proceed with incorrect parameters and the keyboard will be disabled If this happens you can recover by power...

Page 32: ...der distributions as described in this chapter you may also need to separately install optional packages using the rpm command 2 The system disk pair was created as a RAID 1 mirrored drive set on drives sda and sdd Each drive is bootable and configured identically to the other 3 After installation the kudzu haldaemon and microcode_ctl services are disabled Do not enable these services Configuring ...

Page 33: ...fter installation while the system is booting the GRUB menu must supply linux reboot warm nmi_watchdog 0 i8042 noaux At the boot prompt You must type something at least one character on the boot prompt line before its timeout period expires Otherwise the boot will proceed with incorrect parameters and the keyboard will be disabled If this happens you can recover by power cycling the system and boo...

Page 34: ...ackages You may have to manually resolve package dependency failures when installing Express Builder Make sure that the kernel command line does not contain rhgb Make sure that services like kudzu haldaemon and microcode_ctl are disabled Make sure that partitions are set up correctly Additional Documentation and Resources The GNU GRUB Web page Free Software Foundation http www gnu org software gru...

Page 35: ...le with your current Express Builder installation or if you will immediately update to operating system or Express Builder releases that are supported by the updated firmware Updating the System BIOS Make sure that the BIOS you intend to install is compatible with the Express Builder release level that you have or that you will install immediately after performing the BIOS upgrade Verify in the ap...

Page 36: ...tomatically allowing the enclosures to synchronize N O T E If an ftServer system boots from the system enclosure that has not been upgraded the upgraded system firmware will be overwritten with older firmware in order to synchronize to duplex This defeats the intended upgrade C A U T I O N C A U T I O N Do not interrupt a BIOS firmware update while a burn that is a write to EEPROM is in progress I...

Page 37: ...reen ON LED Yellow OFF LED White ON Modelx AA G94340 Firmware Rev 1 3 90 ECO Level 37 Min Partner ECO Level 0 Serial 401318 MTBF Fault Count 0 MTBF Last Timestamp None MTBF Threshold 1200 MTBF Value 0 MTBF Type useThreshold Logic Revision 18023 Then run the following command opt ft bin ftsmaint ls 1 N O T E To determine what model your system is type the ftsmaint lsSystem command The model is iden...

Page 38: ...t this point reboot only if you need to change BIOS configuration settings 7 Repeat step 4 to verify that the CPU I O enclosures are again duplexed 8 If the new BIOS did not perform as you expected first verify that you do not also need to perform an Express Builder upgrade to use the new BIOS If so proceed to step 9 returning here if the upgrade procedure does not initiate or follow the documente...

Page 39: ...er 2 for operating system update procedures Updating BMC Firmware Each I O element contains a socketed Baseboard Management Controller BMC chip Firmware updates are provided on a bootable CD ROM To check the BMC firmware version type the following command opt ft bin ftsmaint ls 10 120 Firmware Rev 7 0 0 The preceding example displays a BMC firmware version number of 7 0 0 for CPU element 0 C A U T...

Page 40: ...ds to update the BMC firmware on each I O element opt ft bin ftsmaint burnProm path and filename for the BMC firmware Updated firmware on the device at path 10 120 opt ft bin ftsmaint burnPROM path and filename for the BMC firmware Updated firmware on the device at path 11 120 6 Type the following commands to verify that your BMC firmware is duplexed be sure that the opstate is DUPLEX opt ft bin f...

Page 41: ...covering from a Failed Software Upgrade Related Information and Resources N O T E S 1 If you want to update or reinstall an individual software package that is provided in a Red Hat Package Manager RPM file use the rpm command see rpm 8 2 The Linux operating system upgrade script has been tested only with firmware hardware and devices meeting design specifications of the Express5800 ftServer syste...

Page 42: ... ensure that your ftServer system supports the new version Upgrade the Express Builder as described in Upgrading or Restoring Express Builder on page 4 6 Related Considerations The upgrade and reinstallation processes do not overwrite the following files if you have modified them etc modprobe d ft network conf etc sysconfig network scripts ifcfg bond0 etc sysconfig network scripts ifcfg bond1 etc ...

Page 43: ...location If the same rpmsave or rpmnew files are generated by uninstalling Express Builder or by an upgrade or reinstallation the previous archived versions could be overwritten 2 If you uninstall Express5800 ftServer system software any of these network files that you modified are saved to the etc OPT ft network scripts ARCHIVE directory and given a rpmsave extension Upgrading or Restoring the Li...

Page 44: ... so the initrd can be re created with these modules boot is mounted by etc fstab The directory opt ft must reside within the root file system Immediately after rebuilding kernel modules at boot time the system automatically reboots to place these rebuilt modules into use If the system cannot successfully build all the required Express5800 ftServer kernel modules a policy of whether a non fault tol...

Page 45: ...ese updates explicitly select their check boxes By default all available Express Builder updates are selected for installation 3 The Update Agent downloads the updates and prompts you to install them 4 To install a new version of Express Builder see Upgrading or Restoring Express Builder 5 Reboot the system only if you manually selected an update that modifies the kernel By default the Update Agen...

Page 46: ... its earlier versions If you must restore an installation whose system files are corrupt this upgrade may fail To ensure that Express Builder is performing correctly you should either perform a complete Express Builder reinstallation or restore the system from backups Carefully read the current Release Notes Express5800 ftServer for the Linux Operating System document on http support necam com Dis...

Page 47: ... the system to the previous Express Builder version see Recovering from a Failed Software Upgrade on page 4 8 Creating a Backup System Disk To create a backup system disk 1 Shut down the system with the command halt p 2 Remove the system disk from the bottom slot of the CPU I O enclosure whose power switch is not lit and set it aside as a backup disk 3 To boot the system lift the switch cover of t...

Page 48: ... prepared before performing the upgrade in the bottom slot of the CPU I O enclosure whose power switch is lit green 4 Boot the system by lifting the switch cover of the core CPU I O enclosure whose power switch is lit green and by pressing the switch momentarily 5 After the system has booted insert the one of the disks you set aside in step 2 in the bottom slot of the CPU I O enclosure whose power...

Page 49: ...on the system Often the device is recognized and automatically supported requiring no direct configuration While the operating system may recognize legacy devices Express5800 ftServer System Software for the Linux Operating System Express Builder does not support them as fault tolerant devices To be supported as a fault tolerant device a device must have a special hardened driver that supports sur...

Page 50: ...1 mirrors are broken the other CPU I O enclosure becomes simplex and its disk status LED becomes amber Pulling the CRU would cause all disk LEDs in the remaining CRU to go amber Pulling one disk would cause only its partner s LED to go amber An amber LED indicates that the device is no longer safe to pull The Opstate Manager OSM administratively removes the missing mirrors from their RAID 1 arrays...

Page 51: ...disks To simplify administration and reduce confusion this section presents recommended configurations For convenience the disks are used in pairs based on vertical grouping of the disks in the CPU I O enclosures sda is paired with sdd sdb with sde and sdc with sdf RAID 1 arrays are created by placing one mirror on each disk of the pair For example RAID array dev md0 occupies sda1 and sdd1 Each SA...

Page 52: ... versions of LILO 2 booting and partitioning software from other OSs e g DOS FDISK OS 2 FDISK Command m for help 2 Enter the p argument of the fdisk command Command m for help p Disk dev sdb 146 8 GB 146815737856 bytes 255 heads 63 sectors track 17849 cylinders Units cylinders of 16065 512 8225280 bytes Device Boot Start End Blocks Id System dev sdb1 1 17849 143372061 83 Linux Command m for help 3...

Page 53: ...ution displayed by the command Command m for help o Building a new DOS disklabel Changes will remain in memory only until you decide to write them After that of course the previous content won t be recoverable The number of cylinders for this disk is set to 17849 There is nothing wrong with that but this is larger than 1024 and could in certain setups cause problems with 1 software that runs at bo...

Page 54: ...zeK 1 8924 default 8924 7 Enter the desired last cylinder number for the partition the size in megabytes or kilobytes or press ENTER to accept the default this example accepts the default Using default value 8924 Command m for help 8 Enter the t command Command m for help t Selected partition 1 Hex code type L to list codes 9 Press ENTER to accept the default ID 83 Enter fd if you want the partiti...

Page 55: ...f SAS SATA disks See User Guide Setup for configuration of internal disk N O T E The RAID array is not deterministic Checking the Current State of the Internal Disk Subsystem The proc scsi scsi file displays the current state of the internal disk subsystem It shows all of the disks and their names and states as well as additional information This example shows a system with two SAS SATA disks ...

Page 56: ...able as SCSI pseudo devices This can be useful to allow certain SCSI software packages to work with non SCSI devices Setting Up RAID Arrays This section discusses the following topics RAID Array Overview Creating a RAID 1 Array Creating a RAID 0 Array Creating and Mounting a File System Checking the Current State of RAID RAID Array Overview RAID is the basis for fault tolerant file system availabi...

Page 57: ...eds Here is a typical line ARRAY dev md2 super minor 2 You can create start and stop the RAID arrays You can manage RAID 1 arrays by adding and removing mirrors The following sections discuss working with RAID arrays This includes configuring RAID arrays administration and tools N O T E To ensure fault tolerant operation of your system only use the mdadm command to create RAID arrays Creating a RA...

Page 58: ...Y dev md20 level 1 num devices 2 devices dev sdb1 dev sde1 Always define RAID 1 arrays on disks in the embedded slots to have two disks and no spares c Save the file and exit the editor 4 Make the RAID array with the following command mdadm create dev md20 level 1 raid devices 2 dev sdb1 dev sde1 This command creates the RAID array and starts it N O T E When an array is created proc mdstat shows t...

Page 59: ...ck is persistent Update Time Wed Sep 28 15 20 58 2005 State clean Active Devices 2 Working Devices 2 Failed Devices 0 Spare Devices 0 Number Major Minor RaidDevice State 0 8 17 0 active sync dev sdb1 1 8 49 1 active sync dev sde1 UUID 866e4ecd 12657190 79293b72 6b774c0d Events 0 3 Creating a RAID 0 Array When the desired file system is larger than a single disk use RAID 0 to combine multiple RAID ...

Page 60: ...ke the RAID array with the following command mdadm create dev md30 level 0 raid devices 2 dev md20 dev md21 This command creates the RAID array and starts it If you type the mdadm command again it shows the active RAID array mdadm Q detail dev md30 dev md30 Version 00 90 01 Creation Time Wed Sep 28 15 20 08 2005 Raid Level raid0 Array Size 286743808 273 46 GiB 293 63 GB Raid Devices 2 Total Device...

Page 61: ...nt dev md30 big_data To verify the work use the command df to show the size of the file system df big_data Use the command ls to show the lost found directory in the file system ls l big_data At this point be sure to add the mount to the etc fstab file so the file system is mounted during boot Reboot the system to make sure it works N O T E A single disk that is not part of a RAID array must have ...

Page 62: ...blocks 2 2 UU md1 active raid1 sdc2 1 sda2 0 2096384 blocks 2 2 UU md2 active raid1 sdc3 2 F sda3 0 31647936 blocks 2 1 U_ md0 active raid1 sdc1 1 sda1 0 2096384 blocks 2 2 UU unused devices none In this example md30 is a RAID 0 array made up of md20 and md21 The remaining stanzas are for RAID 1 arrays Note that md21 is operating in degraded mode It is missing a disk 2 1 _U Removing and Replacing ...

Page 63: ...artitions on Blank Disks and Adding to RAID 1 Arrays You can use the mdadm command to administer RAID arrays The following sections provide examples of how to perform some common administrative procedures using mdadm N O T E Never remove both member disks of a RAID 1 array The Linux operating system does not support that operation To Stop a RAID Array and Move It to Another System You can stop RAI...

Page 64: ...is may not be all RAID arrays that use the disk When a mirror becomes faulty the disk and CPU I O enclosure of the remaining active mirror becomes simplex and that enclosure is no longer safe to pull If you want to remove a good disk from a RAID array you must mark it faulty You can use the mdadm command to simulate an error and mark the mirror faulty mdadm dev md20 f dev sdb1 The proc mdstat file...

Page 65: ...lasses of resynchronization fast and full A fast resync is done when the mirror was recently part of the array and RAID software knows what has been written while the mirror was missing If the fast resync is not possible for example when a clean new disk is added a full resync is performed The full resync synchronizes all of the mirror that is in use If nothing was written while the mirror was mis...

Page 66: ...le and RAID superblocks Then remove and reinsert the disk to start the automatic disk replacement For more information about safe mode see Configuring Safe Mode Do not reboot the system or stop and restart OSM after you remove the failed disk until you have inserted the replacement disk and it has synchronized with its partner The information necessary to perform automatic disk replacement is not ...

Page 67: ... does not belong to a running RAID array The following entry in the OSM configuration file configures safe mode entry key blankDiskSafeMode value true To specify that automatic pairing of disks not operate in safe mode replace the word true with false so that the file contains the following entry entry key blankDiskSafeMode value false Because OSM preferences are only read at start up time you mus...

Page 68: ...he process perform the following procedures Remove the defective disk and insert a spare disk Verify that the spare disk is not in use Zero the spare disk Partition the spare disk to match the running disk Add partitions on the spare disk to RAID 1 arrays Run the GRUB boot loader only if the running disk is the system disk N O T E Replacement disks can be new factory fresh disks or disks recycled ...

Page 69: ...ry little time but may not remove everything from the disk If you are concerned about this zero the entire disk as described in the following step Zero the entire spare disk by typing a command such as the following substitute the device node of the disk you wish to zero for sdf in this example dd if dev zero of dev sdf bs 1024k N O T E Zeroing the entire disk takes quite a long time but removes e...

Page 70: ...s this check d Use the force flag to overrule all checks N O T E The preceding error does not occur if the spare disk already contained a valid partition table If you are sure that the spare disk is not in use force sfdisk to write the partition table by using the no reread flag To add partitions on the spare disk to RAID 1 arrays 1 Type the following command to determine which RAID 1 arrays the r...

Page 71: ... upper memory Minimal BASH like line editing is supported For the first word TAB lists possible command completions Anywhere else TAB lists the possible completions of a device filename grub device hd0 dev sdd grub root hd0 0 Filesystem type is ext2fs partition type 0xfd grub setup hd0 Checking if boot grub stage1 exists no Checking if grub stage1 exists yes Checking if grub stage2 exists yes Chec...

Page 72: ... blank disk e g 10 40 1 or 70 1 11 40 1 Device node s for 11 40 1 dev sdd Is this the correct blank disk device yes no y Device Path ID of source disk e g 10 40 1 or 70 1 10 40 1 Device node s for 10 40 1 dev sda Is this the correct source disk device yes no y Source disk is partitioned partitioning blank disk to match Source disk partition 1 belongs to RAID 1 dev md0 Adding blank disk partition 1...

Page 73: ...ng Monitoring and Configuring Channel Bonding Interfaces MAC Addresses Physical Device Naming On many Linux systems Ethernet devices are normally assigned names based on the order of discovery at system startup The names begin with the letters eth followed by a number starting with 0 and counting up This is convenient because the first and often only device on a host is predictably named eth0 and ...

Page 74: ...ernet PCI adapter CPU 0 I O 10 PCI slot 9 port 0 eth000008 Ethernet PCI adapter CPU 1 I O 10 PCI slot 9 port 1 eth000009 Ethernet PCI adapter CPU 0 I O 10 PCI slot 10 port 0 eth000218 Ethernet PCI adapter CPU 1 I O 10 PCI slot 10 port 1 eth000219 Ethernet PCI adapter CPU 0 I O 10 PCI slot 11 port 0 eth000220 Ethernet PCI adapter CPU 1 I O 10 PCI slot 11 port 1 eth000221 Ethernet PCI adapter CPU 0 ...

Page 75: ...the ftsmaint command to obtain information about the fault tolerant status of the interfaces This section discusses the following topics Monitoring Channel Bonding Interfaces Configuring Channel Bonding Interfaces Determining Interface Device Names Monitoring Channel Bonding Interfaces You can monitor the fault tolerant status of channel bonding interfaces by using the ftsmaint command Example 5 6...

Page 76: ...eth files Additionally you use standard Linux network utilities like ifdown ifup service ifconfig ip and route By default the system supports five channel bonding interfaces In the unlikely event that you must configure more than five bonding master interfaces up to a maximum of 10 modify the options line in the etc modprobe d ft network conf file so that max_bonds x where x is the desired number ...

Page 77: ...ut that corresponds to the newly installed adapter The output might look like the following 04 02 0 Ethernet controller Intel Corp 82546EB Gigabit Ethernet Controller Copper rev 01 The device names for the two physical interfaces on the newly added dual Ethernet adapter shown above are eth000008 and eth000009 C A U T I O N C A U T I O N Issuing an lspci command with the xxx option may temporarily ...

Page 78: ...pe the following command to bring up the new interface ifup bond2 MAC Addresses You can use the ifconfig command to determine the current MAC address of an Ethernet interface Alternatively you can examine the interface s address file in the sys class net interfacename directory For the embedded Ethernet adapter interfaces Ethernet MAC addresses are algorithmically generated from a base MAC address...

Page 79: ... A U T I O N Disable hyperthreading only if your system satisfies the minimum BIOS version requirements Contact the NEC Corporation of America Customer Support Center or your authorized NEC service representative to confirm that you have the correct BIOS version To disable hyperthreading you enter the ftServer Setup utility To disable hyperthreading 1 Turn on or restart your system When the Expres...

Page 80: ... only by using a text editor to change the entries in the etc X11 xorg conf file Use one of the configured video modes that the Express Builder installation program installed in the xorg conf file To do this select one of the available modes for the pixel depth you are using by putting the desired mode first in the list for that depth Changes made to xorg conf file are preserved during an upgrade ...

Page 81: ...ion and Resources Linux System Administrator s Guide v0 8 Linux Documentation Project http www ibiblio org pub Linux docs linux doc project system admin guide http unthought net Software RAID HOWTO Managing RAID on Linux Derek Vadala O Reilly Associates 2003 http www oreilly com catalog mraidlinux ...

Page 82: ...Additional Documentation and Resources 5 34 Express5800 ftServer System Administrator s Guide for the Linux Operating System ...

Page 83: ... dev cdrom dev dvdwriter dev hde In CPU 1 I O 11 dev cdrom1 dev dvdwriter1 dev hdi USB Storage Devices USB storage devices including floppy disk and solid state storage are supported through the SCSI driver These devices appear as SCSI devices You can get information about these devices by examining the file proc scsi scsi by running the command lsusb or by examining the system log var log message...

Page 84: ...umber The udevinfo command translates the internal name into the name assigned by the udev command For example the following command and output show that the udev command has assigned the name sd1usb to the device with the internal name sde udevinfo q name p sys block sde sd1usb The ls command displays the device node for this device ls l dev sd1usb brw rw 1 root disk 8 64 Oct 24 16 18 dev sd1usb ...

Page 85: ...ubsystem scans USB devices only on connection is that simply removing a floppy disk from the floppy drive or inserting a disk does not cause a rescan You must unplug the floppy drive and plug it back in to cause a rescan 2 During failovers access to USB storage devices is not robust 3 If an AC switch occurs some USB devices are not properly reset and disappear from ftsmaint output To reset these d...

Page 86: ...380013AS Rev 3 00 Type Direct Access ANSI SCSI revision 05 Host scsi4 Channel 00 Id 00 Lun 00 Vendor ATA Model ST380013AS Rev 3 00 Type Direct Access ANSI SCSI revision 05 The system log shows details about the device scsi4 SCSI emulation for USB Mass Storage devices Vendor NEC Model USB UF000x Rev 1 50 Type Direct Access ANSI SCSI revision 02 SCSI device sdaz 2880 512 byte hdwr sectors 1 MB sdaz ...

Page 87: ...ncluding its size scsi5 SCSI emulation for USB Mass Storage devices Vendor LEXAR Model JUMPDRIVE SECURE Rev 3000 Type Direct Access ANSI SCSI revision 02 SCSI device sdaz 506880 512 byte hdwr sectors 260 MB Additional Resources Linux Allocated Devices LANANA http www lanana org docs device list devices txt ...

Page 88: ...Additional Resources 6 6 Express5800 ftServer System Administrator s Guide for the Linux Operating System ...

Page 89: ...tative can receive alarm notifications when faults or other significant events occur on your system and can remotely diagnose problems The following sections explain how to use the ftsmaint command and how to configure the Express Service Network and also information about managing dump files and about system load The ftsmaint Command The ftsmaint command provides a control interface for managing ...

Page 90: ...nt lsLong This command displays the status of all fault tolerant devices on the ftServer system This command also returns the status of empty devices such as unpopulated PCI slots This command is useful to study the addressable fault tolerant devices that can be queried or controlled with Express Builder software ftsmaint lsPeriph This command displays information about peripheral devices such as ...

Page 91: ...osure CPU I O enclosure or CPU I O enclosure slot specified by path ftsmaint identify start stop path This command starts or stops the LEDs on the device specified by path The device can be a CPU board an I O board or an I O slot ftsmaint dump path This command generates a dump of the BMC or CPU element specified by path BMC dumps are stored in var crash date bmcx dmp where x is 10 or 11 CPU dumps...

Page 92: ...e level argument ftsmaint setMtbfThresh value path This command sets the MTBF threshold to value of the CPU element I O element or CPU I O enclosure slot specified by path ftsmaint setMtbfType policy path This command sets the MTBF type to policy on the CPU element I O element or CPU I O enclosure slot The policy argument can take one of the following values useThreshold neverRestart alwaysRestart...

Page 93: ...eration Some subsystems and components of the ftServer system are addressable by device path IDs Device path enumerators uniquely identify the various devices in an ftServer system ftServer System Device Path Enumeration Table 7 1 lists the device paths for devices in an ftServer system Table 7 1 Device Paths of ftServer Devices Page 1 of 3 Location Device Path Top CPU element Top CPU element 0 DI...

Page 94: ...t Top I O element 10 Mass storage controller EIDE controller 10 0 05 00 0 SAS SATA controller SAS SATA controller 10 1 05 01 0 USB controllers USB host controller 10 2 05 02 0 05 02 2 VGA controller Graphics controller 10 3 05 03 0 Ethernet controller Ethernet card 10 5 04 02 0 04 02 1 PCI device Core logic 10 8 03 01 0 PCI slots 9 10 11 10 9 10 11 Storage enclosure in top I O element 10 40 Intern...

Page 95: ...hernet controller Ethernet card 11 5 7b 02 0 7b 02 1 PCI device Core logic 11 8 7a 01 0 PCI Slots 9 10 11 11 9 11 11 Storage enclosure in top I O enclosure 11 40 Internal disk slot 1 maps to sdd 11 40 1 Internal disk slot 2 sde 11 40 2 Internal disk slot 3 sdf 11 40 3 BMC 11 120 Fan speed sensor 11 140 Voltage sensors 11 150 11 162 IDs in the format nn nn n indicate PCI bus slot and function These...

Page 96: ... Figure 7 1 ftServer Enclosures Locations of Major Enumerated Devices Front View Callout Device ID Component 1 0 CPU 0 I O 10 2 10 40 1 Internal disk drive 1 sda 3 10 40 2 Internal disk drive 2 sdb 4 10 40 3 Internal disk drive 3 sdc 5 1 CPU 1 I O 11 6 11 40 1 Internal disk drive 1 sdd 7 11 40 2 Internal disk drive 2 sde 8 11 40 3 Internal disk drive 3 sdf asys076a 1 5 4 3 2 8 7 6 ...

Page 97: ...s of Major Enumerated Devices Rear View Callout Device ID Component 1 10 9 Slot 1 low profile PCI Slot 9 2 10 10 Slot 2 full height PCI Slot 10 3 10 11 Slot 3 full height PCI Slot 11 4 11 9 Slot 1 low profile PCI Slot 9 5 11 10 Slot 2 full height PCI Slot 10 6 11 11 Slot 3 full height PCI Slot 11 1 3 2 6 4 5 asys077a ...

Page 98: ... FRev Fct AA G90730 0 Combined CPU IO ONLINE DUPLEX 0 AA M23100 0 0 1GB DDR 2 DIMM ONLINE ONLINE AA M23100 0 1 1GB DDR 2 DIMM ONLINE ONLINE 0 2 MISSING EMPTY 0 3 MISSING EMPTY 0 4 MISSING EMPTY 0 5 MISSING EMPTY 0 6 MISSING EMPTY 0 7 MISSING EMPTY 0 20 15 4 1 ONLINE ONLINE 0 20 130 Internal Temp NORMAL 0 20 150 12V NORMAL 0 23 0 0 0 ONLINE ONLINE 0 23 130 Internal Temp NORMAL 0 23 150 12V NORMAL 0...

Page 99: ...rt 1GB Enet NIC ONLINE DUPLEX eth000011 Network Interface ONLINE DUPLEX 10 6 Bridge ONLINE ONLINE 0 10 7 Bridge ONLINE ONLINE 0 10 8 Misc ONLINE ONLINE 0 03 01 0 ftSwitch Core Logic ONLINE ONLINE 10 9 Network Ctlr ONLINE ONLINE 0 AA U57500 04 01 0 2 port 1GB Copper Enet NIC ONLINE ONLINE eth000008 Network Interface BROKEN BROKEN AA U57500 04 01 1 2 port 1GB Copper Enet NIC ONLINE ONLINE eth000009 ...

Page 100: ...ONLINE ONLINE eth080008 Network Interface BROKEN BROKEN AA U57500 7b 01 1 2 port 1GB Copper Enet NIC ONLINE ONLINE eth080009 Network Interface BROKEN BROKEN 11 10 MISSING EMPTY 11 11 MISSING EMPTY 11 40 SATA Enclosure AA D64200 11 40 1 160GB SATA Disk Drive ONLINE DUPLEX 3 00 AA D64300 11 40 2 74GB SATA Disk Drive ONLINE ONLINE 33 0 11 120 Baseboard Management Ctlr ONLINE DUPLEX 4 0 0 11 140 Fan N...

Page 101: ...ent 10 from service opt ft bin ftsmaint bringDown 10 9 You can bring that PCI adapter back into service by typing the following command opt ft bin ftsmaint bringUp 10 9 Kernel Memory Dump File Management C A U T I O N C A U T I O N To ensure that the ftServer dumping mechanism works successfully do not enable Diskdump or Netdump Diskdump or Netdump can interfere with the completion of an ftServer ...

Page 102: ...nagement 7 14 Express5800 320Ma System Administrator s Guide for the Linux Operating System NR003L It is important that you monitor and maintain the size of the var crash directory Back up old crash dump data before deleting it ...

Page 103: ...immediate discussions of installing and configuring ftlSNMP Installing and Configuring ftlSNMP When installing the Express Builder you have the option of installing ftlSNMP If you chose not to install ftlSNMP at that time you can install it later by rerunning the Express5800 ftServer System Software for the Linux Operating System Express Builder installation program and selecting to install ftlSNM...

Page 104: ...s Various startup restart and shutdown scripts Man pages The ftlSNMP package is currently built against a particular Net SNMP version Review the Release Notes Express5800 ftServer for the Linux Operating System for compatibility information During most Express Builder upgrades ftlSNMP is also upgraded Install ftlSNMP upgrades with the provided installer or upgrade script If a script is not provide...

Page 105: ...upgrades Remove earlier versions of ftlSNMP before you install a later ftlSNMP release Whenever the Express Builder is upgraded the ftlSNMP distribution may require updating as well Among other reasons changes in the proc virtual file system in supported hardware configurations and in device support may need to be reflected in the SRA ftLinux MIB file and possibly in supporting scripts You can exp...

Page 106: ...snmpd conf File on page 8 133 and snmpd conf 5 N O T E The Express Builder installation automatically creates snmpd conf in the etc opt ft snmp directory while Net SNMP creates it in the etc snmp directory You should use the etc opt ft snmp version because it is the directory that the ftlSNMP scripts reference etc opt ft snmp ftlsubagent conf see The ftlsubagent conf and ftltrapsubagent conf Files...

Page 107: ... control These are referred to as the view based access control model VACM and user based security model USM You must keep the following two lines in the snmpd conf file for the master agent to function properly master agentx agentxTimeout 60 ftlSNMP requires agentX services To avoid timeouts when the subagents are running under abnormal system stress for example 80 CPU usage and disks heavily str...

Page 108: ...ation After installation of the lsb ft snmp package the ft snmp initialization script is installed in the etc init d directory and the ft snmp service is added During system initialization the ft snmp service is automatically started at run level 3 4 or 5 This initialization script provides start stop restart and status functionality Configuring SNMP for Service Management There are several ways o...

Page 109: ...r start_snmp This series of commands adds lines in the proper configuration files to add a user to the system Be sure to run stop_snmp before running the net snmp config command which prompts you for a user name and password The command adds a create user snmpv3 user MD5 password DES line entry into etc opt ft snmp snmpd conf file This line is automatically replaced with a key on SNMP restart beca...

Page 110: ...nd password in SNMPv3 snmpwalk and snmpget commands for example snmpwalk v 3 t 40 l authNoPriv u paul A new_passwd localhost 1 3 6 1 4 1 458 Unless you plan to use SNMP to monitor the local server you should configure SNMP to shut down when entering runlevel 1 At any rate SNMP daemons need to exit before shutting the system down It is particularly important that you shut down SNMP before performin...

Page 111: ...t and ftltrapsubagent and the master agent Use the preceding commands for most situations C A U T I O N C A U T I O N The following commands are also available to deal with special situations However you should not normally use them except under the guidance of the NEC Corporation of America Customer Support Center or your authorized NEC service representative as starting and stopping agents in un...

Page 112: ...ng an SNMP GET request See snmpget 1 snmpgetnext This command uses GETNEXT requests to query network entities for information snmpgetbulk This command uses the SNMP GETBULK request to query a network entity for quantities of information See snmpgetbulk 1 snmpdf This command replicates df command functionality on a network accessible drive The snmpdf command checks disk space on the remote machine ...

Page 113: ...etstat 1 snmpdelta This command is a tool used to monitor values of a network object over time and respond if the values deviate from established parameters See snmpdelta 1 MIBs A management information base MIB uses ISO Abstract Syntax Notation 1 to assign a unique object identifier to any object to be managed by SNMP This syntax is a hierarchical model that is intended to provide unique object i...

Page 114: ...nux MIB v 2c c public myhost com ftcBdState 1 SRA ftLinux MIB ftcBdState 1 INTEGER duplex 21 As you begin to develop your own MIB or MIBs for your management requirements you can save a lot of work by adopting defined variables from other MIBs A large number of MIBs are defined by the IETF and are available as plain text files You should use standardized MIBs where they define objects to avoid non...

Page 115: ...rt of the Host Resources MIB The objects defined in RFC1514 Host Resources MIB include hrSystem hrStorage hrDevice hrSWRun hrSWRunPerf hrSWinstalled hrSWRunID N O T E A Host Resources MIB should support these objects which are defined in RFC1514 A Newer Host Resources MIB may comply with RFC2790 which extends and replaces RFC1514 The Net SNMP Host Resources MIB implementation has been tested for t...

Page 116: ... a single MIB Accordingly implementing conformant extensions to SNMP should not cause interoperability conflicts with existing standards conforming SNMP implementations In the SNMP network universe any number of SNMP servers can exist and they can manage the objects they know about using SNMPv1 SNMPv2 SNMPv3 and with confidence that any SNMPv4 or subsequent protocol that may be defined will not ob...

Page 117: ...SNMPv1 and SNMPv2 Net SNMP is the most widely adopted open source SNMP utility package This facilitates interfacing the Net SNMP and ftlSNMP implementations with other servers deploying Net SNMP based distributed SNMP services and service management utilities in a heterogeneous network environment Net SNMP has been ported to Linux UNIX and other operating systems such as Windows NT and Stratus VOS...

Page 118: ... the SRA ftLinux MIB txt file to the host system and install it in opt ft mibs SRA ftLinux MIB txt or wherever the host system stores its MIBs You can use ftp to transfer the MIB file from the ftServer system to the host system as long as the two systems can communicate with each other over a network Run these commands to set up MIB path environment variables and reinitialize Net SNMP export MIBDI...

Page 119: ... deployed on a system performing different tasks under control of the master agent Even a MIB II subagent can be extended to provide new functionality using AgentX Although logging is flexible on some SNMP systems logging is simply merged with syslog output In the default ftlSNMP configuration logging is configured as shown in Figure 8 1 Figure 8 1 AgentX Enabled Extensions and Subagents By defaul...

Page 120: ...dress is the IP address of the remote management system 3 Start or restart SNMP using the etc opt ft snmp scripts start_snmp or etc opt ft snmp scripts restart_snmp command for changes to take effect 4 From the remote management system you can view the traps as they are generated by tailing var log messages or wherever the remote management system is configured to log snmptrapd messages tail f var...

Page 121: ...the target name and IP address will differ To walk the SRA ftLinux MIB file snmpwalk v 1 c public t 120 localhost 1 3 6 1 4 1 458 snmpwalk v 2c c public localhost 1 3 6 1 4 1 458 To walk the Express5800 ftServer ftcPcidevcnf table snmpwalk v 2c c public localhost 1 3 6 1 4 1 458 107 1 2 5 2 1 To walk the UCDAVIS MIB snmpwalk v 2c c public localhost 1 3 6 1 4 1 2021 2 snmpwalk v 2c c public localho...

Page 122: ...nd new_passwd are the user name and password set up in Configuring SNMP for Service Management on page 8 134 To bring down a CPU element Note that a final octet 1 identifies CPU element 0 and a final octet 2 identifies CPU element 1 snmpset v 3 t 40 l authNoPriv u v3user A new_passwd localhost 1 3 6 1 4 1 458 107 1 2 1 2 3 1 13 1 s test To bring up a CPU element snmpset v 3 t 40 l authNoPriv u v3u...

Page 123: ...ption Combined CPU IO State ONLINE Op State DUPLEX Reason SECONDARY LED Green ON LED Yellow OFF LED White ON The command output shows that CPU element 0 is online and duplexed so it is safe to remove if from service To bring down CPU element 0 by invoking the ftcCpubdInitiateBringDown command use the whole numeric OID for that command 1 3 6 1 4 1 458 107 1 2 1 2 3 1 13 plus the CPU element 0 index...

Page 124: ...nd Properties on page 8 160 for that command 1 3 6 1 4 1 458 107 1 2 1 2 3 1 11 again followed by CPU element 0 s index snmpset v 1 c private localhost 1 3 6 1 4 1 458 107 1 2 1 2 3 1 11 1 s test SRA ftLinux MIB ftcCpubdInitiateBringUp 3 STRING test If you check CPU element 0 s status immediately you can see that it has started initializing opt ft bin ftsmaint ls 0 H W Path 0 Description Combined ...

Page 125: ...bps Ethernet PCI adapters installed in slot 1 of both CPU I O enclosures First determine the instance name of the Ethernet device and which slot it is in 1 Run an snmpwalk on ftcEtherInstanceName OID This gives you a list of EtherInstance names mapped to Ethernet device names snmpwalk v 1 c private t 40 localhost ftcEtherInstanceName SRA ftLinux MIB ftcEtherInstanceName 1 STRING lo SRA ftLinux MIB...

Page 126: ...ady 13 In practice you will actually redirect your snmpwalk output to files for before and after diff comparison For example in your work area run snmpwalk for the entire SRA ftLinux MIB file and dump that data to a file Pull the cable then run snmpwalk again and dump it to another file Finally run diff on the two files to see all Express5800 ftServer objects that have changed because of the fault...

Page 127: ... is restarted by physical removal if actually present and insertion of the device into a system slot The assigned state Shot is an automatically determined or managed state based on a failure threshold or MTBF A Shot state can be transitioned to an operational state by bringing the device up automatically or transitioned to Broken through a defined system administrative process A Broken device req...

Page 128: ...ncile differences or your SNMP NMS will not be able to manage mismatched object IDs The SRA ftLinux MIB file for a later Linux operating system release will likely work with the earlier Linux operating system releases but may require some adjustment for different defined objects in the proc file system The MIBs in ASN 1 encoded text form are located in opt ft mibs usr share snmp mibs and subordina...

Page 129: ...y errors or warnings generated during the startup script s execution are posted to syslog and stderr See Deploying SNMP Agents and Subagents on page 8 145 for the default destinations of messages logged by the master agent and subagent processes and The ftlsubagent conf and ftltrapsubagent conf Files on page 8 133 for information on how to change the location of the subagent logs Note that there a...

Page 130: ...ely brought down N O T E The ftsmaint command allows you to bring down an enclosure only if it has an operational duplexed partner When an enclosure is operating duplexed the simple duplex LED is lit steady white The simplex duplex LED is the bottom LED of the three LEDs on the left side of the front of the enclosure and is the right most LED on the rear of the enclosure You can also use ftsmaint ...

Page 131: ...7 1 2 5 2 1 15 0 INTEGER 2 iso 3 6 1 4 1 458 107 1 2 5 2 1 15 1 INTEGER 2 ftcPcidevcnfDetectedParityError iso 3 6 1 4 1 458 107 1 2 5 2 1 16 0 INTEGER 2 iso 3 6 1 4 1 458 107 1 2 5 2 1 16 1 INTEGER 2 Notice that the snmpwalk tool can provide symbolic decoding of absolute numbers OIDs Removing ftlSNMP Whenever possible avoid manual removal of the Net SNMP and ftlSNMP packages Use the standard Linux...

Page 132: ...rror and was taken out of service by system logic When in this state the component is electrically isolated from the rest of the system 5 BROKEN A component has a problem an associated reason see OpState Reason describes the problem This is a terminal state some user action must occur to change this state User actions that cause a transition out of the BROKEN state include bringing the component u...

Page 133: ...ered Table 8 3 Reason Codes Names and Definitions Page 1 of 2 Code Reason Definition 1 UNKNOWN The cause is not known 2 NONE No reason is available 3 BELOW_MTBF The current MTBF is below the MTBF threshold specified for this component 4 DIAGNOSTICS_FAILED This component failed diagnostic testing 5 HARDWARE_INCOMPATIBLE The component hardware is incompatible with the online system hardware 6 HOLDIN...

Page 134: ...SRA ftLinux MIB txt 13 FIRMWARE_PROM_ERROR Could not write to the firmware PROM 14 AUTOBURN_DISABLED Cannot match a new enclosure s BIOS or firmware with that of the existing enclosure 16 PRIMARY With duplex devices this indicates that the specific device is primary in the pair 17 SECONDARY With duplex devices this indicates that the specific device is secondary in the pair Table 8 4 Set Operation...

Page 135: ...PLEX However if you are interested in only the end state for example ONLINE and DUPLEX the trap filtering capability is useful Another reason to use the trap filtering capability is that some SNMP traps are triggered by obvious reason codes For example when you bring down an I O element the display controller with the device path 10 0 or 11 0 will change state from DUPLEX to OFFLINE with the reaso...

Page 136: ... Timeticks 11829 0 01 58 29 SNMPv2 MIB snmpTrapOID 0 OID SRA ftLinux MIB ftcTrapGenericInformationTrap 0 SRA ftLinux MIB ftcTrapDevicePathID 0 STRING 10 0 SRA ftLinux MIB ftcTrapAlertType 0 STRING OPSTATE_CHANGE SRA ftLinux MIB ftcTrapGenName 0 STRING SIMPLEX SRA ftLinux MIB ftcTrapGenDetailInfo 0 STRING NONE SRA ftLinux MIB ftcTrapGenAction 0 STRING UNKNOWN SRA ftLinux MIB ftcTrapGenEventTimeStam...

Page 137: ...ithOffsetFromUTC 0 STRING 20051206134941 625363 300 RFC1213 MIB sysUpTime 0 Timeticks 12231 0 02 02 31 SNMPv2 MIB snmpTrapOID 0 OID SRA ftLinux MIB ftcTrapGenericInformationTrap 0 SRA ftLinux MIB ftcTrapDevicePathID 0 STRING 10 5 SRA ftLinux MIB ftcTrapAlertType 0 STRING OPSTATE_CHANGE SRA ftLinux MIB ftcTrapGenName 0 STRING SIMPLEX SRA ftLinux MIB ftcTrapGenDetailInfo 0 STRING NONE SRA ftLinux MI...

Page 138: ...cTrapDevicePathID 0 STRING 11 3 SRA ftLinux MIB ftcTrapAlertType 0 STRING OPSTATE_CHANGE SRA ftLinux MIB ftcTrapGenName 0 STRING OFFLINE SRA ftLinux MIB ftcTrapGenDetailInfo 0 STRING PARENT_EMPTY SRA ftLinux MIB ftcTrapGenAction 0 STRING UNKNOWN SRA ftLinux MIB ftcTrapGenEventTimeStampWithOffsetFromUTC 0 STRING 20051206134945 675906 300 RFC1213 MIB sysUpTime 0 Timeticks 14444 0 02 24 44 SNMPv2 MIB...

Page 139: ...x MIB ftcTrapGenDetailInfo 0 STRING NONE SRA ftLinux MIB ftcTrapGenAction 0 STRING UNKNOWN SRA ftLinux MIB ftcTrapGenEventTimeStampWithOffsetFromUTC 0 STRING 20051206135102 760559 300 RFC1213 MIB sysUpTime 0 Timeticks 21744 0 03 37 44 SNMPv2 MIB snmpTrapOID 0 OID SRA ftLinux MIB ftcTrapGenericInformationTrap 0 SRA ftLinux MIB ftcTrapDevicePathID 0 STRING 11 40 1 SRA ftLinux MIB ftcTrapAlertType 0 ...

Page 140: ...PathID 0 STRING 10 0 SRA ftLinux MIB ftcTrapAlertType 0 STRING OPSTATE_CHANGE SRA ftLinux MIB ftcTrapGenName 0 STRING SIMPLEX SRA ftLinux MIB ftcTrapGenDetailInfo 0 STRING NONE SRA ftLinux MIB ftcTrapGenAction 0 STRING UNKNOWN SRA ftLinux MIB ftcTrapGenEventTimeStampWithOffsetFromUTC 0 STRING 20051206141302 277883 300 RFC1213 MIB sysUpTime 0 Timeticks 5445 0 00 54 45 SNMPv2 MIB snmpTrapOID 0 OID S...

Page 141: ...e 0 STRING ONLINE SRA ftLinux MIB ftcTrapGenDetailInfo 0 STRING NONE SRA ftLinux MIB ftcTrapGenAction 0 STRING UNKNOWN SRA ftLinux MIB ftcTrapGenEventTimeStampWithOffsetFromUTC 0 STRING 20051206141318 517971 300 RFC1213 MIB sysUpTime 0 Timeticks 5948 0 00 59 48 SNMPv2 MIB snmpTrapOID 0 OID SRA ftLinux MIB ftcTrapGenericInformationTrap 0 SRA ftLinux MIB ftcTrapDevicePathID 0 STRING 10 6 SRA ftLinux...

Page 142: ...A ftLinux MIB ftcTrapGenAction 0 STRING UNKNOWN SRA ftLinux MIB ftcTrapGenEventTimeStampWithOffsetFromUTC 0 STRING 20051206141345 505798 300 RFC1213 MIB sysUpTime 0 Timeticks 8846 0 01 28 46 SNMPv2 MIB snmpTrapOID 0 OID SRA ftLinux MIB ftcTrapGenericInformationTrap 0 SRA ftLinux MIB ftcTrapDevicePathID 0 STRING 11 40 1 SRA ftLinux MIB ftcTrapAlertType 0 STRING OPSTATE_CHANGE SRA ftLinux MIB ftcTra...

Page 143: ...E_CHANGE SRA ftLinux MIB ftcTrapGenName 0 STRING DUPLEX SRA ftLinux MIB ftcTrapGenDetailInfo 0 STRING PRIMARY SRA ftLinux MIB ftcTrapGenAction 0 STRING UNKNOWN SRA ftLinux MIB ftcTrapGenEventTimeStampWithOffsetFromUTC 0 STRING 20051207143732 824273 300 RFC1213 MIB sysUpTime 0 Timeticks 467114 1 17 51 14 SNMPv2 MIB snmpTrapOID 0 OID SRA ftLinux MIB ftcTrapGenericInformationTrap 0 SRA ftLinux MIB ft...

Page 144: ...0 STRING 20051207144108 553784 300 RFC1213 MIB sysUpTime 0 Timeticks 10511 0 01 45 11 SNMPv2 MIB snmpTrapOID 0 OID SRA ftLinux MIB ftcTrapGenericInformationTrap 0 SRA ftLinux MIB ftcTrapDevicePathID 0 STRING 2 SRA ftLinux MIB ftcTrapAlertType 0 STRING OPSTATE_CHANGE SRA ftLinux MIB ftcTrapGenName 0 STRING DUPLEX SRA ftLinux MIB ftcTrapGenDetailInfo 0 STRING SECONDARY SRA ftLinux MIB ftcTrapGenActi...

Page 145: ...ervice representative LED and Visual Diagnostics Express5800 ftServer systems have a number of light emitting diodes LEDs and indicator lamps that can provide information of diagnostic value For a complete explanation of the location and interpretation of LEDs in your system see the troubleshooting chapter in the operation and maintenance guide for your system System Boot Problems If you experienc...

Page 146: ... there is no other bootable disk If a boot partition is found in sdb or sdc it is booted If the boot fails the system switches the active CPU I O enclosure and tries again where it will find and boot sdd if present When the kernel starts it loads the SCSI driver which in turn loads the SAS SATA driver The SAS SATA driver spins up all the disks it discovers It also collects a list of all of the typ...

Page 147: ...start early and all RAID 0 arrays in etc mdadm conf so they start later The operating system checks the file systems N O T E In the case of crash recovery the file check fsck may take a long time and it may fail If it fails the boot stops and enters a debug shell The administrator must manually repair the problem file systems Exiting the shell forces a reboot Possible Boot Problems A problem in bo...

Page 148: ...rts the boot process again GRUB Problem If the system boots and hangs before the operating system is loaded it may be a problem with the GRUB boot loader Reinstall GRUB in the master boot record MBR on the problem disk To manually run GRUB 1 Boot the system from your Linux operating system bootable CD by performing the procedures in System Log Messages on page 9 11 2 Follow the prompts instructing...

Page 149: ...h as RAID repair mode the system heartbeat is not enabled After a defined period the default is 10 minutes the system is automatically rebooted if a heartbeat has not been received If your troubleshooting and repair requires more than the defined period you must disable boot monitoring in the BIOS during the boot sequence To disable boot monitoring 1 When the system is booting and the progress bar...

Page 150: ...rr messages such as those shown in Example 9 1 These and similar messages may occur multiple times They are not a cause for concern if the system boots without undue delay and when the operating system presents you with the logon prompt it is appropriately presented on your display device and your input devices are supported to interact with the system The messages are an unavoidable result of the...

Page 151: ...28 checklists pre installation 2 7 pre upgrade 4 3 restoration 4 3 clock 5 33 configuring DNS resolution 5 32 Ethernet devices 2 5 ftlSNMP 8 2 IP adress for bond interfaces 5 32 Linux operating system 1 3 RAID arrays 5 9 static routes 5 32 system host name 5 32 system time zone 5 32 console log 5 2 controlling system devices 7 12 Coordinated Universal Time UTC 5 33 CPU frequency changed message 5 ...

Page 152: ...upgrade procedure 4 2 agents 8 17 configuration files 8 4 configuring 8 2 for remote service management 8 17 for Service Management 8 6 description 8 2 extensions 8 15 GET operations 8 32 installing 8 1 8 2 8 3 inventory 8 2 management commands 8 9 managing 8 18 MIBs 8 11 8 24 objects defined by 8 12 prerequisites 8 4 removing 8 29 SET operations 8 32 SRA ftLinux MIB 8 26 subagents 8 17 testing th...

Page 153: ...ng system 1 1 2 7 configuring 1 3 default setup 2 3 distribution 2 2 installation 1 2 2 1 network administration 1 2 pre installation checklist 2 7 recovering from an upgrade 4 8 restoring 4 1 system administration 1 2 upgrading 1 2 version information 2 4 logrotate 8 6 logs console 5 2 message 9 6 lspci command and fault tolerance 5 30 lspci command 5 30 lsusb command 6 1 M MAC addresses 5 31 man...

Page 154: ...AID 0 5 9 RAID 1 5 9 configured drives during installation 2 8 fault tolerance 1 1 system pair 2 17 two CPU I O enclosures 5 2 resynchronization 5 18 RAID arrays 5 9 README file for SNMP 8 3 reason definitions 8 31 recovering from a disaster 5 26 from an upgrade 4 8 Red Hat Linux CD ROMs 2 2 documentation 1 4 upgrading 4 4 reinstalling Linux operating system 4 5 reinstalling Express Builder 2 14 r...

Page 155: ...ns 8 32 ftsmaint command identify 7 3 storage devices definition 5 9 subagents log files 8 17 system administration 1 1 1 2 backup 5 26 boot Linux rescue mode 2 15 normal sequence 9 2 problems 9 1 9 3 devices controlling 7 12 initialization 2 6 log messages 9 6 pedestal and rack orientation 2 4 system clock 5 33 system dumps 7 13 systems firmware 2 2 2 7 T testing Ethernet ports 8 23 SNMP configur...

Page 156: ...x Operating System floppy drives 6 4 restoring after enclosure failure 6 3 solid state 6 4 storage 6 1 UTC See Coordinated Universal Time V version operating system identification 2 4 visual diagnostics 9 1 VND Virtual Network Devices 5 28 group configuration 5 28 default 5 28 ...

Reviews:

No comments

Related manuals for Express5800/ftServer

NetVista N2800e

Brand: IBM Pages: 82

Brand: Longshine Pages: 56

eServer xSeries 205 Type 8480

Brand: IBM Pages: 168

UltraNEXUS HD Blade

Brand: Leightronix Pages: 5

Brand: DataOn Storage Pages: 36

System4 Seriver

Brand: Philips Pages: 48

Brand: Polycom Pages: 11

Brand: Black Box Pages: 46

Boot Optimized Server Storage-S1

Brand: Dell EMC Pages: 32

Brand: TAG Pages: 6

Brand: 3onedata Pages: 4

Brand: Vingtor Stentofon Pages: 68

S815EBM1 - Server Board Motherboard

Brand: Intel Pages: 76

Brand: Intel Pages: 179

Brand: GIGA-BYTE TECHNOLOGY Pages: 113

Brand: CAAS Audio Pages: 27

Brand: Telikou Pages: 13

Brand: Dell EMC Pages: 203

Brands by name

0 1 2 3 4 5 6 7 8 9 A B C D E F G H I J K L M N O P Q R S T U V W X Y Z

Popular brands

Load more brands