background image

  FRU Replacement Guide

4 Storage Node Replaceable Units

54  
 

a) Run the following command:

Tip:

 Check the hardware paths in the command below, as they might be different on the new

chassis.

root@HGST-S3-DC01-R01-SN06: 

for add in `ls /sys/devices/pci*/*/*/net/*/

address`; do echo $add; cat $add; done

For example, the output of the above command looks like this:

/sys/devices/pci0000:00/0000:00:02.0/

0000:02:00.0

/net/

eth0

/address

90:e2:ba:7e:b8:30

/sys/devices/pci0000:00/0000:00:02.0/

0000:02:00.1

/net/

eth1

/address

90:e2:ba:7e:b8:31

/sys/devices/pci0000:00/0000:00:1c.4/

0000:07:00.0

/net/

eth2

/address

0c:c4:7a:33:38:10

/sys/devices/pci0000:00/0000:00:1c.4/

0000:07:00.1

/net/

eth3

/address

0c:c4:7a:33:38:11

Tip:

 As an alternative to the command above, you can use the command below to print only the

serial bus paths and MAC addresses in uppercase.

for add in `ls /sys/devices/pci*/*/*/net/*/address`; do echo -en

 "`echo $add|sed 's/\// /g' | awk '{print $5}'`\t"; cat $add|tr 'a-f'

 'A-F'; done

b) Compare the output of the command above to the contents of the file 

/etc/udev/rules.d/70-

persistent-net.rules

.

For example, the contents of this file look like this:

root@HGST-S3-DC01-R01-SN06:~# cat /etc/udev/rules.d/70-persistent-net.rules

SUBSYSTEM=="net", ACTION=="add", KERNELS=="

0000:02:00.0

", KERNEL=="eth*",

 NAME="

eth0

"

SUBSYSTEM=="net", ACTION=="add", KERNELS=="

0000:02:00.1

", KERNEL=="eth*",

 NAME="

eth1

"

SUBSYSTEM=="net", ACTION=="add", KERNELS=="

0000:07:00.0

", KERNEL=="eth*",

 NAME="

eth2

"

SUBSYSTEM=="net", ACTION=="add", KERNELS=="

0000:07:00.1

", KERNEL=="eth*",

 NAME="

eth3

"

If they do not match, update 

/etc/udev/rules.d/70-persistent-net.rules

 to match the output

of the command above, then reboot the node again.

reboot

Содержание SA-7000

Страница 1: ...FRU Replacement Guide HGST Active Archive System SA 7000 September 2015 1ET0036 Revision 1 1 Long Live Data www hgst com...

Страница 2: ...by contacting your local HGST representative or on the Internet at www hgst com support HGST may have patents or pending patent applications covering subject matter in this document The furnishing of...

Страница 3: ...Storage Node Replaceable Units 40 4 1 Warnings 40 4 2 Chassis Replacement Procedure 40 4 3 Hard Disk Drive Replacement Procedure 57 4 4 Power Supply Unit Replacement Procedure 60 4 5 MiniSAS 3M or 6M...

Страница 4: ...ment Procedure 90 7 6 Power Supply Unit Replacement Procedure 92 7 7 I O Canister Replacement Procedure 95 Appendix A Troubleshooting 102 A 1 Field Replaceable Units 102 Active Archive System Glossary...

Страница 5: ...er Node Front 31 Figure 12 Removing a Drive Carrier 32 Figure 13 Decommissioned Disks in the CMC 34 Figure 14 Decommissioned Disk Details from the CMC 35 Figure 15 Controller Node Front 35 Figure 16 R...

Страница 6: ...ions 66 Figure 39 Signal Cabling Scheme 66 Figure 40 Location of Storage Interconnect Switches 1 67 Figure 41 Location of Storage Interconnect Switches 1 68 Figure 42 Location of Storage Interconnect...

Страница 7: ...n 90 Figure 64 Rear Fan 91 Figure 65 A Storage Node Pane in the CMC 92 Figure 66 The Shutdown Button in the Commands Pane 92 Figure 67 Removing the Power Cord 93 Figure 68 Removing the Power Supply Un...

Страница 8: ...able with Sample MAC Addresses and Serial Bus Paths 20 Table 5 Work Table with Sample Ethernet Port Names and NIC Array IDs 23 Table 6 Work Table for Controller Node Chassis Replacement 28 Table 7 Wor...

Страница 9: ...and directory names The file aFile txt is stored in home user Any graphical user interface label Click OK Keyboard keys and sequences To cancel the operation press Ctrl c Menu navigation in a GUI Navi...

Страница 10: ...es for replacing hardware components of the Active Archive System The HGST Active Archive System Installation Guide provides instructions for the installation of the Active Archive System in the data...

Страница 11: ...ased on the combined weight of the server accessories kit rail kit and packaging Table 2 Active Archive System Weight Storage SM 1018R WC0R The following table displays the weight of the Storage serve...

Страница 12: ...em contact Elastic Storage Platforms support Please be prepared to provide the following information serial number S N product name model number and a brief description of the issue Telephone Region T...

Страница 13: ...replacing items from the inside of the chassis ensure that you take precautions to prevent electrostatic discharge ESD Warning Replace only one disk at a time on the Management Node 3 2 Chassis Replac...

Страница 14: ...FRU Replacement Guide 3 Controller Node Replaceable Units 14 Time Estimate 3 hours Figure 1 Overview of Controller Node Chassis Replacement...

Страница 15: ...menu The Linux prompt appears e Copy or write down the hostname in the Linux prompt f Log into the CMC g Navigate to Dashboard Administration Hardware Servers Controller Nodes and select the failed Co...

Страница 16: ...is from the rack a At the front of the chassis loosen the rack mounting screws b At the back of the chassis disconnect the five network cables connected to the ports labeled as follows in the image be...

Страница 17: ...vers Push the pull safety on one side up and the pull safety on the other side down g Continue to slowly slide the chassis out until you reach the pull safety at the end point and disengage it as you...

Страница 18: ...e labeled CNx N3 SW2 Nxx to the port labeled N3 in the image below Connect the cable labeled CNx N4 SW1 Nxx with SFP optical transceiver attached to the port labeled N4 in the image below Connect the...

Страница 19: ...agement Node open an SSH session to the new IP address of the Controller Node obtained in the previous step Log in with username root and password rooter b At the Linux prompt run the following comman...

Страница 20: ...om the step above the work table would look like this Serial Bus Path MAC Address on the New Chassis Ethernet Port Name 0000 01 00 0 00 25 90 fd e8 7c eth0 0000 01 00 1 00 25 90 fd e8 7d eth1 0000 01...

Страница 21: ...ark the new chassis as FAILED in the database you are in effect adding a new node rather than replacing an existing node s chassis Therefore you must remove the INSTOCK node by following the steps bel...

Страница 22: ...ction cloudapi i config cloudApiConnection find main b From the Management Node get the machine GUID using your work table value for Original Hostname of Node Note Use upper case for HOSTNAME_OF_OLD_N...

Страница 23: ...90 e2 ba 7c 5d a5 eth7 7 IPMI See IPMI MAC Address of Node in the work table BMC 8 Table 5 Work Table with Sample Ethernet Port Names and NIC Array IDs f Update the database entry for machine nics N...

Страница 24: ...t Node f Open opt qbase3 cfg dhcpd dhcpd leases with your text editor g Search for the IPMI IP address obtained in substep d in the file The section containing the IPMI IP address looks like the follo...

Страница 25: ...E2 BA 7C 5D A5 Out 9 BMC Out 9 0C C4 7A 36 8B 12 16 Save the Active Archive System database machine settings q drp machine save machine 17 Update and save the Active Archive System database device ob...

Страница 26: ...d in the worktable This value is typically of the format SystemID DCnn Rnn CNnn c Identify the IP addresses listed in the Private IP field d Open an SSH session to the Controller Node using any one of...

Страница 27: ...0000 01 00 1 net eth2 address 00 25 90 fd e8 7d sys devices pci0000 00 0000 00 01 0 0000 01 00 2 net eth3 address 00 25 90 fd e8 7e sys devices pci0000 00 0000 00 01 0 0000 01 00 3 net eth5 address 00...

Страница 28: ...he node again reboot The chassis replacement procedure is done Warning Be very careful when recording and updating MAC addresses A mistake may render the new chassis unusable Item Value Virtual IP Add...

Страница 29: ...th MAC Address on the New Chassis Ethernet Port Name NIC Array ID 0000 01 00 0 eth0 0000 01 00 1 eth1 0000 01 00 2 eth2 0000 01 00 3 eth3 0000 81 00 0 eth4 0000 81 00 1 eth5 0000 82 00 0 eth6 0000 82...

Страница 30: ...HDD proceed as follows Warning Replace only one disk at a time on the Controller Node 1 Obtain details about the decommissioned disk from the CMC a In the CMC navigate to Dashboard Administration Hard...

Страница 31: ...ministration Hardware Servers Controller Nodes b Select the correct node c In the Commands pane click Location LED On A blue LED on its front and back panels is now blinking 3 Go to the rack and ident...

Страница 32: ...ommands pane click Location LED Off 6 Confirm that the Active Archive System correctly determines the purpose for the new disk a Wait 15 minutes b In the CMC navigate to Dashboard Administration HGST...

Страница 33: ...ct Replacement Disk Note You can only select Replacement Disk when there is a decommissioned disk If there are no decommissioned disks you can only select Additional Disk as the purpose for the disk d...

Страница 34: ...under the SSD Disk column To perform a failover see Managing Hardware in the HGST Active Archive System Administration Guide Decommission the faulty SSD in the CMC For more information see Managing H...

Страница 35: ...when it highlights slot 9 the decommissioned SSD is actually located in slot 5 when it highlights slot 10 the decommissioned SSD is actually located in slot 6 Figure 14 Decommissioned Disk Details fro...

Страница 36: ...ommands pane click Location LED Off 6 Confirm that the Active Archive System correctly determines the purpose for the new disk a Wait 15 minutes b In the CMC navigate to Dashboard Administration HGST...

Страница 37: ...ct Replacement Disk Note You can only select Replacement Disk when there is a decommissioned disk If there are no decommissioned disks you can only select Additional Disk as the purpose for the disk d...

Страница 38: ...ack and identify the correct chassis by the blinking blue LED on its front and back panels 3 On the back of the rack identify the failed PSU on the node identified in the previous step In the image be...

Страница 39: ...Ports 2 Remove the faulty SFP cable from the Controller Node a Pull the SFP optical transceiver out of the Controller Node b Unlatch the faulty SFP cable from the SFP optical transceiver by pulling ve...

Страница 40: ...k When replacing items from the inside of the chassis ensure that you take precautions to prevent electrostatic discharge ESD A Storage Node weighs about 43lbs Ensure sufficient manpower to handle it...

Страница 41: ...FRU Replacement Guide 4 Storage Node Replaceable Units 41 Time Estimate 3 hours Figure 19 Overview of Storage Node Chassis Replacement...

Страница 42: ...The sample outputs shown for this procedure are from Storage Node 6 a In the CMC navigate to Dashboard Administration Hardware Servers Storage Nodes b Select the correct node c In the Commands pane c...

Страница 43: ...this Storage Node is now quiesced 3 Go to the rack and identify the correct chassis by the blinking blue LED on its front and back panels 4 Remove the failed chassis from the rack a At the front of th...

Страница 44: ...hassis catch on the rails f Disengage the pull safety on both sides of the chassis and slide it out until the split line of the two top covers Push the pull safety on one side up and the pull safety o...

Страница 45: ...the port labeled M2 in the image below Figure 24 Storage Node Back d Reconnect the miniSAS cables The miniSAS cables are labeled Connect the cable labeled SNx S1 DAx SA to the port labeled S1 in the i...

Страница 46: ...ess mapping of the new chassis a From the Management Node open an SSH session to the new IP address of the Storage Node obtained in the previous step Log in with username root and password rooter b At...

Страница 47: ...3 38 10 eth2 0000 07 00 1 0c c4 7a 33 38 11 eth3 Table 7 Work Table with Sample MAC Addresses and Serial Bus Paths e Close the SSH session to the Storage Node You are now back in the SSH session to th...

Страница 48: ...odelProperties dg status str q enumerators devicestatustype FAILED The new chassis now appears under the FAILED list in the CMC and is removed from the Unmanaged Devices list Figure 26 The New Chassis...

Страница 49: ...Object machine_guid d Display all the Ethernet port names ethN that are registered For example In 3 machine cloudapi machine getObject machine_guid In 4 print machine nics 0 name eth1 In 5 print machi...

Страница 50: ...s 4 hwaddr with the corresponding IPMI MAC address from your work table under MAC Address of Node Important Use capital letters for the MAC address For example machine nics 4 hwaddr 0C C4 7A 36 8B 12...

Страница 51: ...ur previous SSH session do a sanity check to verify that you have updated the new MAC addresses correctly Compare the output of the command below to your work table In 9 for nic in machine nics nic na...

Страница 52: ...estart Stopping dhcpd dhcpd is halted Starting dhcpd dhcpd is running 18 Reboot the new chassis a From the Management Node open an SSH session to the new chassis using the IP address from the work tab...

Страница 53: ...ase3 cfg qconfig main cfg with your text editor The file has a section that looks like this main lastlogcleanup 1428960577 domain somewhere com nodetype STORAGENODE nodename 90E2BA7EB831 logserver_log...

Страница 54: ...lternative to the command above you can use the command below to print only the serial bus paths and MAC addresses in uppercase for add in ls sys devices pci net address do echo en echo add sed s g aw...

Страница 55: ...lue as instructed in the Administrator Interfaces chapter in the HGST Active Archive System Troubleshooting Guide Original Hostname of Node Get this value from the CMC before you shut down the failed...

Страница 56: ...orage Node Replaceable Units 56 Serial Bus Path MAC Address on the New Chassis Ethernet Port Name NIC Array ID 0000 01 00 1 eth1 0000 01 00 2 eth2 0000 01 00 3 eth3 IPMI Table 9 Work Table for Storage...

Страница 57: ...tes To replace an HDD proceed as follows 1 Obtain details about the decommissioned disk from the CMC a In the CMC navigate to Dashboard Administration Hardware Disks Decommissioned Figure 30 Decommiss...

Страница 58: ...oned HDD a Identify the decommissioned HDD by using the drive map The HDD is a front bay drive Figure 32 Storage Node Front b Press the release button on the drive carrier of the decommissioned HDD to...

Страница 59: ...physical drive that has been replaced as well as the logical disks to change status from a red icon to a green icon Note The physical drive that has been replaced as well as the logical disks may take...

Страница 60: ...e back of the rack identify the failed PSU on the node identified in the previous step In the image below the PSUs are labeled P1 and P2 Figure 34 Storage Node Back with PSU Status LEDs Highlighted 4...

Страница 61: ...orage Node MiniSAS Ports 2 Remove the faulty miniSAS cable from the Storage Node a Unlatch the faulty miniSAS cable at its Storage Node end by pulling very gently on its pull tab b While pulling gentl...

Страница 62: ...engaged and the cable is loose grasp its metal connector or cord not its pull tab to pull it out of its port 4 Install the new miniSAS cable Tip If you are replacing the 6M cable install it over the t...

Страница 63: ...driver Time Estimate Unknown Important If Storage Interconnect 1 SWA lower is down then IPMI is down To replace a Storage Interconnect proceed as follows 1 Edit the switch configuration file you obtai...

Страница 64: ...ed Routing This operation may take a few minutes Management interfaces are not available during this time f Verify that the settings on the switch match your configuration file Routing show startup co...

Страница 65: ...he port labeled 01 in the image below b Connect the cable labeled SN2 Nx SWx N03 to the port labeled 03 in the image below c Connect the cable labeled SN3 Nx SWx N05 to the port labeled 05 in the imag...

Страница 66: ...ignal Cabling Scheme below Figure 38 Switch Port Reservations Figure 39 Signal Cabling Scheme 8 Reconnect the power cords to the new Storage Interconnect The Storage Interconnect begins to power up as...

Страница 67: ...on describes how to replace a fan of the Storage Interconnect To replace the fan do the following 1 Remove the two blanking plates from the top front of the rack 2 Identify the Storage Interconnect th...

Страница 68: ...s 1 Remove the two blanking plates from the top front of the rack 2 Identify the Storage Interconnect that has the faulty PSU Figure 41 Location of Storage Interconnect Switches 1 3 On the front side...

Страница 69: ...whose SFP 1G module has an amber LED illuminated on its metal connector 3 Remove the faulty SFP 1G module from the Storage Interconnect a Make a note of which Storage Interconnect port the SFP 1G mod...

Страница 70: ...ministration Hardware Servers b Select each of the six Storage Nodes and in the right pane click Shutdown c Shutdown Controller Node 3 then Controller Node 2 then Controller Node 1 in other words shut...

Страница 71: ...mable PDUs control the bring up sequence b Confirm that all nodes power on in the right order There is a short gap between each segment a Network switches b Controller Nodes c Storage Enclosure Basic...

Страница 72: ...nclosure Basic HDD Rear Fan PSU I O Canister 7 1 Visual Indicator and Field Replaceable Units Locations The Storage Enclosure Basic displays the following visual indicators I O Canister 1 Green enclos...

Страница 73: ...wing diagram displays the visual indicators for the I O canister sled and the rear fans in the Storage Enclosure Basic Figure 43 System Enclosure Information The following diagrams display the physica...

Страница 74: ...FRU Replacement Guide 7 Storage Enclosure Basic Field Replaceable Units 74 Storage Enclosure Basic Figure 44 Rear Fan Order Figure 45 Sled HDD Order...

Страница 75: ...tion Guide Obtain a replacement HDD from HGST Support Required Tools None Time Estimate 1 hour To replace a hard disk drive do the following Note Ensure that you store all removed parts in a safe loca...

Страница 76: ...ne click Location LED On 3 Enable the location LED on the Storage Node a In the CMC navigate to Dashboard Administration Hardware Servers Storage Nodes b Select the correct node c In the Commands pane...

Страница 77: ...slot number is 69 f Exit the Q Shell quit g Identify the sg number of the Storage Enclosure Basic lsscsi g grep PEAK 0 0 42 0 enclosu HGST PIKES PEAK 0109 dev sg42 In the example above the sg number i...

Страница 78: ...still wait until the CMC shows DONE in the Status field All I O to the Storage Enclosure Basic attached to this Storage Node is now quiesced 6 Go to the rack and identify the correct chassis by the bl...

Страница 79: ...ent Guide 7 Storage Enclosure Basic Field Replaceable Units 79 Note Repeat for both the A and B power supplies Figure 50 Removing the Power Cords Note Power cords marked in red Cord retention bale mar...

Страница 80: ...able Units 80 9 Unplug the miniSAS cables from the I O canister Figure 51 Removing the MiniSAS Cables Note The miniSAS cables are marked in red Take note of which miniSAS cable came from which port to...

Страница 81: ...d Replaceable Units 81 10 Unlock the I O canister from the enclosure by pulling the latch handle out and away from the I O canister Figure 52 Unlocking the I O Canister 11 Slide the I O canister away...

Страница 82: ...FRU Replacement Guide 7 Storage Enclosure Basic Field Replaceable Units 82 12 Locate the failed sled by identifying the Sled Fail Identify indicator is blinking amber Figure 54 Sled HDD Order...

Страница 83: ...age Enclosure Basic Field Replaceable Units 83 13 On the front of the first sled depress the latch mechanism button and pull it until it is at a 45 degree angle Figure 55 Sled Release Button Figure 56...

Страница 84: ...the sled in need of a new hard disk drive out of the chassis Figure 57 Removing the Sled Note Ensure that you remove and replace the sleds and sled blanks in the same order Repeat the two previous st...

Страница 85: ...lide the drive cover forward and up until the cover has been removed Figure 58 Sled Cover 16 Identify the drive to be replaced by referring to the drive map you obtained from the CMC and the amber LED...

Страница 86: ...rier in the reverse order that you removed it 19 Install the remaining enclosure components in the reverse order that you removed them 20 Re connect the enclosure to the power cords 21 On the PSUs ide...

Страница 87: ...take about 2 minutes for the job to appear e In the CMC navigate to Dashboard Administration Hardware Servers f Select the desired node g Select the Disks tab h Wait for the physical drive that has be...

Страница 88: ...he server b From the Enclosure end pull the power cord through the rail kit cable guides c Pull the power cord up through the side of the rack rail d Pull the power cord through the top of the rack 3...

Страница 89: ...From the enclosure end pull the miniSAS cable through the rail kit cable guides c Pull the miniSAS cable up through the side of the rack rail 3 Note Ensure the new miniSAS cable is installed in the s...

Страница 90: ...eplace a rear fan do the following Note Ensure that you store all removed parts in a safe location while replacing the FRU The rear fans are hot swappable The enclosure does not need to be powered dow...

Страница 91: ...ceable Units 91 Note Repeat the previous step until all of the fans in need of replacement have been removed Figure 64 Rear Fan 3 Remove the fan from the fan rubber bumpers on the chassis 4 Install th...

Страница 92: ...ved parts in a safe location while replacing the FRU 1 Shut down the Storage Node from the CMC Caution Shut down only the Storage Node that is paired with the Storage Enclosure Basic containing the FR...

Страница 93: ...led power supply unit Figure 67 Removing the Power Cord Note Cord retention bale marked in blue If you are removing power supply A you do not need to remove the miniSAS cables To remove power supply B...

Страница 94: ...essary Figure 68 Removing the Power Supply Unit 4 Remove the power supply unit until free of the I O canister 5 Install the replacement power supply unit 6 Reconnect the miniSAS cables 7 Plug the powe...

Страница 95: ...d parts in a safe location while replacing the FRU Ensure you are wearing an ESD wrist strap to complete the replacement of the I O canister 1 Shut down the Storage Node from the CMC Caution Shut down...

Страница 96: ...ven if all LEDs are off you must still wait until the CMC shows DONE in the Status field All I O to the Storage Enclosure Basic attached to this Storage Node is now quiesced 2 Identify the Storage Enc...

Страница 97: ...s by lifting the power cord retention bale and carefully removing the power cord from the power supply Figure 71 Removing the MiniSAS Cables Note The miniSAS cables are marked in red Take note of whic...

Страница 98: ...Units 98 Repeat for both the A and B power supplies Figure 72 Removing the Power Cords Note Power cords marked in red Cord retention bale marked in blue 5 Wait approximately 30 seconds after the I O...

Страница 99: ...h your palms facing up place the pointer and middle finger into the latch handle sides Figure 73 Latch Handle Identification Note Latch handle marked in red Rack ears marked in yellow 7 With your thum...

Страница 100: ...ack Ear Note Latch handle marked in red Rack ears marked in yellow 9 Completely remove the miniSAS cables and power cords from the I O canister 10 With your palms facing up reposition your hands so th...

Страница 101: ...l the replacement I O canister in the reverse order that you removed it Note Ensure that the I O canister is center properly and press firmly to ensure you are able to latch the replacement I O canist...

Страница 102: ...placement disk or really a new disk Warning Adding disks to the Active Archive System or changing the configuration of any hardware in the Active Archive System is not supported Please contact HGST Su...

Страница 103: ...MC Baseboard Management Controller BOM Bill of Materials BSMI Bureau of Standards Metrology and Inspection Top of B Top of Glossary C CDB Computer Data Bus CLI Command Line Interface CS Climate Saver...

Страница 104: ...urpose Input Output GUI Graphical User Interface Top of G Top of Glossary H HD Hard Drive HDD Hard Disk Drive Top of H Top of Glossary I ICT In circuit Test IEC International Electrotechnical Commissi...

Страница 105: ...ysis System Top of M Top of Glossary O OS Operating System OUI Organizationally Unique Identifier Top of O Top of Glossary P PCB Printed Circuit Boards PCI Peripheral Component Interconnect PDB Power...

Страница 106: ...Services SMART Self Monitoring Analysis and Reporting Technology SMP Server Message Block SMB Server Message Block SPI Serial Peripheral Interface SSP Serial SCSI Protocol Top of S Top of Glossary T...

Страница 107: ...FRU Replacement Guide Active Archive System Glossary 107 X XDP XML Data Package Top of X Top of Glossary...

Страница 108: ...k 13 miniSAS cable 60 N NIC 102 node controller chassis 13 FRU list 13 HDD 30 PSU 38 SSD 34 storage chassis 40 FRU list 40 HDD 57 PSU 60 P PDU FRU list 70 points of contact 12 PostgreSQL partition 102...

Страница 109: ...FRU Replacement Guide Index 109 T troubleshooting 102 typographical 9 W warnings 13 40 63 70 weight 10...

Отзывы: