background image

b) Issue the following command to access a single host's SMP Discover output:

smp_discover_list /dev/bsg/expander-9:39

Note: Repeat this substep for all
expanders.

c) Zone groups will not be visible due to zoning being disabled. All hosts will have access to all drives.
d) Issue the following command to access all hosts smp_discover_list:

smp_discover_list --ignore /dev/bsg/expander-9:39

5.3

Partially Populated Enclosures

5.3.1

Partial Population Configurations

The Ultrastar Data60 supports partially populated configurations that allow a user to increase the size of
storage based on their needs. There are specific requirements that must be followed to ensure that the
enclosure functions properly during operation. Partial population configurations that do not comply with the
requirements listed in this section may result in enclosure performance issues. The following section details
the requirements for HDD and HDD/SSD based configurations.

Minimum HDD Partial Population

The enclosure supports a minimum of 24 SAS or SATA HDDs for a partially populated enclosure. The
enclosure does not support a mix of SAS and SATA drives. The enclosure must be populated starting with
the drives closest to the rear of the enclosure and work towards the front of the enclosure. If more drives are

183

5

System Management

User Guide

5.3

Partially Populated Enclosures

Summary of Contents for Ultrastar Data60 H4060-J

Page 1: ...User Guide Ultrastar Data60 Regulatory Model H4060 J December 2018 Rev 1 7 1ET1101 Long Live Data www hgst com...

Page 2: ...Units CRUs 15 1 7 LEDs 16 1 7 1 Front and Rear IO LEDs 16 1 7 2 IOM LEDs 18 1 7 3 IOM Fan LED 19 1 7 4 PSU LED 20 1 7 5 Rear Fan LED 21 1 7 6 Drive Assembly LED 22 1 8 Supported SKUs 22 1 9 List of Co...

Page 3: ...M Fan Layout 44 3 6 Rails Description 45 3 6 1 Rails Specifications 45 3 6 2 Rails Layout 46 3 6 3 Rear Cover Alignment Bracket Description 47 3 7 CMA Description 47 3 7 1 CMA Specifications 48 3 7 2...

Page 4: ...ware 150 5 1 4 Non Automatic Firmware Activation in Linux 152 5 1 5 Windows Upgrade Preparation 153 5 1 6 Windows Upgrade to New Firmware 155 5 1 7 Non Automatic Firmware Activation in Windows 157 5 1...

Page 5: ...and Service 205 6 7 Safety Warnings and Cautions 206 Chapter 7 Disclaimers 207 7 1 Restricted Access Location 207 7 2 Safety Compliance 207 7 3 Electromagnetic Compatibility EMC Class A Compliance 207...

Page 6: ...uirements 212 A 2 Supported Operating Systems 212 A 3 List of Supported Server Components 212 A 4 Ultrastar Data60 Rack Requirements 214 A 4 1 Compatible Hardware Configuration 215 A 5 ESD 216 A 6 Enc...

Page 7: ...ve Carrier Description on page 53 Added torque requirements for all screws used in the enclosure Updated the IOM replacement section to account for the possibility of a firmware mismatch See IOM Repla...

Page 8: ...scription SeeRear Cover Alignment Bracket Description on page 47 Revision 1 7 November 2018 Updated the images in the Daisy Chaining section See Daisy Chaining on page 188 Updated List of CRUs See Lis...

Page 9: ...HGST representative or on the Internet at support hgst com HGST may have patents or pending patent applications covering subject matter in this document The furnishing of this document does not give y...

Page 10: ...d sharing between PSUs It is designed to fit within a 4U rack space and requires 900mm 35 43in usable rack space frame to frame A fully loaded system will add 79 4 kg 175 lbs of static load when fully...

Page 11: ...system health information locating enclosure components using the IDENT LEDs and updating firmware The system FPGAs control and report the states of the system fans enclosure LEDs connector LEDs drive...

Page 12: ...pecification Summary Operational Non Operational Specification 5 C to 35 C 40 C to 70 C Temperature 20 C per hour maximum 30 C Hr Temperature Gradient 1 C per 125m above 950m 1 C per 300m above 3000m...

Page 13: ...Ultrastar Data60 can only be plugged into highline If the unit is plugged into lowline the PSU will report a Critical state when status pages are queried using SES In this case the enclosure will powe...

Page 14: ...e Specifications Value Specification 60 Number of Drive Slots 12Gbps SAS 6Gbps SATA Data Transfer Rates 840 TB using 14TB HGST Ultrastar HC530 drives Max Raw Data Storage Capacity 12 x Mini SAS HD 6 p...

Page 15: ...lists the replaceable components and their part numbers Table 6 List of Replaceable Components Part Number Component 1EX0442 Ultrastar Data60 Chassis with a single IOM and PSU 1EX0443 Ultrastar Data6...

Page 16: ...ses There are three on the front and three on the rear that mirror each other and provide general status This allows the status of the enclosure to be visible from either side of the rack Figure 5 Fro...

Page 17: ...ction fault Blink 1 Hz Blinks only when Identification has been activated Will blink when any component is identified Blue Identification 3 Blink 1 Hz Enclosure has a fault Amber Fault 4 Off Enclosure...

Page 18: ...OM LED Identification Behavior Color LED Name Blink 1 Hz Blinks only when IOM Identification has been activated Off Not being identified Blue IOM Identification Solid IOM has Fault Off IOM is function...

Page 19: ...ult condition identification and power off Figure 8 IOM Fan LED 1 Table 10 IOM Fan LED Identification Behavior Color LED Name Solid IOM Fan is reporting faults Blinking 1 Hz IOM Fan is being Amber IOM...

Page 20: ...n Behavior Color LED Name Solid PSU is on and reporting no faults Blinking 2Hz PSU in firmware update mode Off PSU is disconnected from power Green PSU Multi function LED Solid PSU is disconnected fro...

Page 21: ...for a fault condition one for Identification and off Figure 10 Fan LED 1 Table 12 Fan LED Identification Behavior Color LED Name Solid Fan is reporting faults Blinking 1 Hz Fan is being Amber Fan LED...

Page 22: ...ault Blinking 1 Hz Drive Identify Off Drive has no faults Amber Drive Multi function LED 1 8 Supported SKUs The following table lists the versions of this HGST product that are supported by this docum...

Page 23: ...r 1EX1185 6TB SE 512e SAS 12Gb s HDD HGST Ultrastar DC HC310 w 3 5 in drive carrier 1EX1184 6TB TCG 512e SAS 12Gb s HDD HGST Ultrastar DC HC310 w 3 5 in drive carrier 1EX1187 6TB SE 4Kn SATA 6Gb s HDD...

Page 24: ...A 6Gb s HDD HGST Ultrastar DC HC320 w 3 5 in drive carrier 1EX0482 10TB ISE 4Kn SAS 12Gb s HDD HGST Ultrastar DC HC510 w 3 5 in drive carrier 1EX0484 10TB SE 4Kn SAS 12Gb s HDD HGST Ultrastar DC HC510...

Page 25: ...B TCG 4Kn SAS 12Gb s HDD HGST Ultrastar He12 w 3 5 in drive carrier 1EX1339 12TB TCG FIPS 4Kn SAS 12Gb s HDD HGST Ultrastar He12 w 3 5 in drive carrier 1EX1007 12TB ISE 512e SAS 12Gb s HDD HGST Ultras...

Page 26: ...14TB SE 512e SATA 6Gb s HDD HGST Ultrastar HC530 w 3 5 in drive carrier 1EX1794 14TB SED 512e SATA 6Gb s HDD HGST Ultrastar HC530 w 3 5 in drive carrier Table 16 SSDs Part Number Volume Encryption Dri...

Page 27: ...n drive carrier 1EX1287 400GB ISE ME 10DW D SAS 12Gb s SSD HGST Ultrastar SS300 w 3 5 in to 2 5 in drive carrier 1EX1289 400GB SE ME 10DW D SAS 12Gb s SSD HGST Ultrastar SS300 w 3 5 in to 2 5 in drive...

Page 28: ...CG RI 3DW D SAS 12Gb s SSD HGST Ultrastar SS200 w 3 5 in to 2 5 in drive carrier 1EX1272 800GB ISE ME 10DW D SAS 12Gb s SSD HGST Ultrastar SS300 w 2 5 in drive carrier 1EX1274 800GB SE ME 10DW D SAS 1...

Page 29: ...00GB SE RI 1 8DW D SATA 6Gb s SSD Sandisk Cloudspeed Ultra Gen II w 2 5 in drive carrier 1EX1305 800GB SE RI 1 8DW D SATA 6Gb s SSD Sandisk Cloudspeed Ultra Gen II w 3 5 in to 2 5 in drive carrier 1EX...

Page 30: ...5 in to 2 5 in drive carrier 1EX1307 1 6TB TCG RI 3DW D SAS 12Gb s SSD HGST Ultrastar SS300 w 3 5 in to 2 5 in drive carrier 1EX1787 1 6TB TCG FIPS RI 3DW D SAS 12Gb s SSD HGST Ultrastar SS300 w 3 5...

Page 31: ...W D ISE SAS 12Gb s SSD HGST Ultrastar SS530 w 2 5 in drive carrier 1EX1813 6 4TB SE RI 3DW D ISE SAS 12Gb s SSD HGST Ultrastar SS530 w 2 5 in drive carrier 1EX1815 6 4TB TCG RI 3DW D ISE SAS 12Gb s SS...

Page 32: ...ontrol page operations All control operations follow a synchronous completion model i e the SEP will send SCSI status only when the requested operation has completed or to notify the host that the req...

Page 33: ...ol operations 2 2 OOBM Management Overview The Ultrastar Data60 uses an implementation of DMTF Redfish for out of band system management All the SES enclosure information can be obtained through the o...

Page 34: ...system components such as the PSUs and Other system components are attached to the exterior of the chassis such as the rear fans and rails to provide system cooling andrackmounting capability The cha...

Page 35: ...isolate the data storage drives from transmitting vibration to one another There is a long central bay that contains the enclosure s IOMs and the IOM fan The front of the chassis has a metal mesh cove...

Page 36: ...AS HD ports capable of four 12Gbps SAS connections each The IOMs are N 1 redundant hot swappable components The IOMs are installed into the central bay from the top of the Chassis and connect to the d...

Page 37: ...2 2 IOM Layout Figure 15 Layout Front Rear 1 2 3 1 4 5 Table 20 Exterior Components Feature Number IOM Handle 1 Latch Release 2 Internal IO Connector 3 Card Edge Power Receptacle 4 Internal IO Connect...

Page 38: ...nd slot It is necessary to have a blank installed in this unused slot in order to ensure the proper airflow dynamics that are within operational parameters designed for the enclosure but has no functi...

Page 39: ...ue Specification 1600W Power Output Platinum 80 PLUS Standard 200 240 VAC Input Voltage C14 Connector Type 2 Number per Enclosure 1EX0434 Part Number Yes Hot Swappable CRU FRU or CRU 1 kg 2 2 lbs Weig...

Page 40: ...igure 18 Layout 1 2 4 5 Rear Front 3 Table 22 Exterior Components Feature Number Internal Connector 1 C14 Power Receptacle 2 Latch Release Lever 3 Fan 4 Handle 5 40 3 Component Overviews User Guide 3...

Page 41: ...he rear of the chassis in the fan housing by a 6 pin connector and two latches that also provides power and control signals to the modules 3 4 1 Rear Fan Specifications Table 23 Specification Summary...

Page 42: ...2 Rear Fan Layout Figure 20 Layout 1 2 2 3 Table 24 Exterior Components Feature Number Fan 1 Latch Releases 2 Internal Power and IO Connector 3 42 3 Component Overviews User Guide 3 4 Rear Fan Descrip...

Page 43: ...rom the top of the enclosure underneath the lid It is attached to the chassis toolless release mechanism that allows for easy replacement 3 5 1 IOM Fan Specifications Table 25 Specification Summary Va...

Page 44: ...2 IOM Fan Layout Figure 22 Layout 1 2 3 Front Table 26 Exterior Components Feature Number Latch Mechanism 1 Fan Module 2 Internal Connector 3 44 3 Component Overviews User Guide 3 5 IOM Fan Descripti...

Page 45: ...ck and receive the chassis to support it inside the rack The outer rails attach to vertical rack rails that should be set between 24 32 The toolless design means that an installer can attach these rai...

Page 46: ...or Components Features Number Lower CMA Connectors 1 Rear Latch Release 2 Rear Rack Mounting Bracket 3 Rear Cover Alignment Bracket 4 Front Rack Mounting Bracket and Latch Release6 5 Inner Rail 6 Uppe...

Page 47: ...he rear vertical rack rails and rest on top of the toolless rail system 3 7 CMA Description Figure 26 Overview Image The cable management assembly CMA provides a number of benefits to protect and mana...

Page 48: ...at the other end The cables are secured to the arms by plastic clips called baskets that can be opened at the top to adjust add or remove cables The arms can also be moved into a service position by...

Page 49: ...t Figure 27 Layout 1 2 3 4 5 Table 30 Exterior Components Feature Number Crossbar 1 Rail and Rack Connectors 2 Baskets retains cables 3 Arm 4 Elbow Connector 5 49 3 Component Overviews User Guide 3 7...

Page 50: ...is used to support cable loads greater then ten five per arm This tray is mounted at the bottom of the chassis using four M3 x 8mm T10 Torx screws two per side Use this cable tray in cases where cable...

Page 51: ...e It stabilizes the motion of the drive into the drive bay so that the drive properly mounts onto the drive board 3 8 1 Drive Assembly Specifications Table 31 Specification Summary Value Specification...

Page 52: ...ure 30 Layout Top Bottom Side 1 2 3 4 5 Table 32 Exterior Components Feature Number Latches 1 Latch Release 2 IO and Power Connectors 3 Drive Carrier 4 Disk Drive 5 52 3 Component Overviews User Guide...

Page 53: ...arrier operates by utilizing an innovative clamping mechanism The 2 5 drive is seated in the orientation shown the overview image Then the clamp is inserted to apply pressure to the SSD and secure it...

Page 54: ...in the following image to loosen it from the drive Be sure not to slide too far as this will allow the clamp to fall from from the carrier body and it will have to be reinstalled Figure 33 Clamp Slid...

Page 55: ...scription The drive blank is a placeholder component that is used to fill empty drive slots in the chassis when a Ultrastar Data60 enclosure is partially populated with drives The purpose of the drive...

Page 56: ...a row is less then the total that are necessary to fill that row the drive blank is used to fill out the row in place of actual drives Figure 35 3 5 Drive Blank Overview Image 56 3 Component Overviews...

Page 57: ...educe the occurrence of thermal issues Table 34 Replacement Service Window Replacement Window Time Required Part 5 Minutes 60s IOM 5 Minutes 60s PSU 5 Minutes 60s Rear Fan 5 Minutes 60s IOM Fan 5 Minu...

Page 58: ...the amber LED that will be lit on top if there is a fault or by activating the identify LED on the IOM being replaced 3 Uninstall the IOM s a Locate the latch release on the IOM and press it in the d...

Page 59: ...facing toward the side shown in the following image d Slowly lower the IOM into the empty slot while being careful to keep it level Do not to force it Figure 40 Installing the IOM e When the IOM is lo...

Page 60: ...hen there is a firmware mismatch c To fix the firmware mismatch perform an upgrade to the current firmware revision by following the upgrade instructions here Firmware Upgrade on page 146 4 3 PSU Repl...

Page 61: ...ce position Cables not shown 2 Locate the faulty PSU by finding the amber LED lit at the rear of the enclosure 3 Detach the retention clip from the PSU cable Figure 43 Cable Retention Mechanism 4 Remo...

Page 62: ...out with even pressure 6 Remove the new PSU from its packaging 7 Install the PSU a Align the PSU in the orientation shown in the following image b Slide the PSU into the slot until it seats fully int...

Page 63: ...re that the retention clip functions properly in the event the cable is pulled on for some reason Figure 47 Cinching Cable Retention Clip 8 Make sure the CMA is in operational position by folding the...

Page 64: ...onnector by pressing the blue release button to unlatch the connector from the rail Figure 48 Unlatching a CMA Connector b Swing the CMA away from the enclosure c Do the same for the lower CMA arm as...

Page 65: ...ress the clip at the top and bottom of the fan and pull to free it from the chassis and remove it Figure 50 Uninstalling the Rear Fan 3 Install Rear Fan a Orient the rear fan as shown in the following...

Page 66: ...4 5 IOM Fan Replacement Table 38 Replacement Procedure Info Replacement Window Time Required of People Required Required Tools 5 Minutes 60s 1 None 1 Grasp both handles at the front of the enclosure a...

Page 67: ...lease the latching mechanism and pull it straight out from the chassis Figure 53 Removing IOM Fan 3 Install the IOM Fan a Align the IOM Fan as shown in the following image Figure 54 Installing the IOM...

Page 68: ...he enclosure from coming out of the rack completely and the cover will remain in the rack attached to the rear alignment brackets Figure 55 Chassis Handle Operation Only extend the enclosure out of th...

Page 69: ...Insert a finger and a thumb into the latch release and pinch to unlatch the Drive Assembly Figure 57 Unlatch Drive Carrier IOM Not Shown 69 4 Part Replacement User Guide 4 6 Drive Assembly Replacemen...

Page 70: ...Removing Drive Assembly 4 Remove the new Drive Assembly from its packaging 5 Install the Drive Assembly a Ensure that the enclosure has been pulled out of the rack until the rail latches engage 70 4...

Page 71: ...Assembly d Pinch the latch release and carefully press downward to seat the Drive Assembly the rest of the way 6 Push the enclosure back into the rack to ensure proper cooling 4 7 CMA Replacement Tab...

Page 72: ...MA away from the enclosure c Do the same for the lower CMA arm as what was done for the upper d Both arms should be extended away from the enclosure as shown in the following example Figure 62 CMAs in...

Page 73: ...extending outward from the connector This will free the cable from the port Make sure each cable is labeled or label them yourself to ensure that they will be plugged back into the same location 4 Unp...

Page 74: ...p for the second CMA 8 Install the lower CMA a Note The CMA has two arms that are labeled upper and a lower These arms are connected to the rails and the enclosure s chassis by four connectors The fir...

Page 75: ...hould be one at the elbow side and two at the other end Figure 66 Lower CMA Orientation c Slowly slide the enclosure forward to ensure the CMA arm is operating properly then slide it back into the rac...

Page 76: ...CMA arm and swing it forward by pressing the blue button that says push to unlatch it b Gather the SAS cables one power cable and one Ethernet cable to install in the left hand side Note Before cablin...

Page 77: ...of the baskets on the CMA e Connect all of the SAS cables that will be used and route them through the baskets one at a time Make sure to follow the labels to make sure they are connected to the prope...

Page 78: ...y be transported inside that rack it is important to use the included cable tie to wrap the CMA bundle to ensure it does not get damaged during transport If the Ultrastar Data60 is instead being insta...

Page 79: ...kets one at a time Make sure to follow the labels to make sure they are connected to the proper port c Connect the power cable to the lower PSU and route it through each basket The following image sho...

Page 80: ...nector and the first basket Make sure to route all of the upper CMA cables under the lower CMA cables Figure 73 Nominal Cable Length at Connectors e Loop the retention clip on the PSU cables around th...

Page 81: ...point at which the binding occurred and adjust the seating of cables in the baskets check the connections to the rails and examine the joints of the CMA arm to ensure that they are all functioning pr...

Page 82: ...ector b Swing the CMA away from the enclosure c Do the same for the lower CMA arm as what was done for the upper d Both arms should be extended away from the enclosure as shown in the following exampl...

Page 83: ...xtending outward from the connector This will free the cable from the port Make sure each cable is labeled or label them yourself to ensure that they will be plugged back into the same location 4 Unpl...

Page 84: ...ight of the enclosure 79 4 kg 175 lbs these steps can be skipped If not please follow these drive removal instructions to remove all of the drives and reduce the weight Never try to support the weight...

Page 85: ...b Insert a finger and a thumb into the latch release and pinch to unlatch the Drive Assembly Figure 82 Unlatch Drive Carrier IOM Not Shown 85 4 Part Replacement User Guide 4 8 Rails Replacement...

Page 86: ...ach drive in the enclosure Attach a label or mark the drives with the drive slot they were removed from in order to add them to the same slot in the future Store the drives in an ESD safe location unt...

Page 87: ...he enclosure is removed 14 Remove the chassis from the rack a Be prepared to support the enclosure once it is free of the rails by having a second person or a lift to support the enclosure b Grasp bot...

Page 88: ...rt mechanism to hold the chassis in position whether that be a team lifting partner or an appropriate lift Warning Do not lift the chassis by the Cable Tray while removing the chassis from the rack OR...

Page 89: ...er Rail b Locate and unlatch the springlock on the side of the inner rail Figure 87 Inner Rail Spring Latch c Slide the inner rail toward the front of the enclosure to unlock it from the pegs that sec...

Page 90: ...e following image Be careful the alignment bracket will be free once the screws are removed Make sure you have a solid grip on it before removing the final screw Figure 88 Rear Screw Locations Screw L...

Page 91: ...ack using a T15 Torx screwdriver Be careful the rack latch bracket will be free once the screws are removed Make sure you have a solid grip on it before removing the final screw Figure 89 Rack Latch B...

Page 92: ...Latch Release Button 18 Gather the replacement rails and prepare to install them 19 Remove the inner rail that is nested inside the rack rails Note There are Right and Left rails and they must be ins...

Page 93: ...are installed on the correct side Each inner rail will read R for the right or L for the left embossed on the side that faces away from the chassis Right and Left are with reference to looking at the...

Page 94: ...an audible click and the mounting pegs will cover the front part of the keyhole Figure 94 Slide Inner Rail Click Click d Caution When installing the inner rail onto the chassis make sure to only use t...

Page 95: ...Orient the rail so that the word REAR that is embossed into the metal of the rail is at the rear end of the rack and the release latch is facing the inside of the rack posts as shown in the following...

Page 96: ...Operation Click g Use a level to make sure that the rails are aligned properly h Follow these steps for the other outer rail 22 Install the rear cover alignment brackets a From the rear of the rack or...

Page 97: ...Torx Screwdriver Add three M5 x 10mm T15 Torx screws and three included washers to attach the rear rail the three lower holes to the rack posts as shown in the following image These screws should be t...

Page 98: ...ew Locations 23 Install the two rack latch brackets at the front of the rack a Orient the brackets so that the screw holes are between the two pins supporting the outer rails as shown in the following...

Page 99: ...ssis into the rails a Caution This step in the installation requires a minimum of 3 individuals to install safely two to lift and one to guide the others whom may have difficulty seeing because the en...

Page 100: ...use serious damage to the unit or serious bodily harm to those handling the unit Always team lift the chassis by gripping the underside of the unit and never try to lift a chassis that is filled with...

Page 101: ...that is filled with drives Figure 101 Bearing Plate Figure 102 Installing the Chassis b Caution Make sure that the bearing plate on the inside of the mid rails are fully forward and that the detent ha...

Page 102: ...h the enclosure the rest of the way into the rack Figure 103 Safety Latch Release e As the chassis is slid into the rack position one installer at the rear of the rack to ensure that the pegs on the s...

Page 103: ...uded M5 x 10mm T15 Torx screws into the two brackets at the front of the chassis in the following locations These screws should be tightened to 3 38 3 61 Nm 30 32 in lbf using a Long T15 Torx Screwdri...

Page 104: ...will receive it Lower it into the slot making sure it stays level and does not snag Figure 107 Installing a Drive Assembly d Pinch the latch release and carefully press downward to seat the Drive Ass...

Page 105: ...MA arm and swing it forward by pressing the blue button that says push to unlatch it b Gather the SAS cables one power cable and one Ethernet cable to install in the left hand side Note Before cabling...

Page 106: ...of the baskets on the CMA e Connect all of the SAS cables that will be used and route them through the baskets one at a time Make sure to follow the labels to make sure they are connected to the prope...

Page 107: ...be transported inside that rack it is important to use the included cable tie to wrap the CMA bundle to ensure it does not get damaged during transport If the Ultrastar Data60 is instead being instal...

Page 108: ...ts one at a time Make sure to follow the labels to make sure they are connected to the proper port c Connect the power cable to the lower PSU and route it through each basket The following image shows...

Page 109: ...ctor and the first basket Make sure to route all of the upper CMA cables under the lower CMA cables Figure 114 Nominal Cable Length at Connectors e Loop the retention clip on the PSU cables around the...

Page 110: ...If it does examine the point at which the binding occurred and adjust the seating of cables in the baskets check the connections to the rails and examine the joints of the CMA arm to ensure that they...

Page 111: ...ctor b Swing the CMA away from the enclosure c Do the same for the lower CMA arm as what was done for the upper d Both arms should be extended away from the enclosure as shown in the following example...

Page 112: ...tending outward from the connector This will free the cable from the port Make sure each cable is labeled or label them yourself to ensure that they will be plugged back into the same location 4 Unplu...

Page 113: ...hat need to be removed one at the elbow and two at the opposite end Figure 121 Unlatching a CMA Connector 7 Complete the previous step for the second CMA 8 Uninstall the crossbar from the CMA mounting...

Page 114: ...should easily come free from the mounting bracket 9 Uninstall the PSU a Grasp the release lever and the metal handle in a downward pinching motion to release the latching mechanism Figure 124 Uninstal...

Page 115: ...fety latches will prevent the enclosure from coming out of the rack completely and the cover will remain in the rack attached to the rear alignment brackets Figure 126 Chassis Handle Operation 12 Remo...

Page 116: ...b Insert a finger and a thumb into the latch release and pinch to unlatch the Drive Assembly Figure 127 Unlatch Drive Carrier IOM Not Shown 116 4 Part Replacement User Guide 4 9 Chassis Replacement...

Page 117: ...slot they were removed from in order to add them to the same slot in the future Store the drives in an ESD safe location until the drives are ready to be installed back into an enclosure 15 Uninstall...

Page 118: ...connectors Figure 130 Removing IOM 16 Remove the second IOM 17 Remove the IOM Fan a With one hand grasp around the center square of the fan housing as shown in the following image b Pinch the IOM fan...

Page 119: ...asp both handles at the front of the enclosure and pull with even pressure to extend the chassis out of the rack until it is stopped by the safety latches Make sure that the top cover comes with the c...

Page 120: ...n the rail and push the chassis very slightly forward The chassis is now unsecured from the rack e Ensure that you have the proper support mechanism to hold the chassis in position whether that be a t...

Page 121: ...r Rail b Locate and unlatch the springlock on the side of the inner rail Figure 135 Inner Rail Spring Latch c Slide the inner rail toward the front of the enclosure to unlock it from the pegs that sec...

Page 122: ...er with the grooves on the top of the chassis b Ensure that there is a good catch of the top cover by the chassis and slide it in all the way 26 Install the inner rail onto the chassis making sure the...

Page 123: ...audible click and the mounting pegs will cover the front part of the keyhole Figure 138 Slide Inner Rail Click Click d Caution When installing the inner rail onto the chassis make sure to only use th...

Page 124: ...he number of cables being installed into the CMA will be greater than 10 If not the following step is not necessary 27 Secure the Cable Tray onto the enclosure using the included M3 x 8mm T10 Torx scr...

Page 125: ...case in which the system may be installed or removed with the drives populated is if the facility has a lift that is rated to handle the maximum weight of the fully loaded system Warning The handles o...

Page 126: ...hat is filled with drives Figure 141 Bearing Plate Figure 142 Installing the Chassis b Caution Make sure that the bearing plate on the inside of the mid rails are fully forward and that the detent has...

Page 127: ...the enclosure the rest of the way into the rack Figure 143 Safety Latch Release e As the chassis is slid into the rack position one installer at the rear of the rack to ensure that the pegs on the si...

Page 128: ...determine what orientation the arm needs to be in The lower arm should have the elbow on the right side the upper arm should have the elbow on the left side Orient the CMA so that the elbow is on the...

Page 129: ...is not forced into position that it is inserted straight and that the directions for installing the IOM are followed exactly b Ensure that the handles on the IOM are not latched To unlatch them press...

Page 130: ...NOT FORCE IT Instead back the IOM out check the pins to make sure none are damaged and try again f Once the IOM is seated properly in the slot close the handles until they latch closed 35 Install the...

Page 131: ...gure 151 Installing a Drive Assembly d Pinch the latch release and carefully press downward to seat the Drive Assembly the rest of the way 38 Install each drive in the place it was removed from by fol...

Page 132: ...ck for shipping purposes skip this step and move on to the next one Figure 152 Shipping Bracket Screw Locations Screw Location 40 Install the PSU a Align the PSU in the orientation shown in the follow...

Page 133: ...ng the PSU c Plug the power cable into the receptacle at the back of the PSU d Loop the retention clip on the PSU cables around the cable and pinch it until the clip catches and locks in place Figure...

Page 134: ...gure 155 Cinching Cable Retention Clip 41 Install the second PSU 42 Install Rear Fan a Orient the rear fan as shown in the following image b Insert the rear fan into the housing as shown in the follow...

Page 135: ...to the brackets on the rails and chassis There should be one at the elbow side and two on the left hand side 45 Install the crossbar onto the CMA mounting bracket a Align the crossbar with the mountin...

Page 136: ...nting bracket Figure 159 Crossbar Underside Peg c Swing the crossbar so that the thumbscrew lines up with the mounting hole on the opposite side of the enclosure Figure 160 Swinging Motion of Crossbar...

Page 137: ...e elbow side of the CMA arm and swing it forward by pressing the blue button that says push to unlatch it b Gather the SAS cables one power cable and one Ethernet cable to install in the left hand sid...

Page 138: ...f the baskets on the CMA e Connect all of the SAS cables that will be used and route them through the baskets one at a time Make sure to follow the labels to make sure they are connected to the proper...

Page 139: ...be transported inside that rack it is important to use the included cable tie to wrap the CMA bundle to ensure it does not get damaged during transport If the Ultrastar Data60 is instead being install...

Page 140: ...s one at a time Make sure to follow the labels to make sure they are connected to the proper port c Connect the power cable to the lower PSU and route it through each basket The following image shows...

Page 141: ...tor and the first basket Make sure to route all of the upper CMA cables under the lower CMA cables Figure 167 Nominal Cable Length at Connectors e Loop the retention clip on the PSU cables around the...

Page 142: ...ently pulling the enclosure out of the rack to ensure the cables extend properly and that the system doesn t bind at all If it does examine the point at which the binding occurred and adjust the seati...

Page 143: ...he port and binding during operation cycles Figure 170 Nominal Cable Length at Connectors The cables at the port side of the CMA should crisscross in front of the IOMs To accomplish this the cables co...

Page 144: ...CMA It is recommended not to wrap the cables tightly around this joint because this can cause binding and prevent smooth operation To ensure there is enough slack at the elbow pull the enclosure in an...

Page 145: ...the cables exit use a cable tie to bundle the cables together Make sure the cables are bending and not twisting Figure 173 Cable Tie at Exit of CMA 145 4 Part Replacement User Guide 4 10 Special Consi...

Page 146: ...to each drive is available during the reset of the IOM that is being upgraded After the firmware has been downloaded to one IOM the IOM will reset and boot to the new firmware Before proceeding with t...

Page 147: ...plore button under the Downloads Documents section The Customer Technical Support and Downloads page will appear 5 Log in to the Customer Technical Support and Downloads page using a username and pass...

Page 148: ...HBA hosted on the Linux Server that presents the Enclosure Services Processor to the Linux operating system The Enclosure Services Processor in the Ultrastar Data60 will be referred to as an IOM Note...

Page 149: ...ed to an HBA that does not present the Enclosure Services Processor to the host for management purposes HGST recommends attaching the Ultrastar Data60 to a host that does expose the Enclosure Services...

Page 150: ...Enclosure services controller electronics subenclosure id 0 ti 5 Overall descriptor empty Element 0 descriptor ESCE IOMA IOM PART NUM IOM SERIAL NUM 5000CCAB0500003C XXX XXX XXX XXX Element 1 descrip...

Page 151: ...plete no error start after hard reset or power cycle 0x11 before proceeding to the activate step Example output sg_ses dev sg0 p 0xe HGST H460 J 2020 Download microcode status diagnostic page number o...

Page 152: ...ive ICs which may take up to 15 minutes Once the sg_ses_microcode command is issued wait 20 minutes to ensure the enclosure has time to perform this process To check the status of this process use the...

Page 153: ...d to verify that there are two paths to each drive multipath ll grep i active ready running c 7 Issues the following command to activate IOM B sg_ses dev sg dev p4 c d 02 00 01 01 8 Ensure multi pathi...

Page 154: ...ice I O SATA Configurations A SATA configuration should not be considered for an online upgrade due to the single path nature of the topology Figure 178 Multipathing Configuration Minimum Requirement...

Page 155: ...ample Element type Enclosure services controller electronics subenclosure id 0 ti 5 Overall descriptor empty Element 0 descriptor ESCE IOMA IOM PART NUM IOM SERIAL NUM 5000CCAB0500003C XXX XXX XXX XXX...

Page 156: ...update completed Waiting for activation EstimatedRemainingMinutes 0 Attention If the OOBM is not being used query Page Eh by executing the following command sg_ses device p0xe The first time this comm...

Page 157: ...le 0000000077010524 Active Optimized 001 005 036 000 0 Adapter Avago Adapter SAS3 3008 Fury StorPo B D F 134 000 000 Controller 46616B65436F6E74726F6C6C6572 State Active 0000000077000431 Active Optimi...

Page 158: ...o 15 minutes Once the sg_ses_microcode command is issued wait 20 minutes to ensure the enclosure has time to perform this process To check the status of this process use the Redfish out of band manage...

Page 159: ...there are two paths to each drive by issuing the following command C more C Users Administrator Desktop mpclaim_output txt Note It could take the OS several minutes to rebuild all the paths to the dri...

Page 160: ...n optimal state following the reset of IOM B c Verify that the output from the mpclaim_output txt output appears similar to the following example 0000000077010524 Active Optimized 001 005 036 000 0 Ad...

Page 161: ...location of the bin file POST redfish v1 UpdateService Actions UpdateService SimpleUpdate HTTP 1 1 Content Type application json charset utf 8 Content Length computed length OData Version 4 0 Authoriz...

Page 162: ...ns for the Ultrastar Data60 Each configuration allows the user connect a different number of hosts that have access to a set number of drives Each of these drives are part of a grouping called a zone...

Page 163: ...mapped to both IOMs Each zone group will display all of the devices that are contained within that zone If a drive slot is not populated it will still be part of that zone group but it will not displ...

Page 164: ...ecific zone group Connect the host servers to the enclosure using SAS cables in the Configuration listed in the table below The left side of the table displays the host connection and the right side d...

Page 165: ...sented by three different colors Each zone group matches to a pair of SAS ports on each side of the rear IOM to allow for the connections to three different hosts In band management Configuration 2 ca...

Page 166: ...e group will display all of the devices that are contained within that zone If a drive slot is not populated it will still be part of that zone group but it will not display any results in enclosure m...

Page 167: ...ecific zone group Connect the host servers to the enclosure using SAS cables in the Configuration listed in the table below The left side of the table displays the host connection and the right side d...

Page 168: ...lity that performs a SCSI send diagnostic command is the sg device Linux or SCSI device Windows that is assigned by the SEP The information collected for the device will be input in any location that...

Page 169: ...as dev sg3 and dev sg106 bolded in the example below dev sg3 scsi9 channel 0 id 43 lun 0 HGST H460 J 0101 rmb 0 cmdq 1 pqual 0 pdev 0xd dev sg106 scsi9 channel 0 id 196 lun 0 HGST H460 J 0101 rmb 0 c...

Page 170: ...rmation recorded in earlier steps a Use the example of the sg_senddiag command shown in the image above to complete the specific sg_senddiag command for IOM A Replace letters a through d with the info...

Page 171: ...dev sg106 pf raw 04 00 00 90 61 01 00 00 50 00 CC AB 03 00 00 7C 5 Enable zoning on IOM A using the sg_senddiag command a Issue the command for IOM A that was built in the previous step b Enabling a...

Page 172: ...9 0 1387 0 end_device 9 41 23 end_device 9 44 1 end_device 9 44 6 9 0 1295 0 9 0 1376 0 9 0 1388 0 end_device 9 41 24 end_device 9 44 10 end_device 9 44 7 9 0 1296 0 9 0 1377 0 9 0 1389 0 end_device...

Page 173: ...LS03517EL0052 5000CCAB0300007C 10 202 239 201 c Record the IOM SAS Addresses for use in a later step 3 Verify the IOM SAS Address that matches each sg_device that is linked to each IOM using sg_vpd pa...

Page 174: ...should be added to the sg_senddiag command should be 50 00 CC AB 03 00 00 3C b Use the example of the sg_senddiag command shown in the image above to complete the specific sg_senddiag command for IOM...

Page 175: ...nd_device 9 41 29 end_device 9 44 15 expander 9 41 9 0 1289 0 9 0 1301 0 9 0 1382 0 end_device 9 41 18 end_device 9 41 30 end_device 9 44 16 expander 9 42 9 0 1290 0 9 0 1302 0 9 0 1383 0 end_device 9...

Page 176: ...each IOM using sg_ses page 7 a Issue the following command sg_ses dev p7 finstr i esce Note For scsi dev type the number of the SCSI device recorded in the previous step b The IP Address for each IOM...

Page 177: ...ing Configuration configuration 01 02 or 03 Note For information on preconfigured zoning configurations see Predefined Zoning Configurations on page 162 d IOM SAS Address SAS Address associated with I...

Page 178: ...tic transport Host_status 0x03 DID_TIME_OUT Driver_status 0x00 DRIVER_OK 6 Enable zoning on IOM B using the sg_senddiag command a Issue the command for IOM B that was built in the previous step b Enab...

Page 179: ...access to The step can be repeated on other hosts to see what zone group each host has access to d Issue the following command to access all hosts smp_discover_list smp_discover_list ignore dev bsg e...

Page 180: ...de set Binary 0x5000ccab0300003c Target port designator type NAA code set Binary transport Serial Attached SCSI Protocol SPL 4 0x5000ccab0300003c designator type Relative target port code set Binary t...

Page 181: ...econfigured zoning configurations see Predefined Zoning Configurations on page 162 d IOM SAS Address SAS Address associated with IOM B Note A comma should be placed after each bit of data in the IOM S...

Page 182: ...0 2 0 0 9 0 1297 0 9 0 1378 0 9 0 1390 0 end_device 9 41 26 end_device 9 44 12 end_device 9 44 9 10 0 0 0 9 0 1298 0 9 0 1379 0 9 0 1391 0 end_device 9 41 27 end_device 9 44 13 expander 9 39 7 0 0 0 9...

Page 183: ...on their needs There are specific requirements that must be followed to ensure that the enclosure functions properly during operation Partial population configurations that do not comply with the req...

Page 184: ...Population The enclosure supports a minimum of 24 HDDs and one SSD for a partially populated enclosure The enclosure can support a minimum of one SSD with the remaining drive slots within that row bei...

Page 185: ...nd Maximum SSD Partial Population The enclosure supports a minimum of 24 HDDs and one SSD for a partially populated enclosure The enclosure can support a maximum of up to 24 total SSDs in this configu...

Page 186: ...n provides steps on how to install drives into the enclosure The enclosure is shipped with a minimum of 24 HDDs and may require HDDs to be moved to other drives slots if SSDs are being installed Befor...

Page 187: ...the HDD 3 Follow the requirements for partial populations listed in Partial Population Configurations on page 183 4 Install the Drive Assembly a Ensure that the enclosure has been pulled out of the ra...

Page 188: ...on needed to use the cable maps in the following sections The daisy chaining configurations are broken into two sections one host configurations and two host configurations Each of the sections provid...

Page 189: ...st Cable Configurations on page 191 Figure 200 One Host Configuration Example Note The diagram displays red SAS cables to indicate passive connections between the host and the enclosure The black SAS...

Page 190: ...iguration Example Note The diagram displays red SAS cables to indicate passive connections between the host and the enclosure The black SAS cables indicate active connections between each enclosure Tw...

Page 191: ...ns between each enclosure Table 46 Two Enclosures One Host with a Single HBA Destination Device Source Device Hardware Enclosure1 IOMA A1 Host1 P1 Host Connections Enclosure2 IOMB B3 Host1 P2 Enclosur...

Page 192: ...osure3 IOMB B1 Enclosure2 IOMB B3 Enclosure4 IOMA A1 Enclosure3 IOMA A3 Figure 203 Enclosure Configurations with One Host with Two HBAs Note The diagram displays red SAS cables to indicate passive con...

Page 193: ...e1 IOMB B3 Enclosure3 IOMB B2 Enclosure1 IOMB B4 Enclosure3 IOMA A1 Enclosure2 IOMA A3 Enclosure3 IOMA A2 Enclosure2 IOMA A4 Enclosure3 IOMB B1 Enclosure2 IOMB B3 Enclosure3 IOMB B2 Enclosure2 IOMB B4...

Page 194: ...to indicate passive connections between the host and the enclosure The black SAS cables indicate active connections between each enclosure Table 52 Four SATA Enclosures One Host with a Single HBA Des...

Page 195: ...the host and the enclosure The black SAS cables indicate active connections between each enclosure Table 53 Two Enclosures Two Hosts with a Single HBA Destination Device Source Device Hardware Enclosu...

Page 196: ...s with a Single HBA Destination Device Source Device Hardware Enclosure1 IOMA A1 Host1 P1 Host Connections Enclosure4 IOMB B3 Host1 P2 Enclosure1 IOMB B1 Host2 P1 Enclosure4 IOMA A3 Host2 P2 Enclosure...

Page 197: ...e Table 56 Two Enclosures Two Hosts with Two HBAs Destination Device Source Device Hardware Enclosure1 IOMA A1 Host1 P1 Host Connections Enclosure2 IOMB B3 Host1 P2 Enclosure1 IOMA A2 Host1 P3 Enclosu...

Page 198: ...Enclosure2 IOMB B1 Enclosure1 IOMB B3 Enclosure2 IOMB B2 Enclosure1 IOMB B4 Enclosure3 IOMA A1 Enclosure2 IOMA A3 Enclosure3 IOMA A2 Enclosure2 IOMA A4 Enclosure3 IOMB B1 Enclosure2 IOMB B3 Enclosure3...

Page 199: ...ost Cable Configurations on page 195 sections The configuration choice should be made based on the number of hosts being connected to the enclosure the number of HBAs in each host and how many enclosu...

Page 200: ...ll of the SAS cables that will be used and route them through the baskets one at a time Make sure to follow the labels to make sure they are connected to the proper port e If the installation includes...

Page 201: ...gth at Connectors f Close all of the baskets g Reconnect the CMA at the elbow to the connectors on the rail 3 Cable the upper CMA a Unlatch the elbow side of the CMA arm and swing it forward by pressi...

Page 202: ...ed to the proper port b Connect the power cable to the lower PSU and route it through each basket The following image shows the appropriate cable criss cross pattern they should be installed in Figure...

Page 203: ...to route all of the upper CMA cables under the lower CMA cables Figure 212 Nominal Cable Length at Connectors d Close all of the baskets e Reconnect the CMA at the elbow to connector A 4 Connect the S...

Page 204: ...product can result in lowered system performance or system failure Do not position the unit in an environment that has extreme high temperatures or extreme low temperatures Be aware of the proximity o...

Page 205: ...tions provided within the rackmount instructions Reliable grounding of rack mounted equipment should be maintained If installed in a closed or multi unit rack assembly the operating ambient temperatur...

Page 206: ...safety instructions and information The following safety symbols may be used throughout the documentation and may be marked on the product and or the product packaging CAUTION Indicates the presence...

Page 207: ...aluated as Information Technology Equipment ITE at accredited third party laboratories for all safety emissions and immunity testing required for the countries and regions where the product is markete...

Page 208: ...4 8 Power Frequency Magnetic Field EN 61000 4 11 Voltage Dips and Interruptions 7 4 Country Certifications Table 59 Country Certifications Authority or Mark Country Region Nemko North America Canada...

Page 209: ...device complies with Part 15 of the FCC Rules Operation is subject to the following two conditions 1 This device may not cause harmful interference 2 This device must accept any interference received...

Page 210: ...cause radio interference in which case the user may be required to take corrective actions 8 5 Taiwan Warning Label Statement Class A ITE English translation This is a Class A product In a domestic e...

Page 211: ...t contact Platform Engineering technical support Please be prepared to provide the following information Serial Number S N product name model number and a brief description of the issue Email support...

Page 212: ...ing between PSUs 200 240 VAC auto ranging 50 60 Hz Voltage per power supply Maximum inrush current per power supply Caution The Ultrastar Data60 can only be plugged into highline If the unit is plugge...

Page 213: ...Hz 2 Rank RDIMM DDR4 8GB MTA18ASF1G72PDZ 2G6B1 Micron 2666 MHz 2 Rank RDIMM DDR4 16GB MTA18ASF2G72PDZ 2G6D1 Micron 2666 MHz 2 Rank RDIMM DDR4 16GB MTA18ASF2G72PDZ 2G6E1 Micron 2666 MHz 2 Rank RDIMM DD...

Page 214: ...ould be installed into the rack at the lowest possible U height to keep the load on the rack balanced Table 64 Required Rack Specifications Requirement Parameter 900mm 35 43in usable rack space frame...

Page 215: ...handles can cause them to fail This can cause serious damage to the unit or serious bodily harm to those handling the unit Always team lift the chassis by gripping the underside of the unit and never...

Page 216: ...Server Technology Server Technology TRIPP LITE Vendor None KIT MBVPT 1B 412 0761 11_STV 4501 Options SR42UBDP Rack Part Number 412 0761 20_STV 4502 SREXTENDER 25U Rack Extension 412 0761 23_STV 4503 S...

Page 217: ...e the enclosure can be extended out of the rack before the enclosure will begin to overheat Attention Limit the amount of time that the enclosure is extended out of the rack to only what is necessary...

Page 218: ...FCI 10m Active SAS Cable Edge Buffering Edge buffering is an enclosure feature that increases the overall enclosure performance when a 6 Gbps target is connected With edge buffering disabled primitive...

Reviews: