background image

User Guide

5. System Management

5.3 Zoning

5.3

Zoning

5.3.1

Before Zoning

This section provides information on actions that should be taken before starting zoning on the Ultrastar

Data60.

Users should install all of the required downloads before beginning the zoning process.

Required Downloads

:

SMP Tools 0.98 for Linux: 

http://sg.danny.cz/sg/smp_utils.html

SG3 Utils: 

http://sg.danny.cz/sg/sg3_utils.html

CLI Tools: to download the latest version of CLI tools, see: 

Downloading Firmware from the Support

Portal

 (page 163)

5.3.2

Predefined Zoning Configurations

There are three predefined zoning configurations for the Ultrastar Data60. Each configuration connects

a different number of hosts to a set number of drives. Each of these drives are part of a grouping called

a zone group. This section displays the necessary information related to each of the predefined zoning

configurations.

Configuration 0:

Configuration 0 allows all hosts to view all drive slots and the devices that are populated in those drive

slots. In this Configuration, all of the drives belong to the same zone group as shown in the image below

represented by one color. Each of the SAS ports on the rear IO of the enclosure are also represented by

one color to display their connection to all of the drives within the enclosure.

In-band management

: Configuration 0 can be initiated to disable zoning in the sg_senddiag

command in-band by using 00 in the Zoning Configuration option. See: 

sg_senddiag Command

 (page

188)

 for the actual senddiag commands.

Out-of-band management

: Configuration 0 (default configuration) can be initiated to disable zoning

in the out-of-band management by using 0 in the ZoningConfig option. The following are example

Redfish POST and cURL commands:

182

Summary of Contents for H4060-J

Page 1: ...User Guide Ultrastar Data60 Regulatory Model H4060 J December 2019 Rev 1 14 1ET1101 ...

Page 2: ...s CRUs 6 LEDs 7 Front and Rear IO LEDs 7 IOM LEDs 9 IOM Fan LED 9 PSU LED 10 Rear Fan LED 11 Drive Assembly LED 12 Ultrastar Data60 Rack Requirements 13 Compatible Rack Hardware Configuration 14 Power Requirements 16 ESD 17 Enclosure Cooling 17 Host Connectivity 17 Supported SKUs 19 List of Compatible Drives 19 Chapter 2 System Management Overview 34 Firmware Features Overview 35 Supported Operati...

Page 3: ...ecifications 47 IOM Fan Layout 47 Rails Description 48 Rails Specifications 49 Rails Layout 49 Rear Cover Alignment Bracket Description 50 CMA Description 51 CMA Specifications 52 CMA Layout 52 CMA Cable Tray 53 Drive Assembly Description 54 Drive Assembly Specifications 54 Drive Assembly Layout 55 2 5 Drive Carrier Description 55 Drive Blank Description 58 Chapter 4 Part Replacement 60 Part Repla...

Page 4: ...eparation 170 Windows Upgrade to New Firmware 172 Non Automatic Firmware Activation in Windows 175 Upgrading Firmware with OOBM 178 Configuring OOBM Network Settings 179 Configuring OOBM Network Settings Using SES 179 Zoning 181 Before Zoning 182 Predefined Zoning Configurations 182 sg_senddiag Command 188 Enabling Zoning using Linux 189 Disabling Zoning using Linux 192 Enabling Zoning using Windo...

Page 5: ...1 Safety and Service 231 Safety Warnings and Cautions 232 Chapter 7 Disclaimers 233 Restricted Access Location 234 Safety Compliance 234 Electromagnetic Compatibility EMC Class A Compliance 234 Country Certifications 235 Chapter 8 Regulatory Statements 236 Europe CE Declaration of Conformity 237 FCC Class A Notice 237 ICES 003 Class A Notice Avis NMB 003 Classe A 237 Japanese Compliance Statement ...

Page 6: ...name January 2018 Revision 1 3 Updated information on the 2 5 drive carrier option See 2 5 Drive Carrier Description page 55 Added torque requirements for all screws used in the enclosure Updated the IOM replacement section to account for the possibility of a firmware mismatch See IOM Replacement page 61 Updated the drive assembly installation instructions to clarify the orientation of the drive a...

Page 7: ...e 17 May 2019 Revision 1 8 Changed senddiag commands from images to codeblocks See sg_senddiag Command page 188 Updated daisy chaining tables to match diagrams See Two Host Cable Configurations page 217 Corrected OOBM zoning configuration instructions See Predefined Zoning Configurations page 182 Added Configuring OOBM Network Settings page 179 May 2019 Revision 1 9 Corrected the system architectu...

Page 8: ...ection November 2019 Revision 1 13 Replaced references to He12 drives with Ultrastrar DC HC520 in List of Compatible Drives page 19 Changed device references from OS specific dev sgX for Linux and SCSIX X X X for Windows to generic dev throughout Updated table for Approved SAS Cables in Host Connectivity page 17 Added Subenclosure Nickname page 202 section Updated Supported Operating Systems page ...

Page 9: ... support wdc com Western Digital may have patents or pending patent applications covering subject matter in this document The furnishing of this document does not give you any license to these patents Copyright 2017 2019 Western Digital Corporation or its affiliates Western Digital 5601 Great Oaks Parkway San Jose CA 95119 Long Live Data is a trademark of Western Digital Inc and its affiliates in ...

Page 10: ...r and a brief description of the issue Email support wdc com Website https portal wdc com Support s 1 1 Product Label Information The following product information is required for technical support requests Part Number P N Serial Number S N Product Name and or Model Number MODEL This information may be found on the product label which is affixed to an exterior non removable surface of the chassis ...

Page 11: ...ar Data60 In This Chapter Ultrastar Data60 Description 2 System Architecture Overview 2 System Level Block Diagram 3 Ultrastar Data60 Specification Summary 3 Ultrastar Data60 Layout 5 List of Customer Replaceable Units CRUs 6 LEDs 7 Ultrastar Data60 Rack Requirements 13 Power Requirements 16 ESD 17 1 ...

Page 12: ...dapter in the 60 available drive bays Up to 12W per drive slot for the 60 data storage drives Cannot exceed 85A on the 5V rail House and control four 4 N 1 redundant 80mm rear fans House and control a dual rotor 40mm internal IOM Fan Controlled by two 2 redundant I O Modules Powered by two 2 redundant 1600W PSUs Full high availability with independent dual paths to all HDDs Toolless replacement of...

Page 13: ... LEDs and T10 drive power disable signals on the 60 data storage drives Note To use T10 power disable the drives installed must also support this feature The I2 C architecture is designed to support only one single master on any given bus The primary expander will be the master on each I2 C bus There are eight I2 C buses used in the Ultrastar Data60 enclosure The number of devices on each bus are ...

Page 14: ...ak for up to one quarter of the AC cycle after which the input current should be no more than the specified maximum input current Caution The Ultrastar Data60 can only be plugged into highline If the unit is plugged into lowline the PSU will report a Critical state when status pages are queried using SES In this case the enclosure will power up but the drives will not The enclosure will remain in ...

Page 15: ...le spacing See EIA 310 Rack Standard Required Rack Depth 900mm 35 43in usable rack space frame to frame Rack Units U 4U Vertical Rack Rail Spacing 24 in 32 in Table 4 Performance Specifications Specification Value Number of Drive Slots 60 Data Transfer Rates 12Gbps SAS 6Gbps SATA Max Raw Data Storage Capacity 840 TB using 14TB Ultrastar HC530 drives SAS Ports 12 x Mini SAS HD 6 per IOM 2 x 10 100 ...

Page 16: ...ing is an image of the layout of the major system components inside the Ultrastar Data60 Figure 5 Component Layout 1 6 List of Customer Replaceable Units CRUs The following table lists the replaceable components and their part numbers Table 6 List of Replaceable Components Component Part Number Ultrastar Data60 Chassis with a single IOM and PSU 1EX0442 Ultrastar Data60 Chassis with IOMs and PSUs 1...

Page 17: ...e for PDU C13 C14 18AWG 3m Qty 1 1EX1158 HD Mini SAS to HD Mini SAS 3m Qty 2 1EX1533 1 7 LEDs 1 7 1 Front and Rear IO LEDs The Ultrastar Data60 has a number of LEDs on the exterior of the enclosure that display various system statuses There are three on the front and three on the rear that mirror each other and provide general status This allows the status of the enclosure to be visible from eithe...

Page 18: ...as a fault Off Enclosure has no fault Note LEDs have a 50 duty cycle On for 2 seconds off for less than a second 3 Power Green Solid Powered On Figure 7 Rear IO LEDs Table 8 Rear LED Identification Number LED Name Color Behavior 1 SAS Link Status Green Solid SAS Cable Connected Off SAS Cable Not Connected 2 SAS Fault Status Amber Blink 1 Hz 50 duty cycle SAS connection fault Off No SAS connection ...

Page 19: ...Link Activity Green Amber Off Operating at 10 Mbps Green Solid Operating at 100 Mbps Amber Solid Operating at 1Gpbs 7 Ethernet Connector Speed Green Off No Connection Solid Connected Blink Activity 1 7 2 IOM LEDs The IOM has three LEDs one each for power fault and identification Figure 8 IOM LEDs Table 9 IOM LED Identification LED Name Color Behavior IOM Identification Blue Blink 0 5 Hz 75 duty cy...

Page 20: ... Fan LED Identification LED Name Color Behavior IOM Fan LED Amber Blink 2 Hz 50 duty cycle IOM Fan is being identified Blink 1 Hz 50 duty cycle IOM Fan is reporting faults Off IOM Fan is on and reporting no faults Note LEDs have a 50 duty cycle On for 2 seconds off for less than a second 1 7 4 PSU LED The PSU has a single multi function LED See the table below for a detailed functional description...

Page 21: ...nected from power PSU Multi function LED Amber Solid PSU is disconnected from power or critical fault causing a shutdown failure Blink 0 5Hz 50 duty cycle PSU reporting warnings Off PSU is reporting no faults Note LEDs have a 50 duty cycle On for 2 seconds off for less than a second 1 7 5 Rear Fan LED The Rear Fan has a single LED that has three distinct states one for a fault condition one for Id...

Page 22: ...ycle Fan is being identified Off Fan is on and reporting no faults Note LEDs have a 50 duty cycle On for 2 seconds off for less than a second 1 7 6 Drive Assembly LED The HDD drive assemblies themselves do not contain an LED However there is an amber multi function LED located on the drive carrier that has three distinct states one for a fault condition one for identification and off 12 ...

Page 23: ...meets the EIA 310 standard at a minimum 900mm 35 43in usable rack space frame to frame The vertical rack rails must be set between 24 in 32 in to support the enclosure It requires 4U of rack space and it should be installed into the rack at the lowest possible U height to keep the load on the rack balanced Table 14 Required Rack Specifications Parameter Requirement Rack Depth 900mm 35 43in usable ...

Page 24: ... 24in on either side of the enclosure for two people to remove the enclosure Warning The handles on the front of the chassis are not intended to be used to support the weight of the Ultrastar Data60 Lifting the unit by the chassis handles or trying to support the unit on the handles can cause them to fail This can cause serious damage to the unit or serious bodily harm to those handling the unit A...

Page 25: ...l PDU Mounting Bracket Additional Mounting Bracket Hardware Vendor AFCO Legrand Server Technology Server Technology Various Part Number Options 42RU WEDIT605 45RU WEDIT604 48RU WEDIT603 51RU WEDIT606 412 0761 11_STV 4501 412 0761 20_STV 4502 412 0761 23_STV 4503 KIT MB 40 None Quantity 1 rack 2 1 N A Table 17 Compatible Hardware Configuration 3 Parameter Rack PDU Vertical PDU Mounting Bracket Addi...

Page 26: ... rack 2 2 Varies 1 9 Power Requirements The following table describes the A C input power specification for the Ultrastar Data60 Table 19 AC Power Specifications Power Alternating Current AC Power Supply 2 per enclosure Wattage per power supply Supply Rating 80 PLUS Platinum rated Max Power Consumption 1250W Typical Power Consumption 1000W Voltage per power supply 200 240 VAC auto ranging 50 60 Hz...

Page 27: ...s based on temperatures within the enclosure with emphasis on reducing power consumption The rack that the Ultrastar Data60 is installed in must not restrict airflow to the enclosure Racks with doors should be tested to ensure they do not constrict airflow to the enclosure If the enclosure reaches critical temperature it will go into low power mode to avoid damage to the enclosure When the Ultrast...

Page 28: ...must be used when connecting between enclosures The use of active cables provides improved signal integrity between the enclosures Passive Cabling If you are connecting more than one host port per I O you must connect cables to every other port per IOM and do not need all six ports Western Digital recommends connecting the cables to every other port as a best practice The recommended connection or...

Page 29: ... 6 Gbps targets to utilize the 12 Gbps link from the expander to the initiator in a more efficient manner 1 13 Supported SKUs The following table lists the versions of this Western Digital product that are supported by this document Table 21 List of Supported SKUs SKUs 1ES1157 1ES1158 1ES1159 1ES1160 1ES1161 1ES1162 1ES1163 1ES1164 1ES1234 1ES1235 1ES1236 1ES1237 1ES1238 1ES1239 1ES1240 1ES1241 1E...

Page 30: ... carrier HDD SAS 12Gb s 512e SE 4TB 1EX2179 Western Digital Ultrastar DC HC310 w 3 5 in drive carrier HDD SAS 12Gb s 512e TCG 4TB 1EX2180 Western Digital Ultrastar DC HC310 w 3 5 in drive carrier HDD SAS 12Gb s 512e TCG FIPS 4TB 1EX2181 Western Digital Ultrastar DC HC310 w 3 5 in drive carrier HDD SAS 12Gb s 4Kn SE 6TB 1EX1183 Western Digital Ultrastar DC HC310 w 3 5 in drive carrier HDD SAS 12Gb ...

Page 31: ...6Gb s 512e SE 6TB 1EX1189 Western Digital Ultrastar DC HC310 w 3 5 in drive carrier HDD SATA 6Gb s 512e TCG 6TB 1EX1188 Western Digital Ultrastar DC HC320 w 3 5 in drive carrier HDD SAS 12Gb s 4Kn SE 8TB 1EX1221 Western Digital Ultrastar DC HC320 w 3 5 in drive carrier HDD SAS 12Gb s 4Kn TCG 8TB 1EX1220 Western Digital Ultrastar DC HC320 w 3 5 in drive carrier HDD SAS 12Gb s 4Kn TCG FIPS 8TB 1EX13...

Page 32: ...B 1EX1226 Western Digital Ultrastar DC HC330 w 3 5 in drive carrier HDD SAS 12Gb s 4Kn SE 10TB 1EX2432 Western Digital Ultrastar DC HC330 w 3 5 in drive carrier HDD SAS 12Gb s 4Kn TCG 10TB 1EX2433 Western Digital Ultrastar DC HC330 w 3 5 in drive carrier HDD SAS 12Gb s 4Kn TCG FIPS 10TB 1EX2434 Western Digital Ultrastar DC HC330 w 3 5 in drive carrier HDD SAS 12Gb s 512e SE 10TB 1EX2435 Western Di...

Page 33: ...TB 1EX0482 Western Digital Ultrastar DC HC510 w 3 5 in drive carrier HDD SAS 12Gb s 4Kn SE 10TB 1EX0484 Western Digital Ultrastar DC HC510 w 3 5 in drive carrier HDD SAS 12Gb s 4Kn TCG 10TB 1EX0483 Western Digital Ultrastar DC HC510 w 3 5 in drive carrier HDD SAS 12Gb s 4Kn TCG FIPS 10TB 1EX1340 Western Digital Ultrastar DC HC510 w 3 5 in drive carrier HDD SAS 12Gb s 512e ISE 10TB 1EX0485 Western ...

Page 34: ... 10TB 1EX0497 Western Digital Ultrastar DC HC510 w 3 5 in drive carrier HDD SATA 6Gb s 512e SE 10TB 1EX0499 Western Digital Ultrastar DC HC510 w 3 5 in drive carrier HDD SATA 6Gb s 512e SED 10TB 1EX0498 Western Digital Ultrastar DC HC520 w 3 5 in drive carrier HDD SAS 12Gb s 4Kn ISE 12TB 1EX1004 Western Digital Ultrastar DC HC520 w 3 5 in drive carrier HDD SAS 12Gb s 4Kn SE 12TB 1EX1006 Western Di...

Page 35: ...Kn ISE 12TB 1EX1010 Western Digital Ultrastar DC HC520 w 3 5 in drive carrier HDD SATA 6Gb s 4Kn SE 12TB 1EX1012 Western Digital Ultrastar DC HC520 w 3 5 in drive carrier HDD SATA 6Gb s 4Kn SED 12TB 1EX1011 Western Digital Ultrastar DC HC520 w 3 5 in drive carrier HDD SATA 6Gb s 512e ISE 12TB 1EX1013 Western Digital Ultrastar DC HC520 w 3 5 in drive carrier HDD SATA 6Gb s 512e SE 12TB 1EX1015 West...

Page 36: ...EX1792 Western Digital Ultrastar DC HC530 w 3 5 in drive carrier HDD SAS 12Gb s 512e TCG FIPS 14TB 1EX1855 Western Digital Ultrastar DC HC530 w 3 5 in drive carrier HDD SATA 6Gb s 4Kn SE 14TB 1EX1790 Western Digital Ultrastar DC HC530 w 3 5 in drive carrier HDD SATA 6Gb s 512e SE 14TB 1EX1793 Western Digital Ultrastar DC HC530 w 3 5 in drive carrier HDD SATA 6Gb s 512e SED 14TB 1EX1794 Western Dig...

Page 37: ...X2153 Western Digital Ultrastar DC HC620 w 3 5 in drive carrier HDD SAS 12Gb s 512e ISE SMR HM 15TB 1EX2154 Table 23 SSD w 3 5 in to 2 5 in drive carrier Drive Type Interface Drive Writes Encryption Volume Part Number Western Digital Ultrastar SS200 w 3 5 in to 2 5 in drive carrier SSD SAS 12Gb s RI 3DW D ISE 400GB 1EX1291 Western Digital Ultrastar SS200 w 3 5 in to 2 5 in drive carrier SSD SAS 12...

Page 38: ...dspeed Ultra Gen II w 3 5 in to 2 5 in drive carrier SSD SATA 6Gb s RI 1 8DW D SE 400GB 1EX1294 Western Digital Ultrastar SS530 w 3 5 in to 2 5 in drive carrier SSD SAS 12Gb s RI 3DW D SE 400GB 1EX2020 Western Digital Ultrastar SS530 w 3 5 in to 2 5 in drive carrier SSD SAS 12Gb s RI 3DW D ISE 400GB 1EX2021 Western Digital Ultrastar SS530 w 3 5 in to 2 5 in drive carrier SSD SAS 12Gb s RI 3DW D TC...

Page 39: ...5 in drive carrier SSD SAS 12Gb s RI 3DW D ISE 800GB 1EX1295 Western Digital Ultrastar SS300 w 3 5 in to 2 5 in drive carrier SSD SAS 12Gb s RI 3DW D SE 800GB 1EX1297 Western Digital Ultrastar SS300 w 3 5 in to 2 5 in drive carrier SSD SAS 12Gb s RI 3DW D TCG 800GB 1EX1308 Western Digital Ultrastar SS300 w 3 5 in to 2 5 in drive carrier SSD SAS 12Gb s RI 3DW D TCG FIPS 800GB 1EX1480 Western Digita...

Page 40: ...0DW D TCG 800GB 1EX2084 Western Digital Ultrastar SS200 w 3 5 in to 2 5 in drive carrier SSD SAS 12Gb s RI 1DW D TCG 960GB 1EX1317 Western Digital Ultrastar SS530 w 3 5 in to 2 5 in drive carrier SSD SAS 12Gb s RI 1DW D SE 960GB 1EX2032 Western Digital Ultrastar SS530 w 3 5 in to 2 5 in drive carrier SSD SAS 12Gb s RI 1DW D ISE 960GB 1EX2033 Western Digital Ultrastar SS530 w 3 5 in to 2 5 in drive...

Page 41: ...Ultrastar SS300 w 3 5 in to 2 5 in drive carrier SSD SAS 12Gb s ME 10DW D TCG FIPS 1 6TB 1EX1786 Sandisk Cloudspeed Ultra Gen II w 3 5 in to 2 5 in drive carrier SSD SATA 6Gb s RI 1 8DW D SE 1 6TB 1EX1319 Western Digital Ultrastar SS530 w 3 5 in to 2 5 in drive carrier SSD SAS 12Gb s RI 3DW D SE 1 6TB 1EX2024 Western Digital Ultrastar SS530 w 3 5 in to 2 5 in drive carrier SSD SAS 12Gb s RI 3DW D ...

Page 42: ...n to 2 5 in drive carrier SSD SAS 12Gb s RI 3DW D SE 3 2TB 1EX1306 Western Digital Ultrastar SS530 w 3 5 in to 2 5 in drive carrier SSD SAS 12Gb s RI 3DW D SE 3 2TB 1EX2026 Western Digital Ultrastar SS530 w 3 5 in to 2 5 in drive carrier SSD SAS 12Gb s RI 3DW D ISE 3 2TB 1EX2027 Western Digital Ultrastar SS530 w 3 5 in to 2 5 in drive carrier SSD SAS 12Gb s RI 3DW D TCG 3 2TB 1EX2090 Western Digit...

Page 43: ...rn Digital Ultrastar SS530 w 3 5 in to 2 5 in drive carrier SSD SAS 12Gb s RI 3DW D TCG 6 4TB 1EX2091 Western Digital Ultrastar SS200 w 3 5 in to 2 5 in drive carrier SSD SAS 12Gb s RI 1DW D SE 7 68TB 1EX0580 Western Digital Ultrastar SS530 w 3 5 in to 2 5 in drive carrier SSD SAS 12Gb s RI 1DW D SE 7 68TB 1EX2038 Western Digital Ultrastar SS530 w 3 5 in to 2 5 in drive carrier SSD SAS 12Gb s RI 1...

Page 44: ...astar Data60 through the in band SAS connections using SG3_utils software and out of band using a REST interface over HTTPS to access Western Digital s implementation of the DMTF Redfish API In This Chapter Firmware Features Overview 35 Supported Operating Systems 36 OOBM Management Overview 36 SCSI Enclosure Services Page 02 36 34 ...

Page 45: ...l i e the SEP will send SCSI status only when the requested operation has completed or to notify the host that the requested operation cannot be performed Typical SES control operations include Requesting LED flash patterns Recording predicted or known component failures Requesting power cycle of one or more drives Perform a code download All firmware in programmable components in the storage subs...

Page 46: ...ems OS Support 2012 R2 x64 Server 2016 R1 x64 Server Microsoft Windows 2019 R1 x64 Server 7 2 x86_64 Kernel 3 10 0 327 7 3 x86_64 Kernel 3 10 0 514 7 4 x86_64 Kernel 3 10 0 693 CentOS RedHat Enterprise Linux RHEL 7 6 x86_64 14 04 Kernel 3 13 Ubuntu Server 16 04 Kernel 4 4 8 10 Debian 9 6 2 3 OOBM Management Overview The Ultrastar Data60 uses an implementation of DMTF Redfish for out of band system...

Page 47: ...User Guide 2 System Management Overview 2 4 SCSI Enclosure Services Page 02 Note Refer to the SES Firmware Management Interface Specification for more information on SES Page 02 37 ...

Page 48: ...hin the Ultrastar Data60 Each section includes specifications descriptions and images that explain the features of each component In This Chapter Chassis Description 39 IOM Description 41 PSU Description 43 Rear Fan Description 44 IOM Fan Description 46 Rails Description 48 CMA Description 51 Drive Assembly Description 54 38 ...

Page 49: ...s such as the PSUs and Other system components are attached to the exterior of the chassis such as the rear fans and rails to provide system cooling andrackmounting capability The chassis also houses the baseboard which is mounted in the bottom of the chassis tub and is the primary data pathway that connects all of the enclosure s system components The chassis has internal backflow preventers to p...

Page 50: ...r 1EX0443 1EX0442 for single IOM chassis replacement Hot Swappable No Weight 20 kg 44 lbs 3 1 2 Chassis Layout Figure 16 Layout Table 26 Exterior Components Number Feature 1 IOM and IOM Fan Bay 2 Drive Bay 3 Chassis Handles 4 Rear Fans Bays 5 PSU Bays 6 IOM A Dual HD Mini SAS Ports x6 40 ...

Page 51: ...t houses the PSU modules Warning The handles on the front of the chassis are not intended to be used to support the weight of the Ultrastar Data60 Lifting the unit by the chassis handles or trying to support the unit on the handles can cause them to fail This can cause serious damage to the unit or serious bodily harm to those handling the unit Always team lift the chassis by gripping the undersid...

Page 52: ...lly at the rear of the enclosure Number per Enclosure 2 Part Number 1EX0430 Hot Swappable Yes FRU or CRU CRU Weight 1 27 kg 2 8 lbs 3 2 2 IOM Layout Figure 18 Layout Table 27 Exterior Components Number Feature 1 IOM Handle 2 Latch Release 3 Internal IO Connector 4 Card Edge Power Receptacle 5 Internal IO Connector 3 2 3 IOM Blank Description 42 ...

Page 53: ...ot It is necessary to have a blank installed in this unused slot in order to ensure the proper airflow dynamics that are within operational parameters designed for the enclosure but has no functional component beyond this feature 3 3 PSU Description Figure 20 Overview Image Ultrastar Data60 contains redundant 1600W Power Supply Units PSU Each PSU requires an input voltage of between 200 240 VAC Th...

Page 54: ...200 240 VAC Connector Type C14 Number per Enclosure 2 Part Number 1EX0434 Hot Swappable Yes FRU or CRU CRU Weight 1 kg 2 2 lbs 3 3 2 PSU Layout Figure 21 Layout Table 28 Exterior Components Number Feature 1 Internal Connector 2 C14 Power Receptacle 3 Latch Release Lever 4 Fan 5 Handle 44 ...

Page 55: ... for the Ultrastar Data60 They are attached to the rear of the chassis in the fan housing by a 6 pin connector and two latches that also provides power and control signals to the modules 3 4 1 Rear Fan Specifications Table 29 Specification Summary Specification Value Number per Enclosure 4 Part Number 1EX0433 Hot Swappable Yes FRU or CRU CRU Weight 318 g 7 lbs 3 4 2 Rear Fan Layout 45 ...

Page 56: ... Guide 3 Component Overviews 3 5 IOM Fan Description Figure 23 Layout 1 2 2 3 Table 30 Exterior Components Number Feature 1 Fan 2 Latch Releases 3 Internal Power and IO Connector 3 5 IOM Fan Description 46 ...

Page 57: ...talled in the central chassis bay and is accessed from the top of the enclosure underneath the lid It is attached to the chassis toolless release mechanism that allows for easy replacement 3 5 1 IOM Fan Specifications Specification Value Number per Enclosure 1 Part Number 1EX0432 Hot Swappable Yes FRU or CRU CRU Weight 181 4 g 4 lbs 3 5 2 IOM Fan Layout 47 ...

Page 58: ...ser Guide 3 Component Overviews 3 6 Rails Description Figure 25 Layout 1 2 3 Front Table 31 Exterior Components Number Feature 1 Latch Mechanism 2 Fan Module 3 Internal Connector 3 6 Rails Description 48 ...

Page 59: ... of the outer rail The outer rails attach to the rack and receive the chassis to support it inside the rack The outer rails attach to vertical rack rails that should be set between 24 32 The toolless design means that an installer can attach these rails to a rack without any tools which simplifies installation Once they are attached they can be secured with the included M5 screws and washers 3 6 1...

Page 60: ... 32 Exterior Components Number Features 1 Lower CMA Connectors 2 Rear Latch Release 3 Rear Rack Mounting Bracket 4 Rear Cover Alignment Bracket 5 Front Rack Mounting Bracket and Latch Release6 6 Inner Rail 7 Upper CMA Connectors 3 6 3 Rear Cover Alignment Bracket Description 50 ...

Page 61: ...rackets are designed to keep the top cover of the chassis in the rack while extending the Ultrastar Data60 out of the rack for servicing The rear cover alignment brackets will attach to the rear vertical rack rails and rest on top of the toolless rail system 3 7 CMA Description Figure 29 Overview Image 51 ...

Page 62: ...as well as the lower PSU power cord The upper arm supports the left hand ports and the upper PSU power cord Each arm is attached to the Ultrastar Data60 by one clip at the elbow and two at the other end The cables are secured to the arms by plastic clips called baskets that can be opened at the top to adjust add or remove cables The arms can also be moved into a service position by unclipping them...

Page 63: ...3 Component Overviews 3 7 CMA Description Figure 30 Layout Table 33 Exterior Components Number Feature 1 Crossbar 2 Rail and Rack Connectors 3 Baskets retains cables 4 Arm 5 Elbow Connector 3 7 3 CMA Cable Tray 53 ...

Page 64: ...m T10 Torx screws two per side Use this cable tray in cases where cables might interfere with the lower U space beneath the chassis 3 8 Drive Assembly Description Figure 32 Overview Image The Drive Assembly is comprised of two parts the storage drive and the drive carrier The carrier attaches to the exterior of the data storage drive and caddies the drive into the enclosure It stabilizes the motio...

Page 65: ...Enclosure up to 60 drives Part Number See the List of Compatible Drives page 19 to find the specific part number required Hot Swappable Yes Weight 68 kg 1 5 lbs 3 8 2 Drive Assembly Layout Figure 33 Layout Table 34 Exterior Components Number Feature 1 Latches 2 Latch Release 3 IO and Power Connectors 4 Drive Carrier 5 Disk Drive 55 ...

Page 66: ... storage medium The carrier operates by utilizing an innovative clamping mechanism The 2 5 drive is seated in the orientation shown the overview image Then the clamp is inserted to apply pressure to the SSD and secure it in place Table 35 SSD Features Number Feature 1 Drive Holder Clamp 2 SSD 3 Carrier Shell 4 Drive Latch Release 3 8 3 1 Operating the 2 5 Drive Carrier Follow these steps to operat...

Page 67: ...s this will allow the clamp to fall from the carrier body and it will have to be reinstalled Figure 36 Clamp Slide clamp shown in blue for visual clarity Step 3 Insert the 2 5 drive into the drive slot so that it is snug into the corner Step 4 Slide the clamp back toward the drive making sure that the two plastic pins on the side of the drive properly install into the drive screwholes If these pin...

Page 68: ...0 enclosure is partially populated with drives The purpose of the drive blank is to maintain proper airflow and cooling of the enclosure and the components within the enclosure For more information on requirements for a partially populated enclosure see Partially Populated Enclosures page 204 When the number of drives that are used in a row is less then the total that are necessary to fill that ro...

Page 69: ...User Guide 3 Component Overviews 3 8 Drive Assembly Description Figure 38 3 5 Drive Blank Overview Image 59 ...

Page 70: ...Replacement Service Window 61 IOM Replacement 61 PSU Replacement 64 Rear Fan Replacement 67 IOM Fan Replacement 70 Drive Assembly Replacement 71 CMA Replacement 76 Rails Replacement 93 Chassis Replacement 122 Special Considerations for Cable Routing 157 60 ...

Page 71: ...w IOM 60s 5 Minutes PSU 60s 5 Minutes Rear Fan 60s 5 Minutes IOM Fan 60s 5 Minutes Drive Assembly 60s 5 Minutes Attention In the case of multiple part failures a failed fan should always be replaced before any other part is replaced Once the enclosure cover is open the failed fan must be removed within a minute The remainder of the replacement of a failed fan should be completed within the 5 minut...

Page 72: ... being replaced Step 3 Uninstall the IOM s a Locate the latch release on the IOM and press it in the direction shown in the following image Figure 40 Unlatching the IOM b Grasp both handles one handle in each hand and lift evenly with both hands to ensure the IOM comes out straight This will prevent any damage to the pins on the internal connectors Figure 41 Removing IOM Step 4 Remove the new IOM ...

Page 73: ...in the direction shown in the following image Figure 42 Unlatching IOM Handles c Align the IOM with the empty slot on the top of the chassis so that the arrow on the IOM latch release is facing toward the side shown in the following image d Slowly lower the IOM into the empty slot while being careful to keep it level Do not to force it Figure 43 Installing the IOM e When the IOM is lowered fully a...

Page 74: ...ls sg_ses dev p 3 Remember to replace the dev field with the appropriate value related to the IOM in slot A b Scan the output for the ESCE element status descriptor If it is critical then there is a firmware mismatch c To fix the firmware mismatch perform an upgrade to the current firmware revision by following the upgrade instructions here Firmware Upgrade page 163 4 3 PSU Replacement Table 38 Re...

Page 75: ...by finding the amber LED lit at the rear of the enclosure Step 3 Detach the retention clip from the PSU cable Figure 46 Cable Retention Mechanism Step 4 Remove the power cable from the faulty PSU Step 5 Uninstall the PSU a Grasp the release lever and the metal handle in a downward pinching motion to release the latching mechanism 65 ...

Page 76: ... Step 7 Install the PSU a Align the PSU in the orientation shown in the following image b Slide the PSU into the slot until it seats fully into the chassis Figure 48 Installing the PSU c Plug the power cable into the receptacle at the back of the PSU d Loop the retention clip on the PSU cables around the cable and pinch it until the clip catches and locks in place 66 ...

Page 77: ...tention clip functions properly in the event the cable is pulled on for some reason Figure 50 Cinching Cable Retention Clip Step 8 Make sure the CMA s is in operational position by folding the arm s in toward the enclosure and attaching the elbow end s to the connector s attached to the rail Verify that all of the cabling is in functional order and does not bind or catch 4 4 Rear Fan Replacement 6...

Page 78: ...rail at the elbow connector by pressing the blue release button Figure 51 Unlatching a CMA Connector b Swing the CMA s away from the enclosure c The arm s should be extended away from the enclosure as shown in the following example Figure 52 CMA s in service position Cables not shown Step 2 To unlatch the rear fan from the fan housing use one hand to press the clip at the top and bottom of the fan...

Page 79: ...placement 4 4 Rear Fan Replacement Figure 53 Uninstalling the Rear Fan Step 3 Install Rear Fan a Orient the rear fan as shown in the following image b Insert the rear fan into the housing as shown in the following image 69 ...

Page 80: ...bind or catch 4 5 IOM Fan Replacement Table 40 Replacement Procedure Info Required Tools of People Required Time Required Replacement Window None 1 60s 5 Minutes Step 1 Grasp both handles at the front of the enclosure and pull with even pressure to extend the chassis out of the rack until it is stopped by the safety latches The safety latches will prevent the enclosure from coming out of the rack ...

Page 81: ...OM fan housing to release the latching mechanism and pull it straight out from the chassis Figure 56 Removing IOM Fan Step 3 Install the IOM Fan a Align the IOM Fan as shown in the following image Figure 57 Installing the IOM Fan b Pinch the latch release mechanism slightly and carefully lower the IOM Fan into the slot Step 4 Push the enclosure back into the rack to ensure proper cooling 71 ...

Page 82: ...stopped by the safety latches The safety latches will prevent the enclosure from coming out of the rack completely and the cover will remain in the rack attached to the rear alignment brackets Figure 58 Chassis Handle Operation Only extend the enclosure out of the rack as far as is needed to reach the drive being replaced Step 2 Locate the faulty Drive Assembly by finding the illuminated amber LED...

Page 83: ...a Find the latch release mechanism on the Drive Assembly being removed b Insert a finger and a thumb into the latch release and pinch to unlatch the Drive Assembly Figure 60 Unlatch Drive Carrier IOM Not Shown c Lift the Drive Assembly free from the enclosure 73 ...

Page 84: ...the new Drive Assembly from its packaging Step 5 Install the Drive Assembly a Ensure that the enclosure has been pulled out of the rack until the rail latches engage b Find the LED pointer on the top of the drive carrier This pointer should point toward the front of the unit as shown in the following image 74 ...

Page 85: ...4 Part Replacement 4 6 Drive Assembly Replacement Figure 62 LED Pointer Orientation c Align the drive with the empty slot that will receive it Lower it into the slot making sure it stays level and does not snag 75 ...

Page 86: ...er brackets Replacing the CMA arm can be done with the enclosure in place in the rack To replace the spacer brackets the enclosure must be removed from the rack For the replacement of a CMA arm alone anything pertaining to the spacer brackets may be skipped Table 42 Replacement Procedure Info Required Tools Required Parts of People Required Time Required 2 Philips Screwdriver Cable Ties for config...

Page 87: ... arm s should be extended away from the enclosure Step 2 Disconnect the Enclosure from power a Locate the redundant PSUs at the rear of the enclosure b Detach the cable retention clip from both power cords Figure 65 Cable Retention Mechanism c Power down the enclosure by disconnecting both power cables one from each PSU Step 3 Disconnect the remaining cables from the enclosure Step 4 Uncable the C...

Page 88: ...om the CMA at a time making sure not to put too much strain on the arm c Repeat these steps to remove the cables from the second arm CMA Lite a Open all of the baskets on the CMA Figure 67 Open Baskets b Remove one cable from the CMA at a time making sure not to put too much strain on the arm 78 ...

Page 89: ...asp both handles at the front of the enclosure and pull with even pressure to extend the chassis out of the rack until it is stopped by the safety latches The safety latches will prevent the enclosure from coming out of the rack completely and the cover will remain in the rack attached to the rear alignment brackets Figure 69 Chassis Handle Operation Step 7 Follow these steps to remove a Drive Ass...

Page 90: ...User Guide 4 Part Replacement 4 7 CMA Replacement Figure 70 Unlatch Drive Carrier IOM Not Shown c Lift the Drive Assembly free from the enclosure Figure 71 Removing Drive Assembly 80 ...

Page 91: ...o support the enclosure once it is free of the rails by having a second person or a lift to support the enclosure b Grasp both handles at the front of the enclosure and pull with even pressure until the enclosure will not extend further Warning The handles on the front of the chassis are not intended to be used to support the weight of the Ultrastar Data60 Lifting the unit by the chassis handles o...

Page 92: ...ng Do not lift the chassis by the Cable Tray while removing the chassis from the rack OR while installing it into a rack This can cause serious damage to the unit or serious bodily harm to those handling the unit Always team lift the chassis by gripping the underside of the unit and never try to lift a chassis that is filled with drives f Slide the chassis forward to free it from the rails Place t...

Page 93: ...cement 4 7 CMA Replacement Figure 74 Captive Screws Removal b Remove the nut plate from the mounting pin on the back of the spacer bracket Figure 75 Rack Spacer Nut Plate Removal c Remove the spacer brackets from the rack 83 ...

Page 94: ...Removal Step 12 CMA Lite Install the new spacer brackets Step 13 Install the chassis into the rails a Extend the bearing plates on the inside of the mid rails until they are fully forward detent has engaged This prevents potential damage due to improper mating of the rails 84 ...

Page 95: ...he chassis are not intended to be used to support the weight of the Ultrastar Data60 Lifting the unit by the chassis handles or trying to support the unit on the handles can cause them to fail This can cause serious damage to the unit or serious bodily harm to those handling the unit Always team lift the chassis by gripping the underside of the unit and never try to lift a chassis that is filled w...

Page 96: ...ed by the safety catch on the rails Push the release lever on the safety latch located on the side of each of the rails and push the enclosure the rest of the way into the rack Figure 79 Safety Latch Release e As the chassis is slid into the rack position one installer at the rear of the rack to ensure that the pegs on the sides of the cover will slide correctly into the rear cover alignment brack...

Page 97: ...osure forward to ensure the arm is operating properly then slide it back into the rack a Repeat these steps to install the upper arm with the elbow facing to the right Step 15 Cable the CMA s a Unlatch the elbow side of the arm s by pressing the blue button labeled push and then swing the arm s open b Gather the SAS power and Ethernet cables for installation Before cabling note the following routi...

Page 98: ...User Guide 4 Part Replacement 4 7 CMA Replacement Figure 81 CMA Cable Routing c Open all of the baskets Figure 82 Open Baskets 88 ...

Page 99: ... 10 total cables follow the recommendations in Special Considerations for Cable Routing page 157 before proceeding Note Each cable must be given enough slack at the connector end to operate smoothly Allow 20 21 in 508 533 4 mm between the connector and the first basket Figure 83 Nominal Cable Length at Connectors h Close all of the baskets i If the Ultrastar Data60 is being installed in a rack and...

Page 100: ...properly Step 18 Secure the chassis top cover to the rack using the captive M5 thumb screws as shown in the following image Use a T15 Torx screwdriver and tighten the screws to 3 38 3 61 Nm 30 32 in lbf Figure 84 Cover Retention Screws Step 19 Now that the chassis is installed test the installation by sliding the enclosure in and out of the rack a minimum of three times If the enclosure binds catc...

Page 101: ...ded to make sure the rail kits are installed properly Step 22 Install the Drive Assembly a Ensure that the enclosure has been pulled out of the rack until the rail latches engage b Find the LED pointer on the top of the drive carrier This pointer should point toward the front of the unit as shown in the following image Figure 86 LED Pointer Orientation 91 ...

Page 102: ...ays level and does not snag Figure 87 Installing a Drive Assembly d Pinch the latch release and carefully press downward to seat the Drive Assembly the rest of the way Step 23 Install each drive in the same way the first was installed Make sure to follow the drive layout in numerical sequence as shown in the following image Figure 88 Drive Layout 92 ...

Page 103: ...g T15 Torx Screwdriver If this chassis will not be installed into a rack for shipping purposes skip this step and move on to the next one Figure 89 Shipping Bracket Screw Locations Step 26 Plug the enclosure power cords into a PDU to power the enclosure Step 27 Double check the power indicators and other LEDs to ensure that the system is booting 4 8 Rails Replacement Table 43 Procedure Info Requir...

Page 104: ...utton Figure 90 Unlatching a CMA Connector b Swing the CMA s away from the enclosure c The arm s should be extended away from the enclosure as shown in the following example Figure 91 CMA s in service position Cables not shown Step 2 Disconnect the Enclosure from power a Locate the redundant PSUs at the rear of the enclosure b Detach the cable retention clip from both power cords 94 ...

Page 105: ...om the rear of the enclosure by pulling don t jerk on the blue tab that is extending outward from the connector This will free the cable from the port Make sure each cable is labeled or label them yourself to ensure that they will be plugged back into the same location Step 4 Unplug the Ethernet cables from the out of band management ports Step 5 Uncable the CMA s a Open all of the basket clips on...

Page 106: ...e the CMA s a Release all of the connectors that attach the CMA s to the enclosure and the rail There are three total connections that need to be released one at the elbow and two at the opposite end b To release a connector press the blue latch release button and pull the connector free Figure 94 Unlatching a CMA Connector Step 7 Complete the previous step for the second CMA 96 ...

Page 107: ...ht of the full system by hand Doing so could cause damage to the system or serious bodily harm Step 8 Grasp both handles at the front of the enclosure and pull with even pressure to extend the chassis out of the rack until it is stopped by the safety latches The safety latches will prevent the enclosure from coming out of the rack completely and the cover will remain in the rack attached to the re...

Page 108: ... mark the drives with the drive slot they were removed from in order to add them to the same slot in the future Store the drives in an ESD safe location until the drives are ready to be installed back into an enclosure Step 11 Release the safety latch on the inner rails on each side of the chassis as shown in the following image Figure 98 Inner Rail Safety Latch Release Step 12 Push the chassis ba...

Page 109: ...ort the enclosure b Grasp both handles at the front of the enclosure and pull with even pressure until the enclosure will not extend further Warning The handles on the front of the chassis are not intended to be used to support the weight of the Ultrastar Data60 Lifting the unit by the chassis handles or trying to support the unit on the handles can cause them to fail This can cause serious damage...

Page 110: ...y the Cable Tray while removing the chassis from the rack OR while installing it into a rack This can cause serious damage to the unit or serious bodily harm to those handling the unit Always team lift the chassis by gripping the underside of the unit and never try to lift a chassis that is filled with drives f Slide the chassis forward to free it from the rails Place the chassis in a safe locatio...

Page 111: ...losure to unlock it from the pegs that secure it to the sidewall and pull it free Step 16 Remove the screws that secure the rack rails to the rack a Uninstall the alignment bracket by removing the screws that secure it to the rack posts using the screw locations in the following image Be careful the alignment bracket will be free once the screws are removed Make sure you have a solid grip on it be...

Page 112: ...s in the rear rack rail c Move to the front of the rack and remove the three screws that hold the rack latch bracket to the front of the rack using a T15 Torx screwdriver Be careful the rack latch bracket will be free once the screws are removed Make sure you have a solid grip on it before removing the final screw 102 ...

Page 113: ...ails Replacement Figure 104 Rack Latch Bracket Installed Step 17 Uninstall the rack rails from the rack a From the front of the rack locate the release clip as shown in the following image Figure 105 Front Rail Release Clip Operation 103 ...

Page 114: ...e the inner rail that is nested inside the rack rails Note There are Right and Left rails and they must be installed as a set Each inner rail will read R for the right or L for the left embossed on the inside Each outer rail will read R Front for the right or L Front for the left Right and Left refer to when you are facing the front of the rack a Start by sliding the inner rail out of the outer ra...

Page 115: ...eyholes don t line up with the pegs flip the rail length wise to see if this will align them Figure 108 Inner Rail Attachment c Slide the inner rail toward the rear of the chassis to lock it in place There will be an audible click and the mounting pegs will cover the front part of the keyhole Figure 109 Slide Inner Rail d Caution When installing the inner rail onto the chassis make sure to only us...

Page 116: ...he rear end of the rack and the release latch is facing the inside of the rack posts as shown in the following image Figure 110 Rear Rail Latch Release Latch c Align the rail on the rack posts at the U height desired for installation The bottom of the rail will be the lower most U of the total 4U height d Pull the rail toward the rack post until the toolless latching mechanism engages the rack The...

Page 117: ...that the rails are aligned properly h Follow these steps for the other outer rail Step 22 Install the rear cover alignment brackets a From the rear of the rack orient the alignment brackets so that the groove that will catch the cover is facing the inside of the rack Figure 112 Alignment Bracket Groove highlighted in red 107 ...

Page 118: ...Torx Screwdriver Add three M5 x 12mm T15 Flat Head Torx screws and three included washers to attach the rear rail the three lower holes to the rack posts as shown in the following image These screws should be tightened to 3 38 3 61 Nm 30 32 in lbf using a Long T15 Torx Screwdriver Figure 113 Screw and Washer Order Caution Be careful to set the screws properly cover alignment bracket and rail to pr...

Page 119: ...brackets so that the screw holes are between the two pins supporting the outer rails as shown in the following image There is a left and a right Use the image below as a guide for how to orient this bracket and mirror it for the other side Notice the increased distance between the top two screw holes and the lower screwholes and the flange being oriented on the outside 109 ...

Page 120: ...er bracket Caution Always install the top cover onto the enclosure before installing the chassis into a rack Not having the top cover installed may damage the alignment brackets Step 24 Install the chassis into the rails a Extend the bearing plates on the inside of the mid rails until they are fully forward detent has engaged This prevents potential damage due to improper mating of the rails 110 ...

Page 121: ...the chassis are not intended to be used to support the weight of the Ultrastar Data60 Lifting the unit by the chassis handles or trying to support the unit on the handles can cause them to fail This can cause serious damage to the unit or serious bodily harm to those handling the unit Always team lift the chassis by gripping the underside of the unit and never try to lift a chassis that is filled ...

Page 122: ...ed by the safety catch on the rails Push the release lever on the safety latch located on the side of each of the rails and push the enclosure the rest of the way into the rack Figure 118 Safety Latch Release e As the chassis is slid into the rack position one installer at the rear of the rack to ensure that the pegs on the sides of the cover will slide correctly into the rear cover alignment brac...

Page 123: ... drives by following the labeling scheme noted earlier If not proceed to the cabling section Step 26 If the chassis is being installed into a rack that will be shipped fully assembled you must install eight four per side of the included M5 x 12mm T15 Flat Head Torx screws into the two brackets at the front of the chassis in the following locations These screws should be tightened to 3 38 3 61 Nm 3...

Page 124: ... rack until the rail latches engage b Find the LED pointer on the top of the drive carrier This pointer should point toward the front of the unit as shown in the following image Figure 121 LED Pointer Orientation c Align the drive with the empty slot that will receive it Lower it into the slot making sure it stays level and does not snag 114 ...

Page 125: ...g the labels or marks that were added earlier Step 29 Install the CMA s Note The CMA has two arms labeled upper and lower The lower arm should have the elbow on the left side and be installed first the upper arm should have the elbow on the right side and be installed last a Orient the CMA so that the elbow is on the left hand side b Attach all three of the connectors to the brackets on the rails ...

Page 126: ...bow side of the arm s by pressing the blue button labeled push and then swing the arm s open b Gather the SAS power and Ethernet cables for installation Before cabling note the following routing patterns for best results Note Route the cables supported by the lower arm to IOM A left hand side looking at the rear Second route the cables supported by the upper arm to IOM B right hand side looking at...

Page 127: ...User Guide 4 Part Replacement 4 8 Rails Replacement Figure 124 CMA Cable Routing c Open all of the baskets Figure 125 Open Baskets 117 ...

Page 128: ...es follow the recommendations in Special Considerations for Cable Routing page 157 before proceeding Note Each cable must be given enough slack at the connector end to operate smoothly Allow 20 21 in 508 533 4 mm between the connector and the first basket Figure 126 Nominal Cable Length at Connectors h Close all of the baskets i If the Ultrastar Data60 is being installed in a rack and will subsequ...

Page 129: ...7 Open Baskets a Connect the Ethernet cable to the Ethernet port on the right hand side of the Ultrastar Data60 and route the cable through each of the baskets on the CMA b Connect the SAS cables and route them through the baskets one at a time Make sure to follow the labels to make sure they are connected to the proper port c Connect the power cable to the upper PSU and route it through each bask...

Page 130: ...ed cable bundle between the ports and the first basket of the CMA Note Each cable must be given enough slack at the connector end to operate smoothly For the upper CMA allow 20 21 508 533 4mm between the end of the connector and the first basket Make sure to route all of the upper CMA cables under the lower CMA cables 120 ...

Page 131: ... on the PSU cables around the cable and pinch it until the clip catches and locks in place Figure 130 Cable Retention Mechanism f Slide the retention clip forward until it stops near the cable connector Doing this will ensure that the retention clip functions properly in the event the cable is pulled on for some reason 121 ...

Page 132: ...e system doesn t bind at all If it does examine the point at which the binding occurred and adjust the seating of cables in the baskets check the connections to the rails and examine the joints of the arm to ensure that they are all functioning properly Step 33 Make sure the CMA s is in operational position by folding the arm s in toward the enclosure and attaching the elbow end s to the connector...

Page 133: ... x 8mm T10 Torx screws Step 1 Place the CMA s into service position a Unlatch the CMA s from the rail at the elbow connector by pressing the blue release button Figure 132 Unlatching a CMA Connector b Swing the CMA s away from the enclosure c The arm s should be extended away from the enclosure as shown in the following example Figure 133 CMA s in service position Cables not shown Step 2 Disconnec...

Page 134: ...from each PSU Step 3 Disconnect the HD Mini SAS cables from the rear of the enclosure by pulling don t jerk on the blue tab that is extending outward from the connector This will free the cable from the port Make sure each cable is labeled or label them yourself to ensure that they will be plugged back into the same location Step 4 Unplug the Ethernet cables from the out of band management ports S...

Page 135: ...e and the rail There are three total connections that need to be released one at the elbow and two at the opposite end b To release a connector press the blue latch release button and pull the connector free Figure 136 Unlatching a CMA Connector Step 7 Complete the previous step for the second CMA Step 8 Uninstall the crossbar from the CMA mounting bracket a Locate the crossbar thumbscrew that sec...

Page 136: ...the crossbar away from the enclosure Figure 138 Crossbar Swinging Out c Once the crossbar is straight it should easily come free from the mounting bracket Step 9 Uninstall the PSU a Grasp the release lever and the metal handle in a downward pinching motion to release the latching mechanism 126 ...

Page 137: ...ment Figure 139 Uninstalling PSU b Pull the PSU straight out with even pressure Step 10 To unlatch the rear fan from the fan housing use one hand to press the clip at the top and bottom of the fan and pull to free it from the chassis and remove it 127 ...

Page 138: ...handles at the front of the enclosure and pull with even pressure to extend the chassis out of the rack until it is stopped by the safety latches The safety latches will prevent the enclosure from coming out of the rack completely and the cover will remain in the rack attached to the rear alignment brackets 128 ...

Page 139: ...as they are removed so they can be reinstalled in the same location in the new chassis Step 13 Follow these steps to remove a Drive Assembly a Find the latch release mechanism on the Drive Assembly being removed b Insert a finger and a thumb into the latch release and pinch to unlatch the Drive Assembly Figure 142 Unlatch Drive Carrier IOM Not Shown c Lift the Drive Assembly free from the enclosur...

Page 140: ...slot in the future Store the drives in an ESD safe location until the drives are ready to be installed back into an enclosure Step 15 Uninstall the IOM s a Locate the latch release on the IOM and press it in the direction shown in the following image Figure 144 Unlatching the IOM b Grasp both handles one handle in each hand and lift evenly with both hands to ensure the IOM comes out straight This ...

Page 141: ...th one hand grasp around the center square of the fan housing as shown in the following image b Pinch the IOM fan housing to release the latching mechanism and pull it straight out from the chassis Figure 146 Removing IOM Fan Step 18 Release the safety latch on the inner rails on each side of the chassis as shown in the following image 131 ...

Page 142: ...oth handles at the front of the enclosure and pull with even pressure to extend the chassis out of the rack until it is stopped by the safety latches Make sure that the top cover comes with the chassis as it is extended out of the rack The safety latches will prevent the enclosure from coming out of the rack completely Step 22 Remove the chassis from the rack a Be prepared to support the enclosure...

Page 143: ... push the chassis very slightly forward The chassis is now unsecured from the rack e Ensure that you have the proper support mechanism to hold the chassis in position whether that be a team lifting partner or an appropriate lift Warning Do not lift the chassis by the Cable Tray while removing the chassis from the rack OR while installing it into a rack This can cause serious damage to the unit or ...

Page 144: ...er rail Figure 151 Inner Rail Spring Latch c Slide the inner rail toward the front of the enclosure to unlock it from the pegs that secure it to the sidewall and pull it free Note Follow the next step if the cable tray was installed Step 24 Uninstall the Cable Tray by removing the M3 x 8mm screws using the long T10 Torx head screwdriver 134 ...

Page 145: ...n all the way Step 26 Install the inner rail onto the chassis making sure they are installed on the correct side Each inner rail will read R for the right or L for the left embossed on the side that faces away from the chassis Right and Left are with reference to looking at the front of the enclosure a Orient the inner rails so that the flat side is facing the enclosure and the side with the groov...

Page 146: ...with the CMA These screws should be tightened to 90 1 12 Nm 8 10 in lbf using a 2 Philips Screwdriver These screws are specially designed for this purpose Using unapproved screws could cause damage to the slides inside the rail Install the two special low profile M4 x 3 2mm Philips screws provided to secure the inner rail to the chassis e Follow these steps for the second inner rail on the opposit...

Page 147: ...k so that they are protruding from the front of the rack and the safety latches engage Figure 156 Extend Mid Rails Step 29 Install the chassis into the rails a Extend the bearing plates on the inside of the mid rails until they are fully forward detent has engaged This prevents potential damage due to improper mating of the rails 137 ...

Page 148: ... the chassis are not intended to be used to support the weight of the Ultrastar Data60 Lifting the unit by the chassis handles or trying to support the unit on the handles can cause them to fail This can cause serious damage to the unit or serious bodily harm to those handling the unit Always team lift the chassis by gripping the underside of the unit and never try to lift a chassis that is filled...

Page 149: ...ped by the safety catch on the rails Push the release lever on the safety latch located on the side of each of the rails and push the enclosure the rest of the way into the rack Figure 159 Safety Latch Release e As the chassis is slid into the rack position one installer at the rear of the rack to ensure that the pegs on the sides of the cover will slide correctly into the rear cover alignment bra...

Page 150: ...mes If the enclosure binds catches or displays any incorrect motion or behavior repeat the installation Note Adjustments of the vertical rack rails may be required to fix any issues that may occur Step 32 Install the CMA s Note The CMA has two arms labeled upper and lower The lower arm should have the elbow on the left side and be installed first the upper arm should have the elbow on the right si...

Page 151: ...s The safety latches will prevent the enclosure from coming out of the rack completely and the cover will remain in the rack attached to the rear alignment brackets Figure 162 Chassis Handle Operation Step 34 Install the IOM a Caution If a pin on the IOM s internal connectors is bent or damaged the IOM will have to be replaced For this reason it is imperative that the IOM is not forced into positi...

Page 152: ... it Figure 164 Installing the IOM e When the IOM is lowered fully apply light pressure with both hands evenly on the IOM body not the handles to seat the IOM in the connector If the IOM won t seat correctly DO NOT FORCE IT Instead back the IOM out check the pins to make sure none are damaged and try again f Once the IOM is seated properly in the slot close the handles until they latch closed Step ...

Page 153: ...slightly and carefully lower the IOM Fan into the slot Step 37 Install the Drive Assembly a Ensure that the enclosure has been pulled out of the rack until the rail latches engage b Find the LED pointer on the top of the drive carrier This pointer should point toward the front of the unit as shown in the following image 143 ...

Page 154: ...e 4 Part Replacement 4 9 Chassis Replacement Figure 166 LED Pointer Orientation c Align the drive with the empty slot that will receive it Lower it into the slot making sure it stays level and does not snag 144 ...

Page 155: ...t were added earlier Step 39 If the chassis is being installed into a rack that will be shipped fully assembled you must install eight four per side of the included M5 x 12mm T15 Flat Head Torx screws into the two brackets at the front of the chassis in the following locations These screws should be tightened to 3 38 3 61 Nm 30 32 in lbf using a Long T15 Torx Screwdriver If this chassis will not b...

Page 156: ...PSU in the orientation shown in the following image b Slide the PSU into the slot until it seats fully into the chassis Figure 169 Installing the PSU c Plug the power cable into the receptacle at the back of the PSU d Loop the retention clip on the PSU cables around the cable and pinch it until the clip catches and locks in place 146 ...

Page 157: ...e connector Doing this will ensure that the retention clip functions properly in the event the cable is pulled on for some reason Figure 171 Cinching Cable Retention Clip Step 41 Install the second PSU Step 42 Install Rear Fan a Orient the rear fan as shown in the following image b Insert the rear fan into the housing as shown in the following image 147 ...

Page 158: ...te The CMA has two arms labeled upper and lower The lower arm should have the elbow on the left side and be installed first the upper arm should have the elbow on the right side and be installed last a Orient the CMA so that the elbow is on the left hand side b Attach all three of the connectors to the brackets on the rails There should be one at the elbow side and two at the other end 148 ...

Page 159: ...ck into the rack a Repeat these steps to install the upper arm with the elbow facing to the right Step 45 Install the crossbar onto the CMA mounting bracket a Align the crossbar with the mounting peg facing down and pointing toward the CMA mounting bracket Figure 174 Initial Alignment b Insert the peg on the underside of the crossbar into the slot on the CMA mounting bracket 149 ...

Page 160: ...bar so that the thumbscrew lines up with the mounting hole on the opposite side of the enclosure Figure 176 Swinging Motion of Crossbar to Locking Position d Press the crossbar against the CMA mounting bracket and secure the crossbar in place by pressing and turning the thumbscrew clockwise until snug 150 ...

Page 161: ...g the blue button labeled push and then swing the arm s open b Gather the SAS power and Ethernet cables for installation Before cabling note the following routing patterns for best results Note Route the cables supported by the lower arm to IOM A left hand side looking at the rear Second route the cables supported by the upper arm to IOM B right hand side looking at the rear in a criss cross patte...

Page 162: ...User Guide 4 Part Replacement 4 9 Chassis Replacement Figure 178 CMA Cable Routing c Open all of the baskets Figure 179 Open Baskets 152 ...

Page 163: ...les follow the recommendations in Special Considerations for Cable Routing page 157 before proceeding Note Each cable must be given enough slack at the connector end to operate smoothly Allow 20 21 in 508 533 4 mm between the connector and the first basket Figure 180 Nominal Cable Length at Connectors h Close all of the baskets i If the Ultrastar Data60 is being installed in a rack and will subseq...

Page 164: ...81 Open Baskets a Connect the Ethernet cable to the Ethernet port on the right hand side of the Ultrastar Data60 and route the cable through each of the baskets on the CMA b Connect the SAS cables and route them through the baskets one at a time Make sure to follow the labels to make sure they are connected to the proper port c Connect the power cable to the upper PSU and route it through each bas...

Page 165: ...led cable bundle between the ports and the first basket of the CMA Note Each cable must be given enough slack at the connector end to operate smoothly For the upper CMA allow 20 21 508 533 4mm between the end of the connector and the first basket Make sure to route all of the upper CMA cables under the lower CMA cables 155 ...

Page 166: ...p on the PSU cables around the cable and pinch it until the clip catches and locks in place Figure 184 Cable Retention Mechanism f Slide the retention clip forward until it stops near the cable connector Doing this will ensure that the retention clip functions properly in the event the cable is pulled on for some reason 156 ...

Page 167: ...t does examine the point at which the binding occurred and adjust the seating of cables in the baskets check the connections to the rails and examine the joints of the arm to ensure that they are all functioning properly Step 49 Make sure the CMA s is in operational position by folding the arm s in toward the enclosure and attaching the elbow end s to the connector s attached to the rail Verify th...

Page 168: ... side of the CMA should crisscross in front of the IOMs To accomplish this the cables connected to the ports for IOM B right hand side when facing the rear should be connected to the upper CMA and the cables connected to the ports for IOM A left hand side when facing the rear should be connected to the lower CMA Figure 187 Crisscross Cables 158 ...

Page 169: ...nt smooth operation To ensure there is enough slack at the elbow pull the enclosure in and out of the rack and have another installer check for binding in the elbow joint Make sure the cables are bending and not twisting Figure 188 CMA Elbow with Full Cable Bundle At the end of the CMA where the cables exit use a cable tie to bundle the cables together Make sure the cables are bending and not twis...

Page 170: ...o and the CMA cage must be set at to avoid binding or snagging Note The measurement provided in this section are only suggested values based on product testing Your specific situation may vary Adjust the measurement as necessary to avoid cable binding or sagging below the rear of the enclosure 1 Identify the configuration that is needed for the particular setup and locate the Service Loop Dimensio...

Page 171: ...11 2 1 SFP and HD Mini SAS Cable Configuration This configuration includes the use of up to four SFP and two HD Mini SAS cables installed into a CMA arm Figure 191 Service Loop Dimension Figure Table 46 Service Loop Dimension Table A B C 6in 12in 16in 161 ...

Page 172: ...estern Digital System Management In This Chapter Firmware Upgrade 163 Configuring OOBM Network Settings 179 Zoning 181 Subenclosure Nickname 202 Partially Populated Enclosures 204 Daisy Chaining 210 162 ...

Page 173: ...st one path to each drive is available during the reset of the IOM that is being upgraded SATA Configuration If the enclosure contains SATA drives the enclosure firmware should not be upgraded while online This is due to the SATA configuration having no redundancy with only a single IOM the second slot contains an IOM Blank When the IOM is rebooted the single path to the drives to service I O will...

Page 174: ...product a From the Identify Product section select the Product Operating System Type and Release Version Figure 193 Identify Product section b From the Select Files for Download section expand the Firmware section and select the check box for the firmware file s Figure 194 Select Files for Download section c From the Review Download Files section review the selected files and click DOWNLOAD FILES ...

Page 175: ...n the Ultrastar Data60 will be referred to as an IOM Note To perform an online firmware upgrade the Ultrastar Data60 must be configured with redundant data paths meaning both IOMs must have a SAS Port populated and connected to the host server SAS Configurations The server host must be configured with multi pathing software that can handle the nature of the firmware upgrade i e Once firmware is do...

Page 176: ...e Ultrastar Data60 to a host that does expose the Enclosure Services Processor so that the upgrade may be performed Attention Beginning with firmware version 2000 073 the user may upgrade in band via sg_ses_microcode without the requirement of having Ethernet interfaces actively configured with DHCP Please proceed to the upgrade procedure Step 3 The following upgrade preparation steps apply only t...

Page 177: ...subenclosure id 0 ti 5 Overall descriptor empty Element 0 descriptor ESCE IOMA IOM PART NUM IOM SERIAL NUM 5000CCAB0500003C XXX XXX XXX XXX Element 1 descriptor ESCE IOMB IOM PART NUM IOM SERIAL NUM 5000CCAB0500007C XXX XXX XXX XXX 5 1 3 Linux Upgrade to New Firmware To download the new firmware package do the following Step 1 Ensure multi pathing can see all of the expected drives a Execute the f...

Page 178: ... device p0xe The first time this command is issued the output may be inaccurate please ignore and issue the command again The string to observe for download microcode status is Complete no error start after hard reset or power cycle 0x11 before proceeding to the activate step Example output sg_ses dev p 0xe HGST H4060 J 2040 Download microcode status diagnostic page number of secondary subenclosur...

Page 179: ... firmware using sg_ses_microcode a Issue the following command sg_ses_microcode dev m 0xe N b 4096 I filename vv Step 4 Press Enter The firmware begins loading onto the IOMs The upgrade can take up to 20 minutes to complete Important Due to the firmware image being a tar gz file the enclosure has to unpack and load the firmware onto the respective ICs which may take up to 15 minutes Once the sg_se...

Page 180: ...nd to activate IOM A sg_ses dev p4 c d 02 00 01 00 Note Activate only one IOM at a time to ensure there is always at least one path to the drives The user will need to issue a reset to each IOM to activate the firmware using an sg_ses command to ensure this occurs properly Step 6 Ensure multi pathing can see all of the expected drives after activating IOM A a Execute the following command to verif...

Page 181: ...nce firmware is downloaded to the IOMs each IOM will reset and boot the new code in a staggered fashion such that the host always has at least one path to the drives to service I O SATA Configurations A SATA configuration should not be considered for an online upgrade due to the single path nature of the topology Figure 199 Multipathing Configuration Minimum Requirement Step 3 Log on to the Window...

Page 182: ...nts indicated by the XXX XXX XXX XXX in the results as shown in the following example Element type Enclosure services controller electronics subenclosure id 0 ti 5 Overall descriptor empty Element 0 descriptor ESCE IOMA IOM PART NUM IOM SERIAL NUM 5000CCAB0500003C XXX XXX XXX XXX Element 1 descriptor ESCE IOMB IOM PART NUM IOM SERIAL NUM 5000CCAB0500007C XXX XXX XXX XXX 5 1 6 Windows Upgrade to Ne...

Page 183: ...equest to the following target curl G k u admin admin H Content type application json https ip address redfish v1 UpdateService Actions UpdateService SimpleUpdate Status Note Execute the command until you see the following result ErrorCode 0 StatusCode 2 Description FW update completed Waiting for activation EstimatedRemainingMinutes 0 Attention If the OOBM is not being used query Page Eh by execu...

Page 184: ...eral times to ensure that all paths are in an optimal state following the reset of IOM A c Verify that the output from the mpclaim_output txt output appears similar to the following example 0000000077010524 Active Optimized 001 005 036 000 0 Adapter Avago Adapter SAS3 3008 Fury StorPo B D F 134 000 000 Controller 46616B65436F6E74726F6C6C6572 State Active 0000000077000431 Active Optimized 000 004 0...

Page 185: ...age Eh by executing the following command sg_ses device p0xe Step 3 Press Enter The firmware begins loading onto the IOMs The upgrade can take up to 20 minutes to complete Important Due to the firmware image being a tar gz file the enclosure has to unpack and load the firmware onto the respective ICs which may take up to 15 minutes Once the sg_ses_microcode command is issued wait 20 minutes to ens...

Page 186: ... IOM at a time to ensure there is always at least one path to the drives to service I O while an IOM is being reset The user will need to issue a reset command to each IOM to activate the firmware using an sg_ses command to ensure this occurs properly Step 5 Ensure Windows MPIO can see all paths to the drives after activating IOM A a Execute the following command C mpclaim exe v C Users Administra...

Page 187: ...vating IOM B a Execute the following command C mpclaim exe v C Desktop mpclaim_output txt b Verify there are two paths to each drive by issuing the following command C more C Users Administrator Desktop mpclaim_output txt Note It could take the OS several minutes to rebuild all the paths to the drives depending on the workload on the drives and how busy the host is Multipathing may have to be veri...

Page 188: ...in a location that is accessible to the Ultrastar Data60 Step 3 Make a POST call to the UpdateService object using the SimpleUpdate action POST redfish v1 UpdateService Actions UpdateService SimpleUpdate HTTP 1 1 Content Type application json charset utf 8 Content Length computed length OData Version 4 0 Authorization Basic userid password a In the body of the POST list the ImageURI as the data pa...

Page 189: ...ftp IP address HGST_Ultrastar DATA60 DATA102 Server60 8_SEP_bundle_2042 001_2 4 4 tar gz Windows Example ImageURI https https IP address HGST_Ultrastar DATA60 DATA102 Server60 8_SEP_bundle_2042 001_2 4 4 tar gz For a non automatic activation send the POST request to the UpdateService object using the FWActivate command Note This command will perform a rolling reset of the IOMs curl X POST k u admi...

Page 190: ...ion on IOM A to static sg_wr_mode dev sg3 dbd page 0x23 0x01 contents e3 01 00 1A 01 00 00 00 00 00 00 00 C0 A8 00 0A FF FF FF 00 C0 A8 00 01 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 Device dev sg3 IOM 01 IOM A Setting 00 static IP Address 192 168 0 10 Netmask 255 255 255 0 Gateway 192 168 0 1 To change the OOBM network configuration on IOM B to static sg_wr_mode dev sg3 dbd page 0x23 0x01 ...

Page 191: ... IOM B Gateway IOM 03 IOMA IOMB IOM A Setting 00 static or 01 DHCP IOM A IPaddr The IP address in four pairs of two digit hex codes IOM A Netmask The netmask in four pairs of two digit hex codes IOM A Gateway The gateway in four pairs of two digit hex codes IOM B Setting 00 static or 01 DHCP IOM B IPaddr The IP address in four pairs of two digit hex codes IOM B Netmask The netmask in four pairs of...

Page 192: ... group This section displays the necessary information related to each of the predefined zoning configurations Configuration 0 Configuration 0 allows all hosts to view all drive slots and the devices that are populated in those drive slots In this Configuration all of the drives belong to the same zone group as shown in the image below represented by one color Each of the SAS ports on the rear IO ...

Page 193: ...ill be part of that zone group but it will not display any results in enclosure management until the drive slot has been populated In this Configuration the enclosure is divided into six zone groups as shown in the image below represented by six different colors Each zone group matches to a single SAS port on each side of the rear IOM to allow for the connections to six different hosts In band man...

Page 194: ...o the enclosure using SAS cables in the Configuration listed in the table below The left side of the table displays the host connection and the right side displays the enclosure IOM SAS port connection Table 47 SAS Cable connections for Configuration 1 Host connection SAS Port Enclosure IOM connection SAS Port Host 1 A1 Host 1 B1 Host 2 A2 Host 2 B2 Host 3 A3 Host 3 B3 Host 4 A4 Host 4 B4 Host 5 A...

Page 195: ...re management until the drive slot has been populated In this Configuration the enclosure is divided into three zone groups as shown in the image below represented by three different colors Each zone group matches to a pair of SAS ports on each side of the rear IOM to allow for the connections to three different hosts In band management Configuration 2 can be initiated in the sg_senddiag command i...

Page 196: ...to view up to 30 drives that are mapped to both IOMs Each zone group will display all of the devices that are contained within that zone If a drive slot is not populated it will still be part of that zone group but it will not display any results in enclosure management until the drive slot has been populated In this Configuration the enclosure is divided into two zone groups as shown in the image...

Page 197: ...o the enclosure using SAS cables in the Configuration listed in the table below The left side of the table displays the host connection and the right side displays the enclosure IOM SAS port connection Table 49 SAS Cable connections for Configuration 3 Host connection SAS Port Enclosure IOM connection SAS Port Host 1 A1 Host 1 A2 Host 1 A3 Host 1 B1 Host 1 B2 Host 1 B3 Host 2 A4 Host 2 A5 Host 2 A...

Page 198: ...that performs a SCSI send diagnostic command a is the sg device Linux or SCSI device Windows that is assigned by the SEP The information collected for the device will be input in any location that requests dev There will be one sg or SCSI device handle for each of the two IOMs pf Page Format pf is a bit and in this case is clear due to the lack of a list option raw raw reads the sequence of bytes ...

Page 199: ...pdev 0xd dev sg106 scsi9 channel 0 id 196 lun 0 HGST H460 J 0101 rmb 0 cmdq 1 pqual 0 pdev 0xd c Record the sg device numbers for use in a later step Step 2 Identify the IOM SAS Address for both IOMs sg_ses page 7h a Issue the following command sg_ses dev p7 grep i esce b Identify the IOM SAS address for both IOMs from the output Each address appears before the IP Address as bolded in the example ...

Page 200: ...ith IOM A b Enable Zoning 61 c Zoning Configuration configuration 01 02 or 03 Note For information on preconfigured zoning configurations see Predefined Zoning Configurations page 182 d IOM SAS Address SAS Address associated with IOM A Note A comma should be placed after each bit of data in the IOM SAS Address that was recorded For example if the IOM SAS Address output was 5000CCAB0300003C the add...

Page 201: ...s 0x00 DRIVER_OK Step 6 Enable zoning on IOM B using the sg_senddiag command a Issue the command for IOM B that was built in the previous step b Enabling a predefined zoning configuration will reset the SAS connector ports which may cause the sg_senddiag command to return a status of DID_TIME_OUT or DID_SOFT_ERROR Despite the error the zoning configuration will be enabled The zoning configuration ...

Page 202: ... as inaccessible because the host is displaying the only devices it has access to The step can be repeated on other hosts to see what zone group each host has access to d Issue the following command to access all hosts smp_discover_list smp_discover_list ignore dev bsg expander 9 39 e Zone group 9 10 11 12 13 and 14 can be identified by the ZG located at the end of each group in each of their resp...

Page 203: ...0003c Target port designator type NAA code set Binary transport Serial Attached SCSI Protocol SPL 4 0x5000ccab0300003c designator type Relative target port code set Binary transport Serial Attached SCSI Protocol SPL 4 Relative target port 0x1 Target device that contains addressed lu designator type NAA code set Binary transport Serial Attached SCSI Protocol SPL 4 0x5000ccab0300003c Step 4 Build th...

Page 204: ...s SAS Address associated with IOM B Note A comma should be placed after each bit of data in the IOM SAS Address that was recorded For example if the IOM SAS Address output was 5000CCAB0300007C the address that should be added to the sg_senddiag command should be 50 00 CC AB 03 00 00 7C c The following are examples of completed sg_senddiag commands for IOM A and B IOM A sg_senddiag dev pf raw 04 00...

Page 205: ...nd_device 9 41 22 end_device 9 44 0 end_device 9 44 5 9 0 1294 0 9 0 1375 0 9 0 1387 0 end_device 9 41 23 end_device 9 44 1 end_device 9 44 6 9 0 1295 0 9 0 1376 0 9 0 1388 0 end_device 9 41 24 end_device 9 44 10 end_device 9 44 7 9 0 1296 0 9 0 1377 0 9 0 1389 0 end_device 9 41 25 end_device 9 44 11 end_device 9 44 8 b Issue the following command to access a single host s SMP Discover output smp_...

Page 206: ...vice that is linked to each IOM using sg_vpd page 83h a Issue the following command sg_vpd dev p0x83 b Identify and match the IOM SAS address and sg device for both IOMs from the output Each address appears bolded in the example below Addressed logical unit designator type NAA code set Binary 0x5000ccab0300003c Target port designator type NAA code set Binary transport Serial Attached SCSI Protocol...

Page 207: ...tion recorded in previous steps sg_senddiag Command sg_senddiag a pf raw 04 00 00 90 b c 00 00 d a SCSI device dev device associated with IOM B b Enable Zoning 61 c Zoning Configuration configuration 01 02 or 03 Note For information on preconfigured zoning configurations see Predefined Zoning Configurations page 182 d IOM SAS Address SAS Address associated with IOM B Note A comma should be placed ...

Page 208: ...Example of the Expander Handles 0 2 0 0 9 0 1297 0 9 0 1378 0 9 0 1390 0 end_device 9 41 26 end_device 9 44 12 end_device 9 44 9 10 0 0 0 9 0 1298 0 9 0 1379 0 9 0 1391 0 end_device 9 41 27 end_device 9 44 13 expander 9 39 7 0 0 0 9 0 1299 0 9 0 1380 0 end_device 9 39 2 end_device 9 41 28 end_device 9 44 14 expander 9 40 9 0 1220 0 9 0 1300 0 9 0 1381 0 end_device 9 41 17 end_device 9 41 29 end_de...

Page 209: ... the SCSI devices that are associated with the Ultrastar Data60 IOMs Note The operating system associates each SEP device as a SCSI device The SCSI device of the SEP can be used to get status from or control elements within the enclosure a Issue the following command sg_scan s findstr i H4060 J b Identify the SCSI devices from the output The device information follows SCSI0 The devices appear as S...

Page 210: ...nd shown in the image above to complete the specific sg_senddiag command for IOM A Replace letters a through d with the information recorded in previous steps sg_senddiag Command sg_senddiag a pf raw 04 00 00 90 b c 00 00 d a SCSI device dev device associated with IOM A b Disable Zoning 60 c Zoning Configuration configuration 00 Note For information on preconfigured zoning configurations see Prede...

Page 211: ...oning configuration will reset the SAS connector ports which may cause the sg_senddiag command to return a status of DID_TIME_OUT or DID_SOFT_ERROR Despite the error the zoning configuration will be enabled The zoning configuration can be verified after both IOMs have been zoned send diagnostic transport Host_status 0x03 DID_TIME_OUT Driver_status 0x00 DRIVER_OK Step 6 Disable zoning on IOM B usin...

Page 212: ... 9 0 1386 0 end_device 9 41 22 end_device 9 44 0 end_device 9 44 5 9 0 1294 0 9 0 1375 0 9 0 1387 0 end_device 9 41 23 end_device 9 44 1 end_device 9 44 6 9 0 1295 0 9 0 1376 0 9 0 1388 0 end_device 9 41 24 end_device 9 44 10 end_device 9 44 7 9 0 1296 0 9 0 1377 0 9 0 1389 0 end_device 9 41 25 end_device 9 44 11 end_device 9 44 8 b Issue the following command to access a single host s SMP Discove...

Page 213: ...ic Pages sdp 0x0 Configuration SES cf 0x1 Enclosure Status Control SES ec es 0x2 Help Text SES ht 0x3 String In Out SES str 0x4 Threshold In Out SES th 0x5 Element Descriptor SES ed 0x7 Additional Element Status SES 2 aes 0xa Download Microcode SES 2 dm 0xe Subenclosure Nickname SES 2 snic 0xf unknown 0x10 unknown 0x17 If supported the Subenclosure Nickname page will be included as one of the Supp...

Page 214: ...ame status 0x0 nickname additional status 0x0 nickname language code nickname nickname Clear the Nickname Step 5 If needed use the sg_ses device p0xf c nickname command to clear the subenclosure s nickname set it to an empty string sg_ses device p0xf c nickname manufacturer regulatorymodel firmwareversion No errors If the command was successful No errors will be returned Step 6 Repeat the sg_ses d...

Page 215: ...sues The following section details the requirements for HDD and HDD SSD based configurations Minimum HDD Partial Population The enclosure supports a minimum of 24 SAS or SATA HDDs for a partially populated enclosure The enclosure does not support a mix of SAS and SATA drives The enclosure must be populated starting with the drives closest to the rear of the enclosure and work towards the front of ...

Page 216: ...ing completed with drive blanks The enclosure does not support a mix of SAS and SATA drives The image below details the minimum required configuration for an HDD and SSD configuration Note When installing SSDs for this configuration the preinstalled HDDs will have to be moved one entire row to the next vacant row near the front of the enclosure Figure 206 Minimum HDD and Minimum SSD Partial Popula...

Page 217: ...onfiguration The enclosure does not support a mix of SAS and SATA drives The image below details the required configuration for minimum HDD and maximum SSD configuration Note When installing SSDs for this configuration the preinstalled HDDs will have to be moved two entire rows to the next vacant pair of rows near the front of the enclosure Figure 207 Minimum HDD and Maximum SSD Partial Population...

Page 218: ...topped by the safety latches The safety latches will prevent the enclosure from coming out of the rack completely and the cover will remain in the rack attached to the rear alignment brackets Figure 208 Chassis Handle Operation Step 2 Locate the area that the new drives will be installed into When adding SSDs the drives slots may already contain a drive The drive will have to be removed and reloca...

Page 219: ...stem Management 5 5 Partially Populated Enclosures Figure 209 LED Pointer Orientation c Align the drive with the empty slot that will receive it Lower it into the slot making sure it stays level and does not snag 209 ...

Page 220: ...latch release and carefully press downward to seat the Drive Assembly the rest of the way Step 5 Install each drive in the same way the first was installed Make sure to follow the drive layout shown in the following image Figure 211 Drive Layout Step 6 Push the enclosure back into the rack to ensure proper cooling 210 ...

Page 221: ...s The following diagram identifies the host host ports IOM configuration and IO SAS connections Figure 212 Daisy Chaining Key The following section identifies the different host configurations for daisy chaining muliple enclosures with either one or two hosts One Host Configurations The following diagram is an example of how the enclosures will be connected via the IO SAS ports and what number eac...

Page 222: ...is section provides the information required to connect two or more enclosures to a single host via SAS connections Choose the cable map that fits the preferred daisy chaining requirement Two Enclosures One Host with a Single HBA Source Device Destination Device Host1 P1 Enclosure1 IOMA A6 Host1 P2 Enclosure2 IOMB B1 Enclosure1 IOMA A4 Enclosure2 IOMA A1 Enclosure1 IOMB B3 Enclosure2 IOMB B6 212 ...

Page 223: ...IOMA A6 Host1 P4 Enclosure1 IOMB B1 Enclosure1 IOMA A1 Enclosure2 IOMA A2 Enclosure1 IOMB B6 Enclosure2 IOMB B5 Three Enclosures One Host with a Single HBA Source Device Destination Device Host1 P1 Enclosure1 IOMA A6 Host1 P2 Enclosure3 IOMB B1 Enclosure1 IOMA A3 Enclosure2 IOMA A1 Enclosure1 IOMB B3 Enclosure2 IOMB B6 Enclosure2 IOMA A3 Enclosure3 IOMA A1 Enclosure2 IOMB B3 Enclosure3 IOMB B6 213...

Page 224: ...rce Device Destination Device Host1 P1 Enclosure1 IOMA A6 Host1 P2 Enclosure3 IOMB B1 Host1 P3 Enclosure3 IOMA A6 Host1 P4 Enclosure1 IOMB B1 Enclosure1 IOMA A1 Enclosure2 IOMA A2 Enclosure1 IOMB B6 Enclosure2 IOMB B5 Enclosure2 IOMA A1 Enclosure3 IOMA A2 Enclosure2 IOMB B6 Enclosure3 IOMB B5 214 ...

Page 225: ... Destination Device Host1 P1 Enclosure1 IOMA A6 Host1 P2 Enclosure4 IOMB B1 Enclosure1 IOMA A3 Enclosure2 IOMA A1 Enclosure1 IOMB B3 Enclosure2 IOMB B6 Enclosure2 IOMA A3 Enclosure3 IOMA A1 Enclosure2 IOMB B3 Enclosure3 IOMB B6 Enclosure3 IOMA A3 Enclosure4 IOMA A1 Enclosure3 IOMB B3 Enclosure4 IOMB B6 215 ...

Page 226: ...Enclosure1 IOMA A6 Host1 P2 Enclosure4 IOMB B1 Host1 P3 Enclosure4 IOMA A6 Host1 P4 Enclosure1 IOMB B1 Enclosure1 IOMA A1 Enclosure2 IOMA A2 Enclosure1 IOMB B6 Enclosure2 IOMB B5 Enclosure2 IOMA A1 Enclosure3 IOMA A2 Enclosure2 IOMB B6 Enclosure3 IOMB B5 Enclosure3 IOMA A1 Enclosure4 IOMA A2 Enclosure3 IOMB B6 Enclosure4 IOMB B5 216 ...

Page 227: ...1 P2 Enclosure1 IOMA A6 Enclosure1 IOMA A1 Enclosure2 IOMA A2 Enclosure2 IOMA A1 Enclosure3 IOMA A2 Enclosure3 IOMA A1 Enclosure4 IOMA A2 5 6 3 Two Host Cable Configurations This section provides the information required to connect two or more enclosures to two hosts via SAS connections Choose the cable map that fits the preferred daisy chaining requirement 217 ...

Page 228: ...e1 IOMA A3 Enclosure2 IOMA A1 Enclosure1 IOMB B5 Enclosure2 IOMB B6 Two Enclosures Two Hosts with Two HBAs Source Device Destination Device Host1 P1 Enclosure1 IOMA A6 Host1 P2 Enclosure2 IOMB B1 Host1 P3 Enclosure1 IOMA A4 Host1 P4 Enclosure2 IOMB B3 Host2 P1 Enclosure1 IOMB B1 Host2 P2 Enclosure2 IOMA A6 Host2 P3 Enclosure1 IOMB B3 Host2 P4 Enclosure2 IOMA A4 Enclosure1 IOMA A1 Enclosure2 IOMA A...

Page 229: ...ce Device Destination Device Host1 P1 Enclosure1 IOMA A6 Host1 P2 Enclosure3 IOMB B1 Host2 P1 Enclosure1 IOMB B1 Host2 P2 Enclosure3 IOMA A6 Enclosure1 IOMA A3 Enclosure2 IOMA A1 Enclosure2 IOMA A3 Enclosure3 IOMA A1 Enclosure1 IOMB B3 Enclosure2 IOMB B5 Enclosure2 IOMB B3 Enclosure3 IOMB B5 219 ...

Page 230: ... Host1 P2 Enclosure3 IOMB B1 Host1 P3 Enclosure1 IOMA A4 Host1 P4 Enclosure3 IOMB B3 Host2 P1 Enclosure1 IOMB B1 Host2 P2 Enclosure3 IOMA A6 Host2 P3 Enclosure1 IOMB B3 Host2 P4 Enclosure3 IOMA A4 Enclosure1 IOMA A1 Enclosure2 IOMA A2 Enclosure2 IOMA A1 Enclosure3 IOMA A2 Enclosure1 IOMB B5 Enclosure2 IOMB B6 Enclosure2 IOMB B5 Enclosure3 IOMB B6 220 ...

Page 231: ...nclosure1 IOMA A6 Host1 P2 Enclosure4 IOMB B1 Host2 P1 Enclosure1 IOMB B1 Host2 P2 Enclosure4 IOMA A6 Enclosure1 IOMA A3 Enclosure2 IOMA A1 Enclosure2 IOMA A3 Enclosure3 IOMA A1 Enclosure3 IOMA A3 Enclosure4 IOMA A1 Enclosure1 IOMB B3 Enclosure2 IOMB B5 Enclosure2 IOMB B3 Enclosure3 IOMB B5 Enclosure3 IOMB B3 Enclosure4 IOMB B5 221 ...

Page 232: ...Enclosure3 IOMB B6 Enclosure3 IOMB B5 Enclosure4 IOMB B6 5 6 4 Cabling for Daisy Chaining Note The CMA should be installed before installing cabling Step 1 Choose a configuration from the One Host Cable Configurations page 212 section or Two Host Cable Configurations page 217 sections The configuration choice should be made based on the number of hosts being connected to the enclosure the number o...

Page 233: ...bles that are supported by the upper CMA are inserted into IOM B right hand side looking at the rear and the lower CMA cables are routed to IOM A left hand side looking at the rear in a criss cross pattern See the Special Considerations for Cable Routing page 157 for more information Figure 226 Connected Cable Routing c Open all of the baskets 223 ...

Page 234: ...bels to make sure they are connected to the proper port e If the installation includes more than 10 total cables follow the recommendations in Special Considerations for Cable Routing page 157 Read this section before proceeding Note Each cable must be given enough slack at the connector end to operate smoothly For the lower CMA allow 20 21 508 533 4mm between the connector and the first basket 22...

Page 235: ...connect the CMA at the elbow to the connectors on the rail Step 3 Cable the upper CMA a Unlatch the elbow side of the CMA arm and swing it forward by pressing the blue button that says push to unlatch it b Gather the SAS cables one power cable and one Ethernet cable to install in the left hand side c Open all of the baskets 225 ...

Page 236: ... route them through the baskets one at a time Make sure to follow the labels to make sure they are connected to the proper port b Connect the power cable to the lower PSU and route it through each basket The following image shows the appropriate cable criss cross pattern they should be installed in 226 ...

Page 237: ...d cable bundle between the ports and the first basket of the CMA Note Each cable must be given enough slack at the connector end to operate smoothly For the upper CMA allow 20 21 508 533 4mm between the end of the connector and the first basket Make sure to route all of the upper CMA cables under the lower CMA cables 227 ...

Page 238: ...Nominal Cable Length at Connectors d Close all of the baskets e Reconnect the CMA at the elbow to connector A Step 4 Connect the SAS cables to the host server s according to the One Host Cable Configurations page 212 and Two Host Cable Configurations page 217 228 ...

Page 239: ...es safety and regulatory information for the Ultrastar Data60 In This Chapter Electrostatic Discharge 230 Optimizing Location 230 Power Connections 230 Power Cords 230 Rackmountable Systems 231 Safety and Service 231 Safety Warnings and Cautions 232 229 ...

Page 240: ...can result in lowered system performance or system failure Do not position the unit in an environment that has extreme high temperatures or extreme low temperatures Be aware of the proximity of the unit to heaters radiators and air conditioners Position the unit so that there is adequate space around it for proper cooling and ventilation Consult the product documentation for spacing information Ke...

Page 241: ... warnings labels and instructions provided within the rackmount instructions Reliable grounding of rack mounted equipment should be maintained If installed in a closed or multi unit rack assembly the operating ambient temperature of the rack environment may be greater than room ambient Therefore consideration should be given to installing the equipment in an environment compatible with the maximum...

Page 242: ...ad observe and adhere to all of the following safety instructions and information The following safety symbols may be used throughout the documentation and may be marked on the product and or the product packaging CAUTION Indicates the presence of a hazard that may cause minor personal injury or property damage if the CAUTION is ignored WARNING Indicates the presence of a hazard that may result in...

Page 243: ...nt The following chapter describes the Regulatory Statement of Compliance Safety Compliance and Electromagnetic Compatibility Agency Requirements for the Ultrastar Data60 In This Chapter Restricted Access Location 234 Safety Compliance 234 Electromagnetic Compatibility EMC Class A Compliance 234 Country Certifications 235 233 ...

Page 244: ...ountries and regions where the product is marketed and sold The product has been verified as compliant with the latest applicable standards regulations and directives for those regions countries The suitability of this product for other product categories other than ITE may require further evaluation The product is labeled with a unique regulatory model that is printed on the label and affixed to ...

Page 245: ... Frequency Magnetic Field EN 61000 4 11 Voltage Dips and Interruptions 7 4 Country Certifications Table 51 Country Certifications Country Region Authority or Mark North America Canada USA Nemko European Union CE Japan VCCI Korea MSIP Taiwan BSMI Australia New Zealand RCM Russia Kazakhstan Belarus Armenia CU EAC Ukraine Ukrsepro Mexico NOM Israel SII South Africa SABS India BIS 235 ...

Page 246: ...ed may cause interference to other electronic equipment and result in violation of Class A legal requirements Changes or modifications to this equipment that are not expressly approved in advance by Western Digital will void the warranty In addition changes or modifications to this equipment might cause it to create harmful interference In This Chapter Europe CE Declaration of Conformity 237 FCC C...

Page 247: ...easonable protection against harmful interference when the equipment is operated in a commercial environment This equipment generates uses and can radiate radio frequency energy and if it is not installed and used in accordance with the instruction manual it may cause harmful interference to radio communications Any modifications made to this device that are not approved by Western Digital may voi...

Page 248: ...nts 8 5 Taiwan Warning Label Statement Class A ITE English translation This is a Class A product In a domestic environment this product may cause radio interference in which case the user may be required to take adequate measures 238 ...

Reviews: