manualshive.com logo in svg

Oracle DE2-24, Customer Service Manual

Share
Download
Oracle DE2-24 Customer Service Manual Download Page 46

Servicing the ZS4-4 Controller

through 5, in that order. A filler panel must be installed in empty drive slots. The system drive

LEDs are shown in the following figure.

FIGURE   3

System Drive LEDs

TABLE 16

System Drive LEDs

Figure Legend

Figure Legend

Figure Legend

1 Ready to remove (blue)

2 Service action required (amber)

3 OK/Activity (green)

ZS4-4 Rear Panel

The ZS4-4 rear panel is shown in the following figure. Base configuration PCIe cards are not

depicted in this illustration.

46

Oracle ZFS Storage Appliance Customer Service Manual • February 2016

Summary of Contents for DE2-24

Page 1: ...Oracle ZFS Storage Appliance Customer Service Manual For ZS4 4 ZS3 x 7x20 Controllers and DE2 24 Sun Disk Shelves Release 2013 1 5 0 Part No E69256 02 February 2016 ...

Page 2: ......

Page 3: ...tly dangerous applications including applications that may create a risk of personal injury If you use this software or hardware in dangerous applications then you shall be responsible to take all appropriate fail safe backup redundancy and other measures to ensure its safe use Oracle Corporation and its affiliates disclaim any liability for any damages caused by use of this software or hardware i...

Page 4: ...s à risque notamment dans des applications pouvant causer des dommages corporels Si vous utilisez ce logiciel ou matériel dans le cadre d applications dangereuses il est de votre responsabilité de prendre toutes les mesures de secours de sauvegarde de redondance et autres mesures nécessaires à son utilisation dans des conditions optimales de sécurité Oracle Corporation et ses affiliés déclinent to...

Page 5: ...ng with Problems 28 Using Logs 30 Using Workflows 39 Prerequisites for Servicing Hardware 39 Safety Information 40 Required Tools and Information 40 Controller and Disk Shelf Prerequisite Tasks 41 Servicing the ZS4 4 Controller 44 ZS4 4 Controller Hardware Overview 44 Replacing the ZS4 4 Hardware 58 Servicing the ZS3 4 Controller 76 ZS3 4 Controller Hardware Overview 76 Replacing the ZS3 4 Hardwar...

Page 6: ... Initial Setup 272 Performing a Factory Reset 272 Backing Up the Configuration 273 Configuration Backup Contents 274 Configuration Restore Impact 275 Security Considerations for Configuration Backups 276 How to Create a Configuration Backup BUI 277 How to Create a Configuration Backup CLI 277 How to Restore from a Saved Configuration BUI 277 How to Restore from a Saved Configuration CLI 278 How to...

Page 7: ...te Controller A CLI 291 How to Update Controller B BUI 293 How to Update Controller B CLI 293 Working with Health Checks 294 How to Check System Health BUI 295 How to Check System Health CLI 297 Troubleshooting Update Health Check Failures 297 Resolving Health Check Alerts 298 Applying Deferred Updates 299 How to Apply Deferred Updates BUI 301 How to Apply Deferred Updates CLI 301 Understanding De...

Page 8: ...8 Oracle ZFS Storage Appliance Customer Service Manual February 2016 ...

Page 9: ...nce This document encompasses the following sections that describe maintenance procedures for the Oracle ZFS Storage Appliance Servicing the Hardware on page 11 Maintaining the System on page 267 Servicing the Oracle ZFS Storage Appliance 9 ...

Page 10: ...10 Oracle ZFS Storage Appliance Customer Service Manual February 2016 ...

Page 11: ...uction to the BUI The Browser User Interface BUI is the graphical tool for administration of the appliance The BUI provides an intuitive environment for administration tasks visualizing concepts and analyzing performance data The management software is designed to be fully featured and functional on a variety of web browsers as described in Browser User Interface BUI in Oracle ZFS Storage Applianc...

Page 12: ...the topic as an argument to help for example help commands Available topics are displayed by tab completing the help command or by typing help topics You can combine these two principles as follows dory helptab builtins commands general help properties script BUI Hardware View The BUI hardware view provides interactive illustrations that enable you to browse through the appliance and attached disk...

Page 13: ...mary system chassis is shown on the top half of the view At the top left click the right arrow icon to get more detail about the chassis The indicator notes if there are any faulted components within the chassis and the name of the chassis The chassis name is initially set to the appliance name during installation To change the chassis name use the entry field on the Configuration Services System ...

Page 14: ... currently selected disk shelf Clicking on the right pointing arrow or double clicking on a row within the list will provide complete details about the disk shelf The state indicator will be orange if the chassis contains any faulted components The following fields are displayed in the list TABLE 3 Disk Shelf Properties Property Description Name Name of the disk shelf used in faults and alerts Thi...

Page 15: ...ssis At the left is a set of images describing the chassis If there are multiple views then you can switch between them by clicking on the name of the view above the image For each view faulted components will be highlighted in red In addition the currently selected component will be highlighted in the image Clicking on a component within the image will select the corresponding component in the li...

Page 16: ...ar location or batch where the component was manufactured Part Component part number or core factory part number The orderable part number may differ depending on whether a component is for replacement or expansion and whether it s part of a larger assembly Your service provider should be able to refer you to the appropriate orderable part For components without part numbers the model number shoul...

Page 17: ... To check if an upgrade is in progress navigate to Maintenance System in the BUI or maintenance system updates in the CLI Online Online the disk Reverses the above operation SSD Endurance SSD endurance reports the remaining life expectancy of an SSD Endurance properties are reported on the BUI Maintenance Hardware chassis details page and in the CLI maintenance chassis disk context You can set a t...

Page 18: ...e behavior of the service processor network management port TABLE 7 Properties for the Service Processor Network Management Port Property Description MAC Address Hardware MAC address This is read only IP Address Source Either DHCP or Static Controls whether DHCP should be used on the interface IP Address IPv4 Address when using static IP configuration IPv6 is not supported Subnet Dotted decimal su...

Page 19: ...ystems Inc 541 2068 fan 003 FT 0 FM 2 ok Sun Microsystems Inc 541 2068 fan 004 FT 1 ok unknown ASY FAN BOARD H2 fan 005 FT 1 FM 0 ok Sun Microsystems Inc 541 2068 fan 006 FT 1 FM 1 ok Sun Microsystems Inc 541 2068 fan 007 FT 1 FM 2 ok Sun Microsystems Inc 541 2068 memory 000 DIMM 0 0 ok HYNIX 4096MB DDR II 66 memory 001 DIMM 0 1 ok HYNIX 4096MB DDR II 66 A 5th and 6th column for serial number SERI...

Page 20: ...is also available How to View the Remaining SSD Lifetime CLI Use the following procedure to view the remaining SSD lifetime To list the properties of a disk use the following CLI commands tarpon maintenance hardware tarpon maintenance hardware select chassis 001 tarpon maintenance hardware chassis 001 select disk tarpon maintenance hardware chassis 001 select disk 015 tarpon maintenance hardware c...

Page 21: ...ce use the following CLI commands tarpon configuration alerts thresholds tarpon configuration alerts thresholds create tarpon configuration alerts threshold uncommitted set statname ssd endurance ssd statname ssd endurance ssd uncommitted 2 To list the properties of the threshold alert use the following CLI command tarpon configuration alerts threshold uncommitted list Properties uuid generated on...

Page 22: ...CLI Caution Only issue the restart command as instructed by Oracle Service personnel This function is only available via the CLI and is not the same as a reboot power cycle via the BUI The restart command is a software only operation that restarts the management server which could impact some client services like replication During execution both the CLI and BUI are not available wait for the appl...

Page 23: ...s must be locked to the controller using the Configuration Cluster option in the BUI In some cases this may require installation of an additional network interface card on each controller in a cluster configuration If access to the appliance data interfaces is impossible for any reason the management network interface will maintain BUI and CLI access During a cluster takeover interfaces are taken ...

Page 24: ...p bit 9600 baud Disable hardware flow control CTS RTS Disable software flow control XON XOFF 2 Connect the administrative client to the SER MGT port on the controller using a serial null modem cable 3 To establish a connection between your serial console and Oracle ILOM press Enter on the administrative client A login prompt for Oracle ILOM is displayed 4 Log in to the Oracle CLI using the adminis...

Page 25: ...t you know the administrative account name and password defaults are root and changeme and that you know the IP address or host name of the controller Service Processor SP 1 Using a Secure Shell SSH session log in to Oracle ILOM by specifying your administrative account user name and the IP address or host name of the controller SP Examples ssh l username host ssh username host where host is eithe...

Page 26: ...iled Component CLI on page 27 How to Locate the Chassis Serial Number To obtain support for your storage controller or to order new parts you need your chassis serial number There are three ways to locate the chassis serial number 1 You can find a chassis serial number label on the storage controller front panel on the left side Another label is on the top of the storage controller 2 You can click...

Page 27: ...mponent CLI Use the following procedure to locate a failed component using the CLI 1 Go to the maintenance hardware context hostname maintenance hardware 2 List the appliance components hostname maintenance hardware list NAME STATE MODEL SERIAL chassis 000 hostname ok Sun Storage 7320 unknown chassis 001 000000000C faulted J4410 000000000C 3 Select the chassis and list its components hostname main...

Page 28: ...630NS ST3500630NS 9QG1A76S disk 018 HDD 18 ok ST3500630NS ST3500630NS 9QG1ACDY disk 019 HDD 19 ok ST3500630NS ST3500630NS 9QG1AC3Y disk 020 HDD 20 ok ST3500630NS ST3500630NS 9QG1ACG6 disk 021 HDD 21 ok ST3500630NS ST3500630NS 9QG1AC3X disk 022 HDD 22 ok ST3500630NS ST3500630NS 9QG1ACHL disk 023 HDD 23 ok ST3500630NS ST3500630NS 9QG1ABLW Note The RPM revolutions per minute of the disk drive is also...

Page 29: ...s Major Error Never 2009 07 16 22 03 22 A memory module is experiencing excessive correctable errors affecting large numbers of pages Major Fault Never This information can also be viewed in the CLI gefilte maintenance problems show Problems COMPONENT DIAGNOSED TYPE DESCRIPTION problem 000 2010 7 27 00 02 49 Major Fault SMART health monitoring firmware reported that a failure is imminent on disk H...

Page 30: ... is available under Logs as the Fault log For more information see Fault Log Entries on page 31 Faults and defects are subcategories of Alerts Filter rules can be configured to cause the appliance to email administrators or perform other actions when faults are detected For more information about alerts see Configuring Alerts in Oracle ZFS Storage Appliance Administration Guide Release 2013 1 5 0 ...

Page 31: ...ation is available Click the icon to display information below the list of alerts The appliance can also be configured to send email raise an SNMP trap or perform other actions when particular alerts occur This is configured in the Alerts section All alerts appear in this log regardless of whether they have actions configured for them For more information about alerts see Configuring Alerts in Ora...

Page 32: ...the alert and fault logs The following are example system log entries as they would appear in the BUI TABLE 12 Example BUI System Log Entry Displays Time Module Priority Description 2013 10 11 14 13 38 ntpdate error no server suitable for synchronization found 2013 10 11 14 03 52 genunix notice MSunOS Release 5 11 Version ak generic 2013 10 10 1 0 64 bit 2013 10 11 14 02 04 genunix notice done 201...

Page 33: ...wing is an example phone home entry as it would appear in the BUI TABLE 14 Example BUI Phone Home Entry Display Time Description Result 2013 10 12 05 24 09 Uploaded file cores ak 45e5ddd1 ce92 c16e b5eb 9cb2a8091f1c tar gz to Oracle support OK How to View Logs BUI Use the following procedure to view logs using the BUI The following log types are available Alerts Faults System Audit and Phone Home ...

Page 34: ... list a ENTRY TIME SUMMARY entry 000 2013 1 9 15 13 50 root 10 154 161 197 User logged in entry 001 2013 1 9 15 17 42 root 10 154 161 197 Released resources to cluster peer entry 002 2013 1 9 15 20 17 root 10 154 161 197 Cluster takeover requested entry 003 2013 1 9 15 20 33 root 10 154 161 197 Transferred ak net igb1 to 2917b8aa 0b0a 4b74 f36b ff0a8d150c3b entry 2077 2013 12 17 05 24 43 osc_agent...

Page 35: ...logged out of CLI entry 2971 2014 2 27 17 48 23 root 10 159 100 157 User logged in entry 2972 2014 2 27 19 05 46 root 10 159 100 157 Browser session timed out entry 2973 2014 2 27 23 53 31 root dhcp amer vpn rmdc anyconnect 10 159 125 20 vpn oracle com User logged in via CLI 2 To view the previous or next 100 log entries use the following CLI commands caji maintenance logs alert list ENTRY TIME SU...

Page 36: ...9 243 User logged in entry 724 2013 2 19 00 48 51 root 10 135 69 243 Browser session timed out entry 725 2013 2 19 23 30 11 root User logged in via CLI How to View Entry Details CLI Use the following procedure to view entry details using the CLI To view details of a log entry use the following CLI commands caji maintenance logs select audit caji maintenance logs audit select entry 000 show Propert...

Page 37: ...n export any combination of log types to your local machine by using the BUI Collect button For information on using the RESTful API see its product documentation at Oracle ZFS Storage Appliance RESTful API Guide Release 2013 1 5 0 1 To view logs navigate to the Maintenance Logs screen 2 Click Collect FIGURE 1 Logs Screen Servicing the Hardware 37 ...

Page 38: ...nds A stdout gz file containing all the requested log information is downloaded to your local machine caji maintenance logs show Logs LOG ENTRIES LAST alert 3458 2013 2 18 23 02 29 audit 731 2013 2 20 16 13 04 fltlog 2 2013 2 3 06 29 02 scrk 0 system 44 2013 1 14 18 19 59 caji maintenance logs select fltlog caji maintenance logs fltlog collect SUNW MSG ID AK 8000 86 TYPE Defect VER 1 SEVERITY Majo...

Page 39: ...aji maintenance logs fltlog Using Workflows A workflow is a script that is uploaded to and managed by the Oracle ZFS Storage Appliance by itself For information on scripting see Working with CLI Scripting in Oracle ZFS Storage Appliance Administration Guide Release 2013 1 5 0 Workflows can be parameterized and executed in a first class fashion from either the browser user interface BUI or the comm...

Page 40: ...ic electricity Ordinary amounts of static electricity from clothing or the work environment can destroy the components located on these boards Do not touch the components without using antistatic precautions especially along the connector edges Note The Critical status indicator on the front panel flashes red when powering off and powering on the ZS3 2 After the controller is powered on the Power ...

Page 41: ...weroff SSH or serial console into the service processor SP and issue the command stop SYS Use a pen or nonconducting pointed object to press and release the Power button on the front panel To initiate emergency shutdown during which all applications and files will be closed abruptly without saving press and hold the power button for at least four seconds until the Power OK status indicator on the ...

Page 42: ...ng the slide release latches slowly pull the storage controller forward until the slide rails latch How to Remove the Top Cover To access internal controller components for servicing remove the top cover Use the following procedure to remove the top cover 42 Oracle ZFS Storage Appliance Customer Service Manual February 2016 ...

Page 43: ...elf must not be operated without all components in place Powering off or removing all SAS chains from a disk shelf will trigger a kernel panic on the controller s to prevent data loss unless the shelf is part of an NSPF no single point of failure data pool To avoid this shut down the controller s before decommissioning the shelf For details on NSPF profiles see Choose a Storage Profile in Oracle Z...

Page 44: ...igured as a single controller or two controllers to create a high availability cluster configuration The following table describes the base configuration TABLE 15 ZS4 4 Controller Base Configuration Component Description CPU Four Intel Xeon 15 core 2 8 GHz Memory 1 5TB 16GB DDR3 LV RDIMM Boot Disks Two 2 5 inch 1 2TB or 900GB SAS 2 HDDs Read Flash Up to four optional 2 5 inch 1 6TB SAS 2 SSDs HBAs...

Page 45: ...utton 12 Boot drive 1 required 5 Service Processor SP OK green Fault amber LED 13 Solid state drive 2 optional 6 Fan CPU Memory Service action required LED amber 14 Solid state drive 3 optional 7 Power Supply PS Service action required LED amber 15 Solid state drive 4 optional 8 Over temperature warning LED amber 16 Solid state drive 5 optional ZS4 4 System Drive The ZS4 4 controller has two 2 5 i...

Page 46: ... 3 System Drive LEDs TABLE 16 System Drive LEDs Figure Legend Figure Legend Figure Legend 1 Ready to remove blue 2 Service action required amber 3 OK Activity green ZS4 4 Rear Panel The ZS4 4 rear panel is shown in the following figure Base configuration PCIe cards are not depicted in this illustration 46 Oracle ZFS Storage Appliance Customer Service Manual February 2016 ...

Page 47: ...1 indicator panel 9 PCIe card slots 711 4 PSU 1 AC inlet 10 Service processor SP network management NET MGT port 5 System status indicator panel 11 Serial management SER MGT RJ 45 port 6 PCIe card slots 1 6 12 DB 15 video port ZS4 4 4x4 SAS 2 HBA The 4x4 SAS 2 HBA provides connectivity to external DE2 24 disk shelves The HBA ports are numbered 3 0 top to bottom as shown in the following figure Ser...

Page 48: ...2 HBA slot placement of the HBAs ZS4 4 Internal Components The ZS4 4 chassis contains both customer replaceable units CRUs and field replaceable units FRUs as shown in the following figure FRUs must be replaced by trained Oracle service technicians 48 Oracle ZFS Storage Appliance Customer Service Manual February 2016 ...

Page 49: ... CRU 11 Fan module CRU 5 CPU FRU 12 Fan board FRU 6 Heatsink FRU 13 Drive backplane FRU 7 Cover 14 Chassis ZS4 4 CPU and Memory The ZS4 4 controller has four Intel Xeon E7 8895 v2 15 core 2 8 GHz CPUs and eight memory riser cards as shown in the following figure The memory configuration is 16GB DDR3 DIMMs to accommodate up to 1 5TB ninety six 16GB All ZS4 4 DIMM risers are fully populated to accom...

Page 50: ...R1 7 Memory riser card P0 MR1 2 Memory riser card P3 MR0 8 Memory riser card P0 MR0 3 Memory riser card P2 MR1 9 CPU P3 4 Memory riser card P2 MR0 10 CPU P2 5 Memory riser card P1 MR1 11 CPU P1 6 Memory riser card P1 MR0 12 CPU P0 50 Oracle ZFS Storage Appliance Customer Service Manual February 2016 ...

Page 51: ... more information about memory layout and procedures for replacing DIMMs see Replacing the ZS4 4 Hardware on page 58 ZS4 4 PCIe I O Slot Numbering The ZS4 4 base configuration contains the following PCIe cards One 8 port SAS 2 internal HBA slot 2 Two 4 port 4x4 SAS 2 external HBAs slot 6 and slot 7 One cluster interface card slot 4 The following figure shows the PCIe I O slot numbers FIGURE 8 ZS4 ...

Page 52: ...4 4 standalone and cluster configurations PCIe slot numbering begins with slot 1 See the legend for a description of the interconnect types and option codes shown in the Type column Slot Description Max Type Note 1 2 port InfiniBand CX3 HCA 4 A Optional recommended front end 1 2 port 10Gb Ethernet Optical NIC 4 C Optional recommended front end 1 2 port 10Gb Ethernet Copper NIC 4 D Optional recomme...

Page 53: ... end 8 16GB Dual Universal FC HBA 4 B Optional FC target or initiator Backup 9 4 port 4x4 SAS 2 External HBA 4 E Base configuration 9 2 port InfiniBand CX3 HCA 4 A Optional recommended front end 9 2 port 10Gb Ethernet Optical NIC 4 C Optional recommended front end 9 2 port 10Gb Ethernet Copper NIC 4 D Optional recommended front end 9 16GB Dual Universal FC HBA 4 B Optional FC target or initiator B...

Page 54: ...i SAS Copper C GbE NIC Multi mode Fiber SFP 10GBase SR LR Optical Transceiver SFP Short Range 10Gbs Optical Transceiver SFP Long Range 10Gbs G Server Heartbeat 2 port RS 232 1 port 1GBase T Copper RJ 45 Serial RS 232 Copper RJ 45 Unshielded Twisted Pair D GbE NIC UTP 10GBase T Copper RJ 45 Unshielded Twisted Pair ZS4 4 Connectors This section describes ZS4 4 Ethernet ports network management port ...

Page 55: ...Port The network management connector NET MGT shown in the following figure is an RJ 45 port and provides an alternate terminal interface to the service processor SP console FIGURE 10 Network Management Port ZS4 4 Serial Management Port The serial management connector SER MGT shown in the following figure is an RJ 45 port and provides a terminal connection to the SP console Servicing the Hardware ...

Page 56: ... exhausted out the back of the controller Cooling occurs in two areas of the chassis the power supply area and the motherboard area The following figure shows the cooling zones and the approximate location of the temperature sensors The accompanying legend table provides sensor NAC names and sensor motherboard designations 56 Oracle ZFS Storage Appliance Customer Service Manual February 2016 ...

Page 57: ...emperature sensor TS_ZONE2 U4505 1 Cooling zone 1 7 Temperature sensor TS_OUT U4506 2 Cooling zone 2 8 Temperature sensor TS_TVL_1 U4002 3 Cooling zone 3 power supply backplane area 9 Temperature sensor TS_TVL_0 U4302 4 Temperature sensor TS_PS U4603 10 Temperature sensor TS_ZONE0_B U4509 Servicing the Hardware 57 ...

Page 58: ...o Replace a ZS4 4 Power Supply on page 60 How to Replace a ZS4 4 Fan Module on page 61 How to Identify a Faulted ZS4 4 Memory Module on page 63 How to Replace a ZS4 4 DIMM on page 64 How to Replace a ZS4 4 Memory Riser Card on page 66 How to Replace a ZS4 4 PCIe Card on page 68 How to Replace a ZS4 4 Battery on page 73 To become familiar with the replaceable parts of the system see ZS4 4 Controlle...

Page 59: ...o highlight the location of the drive in the controller picture click on the drive ID To view details about the faulted drive click its information icon and then click Active Problems If you are physically at the system the amber Service action required indicator on the HDD or SSD should be lit Additionally you can click the locator icon in the BUI to flash the locator indicator on the faulted dri...

Page 60: ...er Supply Storage controllers are equipped with redundant hot swappable power supplies If a power supply fails and you do not have a replacement available leave the failed power supply installed to ensure proper air flow A faulted power supply is indicated by an amber colored status LED Use the following procedure to replace a ZS4 4 power supply 1 Gain access to the rear of the storage controller ...

Page 61: ...11 Verify that the green AC Present status indicator is lit 12 Go to the Maintenance Hardware screen of the BUI Click the right arrow icon for the controller click PSU and verify that the status icon is green for the newly installed power supply To view details about the new power supply click its information icon How to Replace a ZS4 4 Fan Module Caution Operating a controller for an extended per...

Page 62: ...dentify the faulted fan module by locating the corresponding Service Required status indicator or by navigating to the Maintenance Hardware screen of the BUI clicking Fan and noting the ID of the faulted module which has an amber icon To highlight the location of the fan module in the controller picture click on the module ID To view details about the faulted module click its information icon and ...

Page 63: ... Service Action Required indicator on the front panel are not lit How to Identify a Faulted ZS4 4 Memory Module Replacing a DIMM is a cold swap procedure and you must remove power from the storage controller Use the following procedure to identify a faulted ZS4 4 memory module 1 To identify a general memory fault go to the Maintenance Hardware screen of the BUI and click the right arrow icon for t...

Page 64: ...emory Riser Card on page 66 for removal and installation instructions If a DIMM has failed see How to Replace a ZS4 4 DIMM on page 64 for removal and installation instructions If a CPU has failed the LEDs for both memory riser cards associated with the failed CPU turn on The following example shows the Fault indicators for memory riser cards P0 MR0 and P0 MR1 are lit as is the Fault indicator for ...

Page 65: ...failed DIMM Use the DIMM Fault Remind circuit to locate the failed DIMM See How to Identify a Faulted ZS4 4 Memory Module on page 63 5 To remove the failed DIMM rotate both DIMM slot ejector levers outward as far as they will go 6 Carefully lift the DIMM straight up to remove it from the socket 7 Repeat the previous steps for any other faulty DIMMs 8 Ensure that the DIMM ejector levers at both end...

Page 66: ... the chassis 14 Return the controller to the normal rack position by pushing the release tabs on the side of each rail while slowly pushing the storage controller into the rack 15 Reconnect the power cords to the power supplies 16 Verify that standby power is on indicated by the Power OK status indicator flashing on the front panel about two minutes after the power cords are plugged in 17 Use a pe...

Page 67: ...onnector on the motherboard 5 On the replacement memory riser card ensure that all populated and unpopulated DIMM slot ejector levers are in the closed and locked position Caution Open DIMM ejector levers can break off during the installation of the memory riser card All populated and unpopulated DIMM slot ejector levers on the memory riser card must be in the fully closed and locked position befo...

Page 68: ...s 14 Verify that standby power is on indicated by the Power OK status indicator flashing on the front panel about two minutes after the power cords are plugged in 15 Use a pen or other pointed object to press and release the recessed Power button on the storage controller front panel 16 Go to the Maintenance Hardware screen of the BUI Click the right arrow icon for the controller and then click DI...

Page 69: ...con and then click Active Problems Caution This procedure requires that you handle components that are sensitive to static discharge which can cause the component to fail To avoid damage wear an antistatic wrist strap and use an antistatic mat when handling components 2 Shut down the controller using one of the power off methods described in How to Power off the Controller on page 41 3 Extend the ...

Page 70: ...k wall and lift it to an upright position 7 Carefully remove the PCIe card from the PCIe card slot Caution Whenever you remove a PCIe card you should replace it with another PCIe card or a filler panel otherwise the controller might overheat due to improper airflow 70 Oracle ZFS Storage Appliance Customer Service Manual February 2016 ...

Page 71: ...How to Replace a ZS4 4 PCIe Card 8 Ensure the PCIe card retaining bar is open Servicing the Hardware 71 ...

Page 72: ...locked position 11 Replace the top cover on the chassis 12 Return the controller to the normal rack position by pushing the release tabs on the side of each rail while slowly pushing the storage controller into the rack 13 Reconnect the power cords to the power supplies 72 Oracle ZFS Storage Appliance Customer Service Manual February 2016 ...

Page 73: ...n page 266 If you installed a new HBA install the disk shelf as described in Installation Prerequisites and Hardware Overviews in Oracle ZFS Storage Appliance Installation Guide and connect the expansion storage as described in Connecting to Attached Storage on page 266 How to Replace a ZS4 4 Battery Replacing a system battery is a cold swap procedure and you must remove power from the storage con...

Page 74: ...from the battery holder by pushing the back of the battery negative side toward the metal tab on the positive side and lifting the battery up and out of the battery holder Take care not to bend the tab when pushing against it Caution Do not deform the metal tab on the positive side of the battery The metal tab maintains the positive battery connection and secures the battery in the holder 74 Oracl...

Page 75: ...g the release tabs on the side of each rail while slowly pushing the storage controller into the rack 10 Connect the power cords to the power supplies 11 Verify that standby power is on indicated by the Power OK status indicator flashing on the front panel about two minutes after the power cords are plugged in 12 Use a pen or other pointed object to press and release the recessed Power button on t...

Page 76: ...al components of the Oracle ZFS Storage ZS3 4 controller ZS3 4 Base Configuration The ZS3 4 controller can be configured as a single controller or two controllers to create a high availability cluster configuration The following table describes the configuration options TABLE 17 ZS3 4 Controller Features Mktg Part Number CPU Memory Readzilla SAS 2 Boot Drive SAS 2 HBA SAS 2 Software Version min 71...

Page 77: ...e Processor SP OK LED green 13 Solid state drive 2 optional 6 Fan CPU Memory Service Required LED 14 Solid state drive 3 optional 7 Power Supply PS Service Required LED 15 Solid state drive 4 optional 8 Over Temperature Warning LED 16 Solid state drive 5 optional ZS3 4 System Drives The ZS3 4 controller has two 900GB SAS 2 system boot drives in slots 0 and 1 configured as a mirrored pair Up to fou...

Page 78: ...o remove blue 2 Service action required amber 3 OK Activity green ZS3 4 Rear Panel The following graphic shows the rear panel Base configuration HBAs are not depicted in this illustration FIGURE 15 ZS3 4 Controller Rear Panel 78 Oracle ZFS Storage Appliance Customer Service Manual February 2016 ...

Page 79: ...n Power Supply Fail amber AC OK green 10 PCIe slots 5 9 4 Power supply unit 1 AC inlet 11 Network management NET MGT port 5 System status LEDs Power green Attention amber Locate white 12 Serial management SER MGT port 6 PCIe slots 0 4 13 DB 15 video connector 7 Cluster card slot ZS3 4 4x4 SAS 2 HBA The 4x4 SAS 2 HBA installed in the ZS3 4 provides connectivity to external DE2 and Sun Disk Shelves ...

Page 80: ...4 controller chassis fits in a standard equipment rack and occupies three rack units 3RU in height The chassis dimensions are as follows TABLE 18 ZS3 4 Controller Dimensions Dimension Measurement Dimension Measurement Height 13 3 cm 5 25 in Depth 70 6 cm 27 8 in Width 43 7 cm 17 19 in Weight 16 36 kg 96 lbs 80 Oracle ZFS Storage Appliance Customer Service Manual February 2016 ...

Page 81: ...st system events power and environmental The SP controller draws power from the host s 3 3V standby supply rail which is available whenever the system is receiving AC input power even when the system is turned off Power Distribution Board The power distribution board distributes main 12V power from the power supplies to the rest of the system It is directly connected to the Vertical PDB card and t...

Page 82: ...r for Power Activity Fault and Locate ZS3 4 Internal Components The components of the ZS3 4 controller are shown in the following figure and identified in the legend FIGURE 17 ZS3 4 Controller Components Figure Legend Figure Legend 1 Motherboard 7 CPUs and heatsinks 2 Low profile PCIe cards 8 Memory risers 3 Power supplies 9 Fan board 4 Power supply backplane 10 Fan modules 82 Oracle ZFS Storage A...

Page 83: ...Ms installed on all eight risers accommodating 1TB of memory FIGURE 18 ZS3 4 Controller DIMM Risers Refer to the service label on the cover for DIMM placement information On every memory riser slots D0 D2 D4 and D6 must be populated optionally slots D1 D3 D5 and D7 may be populated as a group on all installed memory risers All DIMMs in the system must be identical Servicing the Hardware 83 ...

Page 84: ...ntenance Hardware view are displayed with the full name such as SYS MB P0 D7 ZS3 4 Fan Modules The Fan Modules and Fan Module LEDs of the controller are shown in the following figure The following LEDs are lit when a fan module fault is detected 84 Oracle ZFS Storage Appliance Customer Service Manual February 2016 ...

Page 85: ...t if a fan fault causes an increase in system operating temperature ZS3 4 NIC HBA Options This table describes NIC HBA PCIe card options for ZS3 4 standalone and cluster configurations TABLE 19 ZS3 4 Controller NIC HBA Options Mktg Part Number Description SG SAS6 INT Z 8 port 6Gb s SAS 2 internal HBA SG XPCIE2FC QF8 Z 2 port 8Gb FC HBA 7103791 4 port 4x4 SAS 2 6Gb s external HBA 7101674 2 port 16G...

Page 86: ...S 2 external HBA 4 Base configuration 2 7067091 4 port 4x4 SAS 2 external HBA 4 Additional optional back end 2 7070006 2 port 10Gb Ethernet Copper NIC 4 Optional recommended front end 2 375 3696 01 2 port InfiniBand CX2 HCA 4 Optional recommended front end 2 7070195 4 port 1Gb Ethernet Copper UTP NIC 4 Optional recommended front end 2 7051223 2 port 10Gb Ethernet Optical NIC 6 Optional recommended...

Page 87: ...nal recommended front end 4 7051223 2 port 10Gb Ethernet Optical NIC 6 Optional recommended front end 4 371 4325 02 2 port 8Gb FC HBA 4 Optional FC target or initiator backup 4 7023303 2 port 16Gb FC HBA 4 Optional FC target or initiator backup C 511 1496 05 Cluster Controller 200 1 Cluster base configuration 5 7070006 2 port 10Gb Ethernet Copper NIC 4 Optional recommended front end 5 375 3696 01 ...

Page 88: ...7070006 2 port 10Gb Ethernet Copper NIC 4 Optional recommended front end 7 371 4325 02 2 port 8Gb FC HBA 4 Optional recommended front end 7 375 3696 01 2 port InfiniBand CX2 HCA 4 Optional recommended front end 7 7051223 2 port 10Gb Ethernet Optical NIC 6 Optional recommended front end 7 7070195 4 port 1Gb Ethernet Copper UTP NIC 4 Optional recommended front end 7 371 4325 02 2 port 8Gb FC HBA 4 O...

Page 89: ...ckup ZS3 4 PCIe Slot Order When installing additional PCIe cards to your base configuration cards must be added in a specific order Note Slot 0 is always populated with a SAS 2 internal HBA Slots 1 and 8 are reserved for 4x4 SAS 2 external HBAs FIGURE 21 ZS3 4 Controller PCIe Cards Slot Order Install optional PCIe cards in the following order TABLE 21 ZS3 4 Controller Optional PCIe Cards and Slot ...

Page 90: ...t 1Gb Ethernet NIC Slot 3 6 4 5 2 7 9 6 16Gb FC HBA Slot 3 6 4 5 2 7 9 7 Remaining 8Gb FC HBAs Slot 3 6 4 5 2 7 slot 9 see step 2 ZS3 4 Connectors The serial management connector SER MGT is an RJ 45 connector and provides a terminal connection to the SP console FIGURE 22 ZS3 4 Controller Serial Management Port The network management connector NET MGT is an RJ 45 connector and provides a LAN interf...

Page 91: ... ZS3 4 Hardware This section describes how to replace the following ZS3 4 hardware components How to Replace a ZS3 4 HDD or SSD on page 91 How to Replace a ZS3 4 Fan Module on page 93 How to Replace a ZS3 4 Power Supply on page 94 How to Replace a ZS3 4 Memory on page 97 How to Replace a ZS3 4 PCIe Card or Riser on page 105 How to Replace a ZS3 4 Battery on page 109 To become familiar with the rep...

Page 92: ...dware section of the BUI and clicking the drive information icon If you are physically at the system the amber Service Required indicator on the HDD or SSD should be illuminated 2 If you are not physically at the system turn on the locator indicator by clicking the locator icon 3 Push the release button on the HDD or SSD to open the latch 4 Grasp the latch 2 and pull the drive out of the drive slo...

Page 93: ...e effectiveness of the cooling system For this reason the replacement fan should be unpacked in advance and ready to insert into the controller chassis as soon as the faulted fan is removed Fan modules are hot swappable and can be removed and installed while the storage controller is running without affecting other hardware capabilities Use the following procedure to replace a ZS3 4 fan module 1 T...

Page 94: ... Apply firm pressure to fully seat the fan module 7 Verify that the Fan OK status indicator is lit and that the fault status indicator on the replaced fan module is dim 8 Verify that the Top Fan status indicator the Service Required status indicators and the Locator status indicator Locator button are dim 9 Push the release tabs on the side of each rail and slowly slide the storage controller into...

Page 95: ...ss to the rear of the storage controller where the faulted power supply is located 2 If a cable management arm CMA is installed press and hold the CMA release tab and rotate the arm out of the way 3 Disconnect the power cord from the faulted power supply 4 Shut down the controller using one of the power off methods described in How to Power off the Controller on page 41 Servicing the Hardware 95 ...

Page 96: ...y 5 Grasp the power supply handle and press the release latch to remove the power supply 6 Align the replacement power supply with the empty power supply chassis bay 96 Oracle ZFS Storage Appliance Customer Service Manual February 2016 ...

Page 97: ... the controller and then click power supply to verify that the online icon is green for the newly installed power supply How to Replace a ZS3 4 Memory Caution This procedure requires that you handle components that are sensitive to static discharge which can cause the component to fail To avoid damage wear an antistatic wrist strap and use an antistatic mat when handling components To identify a s...

Page 98: ...w to Power off the Controller on page 41 2 Extend the controller from the rack as described in How to Extend the Storage Controller from the Rack on page 41 3 Remove the top cover as described in How to Remove the Top Cover on page 42 4 To locate the DIMM you want to service press the Fault Remind Button on the storage controller The following illustration shows the Fault remind button on the ZS3 ...

Page 99: ...ice Required status indicator Lift the memory riser straight up to remove it from the motherboard and place it on an antistatic mat 6 Rotate both DIMM slot ejectors outward as far as they will go and carefully lift the faulted DIMM straight up to remove it from the socket Servicing the Hardware 99 ...

Page 100: ...connector aligning the notch with the key to ensure that the component is oriented correctly 8 Push the DIMM into the connector until the ejector tabs lock the component in place 9 To replace the cover 100 Oracle ZFS Storage Appliance Customer Service Manual February 2016 ...

Page 101: ...mory riser module into the associated CPU memory riser slot until the riser module locks in place b Place the top cover on the chassis so that it is forward of the rear of the storage controller by about an inch 2 5 cm Servicing the Hardware 101 ...

Page 102: ...S3 4 Memory c Slide the top cover toward the rear of the chassis until it seats and press down on the cover with both hands until both latches engage 102 Oracle ZFS Storage Appliance Customer Service Manual February 2016 ...

Page 103: ...How to Replace a ZS3 4 Memory 10 Push the release tabs on the side of each rail and slowly push the storage controller into the rack Servicing the Hardware 103 ...

Page 104: ...t two minutes after the power cords are plugged in 13 Use a pen or other pointed object to press and release the recessed Power button on the storage controller front panel The Power OK status indicator next to the Power button lights and remains lit The Maintenance Hardware screen of the BUI provides status of the replacement on the Details page for DIMMs 104 Oracle ZFS Storage Appliance Customer...

Page 105: ...hen click Slots to locate the faulted component All HBAs must be of the same type Ensure that you upgrade your system software before installing a newly released HBA 1 Shut down the controller using one of the power off methods described in How to Power off the Controller on page 41 2 Extend the controller from the rack as described in How to Extend the Storage Controller from the Rack on page 41 ...

Page 106: ...e retaining screw that holds the PCIe card to the chassis c Carefully remove the PCIe card from the connector and clean the slot with filtered compressed air if necessary d Install the replacement PCIe card into the PCIe card slot e Install the retaining screw to hold the PCIe card to the chassis 106 Oracle ZFS Storage Appliance Customer Service Manual February 2016 ...

Page 107: ...closed and locked position 6 To install the top cover a Place the top cover on the chassis 1 so that it is forward of the rear of the storage controller by about an inch 2 5 cm b Slide the top cover toward the rear of the chassis 2 until it seats Servicing the Hardware 107 ...

Page 108: ...onnect the power cords to the power supplies 9 Verify that standby power is on indicated by the Power OK status indicator flashing on the front panel about two minutes after the power cords are plugged in 10 Use a pen or other pointed object to press and release the recessed Power button on the storage controller front panel The Power OK status indicator next to the Power button lights and remains...

Page 109: ...xpansion storage as described in Connecting to Attached Storage on page 266 How to Replace a ZS3 4 Battery You might need to replace the battery if the storage controller fails to maintain the proper time when powered off and disconnected from the network You will need a small No 1 flat blade non metallic screwdriver or equivalent 1 Shut down the controller using one of the power off methods descr...

Page 110: ...e replacement battery into the motherboard with the positive side facing upward 6 To install the top cover a Place the top cover on the chassis 1 so that it is forward of the rear of the storage controller by about an inch 2 5 cm b Slide the top cover toward the rear of the chassis 2 until it seats 110 Oracle ZFS Storage Appliance Customer Service Manual February 2016 ...

Page 111: ...e controller 8 Connect the power cords to the power supplies 9 Verify that standby power is on indicated by the Power OK status indicator flashing on the front panel about two minutes after the power cords are plugged in 10 Use a pen or other pointed object to press and release the recessed Power button on the storage controller front panel The Power OK status indicator next to the Power button li...

Page 112: ...e Configuration The ZS3 2 controller is an enterprise class rackmount x86 system powered by the Intel Xeon processor It provides high performance and room for growth with expandable PCIe slots and 16 DIMM slots in a compact 2U footprint TABLE 22 ZS3 2 Controller Features CPU Memory Readzilla Boot Drive PCIe Slots HBA 2x8 core 2 1 GHz 256GB 16x16GB 512GB 16x32GB 1 4 1 6TB SAS 2 SSDs 2x2 5 inch 900G...

Page 113: ...empty and must contain drive fillers Figure Legend 1 Locator LED button white 5 Service Processor OK LED green 2 Service Action Required LED amber 6 Fan CPU Memory Service Required LED 3 Power OK LED green 7 USB 2 0 ports 4 Power button Note The LEDs below the Fan CPU Memory Service Required LED are not currently used ZS3 2 Rear Panel The ZS3 2 controller PCIe slots and rear panel components are s...

Page 114: ...ot 4 10 SP 15 pin VGA video port 18 Chassis ground post 5 PCIe slot 5 11 Serial management port 6 PCIe slot 6 12 Network management port Note The three Cluster I O ports 0 1 and GigE are reserved for cluster interconnection only ZS3 2 4x4 SAS 2 HBA The 4x4 SAS 2 HBA installed in PCIe slot 2 of the ZS3 2 provides connectivity to external DE2 and Sun Disk Shelves The HBA ports are numbered 0 3 left ...

Page 115: ...Measurement Height 3 44 in 87 4 mm Depth 20 25 in 514 mm Width 17 52 in 445 mm Weight 41 23 lb 18 70 kg ZS3 2 Electrical Specifications The ZS3 2 controller electrical specifications are listed below The power dissipation numbers listed are the maximum rated power numbers for the power supply The numbers are not a rating of the actual power consumption of the appliance Connectors Two C13 connector...

Page 116: ... subsystems and the service processor SP subsystem The SP subsystem controls the host power and monitors host system events power and environmental The SP controller draws power from the host 3 3V standby supply rail which is available whenever the system is receiving AC input power even when the system is turned off Power Distribution Board The power distribution board distributes main 12V power ...

Page 117: ...s internal storage power and cooling components are described in the following figure and legend A component identified as a field replaceable unit FRU must be replaced by trained Oracle service technicians FIGURE 27 ZS3 2 Controller Storage Power and Fan Components Servicing the Hardware 117 ...

Page 118: ...rd FRU 4 LED board FRU 8 PDB signal cable FRU 12 Power supplies ZS3 2 Internal Cables The ZS3 2 controller contains the following field replaceable unit FRU internal cables FRUs are not customer serviceable and must be replaced by trained Oracle service technicians FIGURE 28 ZS3 2 Controller Internal Cables 118 Oracle ZFS Storage Appliance Customer Service Manual February 2016 ...

Page 119: ...e 4 LED board cable ZS3 2 Motherboard Memory and PCIe Cards The ZS3 2 controller motherboard memory and PCIe components are described in the following figure and legend Note Field replaceable components FRUs are not customer serviceable and must be replaced by trained Oracle service technicians Servicing the Hardware 119 ...

Page 120: ...ard Memory and PCIe Components Figure Legend 1 Drive cage FRU 5 Airduct 9 Battery 2 Drive backplane FRU 6 PCIe Risers FRU 10 PDB duct 3 Motherboard FRU 7 PCIe cards 11 Power distribution board FRU 120 Oracle ZFS Storage Appliance Customer Service Manual February 2016 ...

Page 121: ...d has 16 slots in two groups that hold industry standard DDR3 low voltage LV DIMMS FIGURE 30 ZS3 2 Controller CPU and Memory Components Note All sockets must be occupied by identical DDR3 DIMMs TABLE 24 ZS3 2 Controller CPU Descriptions Capacity CPU 0 CPU 1 256GB D0 D2 D5 D7 blue D0 D2 D5 D7 blue Servicing the Hardware 121 ...

Page 122: ...ptions Mktg Part Number Description SG SAS6 INT Z 8 port 6Gb s SAS 2 internal HBA SG XPCIE2FC QF8 Z 2 port 8Gb FC HBA 7103791 4 port 4x4 SAS 2 6Gb s external HBA 7101674 2 port 16Gb FC HBA X1109A Z 2 port 10GbE SFP NIC X4242A 2 port InfiniBand CX2 HCA 7100477 4 port 1Gb Ethernet Copper UTP NIC 7100488 2 port 10Gb Ethernet Copper Base T NIC X2129A XCVR 850NM 1 10GPS SFP short reach X5562A Z 10GbE 1...

Page 123: ...ernal HBA 1 Base configuration 2 7067091 4 port 4x4 SAS 2 external HBA 2 Base configuration 3 7067091 4 port 4x4 SAS 2 external HBA 2 Second 4x4 port SAS 2 external HBA 3 7070195 4 port 1Gb Ethernet Copper UTP NIC 4 Optional recommended front end 3 371 4325 02 2 port 8Gb FC HBA 4 Optional FC target or initiator backup 3 7023303 2 port 16Gb FC HBA 4 Optional FC target or initiator backup 3 375 3696...

Page 124: ...f PCIe option cards always start installing in slot 6 and then work down to slot 3 in this order 2 Install InfiniBand CX2 HCA 375 3696 01 in slot 6 and continue until all InfiniBand options are installed and or 3 Install 10Gb Ethernet Optical NICs 7051223 and or 4 Install 10Gb Ethernet Copper NICs 7070006 and or 5 Install 8Gb FC HBAs 371 4325 02 or 16Gb FCs HBA 7023303 and or 6 Install 1Gb Etherne...

Page 125: ...alternate terminal interface to the SP console FIGURE 32 ZS3 2 Controller Network Management Port ZS3 2 Ethernet Ports The ZS3 2 has four RJ 45 10 Gigabit Ethernet 10GbE network connectors labeled NET 3 NET 2 NET 1 and NET 0 left to right on the rear panel The ports operate at 100 Mbits sec 1000 Mbits sec or 10 Gbits sec Use these ports to connect the appliance to the network Servicing the Hardwar...

Page 126: ...Gigabit Ethernet 1000BASE T Amber 1000 Mbits sec 10 Gigabit Ethernet 10GBASE T Green 10000 Mbits sec ZS3 2 Cluster I O Ports Two cluster serial ports 0 and 1 and one Ethernet port provide communication between two controllers to form a cluster configuration For information about how to connect cables to form a cluster see the topic Cabling ZS3 2 Clusters in Oracle ZFS Storage Appliance Administrat...

Page 127: ...e extreme care not to damage the internal RJ 45 receptacle To properly remove an RJ 45 cable from a cluster serial port do the following How to Disconnect the RJ 45 Cable from the Cluster Serial Port 1 Using your index finger press down fully on the RJ 45 release tab Be sure the tab is fully disengaged from the port Servicing the Hardware 127 ...

Page 128: ...out of the port Do not pull the plug upward or pinch the release tab with your fingers below the plug as shown below ZS3 2 Optional Cable Management Arm The following figure identifies the components of the second generation cable management arm CMA See the CMA installation instructions 128 Oracle ZFS Storage Appliance Customer Service Manual February 2016 ...

Page 129: ...Front slide bar 7 Slide rail latching bracket used with connector D 3 Velcro straps 6 8 Rear slide bar 4 Connector B 9 Cable covers 5 Connector C ZS3 2 Attached Storage The ZS3 2 controller connects to external storage through a 4 port 4x4 SAS 2 HBA You can attach from one to eight HDD only or SSD HDD Logzilla capable disk shelves to the Servicing the Hardware 129 ...

Page 130: ...ble parts of the system see ZS3 2 Controller Hardware Overview on page 112 Be sure to read sections Getting Started with Servicing the Hardware on page 11 and Prerequisites for Servicing Hardware on page 39 Oracle DE2 24s and Sun Disk Shelves can be used together with standalone and clustered controllers after certain hardware modifications Contact Oracle Service to update your controllers for dis...

Page 131: ...y at the system the amber Service Required indicator on the HDD or SSD should be illuminated 2 If you are not physically at the system turn on the locator indicator by clicking the locator icon 3 At the front of the controller pinch the air filter s left and right release levers inward 1 4 Pivot the air filter forward and lift if out of the chassis 2 Servicing the Hardware 131 ...

Page 132: ... pull the drive out of the drive slot 7 After at least 30 seconds navigate to the Hardware Maintenance screen and click the right arrow icon on the system controller to verify that the software has detected that the drive is not present 8 Align the replacement drive with the drive slot 132 Oracle ZFS Storage Appliance Customer Service Manual February 2016 ...

Page 133: ...ghtly inward 10 Press the release lever fully closed with a click securing the drive into the drive slot The Oracle ZFS Storage system software automatically detects and configures the new drive The device appears in the BUI Maintenance Hardware screen when you view details for the controller or drive shelf Servicing the Hardware 133 ...

Page 134: ...s indicated by an amber colored status LED Use the following procedure to replace a ZS3 2 power supply 1 Gain access to the rear of the storage controller where the faulted power supply is located 2 If a cable management arm CMA is installed press and hold the CMA release tab and rotate the arm out of the way 3 Disconnect the power cord from the faulted power supply 4 Press the release tab to the ...

Page 135: ...pty power supply chassis bay 7 Slide the power supply into the bay until the power supply seats and the release tab clicks 8 Push the release tabs on the side of each rail and slowly push the storage controller into the rack making sure no cables obstruct the path of the controller 9 Reconnect the data cables and the disk shelf cables Servicing the Hardware 135 ...

Page 136: ...red configuration The status of each fan module is represented by a single bi color LED The LEDs are located on the motherboard near each fan module and are visible from the rear panel by looking through the grille below the risers Use the following procedure to replace a ZS3 2 fan module 1 To locate the chassis you want to service click the associated locator icon on the Maintenance Hardware scre...

Page 137: ...inger and press down on the fan module with your thumb 7 Pull the band straight up and lift the fan module out of the chassis 8 Align the replacement fan module into the fan tray slot The green band is on the top of the fan module and the arrow points to the rear of the chassis Servicing the Hardware 137 ...

Page 138: ...tus indicators flashing green on the front panel 14 After the SP status indicator is solid green use a pen or other pointed object to press and release the recessed Power button on the front panel The Power OK status indicator next to the Power button lights and remains lit 15 Verify that the Fan OK status indicator is lit and that the fault status indicator on the replaced fan module is dim How t...

Page 139: ... warning icon To identify a specific memory module that has faulted you can open the storage controller and use the amber status LEDs on the motherboard 2 Power off the storage controller as described in How to Power off the Controller on page 41 3 Extend the controller from the rack as described in How to Extend the Storage Controller from the Rack on page 41 4 Remove the top cover as described i...

Page 140: ...How to Replace a ZS3 2 Memory 7 Raise the drive cage to the vertical position 2 140 Oracle ZFS Storage Appliance Customer Service Manual February 2016 ...

Page 141: ... thumbscrews that secure the air duct 9 Slide the left L thumbscrew bracket forward and off of the mounting pins 10 Slide the right R thumbscrew bracket rearward and off of the mounting pins Set the thumbscrew bracket aside Servicing the Hardware 141 ...

Page 142: ...d off the alignment pins Set the air duct aside 12 Press the button on the midplane An amber LED indicates the faulty DIMM 13 Press down and out on the release levers at both ends of the DIMM slot 142 Oracle ZFS Storage Appliance Customer Service Manual February 2016 ...

Page 143: ...How to Replace a ZS3 2 Memory 14 Lift the DIMM up and out of the slot Set the DIMM aside on an antistatic mat Servicing the Hardware 143 ...

Page 144: ... ZS3 2 Memory 15 Align the DIMM to the location where it installs into the slot Ensure that the notch in the DIMM lines up with the key in the slot 144 Oracle ZFS Storage Appliance Customer Service Manual February 2016 ...

Page 145: ...s 20 Push the release tabs on the side of each rail and slowly push the storage controller into the rack making sure no cables obstruct the path of the controller 21 Reconnect the data cables and the disk shelf cables 22 Connect the power cords to the power supplies Verify that standby power is on indicated by the Power OK and SP status indicators flashing green on the front panel 23 After the SP ...

Page 146: ...ou remove the card There will be a loss of access to the storage unless the system is in a clustered configuration 1 To locate a faulted component go to the Maintenance Hardware screen of the BUI and click the right arrow icon on the controller and then click Slots 2 Power off the storage controller as described in How to Power off the Controller on page 41 3 Extend the controller from the rack as...

Page 147: ...How to Replace a ZS3 2 PCIe Card or Riser 6 Fully loosen the two captive screws securing the riser to the motherboard Servicing the Hardware 147 ...

Page 148: ...herboard 8 Disconnect any internal cables attached to the PCIe cards installed in the riser 9 Swing the retainer to its fully open 120 degrees position Note that the riser 3 latch is slightly different than the latch for riser 1 and 2 148 Oracle ZFS Storage Appliance Customer Service Manual February 2016 ...

Page 149: ...the bracket alignment pin and out of the socket 11 Position the replacement PCIe card with where it will install into the riser The PCIe card bracket mates with the alignment pin and the socket of the riser 12 Press the PCIe card into the socket Servicing the Hardware 149 ...

Page 150: ...lignment of the PCIe card bracket and try again 14 Align the riser to the location where it installs into the chassis 15 Reconnect any previously removed internal cables to the PCIe card installed in the riser if doing so will ease installation of the riser 150 Oracle ZFS Storage Appliance Customer Service Manual February 2016 ...

Page 151: ...e of each rail and slowly push the storage controller into the rack making sure no cables obstruct the path of the controller 20 Reconnect the data cables and the disk shelf cables 21 Connect the power cords to the power supplies Verify that standby power is on indicated by the Power OK and SP status indicators flashing green on the front panel 22 After the SP status indicator is solid green use a...

Page 152: ...figuration The USB flash drive is located in the forward most USB socket at the center rear of the motherboard labeled USB 1 near where Riser 2 installs Use the following procedure to replace a ZS3 2 flash drive 1 Power off the storage controller as described in How to Power off the Controller on page 41 2 Extend the controller from the rack as described in How to Extend the Storage Controller fro...

Page 153: ...e screws 10 Push the release tabs on the side of each rail and slowly push the storage controller into the rack making sure no cables obstruct the path of the controller 11 Reconnect the data cables and the disk shelf cables 12 Connect the power cords to the power supplies Verify that standby power is on indicated by the Power OK and SP status indicators flashing green on the front panel 13 After ...

Page 154: ...ll No 1 flat blade non metallic screwdriver or equivalent Use the following procedure to replace a ZS3 2 battery 1 Power off the storage controller as described in How to Power off the Controller on page 41 2 Extend the controller from the rack as described in How to Extend the Storage Controller from the Rack on page 41 3 Remove the top cover as described in How to Remove the Top Cover on page 42...

Page 155: ...data cables and the disk shelf cables 13 Connect the power cords to the power supplies Verify that standby power is on indicated by the Power OK and SP status indicators flashing green on the front panel 14 After the SP status indicator is solid green use a pen or other pointed object to press and release the recessed Power button on the front panel The Power OK status indicator next to the Power ...

Page 156: ...ns Product ID Mktg Part Number CPU DIMMs Readzilla Boot Drive Mfg Part Number 7420 M2 7107089 4x8 core 2 0 GHz 8GB 16GB 1 6TB SAS 900GB SAS 7075466 7420 M2 7107090 4x10 core 2 40GHz 8GB 16GB 1 6TB SAS 900GB SAS 7075470 7420 7100566 4x8 core 2 0 GHz 8GB 16GB 512GB SATA 500GB SATA 7014572 7420 7100568 4x10 core 2 40GHz 8GB 16GB 512GB SATA 500GB SATA 7014573 You can identify your configuration by loo...

Page 157: ...tor LED and button white 7 Power Supply PS Service Required LED 13 SSD 2 optional 2 Service Required LED amber 8 Over Temperature Warning LED 14 SSD 3 optional 3 Power OK LED green 9 USB 2 0 Connectors 15 SSD 4 optional 4 Power button 10 DB 15 video connector 16 SSD 5 optional 5 Service Processor SP OK LED green 11 Boot drive 0 mirrored 6 Fan CPU Memory Service Required LED 12 Boot drive 1 mirrore...

Page 158: ...d in each controller can vary 7420 controllers have two 500GB SATA system boot drives in slots 0 and 1 configured as a mirrored pair Zero two three or four 512GB SSDs may optionally fill slots 2 through 5 in order In a 7420 cluster the number of SSDs installed in both controllers must match FIGURE 37 7420 Controller System Drive Figure Legend 1 Ready to remove blue 2 Service action required amber ...

Page 159: ...Network NET 10 100 1000 ports NET0 NET3 2 Power supply unit 0 AC inlet 9 USB 2 0 ports 3 Power supply unit 1 status LEDs OK green Power Supply Fail amber AC OK green 10 PCIe slots 5 9 4 Power supply unit 1 AC inlet 11 Network management NET MGT port 5 System status LEDs Power green Attention amber Locate white 12 Serial management SER MGT port 6 PCIe slots 0 4 13 DB 15 video connector 7 Cluster ca...

Page 160: ...d Field replaceable units FRUs should only be replaced by trained Oracle service technicians Motherboard The motherboard is a FRU and includes CPU modules slots for eight DIMM risers memory control subsystems and the service processor SP subsystem The SP subsystem controls the host power and monitors host system events power and environmental The SP controller draws power from the host s 3 3V stan...

Page 161: ...RUs and carry power to the storage controller fan modules In addition they contain fan module status LEDs and transfer I2C data for the fan modules Drive Backplane The six drive backplane is a FRU and includes the connectors for the drives as well as the interconnect for the I O board Power and Locator buttons and system component status LEDs Each drive has an LED indicator for Power Activity Faul...

Page 162: ...r or eight 8GB DDR3 DIMMs installed on each riser accommodating 256GB or 512GB of memory for 2 0GHz and 2 4Ghz CPUs Four or eight 16GB DDR3 DIMMs installed on each riser accommodating 512GB or 1TB of memory for 2 4Ghz CPUs Note For proper cooling memory risers corresponding to unpopulated CPU sockets must have fillers installed Previous 7420 controller configurations support two or four 1 86GHz or...

Page 163: ...e service label on the cover for DIMM placement information On every memory riser slots D0 D2 D4 and D6 must be populated optionally slots D1 D3 D5 and D7 may be populated as a group on all installed memory risers All DIMMs in the system must be identical Servicing the Hardware 163 ...

Page 164: ...nce Hardware view are displayed with the full name such as SYS MB P0 D7 7420 Fan Modules The Fan Modules and Fan Module LEDs of the storage controller are shown in the following figure The following LEDs are lit when a fan module fault is detected 164 Oracle ZFS Storage Appliance Customer Service Manual February 2016 ...

Page 165: ...in system operating temperature 7420 NIC HBA Options This table describes NIC HBA PCIe card options for standalone and cluster configurations TABLE 31 7420 Controller NIC HBA Options Mktg Part Number Description Mfg Part Number SGX SAS6 INT Z 8 port 6Gb s SAS 2 internal HBA 7054001 SG XPCIE2FC QF8 Z 2 port 8Gb FC HBA 371 4325 02 SG XPCIESAS GEN2 Z 2 port SAS x4 external HBA F375 3609 03 7105394 2 ...

Page 166: ...ion Max Note 0 7054001 8 port 6Gb s SAS 2 internal HBA 1 Slot 0 of the 7420 M2 is reserved for the SAS 2 internal HBA 0 371 4325 02 8Gb 2 port FC HBA 6 Optional FC target or initiator Backup for the 7420 controller 0 7051223 2 port optical 10GbE NIC 6 Optional recommended front end for the 7420 controller 0 7054739 4 port copper NIC 6 Optional recommended front end for the 7420 controller 1 F375 3...

Page 167: ...or Backup 3 375 3606 03 CX1 InfiniBand HCA 4 Optional recommended front end 3 7051223 2 port optical 10GE NIC 6 Optional recommended front end 3 375 3696 01 CX2 InfiniBand HCA 4 Optional recommended front end 4 7054739 4 port copper NIC 6 Optional recommended front end 4 375 3606 03 CX1 InfiniBand HCA 4 Optional recommended front end 4 7051223 2 port optical 10GE NIC 6 Optional recommended front e...

Page 168: ...6 Optional FC target or initiator Backup 6 375 3606 03 CX1 InfiniBand HCA 4 Optional recommended front end 6 7051223 2 port optical 10GE NIC 6 Optional recommended front end 6 375 3696 01 CX2 InfiniBand HCA 4 Optional recommended front end 7 F375 3609 03 7059331 for EU countries DP SAS external HBA 6 Additional optional back end 7 7054739 4 port copper NIC 6 Optional recommended front end 7 371 43...

Page 169: ...al recommended front end 9 7054739 4 port copper NIC 6 Optional recommended front end 7420 PCIe Slot Order When installing additional PCIe cards to your base 7420 configuration cards must be added in a specific order Note The 7420 M2 reserves slot 0 for a SAS 2 internal HBA and slots 1 and 8 for two SAS 2 external HBAs see 7420 PCIe Options on page 166 FIGURE 43 7420 Controller PCIe Cards and Slot...

Page 170: ...ot 7 2 6 3 5 4 0 not available for 7420 M2 9 6 Remaining 8Gb FC HBAs Slot 7 2 6 3 5 4 0 not available for 7420 M2 7420 Connectors The serial management connector SER MGT is an RJ 45 connector and provides a terminal connection to the SP console FIGURE 44 7420 Controller Serial Management Port The network management connector NET MGT is an RJ 45 connector and provides a LAN interface to the SP cons...

Page 171: ...rage 7320 controller 7320 Configuration Options The single controller base configuration is 96GB RAM 2x2 4GHz Quad Core processors one external SAS HBA and four 10 100 1000 Ethernet ports The following table describes base configurations for the 7320 TABLE 34 7320 Controller Base Configurations Mktg Part Number Description Mfg Part Number TA7320 24A S7320 2xCPU 24GB Single 597 1060 01 7104054 S732...

Page 172: ...l Recommended Front end 1 PCIe 371 4325 01 QLogic 8Gb DP FC HBA Optional FC Target or Initiator Backup 2 PCIe 375 3609 03 Sun Thebe External SAS HBA Base Configuration 7320 Cluster Configurations The 7320 cluster base configuration is 96GB RAM 2x2 4GHz Quad Core processors one external SAS HBA and four 10 100 1000 Ethernet ports and a Cluster card The Sun Storage 7420C Cluster Upgrade Kit XOPT 594...

Page 173: ...d configuration supports one to six disk shelves The 7320 controller base configuration includes two CPUs built in 4 x 1Gb s front end GigE ports redundant power supplies NIC options for expanded front end support tape backup InfiniBand and dual port SAS HBA for storage expansion The CPUs are Intel Xeon 5600 series 2 40GHz 80W with 4 core processors The standard memory configuration is 96GB 6 x 8G...

Page 174: ...ts of an HBA disk shelf and disks 1TB and 2TB SAS 2 The SAS 2 storage fabric supports a greater number of targets greater bandwidth higher reliability and bigger scale than the SAS 1 fabric 7320 Front Panel The following figure and legend identify the front panel LEDs FIGURE 46 7320 Controller Front Panel LEDs Figure Legend 1 Locate Button LED 2 Service Required LED amber 3 Power OK LED green 4 Po...

Page 175: ... through 5 in order Slots 6 and 7 are empty and must contain drive fillers FIGURE 47 7320 Controller Front Panel Drive Locations TABLE 37 7320 Controller Front Panel Drive Locations Disk Drive Locations HDD1 HDD3 HDD5 HDD0 HDD2 HDD4 HDD6 HDD7 7320 Rear Panel Following is an illustration of the 7320 storage controller rear panel The Sun 375 3609 belongs in slot 2 cannot be installed in any other sl...

Page 176: ...tion of the appliance Connectors Two C13 connectors which work on 110 220v outlets Input Nominal frequencies 50 60Hz Nominal voltage range 100 120 200 240 VAC Maximum current AC RMS 9 0 amps Max AC operating range 90 264 VAC Output 3 3 VDC STBY 3 6A 12 VDC 62 3A Power Dissipation Max power consumption 873 W Max heat output 2977 BTU hr Volt Ampere rating 891 VA 240 VAC 0 98P F 7320 Internal Boards ...

Page 177: ... fan power boards hard drive backplane and I O board Fan Board The fan boards are FRUs and carry power to the storage controller fan modules In addition they contain fan module status LEDs and transfer I2C data for the fan modules Disk Backplane The hard drive backplane is a FRU and includes the connectors for the hard disk drives as well as the interconnect for the I O board Power and Locator but...

Page 178: ...The following list contains the replaceable CPU and memory components of the 7320 TABLE 40 7320 Controller Replaceable CPU and Memory Components Part Number Description FRU CRU F371 4966 01 DIMM 8GB DDR3 2RX4 13 CRU F371 4885 01 Intel E5620 2 40G FRU The storage controller motherboard has 18 slots in two groups that hold industry standard DDR3 DIMM memory cards All sockets must be occupied by eith...

Page 179: ...egend identify the Power Distribution Fan Module components of the storage controller FIGURE 50 7320 Controller Power Distribution and Fan Module Components Figure Legend Figure Legend 1 Fan Modules 4 Power Distribution Bus Bar Assembly 2 Fan Board 5 Power Supplies 3 Paddle Board Servicing the Hardware 179 ...

Page 180: ...oller I O Components Figure Legend 1 Top cover 2 Left Control Panel Light Pipe Assembly 3 Drive Cage 4 Solid State Drives 5 blank USB Module 6 Right Control Panel Light Pipe Assembly 7320 PCIe Cards and Risers Following is the complete list of replaceable PCIe cards for the 7320 system 180 Oracle ZFS Storage Appliance Customer Service Manual February 2016 ...

Page 181: ...F375 3481 01 NIC Card Quad Port 1GigE Cu PCIe CRU F511 1496 04 Sun Fishworks Cluster Controller 200 PCIe FRU 7320 Connectors The serial management connector SERIAL MGT is an RJ 45 connector and is a terminal connection to the SP console FIGURE 52 7320 Controller Serial Management Port The network management connector NET MGT is an RJ 45 connector on the motherboard and provides an alternate termin...

Page 182: ...RU external 7320 Attached Storage The 7320 single and cluster controller configurations allow a single chain of one to six disk shelves Any combination of disk only and Logzilla capable shelves may be combined within the chain in any order The cabling configurations are unchanged Half populated shelf configurations are not supported For more information see Connecting to Attached Storage on page 2...

Page 183: ...ots and 18 DIMM slots into a compact 2U footprint Refer to the product site at https www oracle com storage nas index html for the most recent component specification Refer to the white paper Implementing Fibre Channel SAN Boot with Oracle s Sun ZFS Storage Appliance at http www oracle com technetwork articles servers storage admin fbsanboot 365291 html for details on FC SAN boot solutions using t...

Page 184: ...er OK LED green 10 HDD 5 16 HDD 11 5 HDD 0 11 HDD 6 17 Drive map 6 HDD 1 12 HDD 7 7120 Rear Panel The following figure and legend show the rear panel Note Optional Sun Dual Port 40Gb sec 4x InfiniBand QDR HCAdapter PCIe cards 375 3606 01 may be located in slots 1 2 or 3 375 3606 01 HCA expansion cards are not supported in the 10Gb network configurations 184 Oracle ZFS Storage Appliance Customer Se...

Page 185: ...hassis form factor dimensions are as follows TABLE 45 7120 Controller Dimensions Dimension Measurement Dimension Measurement Height 87 6 mm 3 45 in Depth 765 25 mm 30 13 in Width 436 8 mm 17 2 in Weight 29 54 kg 65 lb 7120 Electrical Specifications The following list shows the electrical specifications for the 7120 Note that the power dissipation numbers listed are the maximum rated power numbers ...

Page 186: ... environmental The SP controller draws power from the host 3 3V standby supply rail which is available whenever the system is receiving AC input power even when the system is turned off Power Distribution Board The power distribution board is a FRU and distributes main 12V power from the power supplies to the rest of the storage controller It is directly connected to the connector break out board ...

Page 187: ...dard memory configuration is 48GB 6x8GB DDR 1333 low voltage LV DIMMS Following are the replaceable CPU and memory components of the 7120 system TABLE 46 7120 Controller Replaceable CPU and Memory Components Part Number Description FRU CRU F371 4966 01 DIMM 8GB DDR3 2RX4 13 CRU F371 4885 01 Intel E5620 2 40G FRU All sockets must be occupied by either a filler or a DDR3 DIMM All DDR3 DIMMs must be ...

Page 188: ...20 Controller FIGURE 57 7120 Controller Fan Modules and LEDs The following figure and legend show the power distribution and associated components 188 Oracle ZFS Storage Appliance Customer Service Manual February 2016 ...

Page 189: ...nents Figure Legend 1 Fan Board 5 Power Distribution Board 2 SAS Expander Board 6 Connector Board 3 Disk Backplane 7 Power Supply Backplane 4 Front Control Panel Light Pipe Assembly 7120 I O Components The following figure and legend show the I O components of the 7120 system Servicing the Hardware 189 ...

Page 190: ...mbly 4 Left Control Panel Light Pipe Assembly 7120 NIC HBA Options The following table describes NIC HBA options for the 7120 TABLE 47 7120 Controller NIC HBA Options Mktg Part Number Description Mfg Part Number SG XPCIESAS GEN2 Z 2 port External Sun Thebe SAS x4 HBA PCIe 594 5889 01 190 Oracle ZFS Storage Appliance Customer Service Manual February 2016 ...

Page 191: ...ETE 0 PCIe 375 3481 01 Intel EXPI9404PT QP Copper NIC Optional Recommended Front end 0 PCIe 375 3617 01 Intel Niantic DP Optical 10GE NIC Optional Recommended Front end 0 PCIe 371 4325 01 QLogic 8Gb DP FC HBA Optional FC Target or Initiator Backup 0 PCIe 375 3606 01 Mellanox MHJH29 XTC InfiniBand HCA Optional Recommended Front end 1 PCIe 375 3617 01 Intel Niantic DP Optical 10GE NIC Optional Recom...

Page 192: ...n Thebe EXT 8P 6Gb s SAS HBA Additional Optional Back end 7120 Connectors The serial management connector SER MGT is an RJ 45 port and provides a terminal connection to the SP console FIGURE 60 7120 Controller Serial Management Port The network management connector NET MGT is an RJ 45 port and provides an alternate terminal interface to the SP console FIGURE 61 7120 Controller Network Management P...

Page 193: ...es must be configured before use 7120 Cables The following figure and legend show the storage controller internal cables Note The rear boot drives are not depicted in this illustration FIGURE 62 7120 Controller Storage Drive Data Cable Cable Connection 1 Storage Drive Data Cable Connection between the HBA PCI Express Card and the storage drive backplane Servicing the Hardware 193 ...

Page 194: ...helves must be fully populated with 24 HDDs Half populated shelf configurations are not supported For more information see Connecting to Attached Storage on page 266 See also Disk Shelf Hardware Overview on page 234 for component specifications and diagrams Replacing the 7x20 Hardware This section describes how to replace the following 7x20 hardware components How to Replace a 7x20 HDD or SSD on p...

Page 195: ... swappable and can be removed and installed while the storage controller is running without affecting other hardware capabilities Use the following procedure to replace a 7x20 HDD or SSD Note If you have more than one failed drive replace only one drive at a time Removing more than one drive in quick succession causes a hardware pool fault Also do not perform a pool configuration operation while a...

Page 196: ...Hardware Maintenance screen and click the right arrow icon on the system controller to verify that the software has detected that the drive is not present 6 Slide the replacement drive into the slot until it is fully seated 7 Close the latch to lock the drive in place 196 Oracle ZFS Storage Appliance Customer Service Manual February 2016 ...

Page 197: ...hassis as soon as the faulted fan is removed Fan modules are hot swappable and can be removed and installed while the storage controller is running without affecting other hardware capabilities 7120 or 7320 The fan modules and status indicators are hidden under a fan door in the 7120 and 7320 storage controllers Components may differ slightly between the 7120 and 7320 however service procedures fo...

Page 198: ... the controller from the rack as described in How to Extend the Storage Controller from the Rack on page 41 3 7120 or 7320 To replace the fan module a Open the fan module door while unlatching the release tabs on the door b Identify the faulted fan module by locating the corresponding Service Required status indicator or by clicking the locator icon on the Maintenance Hardware screen of the BUI fo...

Page 199: ...How to Replace a 7x20 Fan Module c Using thumb and forefinger pull the fan module up and out d Install the replacement fan module into the storage controller fan slot Servicing the Hardware 199 ...

Page 200: ...t the fan module f Verify that the Fan OK status indicator is lit and that the fault status indicator on the replaced fan module is dim g Close the top cover door immediately after replacing the fan to maintain airflow in the storage controller 4 7420 To replace the fan module 200 Oracle ZFS Storage Appliance Customer Service Manual February 2016 ...

Page 201: ...at the fan module e Verify that the Fan OK status indicator is lit and that the fault status indicator on the replaced fan module is dim 5 Verify that the Top Fan status indicator the Service Required status indicators and the Locator status indicator Locator button are dim 6 Push the release tabs on the side of each rail and slowly slide the storage controller into the rack How to Replace a 7x20 ...

Page 202: ...torage controller where the faulted power supply is located 2 If a cable management arm CMA is installed press and hold the CMA release tab and rotate the arm out of the way 3 Disconnect the power cord from the faulted power supply 4 Shut down the controller using one of the power off methods described in How to Power off the Controller on page 41 202 Oracle ZFS Storage Appliance Customer Service ...

Page 203: ...7120 or 7320 Release the latch then remove the power supply Components may differ slightly between the 7120 and 7320 however service procedures for each are identical The illustration shows the 7320 controller Servicing the Hardware 203 ...

Page 204: ...7420 Grasp the power supply handle and press the release latch to remove the power supply 5 Align the replacement power supply with the empty power supply chassis bay 204 Oracle ZFS Storage Appliance Customer Service Manual February 2016 ...

Page 205: ...or the controller and then click power supply to verify that the online icon is green for the newly installed power supply How to Replace a 7x20 Memory Caution This procedure requires that you handle components that are sensitive to static discharge which can cause the component to fail To avoid damage wear an antistatic wrist strap and use an antistatic mat when handling components To identify a ...

Page 206: ...20 Components may differ slightly between the 7120 and 7320 however service procedures for each are identical The illustration shows the 7320 controller To remove the top cover a Unlatch the fan module door pull the two release tabs back rotate the fan door to the open position and hold it there b Press the top cover release button and slide the top cover to the rear about a half inch 1 3 cm c Lif...

Page 207: ...remove the top cover a Simultaneously lift both cover latches in an upward motion b Lift up and remove the top cover 5 To locate the DIMM you want to service press the Fault Remind Button on the storage controller Servicing the Hardware 207 ...

Page 208: ...How to Replace a 7x20 Memory The following illustration shows the Fault remind button on the 7120 controller 208 Oracle ZFS Storage Appliance Customer Service Manual February 2016 ...

Page 209: ...How to Replace a 7x20 Memory The following illustration shows the Fault remind button on the 7420 controller Servicing the Hardware 209 ...

Page 210: ...indicator Lift the memory riser straight up to remove it from the motherboard and place it on an antistatic mat 7 Rotate both DIMM slot ejectors outward as far as they will go and carefully lift the faulted DIMM straight up to remove it from the socket 210 Oracle ZFS Storage Appliance Customer Service Manual February 2016 ...

Page 211: ... ejector tabs lock the component in place 10 7120 or 7320 Components may differ slightly between the 7120 and 7320 however service procedures for each are identical The illustration shows the 7320 To replace the cover a Place the top cover on the chassis so that it hangs over the rear of the storage controller by about an inch 2 5 cm b Slide the top cover forward until it seats Servicing the Hardw...

Page 212: ... c Close the fan cover and engage the fan cover latches The cover must be completely closed for the storage controller to power on 11 7420 To replace the cover 212 Oracle ZFS Storage Appliance Customer Service Manual February 2016 ...

Page 213: ...ory riser module into the associated CPU memory riser slot until the riser module locks in place b Place the top cover on the chassis so that it is forward of the rear of the storage controller by about an inch 2 5 cm Servicing the Hardware 213 ...

Page 214: ...x20 Memory c Slide the top cover toward the rear of the chassis until it seats and press down on the cover with both hands until both latches engage 214 Oracle ZFS Storage Appliance Customer Service Manual February 2016 ...

Page 215: ...How to Replace a 7x20 Memory 12 Push the release tabs on the side of each rail and slowly push the storage controller into the rack Servicing the Hardware 215 ...

Page 216: ...out two minutes after the power cords are plugged in 15 Use a pen or other pointed object to press and release the recessed Power button on the storage controller front panel The Power OK status indicator next to the Power button lights and remains lit The Maintenance Hardware screen of the BUI provides status of the replacement on the Details page for DIMMs 216 Oracle ZFS Storage Appliance Custom...

Page 217: ... controller and then click Slots to locate the faulted component All HBAs must be of the same type Ensure that you upgrade your system software before installing a newly released HBA 1 Power off the storage controller as described in How to Power off the Controller on page 41 2 Extend the controller from the rack as described in How to Extend the Storage Controller from the Rack on page 41 3 7120 ...

Page 218: ...roller see 7320 Configuration Options on page 171 for the 7320 the 7120 PCIe Options on page 191 for the 7120 or 7420 PCIe Options on page 166 for the 7420 6 7120 or 7320 To replace the PCIe card a Disconnect any data cables connected to the cards on the PCIe riser you want to replace Label the cables for proper connection later 218 Oracle ZFS Storage Appliance Customer Service Manual February 201...

Page 219: ...s on the end of the rear panel crossbar and lift the crossbar up and back to remove it c Loosen the captive retaining screw holding the front end of the riser and the Phillips screw on the end of the riser d Lift the riser up to remove it from the storage controller Servicing the Hardware 219 ...

Page 220: ...ontroller PCIe Card or Riser e Carefully remove the PCIe card from the riser board connector and clean the slot with filtered compressed air if necessary 220 Oracle ZFS Storage Appliance Customer Service Manual February 2016 ...

Page 221: ...How to Replace a 7x20 Controller PCIe Card or Riser f Seat the replacement PCIe card in the slot of the riser and connect the cables Servicing the Hardware 221 ...

Page 222: ...PCIe cards with the intended location on the motherboard and carefully insert it into its slot h Slide the back of the riser into the motherboard rear panel stiffener i Tighten the screw that secures the riser to the motherboard 222 Oracle ZFS Storage Appliance Customer Service Manual February 2016 ...

Page 223: ...roller PCIe Card or Riser j Replace the rear panel PCI crossbar by sliding it down over the PCIe risers ensuring the crossbar is secured with two captive Phillips screws 7 7420 To replace the PCIe card Servicing the Hardware 223 ...

Page 224: ...ve the retaining screw that holds the PCIe card to the chassis c Carefully remove the PCIe card from the connector and clean the slot with filtered compressed air if necessary d Install the replacement PCIe card into the PCIe card slot e Install the retaining screw to hold the PCIe card to the chassis 224 Oracle ZFS Storage Appliance Customer Service Manual February 2016 ...

Page 225: ... slightly between the 7120 and 7320 however service procedures for each are identical The illustration shows the 7320 controller To install the top cover a Place the top cover on the chassis so that it hangs over the rear of the storage controller by about an inch 2 5 cm then slide the top cover forward until it seats Servicing the Hardware 225 ...

Page 226: ...osed for the storage controller to power on 9 7420 To install the top cover a Place the top cover on the chassis 1 so that it is forward of the rear of the storage controller by about an inch 2 5 cm b Slide the top cover toward the rear of the chassis 2 until it seats 226 Oracle ZFS Storage Appliance Customer Service Manual February 2016 ...

Page 227: ...path of the controller 11 Connect the power cords to the power supplies 12 Verify that standby power is on indicated by the Power OK status indicator flashing on the front panel about two minutes after the power cords are plugged in 13 Use a pen or other pointed object to press and release the recessed Power button on the storage controller front panel The Power OK status indicator next to the Pow...

Page 228: ...ls to maintain the proper time when powered off and disconnected from the network You will need a small No 1 flat blade non metallic screwdriver or equivalent Use the following procedure to replace a 7x20 battery 1 Power off the storage controller as described in How to Power off the Controller on page 41 2 Extend the controller from the rack as described in How to Extend the Storage Controller fr...

Page 229: ...How to Replace a 7x20 Battery a Simultaneously lift both cover latches in an upward motion b Lift up and remove the top cover Servicing the Hardware 229 ...

Page 230: ...a 7x20 Battery 5 Using a small non metallic screwdriver press the latch and remove the battery from the motherboard The 7420 battery is shown here 230 Oracle ZFS Storage Appliance Customer Service Manual February 2016 ...

Page 231: ...120 or 7320 Components may differ slightly between the 7120 and 7320 however service procedures for each are identical The illustration shows the 7320 To install the top cover a Place the top cover on the chassis so that it hangs over the rear of the storage controller by about an inch 2 5 cm then slide the top cover forward until it seats Servicing the Hardware 231 ...

Page 232: ...e storage controller to power on 8 7420 To install the top cover a Place the top cover on the chassis 1 so that it is forward of the rear of the storage controller by about an inch 2 5 cm b Slide the top cover toward the rear of the chassis 2 until it seats 232 Oracle ZFS Storage Appliance Customer Service Manual February 2016 ...

Page 233: ... controller 10 Connect the power cords to the power supplies 11 Verify that standby power is on indicated by the Power OK status indicator flashing on the front panel about two minutes after the power cords are plugged in 12 Use a pen or other pointed object to press and release the recessed Power button on the storage controller front panel The Power OK status indicator next to the Power button l...

Page 234: ...r connecting to controllers and other disk shelves and dual load sharing power supply with fan modules This provides a fault tolerant environment with no single point of failure Component status is indicated with lights on the disk shelf and in the Maintenance Hardware screen of the BUI Refer to Replacing the Disk Shelf Hardware on page 249 for procedural information about replacing disk shelf com...

Page 235: ...e Enclosure DE2 24C The Oracle Storage Drive Enclosure DE2 24C is a 4U chassis that supports 24 3 5 SAS 2 drives The SSDs provide accelerated write operations and the high capacity HDDs provide reliable storage This disk shelf features dual redundant I O Modules IOMs and dual power supply with fan modules FIGURE 66 Sun Disk Shelf 24x3 5 SAS 2 Servicing the Hardware 235 ...

Page 236: ...tal of 864 disks In addition the high performance SAS 2 HBA is designed for the Oracle ZFS Storage Appliance family with a standard chip set to support a high density of target devices capable of attachment to 1024 targets With this fabric you are encouraged to apply entire shelves to pools so you can gain the benefits of No Single Point of Failure configurations and striping across the maximum po...

Page 237: ... and 23 FIGURE 68 Oracle Storage Drive Enclosure DE2 24C and Sun Disk Shelf Drive Locations Up to four Logzilla SSDs are supported per disk shelf Logzilla SSDs should be populated in order of slots 20 21 22 and 23 The Oracle Storage Drive Enclosure DE2 24C is shown and represents both models Disk Shelf Front Panel Indicators The following figures show the front panel indicators Servicing the Hardw...

Page 238: ...Enclosure DE2 24P Front Panel Indicators Figure Legend Figure Legend 1 System power indicator 4 Drive fault indicator 2 Module fault indicator 5 Power Activity indicator 3 Locate indicator 238 Oracle ZFS Storage Appliance Customer Service Manual February 2016 ...

Page 239: ... Oracle Storage Drive Enclosure DE2 24C Front Panel Indicators Figure Legend Figure Legend 1 System power indicator 4 Power Activity indicator 2 Module fault indicator 5 Drive fault indicator 3 Locate indicator Servicing the Hardware 239 ...

Page 240: ...perature warning indicator 2 System fault indicator 5 Disk fault indicator 8 SIM board fault indicator 3 System power indicator 6 Disk activity indicator 9 Power supply fault indicator Disk Shelf Back Panel The back panel consists of the power supplies fans I O Modules IOMs or SAS Interface Modules SIMs and indicator lights 240 Oracle ZFS Storage Appliance Customer Service Manual February 2016 ...

Page 241: ... Shelves FIGURE 72 Oracle Storage Drive Enclosure DE2 24P Back Panel Figure Legend Figure Legend 1 Power Supply with Fan Module 0 3 I O Module 0 2 I O Module 1 4 Power Supply with Fan Module 1 Servicing the Hardware 241 ...

Page 242: ...lot 0 4 Power Supply Filler Panel Slot 3 7 I O Module Filler Panel 2 Power Supply with Fan Module 1 5 I O Module Filler Panel 8 I O Module 1 3 Power Supply with Fan Module 2 6 I O Module 0 Note It is especially important that power supplies and their filler panels are in the correct slots 242 Oracle ZFS Storage Appliance Customer Service Manual February 2016 ...

Page 243: ...y 0 is on the left and power supply 1 is on the right 2 Removable SAS Interface Module SIM Boards SIM 0 is on the left and SIM 1 is on the right Disk Shelf I O Module Indicators The following disk shelves have I O Modules IOMs Oracle Storage Drive Enclosure DE2 24P Oracle Storage Drive Enclosure DE2 24C Servicing the Hardware 243 ...

Page 244: ...ervice only 2 Power OK indicator 5 SAS 2 Port 2 8 For Oracle service only 3 SAS 2 Port 0 6 Host port activity indicators Disk Shelf SIM Board Indicators The following disk shelves have SIM boards Sun Disk Shelf The following figure shows the SIM board indicators for the Sun Disk Shelf 244 Oracle ZFS Storage Appliance Customer Service Manual February 2016 ...

Page 245: ...ort OK indicator 4 Power supply fault indicator 9 SIM board OK indicator green SIM board fault indicator amber 5 Universal power connector 10 SIM locator indicator Disk Shelf Power Supply Indicators The following figure shows power supply with fan module indicators for these disk shelves Oracle Storage Drive Enclosure DE2 24P Oracle Storage Drive Enclosure DE2 24C Servicing the Hardware 245 ...

Page 246: ...6 Universal power input connector 2 Fan fail indicator 7 Power cord tie wrap 3 AC power fail indicator 4 Power supply status indicator 5 Power on off switch The following figure shows power supply with fan module indicators for these disk shelves Sun Disk Shelf 246 Oracle ZFS Storage Appliance Customer Service Manual February 2016 ...

Page 247: ...al power input connector 3 DC power status indicator 8 Right ejection arm and captive screw latch 4 Power supply status indicator 5 Power on off switch Disk Shelf Configurations The following tables describe and provide part numbers for the supported expansion storage shelves Oracle Storage Drive Enclosure DE2 24P The following sections describe disk shelf components Servicing the Hardware 247 ...

Page 248: ...B 7 2Krpm SAS 2 3 5 HDD 8TB 7 2Krpm SAS 3 3 5 HDD 73GB SSD SAS 2 2 5 Write Flash Accelerator 2 5 to 3 5 Drive Adapter 200GB SSD SAS 3 2 5 Write Flash Accelerator 2 5 to 3 5 Drive Adapter Filler Panel Drive Enclosure DE2 24C Sun Disk Shelf DS2 The Sun Disk Shelf DS2 can contain the following components Sun Disk Shelf DS2 24x3 5 SAS 2 1TB 7 2Krpm SAS 2 3 5 HDD 2TB 7 2Krpm SAS 2 3 5 HDD 3TB 7 2Krpm S...

Page 249: ... and foam material from the work area Wear an antistatic wrist strap at all times when handling any CRU Before handling any CRU discharge any static electricity by touching a grounded surface Do not remove a CRU from its antistatic protective bag until you are ready to install it After removing a CRU from the chassis immediately place it in an antistatic bag or antistatic packaging Handle any card...

Page 250: ... Maintenance System in the BUI or maintenance system updates in the CLI 1 Faulted drives are indicated by an amber LED Go to the Maintenance Hardware section of the BUI click the right arrow icon at the beginning of the appropriate disk shelf row and click the information icon for the appropriate drive to view details or click the locator icon to turn on the locator LED To add not replace a new ca...

Page 251: ...Disk Shelf Drive OR 5 Grasp the middle of the drive body and pull it toward you to remove it from the chassis 6 Wait at least 30 seconds 7 Ensure the new drive lever is in the fully extended position Servicing the Hardware 251 ...

Page 252: ...lace a Faulty Disk Shelf Drive 8 While constantly pushing toward the pivot point of the lever slide the drive fully into the chassis slot OR 252 Oracle ZFS Storage Appliance Customer Service Manual February 2016 ...

Page 253: ... replaceable unit CRU Power supplies are hot swappable meaning they can be replaced one at a time without removing power from the disk shelf The modules can produce a high energy hazard and should only be replaced by instructed individuals with authorized access to the equipment 1 Separate indicator LEDs on the back panel see Disk Shelf Back Panel on page 240 represent the operational state of pow...

Page 254: ...place a Disk Shelf Power Supply Grasp the latch and the opposite side of the module and squeeze together to release the lever Sun Disk Shelf 254 Oracle ZFS Storage Appliance Customer Service Manual February 2016 ...

Page 255: ... open 6 Pull the module out of the chassis being careful not to damage the connector pins in the back 7 With the lever ejection arms fully open slide the new module into the chassis slot until it contacts the chassis backplane and the lever ejection arms begin to engage 8 Close the lever ejection arms Oracle Storage Drive Enclosure DE2 24P or DE2 24C Servicing the Hardware 255 ...

Page 256: ...How to Replace a Disk Shelf Power Supply Push the lever fully closed until you hear or feel a click Sun Disk Shelf 256 Oracle ZFS Storage Appliance Customer Service Manual February 2016 ...

Page 257: ...assis 9 Ensure the power supply on off switch is in the O off position 10 Plug the power cord into the new power supply and attach the power cord tie strap to the power cord 11 Place the power supply on off switch to the I on position The Power OK status LED should be a steady green and all other indicators should be off Servicing the Hardware 257 ...

Page 258: ...propriate disk shelf row As appropriate for the failure click either PSU or Fan to verify that the online icon is green for the newly installed power supply with fan module How to Replace a Disk Shelf I O Module Caution Do not remove a component if you do not have an immediate replacement The disk shelf must not be operated without all components in place including filler panels Refer to Disk Shel...

Page 259: ...e button toward the lever hole to release the lever 5 Grasp the lever and remove the I O Module being careful not to damage the connector pins in back 6 With the lever of the new I O Module in the open position slide the I O Module into the disk shelf being careful of the connector pins 7 Push the lever fully closed until you hear or feel a click 8 Reconnect the interface cables to their original ...

Page 260: ... indicated by an amber LED Go to the Maintenance Hardware section of the BUI click the right arrow icon at the beginning of the appropriate disk shelf row and then click Slot to view details or click the locator icon to turn on the locator LED 2 Locate the failed SIM at the back of the disk tray 3 Label and disconnect the tray interface cables 4 Use two hands to disconnect the SAS cable Grasp the ...

Page 261: ...sk Shelf SIM Board 6 Pull each ejector tab outward and push to the sides to release and partially eject the SIM from the chassis 7 Grasp the middle of the SIM board and slide it out of the slot Servicing the Hardware 261 ...

Page 262: ... to secure the board 11 Reconnect the SAS interface cables to their original locations 12 Wait approximately 60 seconds for the SIM board to complete its boot process at which time the Power LED should be solid green and the SIM locate LED should be off 13 Go to the Maintenance Hardware section of the BUI click the right arrow icon at the beginning of the appropriate disk shelf row and then click ...

Page 263: ...FS Storage Appliance Installation Guide For disk shelf placement guidelines see Cabinet Guidelines in Oracle ZFS Storage Appliance Cabling Guide 3 Working with a single disk shelf cable at a time connect the cables to the controller s and other disk shelves using redundant paths and following the diagrams in the Oracle ZFS Storage Appliance Cabling Guide Always retain one active path while cabling...

Page 264: ...ot Cache devices can be added without removing power from the disk shelf To replace a faulty drive see How to Replace a Faulty Disk Shelf Drive on page 249 1 Remove the filler panel from the appropriate slot For SSD locations and slot order see the Disk Shelf Hardware Overview on page 234 2 Ensure the new drive lever is in the fully extended position 3 While constantly pushing toward the pivot poi...

Page 265: ...n of the BUI click the right arrow icon at the beginning of the appropriate disk shelf row and then click Disk Verify that the new disk is present and that its disk icon icon is green 6 To add the new drive to a pool go to Configuration Storage 7 From the Available Pools list select the pool you are adding the drive to 8 Click the Add button to add the drive to the pool 9 Select the drive you are ...

Page 266: ...uration The following table shows the maximum number of disk shelves supported per controller configuration Note Controllers cannot use 2X4 port SAS 2 HBAs and 4X4 port SAS 2 HBAs at the same time For controllers that support using DE2 24 and Sun Disk Shelves together the controller must use 4X4 port SAS 2 HBAs which are only supported with software version 2013 1 0 and later TABLE 49 Maximum Numb...

Page 267: ...ferred Updates on page 299 Working with Firmware Upgrades on page 307 Rolling Back System Software on page 309 Removing an Update Package on page 311 For information on servicing the hardware components see the appropriate section Servicing the ZS4 4 Controller on page 44 Servicing the ZS3 4 Controller on page 76 Servicing the ZS3 2 Controller on page 112 Servicing the 7x20 Controller on page 156 ...

Page 268: ...enerate support bundles containing system configuration information and core files for use by Oracle support personnel for troubleshooting system problems When the Phone Home service is enabled support bundles will be generated automatically and securely uploaded in response to faults You can also manually generate and upload bundles using the BUI or CLI To facilitate support bundle uploads you mu...

Page 269: ...on If the bundle is being generated it will be deleted If the bundle is being uploaded the upload will be cancelled and the appliance will not retry it later Download the support bundle This icon appears after the bundle is built and the upload is cancelled or fails Try again to upload the bundle to support Cancel any pending operation and delete the support bundle How to Generate and Upload a Sup...

Page 270: ...will receive an alert when the bundle has finished uploading Please save the following filename as Oracle support personnel will need it in order to access the bundle upload issue 3 9999999999 3 9999999999_ak edd08324 f091 cd19 b4c9 bb508d6ecc59 tar gz upload issue 3 9999999999 3 9999999999_ak fee4b98a e3f7 e600 877d b6d7933255f3 tar gz How to View Support Bundle Details CLI Use the following proc...

Page 271: ...ilename upload uuid fee4b98a e3f7 e600 877d b6d7933255f3 ak fee4b98a e3f7 e600 877d b6d7933255f3 tar gz status building date 2014 1 9 17 42 09 type User initiated step_progress 66 How to Retry a Failed Upload CLI Use the following procedure to retry a failed upload using the CLI 1 To select a support bundle use the following CLI command loader maintenance system bundles select fee4b98a e3f7 e600 8...

Page 272: ...ugh the tasks performed as part of the initial configuration as described in Initial Appliance Configuration in Oracle ZFS Storage Appliance Administration Guide Release 2013 1 5 0 This does not change any of the current settings unless explicitly requested User data on the storage pool including projects and shares is not affected To perform an initial setup BUI Click the Initial Setup button on ...

Page 273: ...iously saved configuration from a backup Export a saved configuration as a plain file so that it may be stored on an external server or included in a backup of a share on the appliance itself Import a saved configuration that was previously exported from this system or another system making it available for a restore operation To back up the configuration and manage the backups use these tasks How...

Page 274: ...M and the names only of the keys Note In a cluster configuration configuration backups are visible only on the node on which they were created or imported A configuration backup does not include User data shares and LUNs Your user data must be backed up separately using NDMP backup software snapshots and or remote replication User passwords for directory users These remain stored solely in your se...

Page 275: ...onnected to a network address managed by DHCP the browser session is interrupted during the restore The restore process completes in the background but you need to reload or point the browser at a new restored network address to continue For this reason it may be desirable to initiate a complex configuration restore from the service processor serial console using the CLI Un cluster restore and re ...

Page 276: ...at unauthorized users cannot read the backup file Local user passwords are stored in the backup file in encrypted hashed format not as clear text However on the system access to these password hashes is restricted as they could be used as input to dictionary attacks Therefore administrators must carefully protect configuration backups that are exported either by restricting file access to the back...

Page 277: ...m configs backup Backup Configuration Enter a descriptive comment for this configuration and click Commit to backup current appliance settings host maintenance system configs conf_backup step0 set comment pre upgrade comment pre upgrade 2 To execute the backup operation use the following CLI command host maintenance system configs conf_backup step0 done host maintenance system configs How to Resto...

Page 278: ...lowing CLI command host maintenance system configs conf_restore step0 done Note Storage pools are not automatically unconfigured when you execute the restore command How to Delete a Saved Configuration BUI Use the following procedure to delete a saved configuration 1 Go to Maintenance System 2 For the appropriate configuration click the trash icon How to Delete a Saved Configuration CLI Use the fo...

Page 279: ...o be imported back to the appliance successfully How to Export a Saved Configuration CLI Use the following procedure to export a saved configuration You can also use the export function to export the file to a share on the appliance itself that has the HTTP or FTP protocol enabled for writing You can enter a username and password for authentication to the remote server if one is required To export...

Page 280: ... if one is required To import a saved configuration use the following CLI command and specify the universal unique identifier for the backup host maintenance system configs import cb2f005f cf2b 608f 90db fc7a0503db2a How to List Configurations CLI Use the following procedure to list configurations To list configurations use the following CLI command host maintenance system configs list CONFIG DATE...

Page 281: ...will receive an alert notification similar to the following An update is available on My Oracle Support version 2013 1 0 1 3 Go to Maintenance System Software Updates and click the download icon at the far right 4 Click the download link shown in the popup window and save the zip file How to Set Up Software Notification CLI Use the following procedure to set up software notifications using the CLI...

Page 282: ...ce is enabled 1 Go to Maintenance System Software Updates 2 Notice the date of the last software check displayed next to the Check now link 3 Click the Check now link 4 When an update is available on MOS you see the following under STATUS Update available for download 5 Click the download icon at the far right 6 Click the download link shown in the pop up window and save the zip file How to Check ...

Page 283: ...1 1 5 show Properties version 2013 1 1 5 date 2014 2 18 08 00 status downloadable url https updates oracle com Orion Services download p18269573_20131_Generic zip aru 17312483 patch_file p18269573_20131_Generic zip checkdate 2014 3 4 zfs appliance maintenance system 2013 1 1 5 Updating Software on a Single Controller This section describes updating the system software for an Oracle ZFS Storage App...

Page 284: ...bar may not be updated continuously during the upload if you see a watch cursor just wait a minute in the worst case the upload will proceed all the way to completion and you may not see the progress bar After the media is done uploading it is automatically unpacked and verified When the verification completes the software update is displayed 4 Click the information icon to view the Release Notes ...

Page 285: ...ance system updates download uncommitted get url unset user unset password unset 2 You must set the url property to be a valid URL for the download This may be either local to your network or over the internet The URL can be either HTTP beginning with http or FTP beginning with ftp If user authentication is required it may be a part of the URL for example ftp myusername mypasswd myserver export fo...

Page 286: ...1 0 nd As the update proceeds the latest message will be printed You can cancel the upgrade at any time by pressing C at which point you will be prompted for confirmation dory maintenance system updates select ak nas 2009 10 14 1 0 nd dory maintenance system updates ak nas 2009 10 14 1 0 nd upgrade The selected software update requires a system reboot in order to take effect The system will automa...

Page 287: ...le ZFS Storage Appliance with clustered controllers Cluster update is also referred to as a rolling update Controllers are updated one at a time and each controller is updated while it is not providing service to clients A cluster update can be performed using either the BUI or CLI Preconditions Check the following conditions on both controllers immediately before applying an update Ensure that an...

Page 288: ...ve resources perform the update on that controller first to avoid availability delays This is Controller A If both controllers in a cluster have active resources choose either controller to update first The controllers can be updated in either order Note For the purpose of this procedure the first controller to be updated is referred to as Controller A the other one is Controller B 3 On your local...

Page 289: ...urces uncommitted set owner other controller configuration cluster resources uncommitted set type private configuration cluster resources uncommitted commit Note that each controller must be the current owner of the management interface 2 Lock the management interface on Controller B as above 3 Verify each controller has a dedicated management interface and a private cluster resource For each cont...

Page 290: ...tes download uncommitted set user bmc user bmc controller a maintenance system updates download uncommitted set password Enter password password controller a maintenance system updates download uncommitted commit Transferred 157M of 484M 32 3 controller b maintenance system updates download uncommitted set url ftp foo update pkg gz url ftp foo update pkg gz controller b maintenance system updates ...

Page 291: ...he resources it starts any firmware upgrades that are part of the update 8 To monitor the progress of the firmware upgrades see the update counter on the Maintenance System page of Controller A 9 To ensure the number of pending resources is decreasing use the information icon to view the update details 10 Wait for the firmware upgrade to complete then go to Maintenance Hardware and verify that all...

Page 292: ...rces from Controller B controller a configuration cluster takeover After Controller A has control of the resources it starts any hardware firmware upgrades as part of the update See Working with Firmware Upgrades on page 307 5 From Controller A verify that all firmware upgrades are complete controller a maintenance system updates show controller a maintenance system updates firmwareUpdatesDetails ...

Page 293: ...n you want to install As part of the update Controller B reboots 3 After Controller B has fully rebooted log back in to the BUI of Controller B 4 To change the cluster to an Active Active state go to the Configuration Cluster page on Controller A and click Failback 5 Go to Maintenance Hardware and verify that all disks are online all lights are green Click the right arrow icon next to the controll...

Page 294: ...E ST330057SSUN300G 001117G1G929 6SJ1G929 15000 disk 001 HDD 1 ok SEAGATE ST330057SSUN300G 001117G1GA8Y 6SJ1GA8Y 15000 disk 002 HDD 2 ok SEAGATE ST330057SSUN300G 001117G1KDPZ 6SJ1KDPZ 15000 6 Ensure there are no pool errors controller b configuration storage show Controller B is now updated Working with Health Checks System level health checks are provided to help ensure that no pathologies interfe...

Page 295: ... software updates Note Running an update health check does not replace meeting required preconditions Precondition checks described in Preconditions on page 287 must also be executed and problems resolved prior to updating the system software How to Check System Health BUI Use the following procedure to check system health using the BUI 1 After you select and start an update update health checks m...

Page 296: ...ealth Checks in Progress in the BUI 3 After completion the System Ready state changes to Yes or No with a link to the Alert Log FIGURE 81 Completed Update Health Checks in the BUI 296 Oracle ZFS Storage Appliance Customer Service Manual February 2016 ...

Page 297: ...idate system readiness before an update is attempted and may also be executed independently using the check command Are you sure Y N Healthcheck running Healthcheck completed There are no issues at this time which would cause an upgrade to this media to be aborted Troubleshooting Update Health Check Failures Prior to the actual update health checks are performed automatically when an update is sta...

Page 298: ... Check Alerts ID and Alert Log Message Failure Resolution Steps B1 System software update cannot proceed Slot label in disk shelf name is reported as absent SIM or IOM cannot be detected 1 2 4 B2 System software update cannot proceed Slot label in disk shelf name is faulted SIM or IOM is faulted 1 2 4 C1 System software update cannot proceed Some slots of disk shelf name have no firmware revision ...

Page 299: ...econnecting cables 3 Identify affected chassis and remove faulted disk After 30 seconds re seat disk and wait for steady or flashing LED 4 Contact Oracle Support for component service or replacement Applying Deferred Updates Each update may come with new firmware or updates to external resources In general these updates are backwards compatible and applied automatically without user intervention T...

Page 300: ... updates Note Replication does not work across deferred updates After deferred updates are applied that increment the stream format version it is no longer possible to replicate to an older system See the Incompatible Target failure in section Replication Failures in Oracle ZFS Storage Appliance Administration Guide Release 2013 1 5 0 TABLE 52 Deferred Updates Feature Version introduced Support fo...

Page 301: ...he available deferred updates a description and what effects the update will have on the system 2 Click the Apply button to apply all available deferred updates Deferred updates will apply to both nodes in a cluster and the cluster peer must be up and available to apply any deferred updates How to Apply Deferred Updates CLI Use the following procedure to apply deferred updates using the CLI To see...

Page 302: ...res clownfish maintenance system updates apply Applying deferred updates will prevent rolling back to previous versions of software Are you sure Y N clownfish maintenance system updates apply Understanding Deferred Updates This sections describe support for a wide range of deferred updates in a detailed way Support for NDMP zfs Replica Backup Deferred Update With this deferred update NDMP backup t...

Page 303: ...port large block sizes fail Support for Multiple Initiator Groups per LUN Deferred Update This deferred update allows a LUN to be associated with more than one initiator group at a time If replicating LUNs with this update applied also apply the update to the replication target system s Support for Optional Child Dir Deferred Update This deferred update improves list retrieval performance and repl...

Page 304: ...e old much slower algorithm Applying this update is equivalent to upgrading the on disk ZFS pool to version 27 Support for Snapshot Deletion Deferred Update This deferred update increases snapshot deletion parallelism and reduces the size of transaction groups associated with snapshot deletion to improve systemic responsiveness These improvements rely on a ZFS pool upgrade provided by this update ...

Page 305: ...ace in the storage pool Additionally the system does not send replication updates for actions configured on earlier releases After applying this update incoming replication updates for replicas originally received on earlier releases continue normally and without a full resync The system also sends incremental replication updates for actions configured under earlier releases Support for Dedup Defe...

Page 306: ...s the current usage user or group to be queried on a per filesystem or per project basis To quote the product documentation Quotas can be set on a user or group at the filesystem level These enforce physical data usage based on the POSIX or Windows identity of the owner or group of the file or directory There are some significant differences between user and group quotas and filesystem and project...

Page 307: ...e application of a software upgrade any hardware for which the upgrade includes newer versions of firmware is upgraded There are several types of devices for which firmware upgrades may be made available each has distinct characteristics Disks storage enclosures and certain internal SAS devices are upgraded in the background When this is occurring the firmware upgrade progress is displayed in the ...

Page 308: ... below are reevaluated in the context of the new cluster state and if possible firmware upgrades resume Caution Unless absolutely necessary takeover and failback operations should not be performed while firmware upgrades are in progress The rolling upgrade procedure documented later meets all of these best practices and addresses the per device class restrictions described later It should always b...

Page 309: ...edure reverts all of the system software and all of the metadata settings of the system back to their state just prior to applying an update This feature is implemented by taking a snapshot of various aspects of the system before the new update is applied and rolling back this snapshot to implement the rollback The implications of rollback are as follows Any appliance configuration changes are rev...

Page 310: ...cted OS e to edit the commands before booting or c for a command line After the rollback boot menu entry is selected the system boots the old kernel software but the rollback must be manually confirmed on the console to commit the rollback which effectively removes all changes to the system that have happened since as described above The confirmation step looks like this SunOS Release 5 11 Version...

Page 311: ...te that corresponds to that version and execute the rollback command You will be asked to confirm to execute a rollback and then the system will reboot and execute the rollback Unlike fail safe rollback you will not be asked for further confirmation when the system reboots Removing an Update Package This sections describes how to remove an update package How to Remove an Update Package BUI Use the...

Page 312: ...ory maintenance system updates destroy ak nas 2009 10 14 1 0 nd This will destroy the update ak nas 2009 10 14 1 0 nd Are you sure Y N y dory maintenance system updates 312 Oracle ZFS Storage Appliance Customer Service Manual February 2016 ...

Reviews:

No comments

Brands by name

Popular brands

Load more brands