manualshive.com logo in svg

Oracle SPARC T8-2, Service Manual

Share
Download
Oracle SPARC T8-2 Service Manual Download Page 11

Using This Documentation

■

Overview

 – Describes how to troubleshoot and maintain the server

■

Audience

 – Technicians, system administrators, and authorized service providers

■

Required knowledge

 – This guide is intended for trained technicians and authorized

service personnel who have been instructed on the hazards within the equipment and are

qualified to remove and replace hardware

Product Documentation Library

Documentation and resources for this product and related products are available at 

http://www.

oracle.com/goto/t8-2/docs

.

Feedback

Provide feedback about this documentation at 

http://www.oracle.com/goto/docfeedback

.

Using This Documentation

11

Summary of Contents for SPARC T8-2

Page 1: ...SPARC T8 2 Server Service Manual Part No E80511 04 June 2019 ...

Page 2: ......

Page 3: ...rmation management applications It is not developed or intended for use in any inherently dangerous applications including applications that may create a risk of personal injury If you use this software or hardware in dangerous applications then you shall be responsible to take all appropriate fail safe backup redundancy and other measures to ensure its safe use Oracle Corporation and its affiliat...

Page 4: ...n des informations Ce logiciel ou matériel n est pas conçu ni n est destiné à être utilisé dans des applications à risque notamment dans des applications pouvant causer un risque de dommages corporels Si vous utilisez ce logiciel ou ce matériel dans le cadre d applications dangereuses il est de votre responsabilité de prendre toutes les mesures de secours de sauvegarde de redondance et autres mesu...

Page 5: ...ations 21 Power Distribution and Fan Module Component Locations 22 Server Block Diagram 23 Detecting and Managing Faults 27 Checking for Faults 27 Related Information 28 Log In to Oracle ILOM Service 28 Identify Faulted Components 29 Identify Disabled Components 31 Component Names Displayed by Diagnostic Software 32 Interpreting LEDs 33 Front Panel Controls and LEDs 34 Rear Panel Controls and LEDs...

Page 6: ...oving Power From the Server 51 Prepare to Power Off the Server 51 Power Off the Server Oracle ILOM 52 Power Off the Server Server Power Button Graceful 53 Power Off the Server Emergency Shutdown 53 Disconnect Power Cords 54 Accessing Server Components 54 Prevent ESD Damage 55 Extend the Server to the Service Position 55 Release the CMA 57 Remove the Server From the Rack 59 Remove the Top Cover 60 ...

Page 7: ...a Power Supply 86 Verify a Power Supply 88 Servicing Memory Risers and DIMMs 89 Memory Riser and DIMM Configuration 89 Identifying DIMMs 90 Memory Riser and DIMM FRU Names 91 Add Memory to the Server 93 Locating and Replacing a Faulty DIMM 94 Locate a Faulty DIMM Oracle ILOM 94 Locate a Faulty DIMM LEDs 95 Replace a Faulty DIMM 97 Remove a Memory Riser 98 Remove a DIMM 100 Install a DIMM 102 Insta...

Page 8: ...cing the SPM 129 SPM Firmware and Configuration 129 Remove the SPM 130 Install the SPM 131 Verify the SPM 134 Servicing the Fan Board 137 Remove the Fan Board 137 Install the Fan Board 141 Verify the Fan Board 145 Servicing the Motherboard 147 Remove the Motherboard 147 Install the Motherboard 151 Reactivate RAID Volumes 155 Verify the Motherboard 158 Servicing the Drive Backplane 159 Remove the D...

Page 9: ...ckplane 167 Verify the PS Backplane 169 Returning the Server to Operation 171 Replace the Top Cover 172 Return the Server to the Normal Operating Position 173 Attach Power Cords 174 Power On the Server Oracle ILOM 174 Power On the Server System Power Button 175 Glossary 177 Index 183 9 ...

Page 10: ...10 SPARC T8 2 Server Service Manual June 2019 ...

Page 11: ...echnicians and authorized service personnel who have been instructed on the hazards within the equipment and are qualified to remove and replace hardware Product Documentation Library Documentation and resources for this product and related products are available at http www oracle com goto t8 2 docs Feedback Provide feedback about this documentation at http www oracle com goto docfeedback Using T...

Page 12: ...12 SPARC T8 2 Server Service Manual June 2019 ...

Page 13: ...nent Locations on page 17 Motherboard Component Locations on page 19 I O Component Locations on page 21 Power Distribution and Fan Module Component Locations on page 22 Server Block Diagram on page 23 Related Information Detecting and Managing Faults on page 27 Preparing for Service on page 45 Front Panel Components Service The following figure shows the layout of the server front panel including ...

Page 14: ...er for fan module FAN processor CPU and memory MEM Servicing Fan Modules on page 75 Servicing the Motherboard on page 147 Servicing Memory Risers and DIMMs on p 7 PS Service Action Required LED amber Servicing Power Supplies on page 83 8 Overtemp LED amber Front Panel Controls and LEDs on page 34 9 Drive labels 10 11 12 13 HDD 5 or NVMe 3 HDD 4 or NVMe 2 HDD 3 or NVMe 1 HDD 2 or NVMe 0 Servicing D...

Page 15: ... AC inlet 5 Server status LEDs Rear Panel Controls and LEDs on page 36 6 PCIe card slots 1 to 4 left to right Servicing PCIe Cards on page 119 7 NET 10 100 1000 ports 4 NET 0 to NET 3 8 USB 3 0 connectors 2 9 PCIe card slots 5 to 8 left to right Servicing PCIe Cards on page 119 10 DB 15 video connector 11 SER MGT RJ 45 serial port 12 NET MGT port Internal System Cables The following table identifi...

Page 16: ... This cable carries signals between the power distribution board and the motherboard Drive data cables 2 bundled These cables carry data and control signals between the motherboard and the drive backplane Mini SAS cables 2 bundled These cables connect the drive backplane HDD SSD to either an on motherboard SAS controller or to a PCI E low profile form factor HBA option Related Information Internal...

Page 17: ...he replaceable component locations with the top cover removed No Component Oracle ILOM Target Links 1 SP board module SYS MB SPM Servicing the SPM on page 129 2 PCIe card in slot 1 SYS MB PCIE1 SYS MB PCIE2 SYS MB PCIE3 SYS MB PCIE4 Servicing PCIe Cards on page 119 Identifying Components 17 ...

Page 18: ...Servicing Memory Risers and DIMMs on page 89 5 PS backplane and cover SYS PDB Servicing the PS Backplane on page 165 6 Drive backplane SYS DBP Servicing the Drive Backplane on page 159 7 Drives SYS DBP HDD0 bottom SYS DBP HDD1 SYS DBP HDD2 SYS DBP HDD3 SYS DBP HDD4 SYS DBP HDD5 top Servicing Drives on page 63 8 Fan modules As viewed from front of server SYS FANBD F0 left front SYS FANBD F1 center ...

Page 19: ...cing the Battery on page 111 12 Processor modules and heat sinks these are only replaceable by replacing the motherboard SYS MB CM0 SYS MB CM1 Servicing the Motherboard on page 147 13 Motherboard SYS MB Servicing the Motherboard on page 147 Motherboard Component Locations Identifying Components 19 ...

Page 20: ... Servicing the SPM on page 129 2 Memory riser SYS MB CMn CMP MRn Servicing Memory Risers and DIMMs on page 89 4 DIMMs SYS MB CMn CMP MRn BOBn CHn DIMM Servicing Memory Risers and DIMMs on page 89 5 Battery SYS MB BAT Servicing the Battery on page 111 6 eUSB SYS MB EUSB Servicing the eUSB Drive on page 115 20 SPARC T8 2 Server Service Manual June 2019 ...

Page 21: ...ations No Component Oracle ILOM Target LInks 1 Light pipe assembly Servicing the Drive Backplane on page 159 2 Drives SYS DBP HDD0 bottom SYS DBP HDD1 SYS DBP HDD2 SYS DBP HDD3 SYS DBP HDD4 Servicing Drives on page 63 Identifying Components 21 ...

Page 22: ...BP HDD5 top 3 Drive backplane SYS DBP Servicing the Drive Backplane on page 159 Power Distribution and Fan Module Component Locations No Component Oracle ILOM Target Links 1 Power supplies SYS PS0 outer SYS PS1 inner Servicing Power Supplies on page 83 22 SPARC T8 2 Server Service Manual June 2019 ...

Page 23: ... Servicing Fan Modules on page 75 Server Block Diagram This block diagram shows the connections between and among components and device slots on the server Use this block diagram to determine the optimum locations for optional cards or other peripherals based on your server s configuration and intended use Note For more detail on root complexes related to the PCIe slots see I O Root Complex Connec...

Page 24: ...Server Block Diagram 24 SPARC T8 2 Server Service Manual June 2019 ...

Page 25: ...ponent Service Categories on page 48 Internal Component Locations on page 17 Motherboard Component Locations on page 19 I O Component Locations on page 21 Power Distribution and Fan Module Component Locations on page 22 Identifying Components 25 ...

Page 26: ...26 SPARC T8 2 Server Service Manual June 2019 ...

Page 27: ...rpreting LEDs on page 33 2 Perform additional troubleshooting if needed Performing Advanced Troubleshooting on page 37 3 Manage faults following a service procedure Clear a Fault Manually on page 43 4 Contact technical support if the problem persists https support oracle com Related Information Identifying Components on page 13 Preparing for Service on page 45 Returning the Server to Operation on ...

Page 28: ...ftware Component Names Displayed by Diagnostic Software on page 32 Related Information Interpreting LEDs on page 33 Performing Advanced Troubleshooting on page 37 Clear a Fault Manually on page 43 Log In to Oracle ILOM Service At the terminal prompt type ssh root SP IP address Password password Oracle R Integrated Lights Out Manager Version 4 0 x Copyright c 2017 Oracle and or its affiliates Inc A...

Page 29: ... want to start SP faultmgmt shell y n y faultmgmtsp fmadm faulty Time UUID msgid Severity 2015 01 16 17 55 26 f4ee56c 9fdd ca19 efb5 ae39675dfee3 SPT 8000 PX Major Problem Status open Diag Engine fdd 1 0 System Manufacturer Oracle Corporation Name SPARC T8 2 Part_Number 12345678 11 1 Serial_Number 1238BDC0DF Suspect 1 of 1 Fault class fault component misconfigured Certainty 100 Affects SYS MB CM1 ...

Page 30: ...c 9fdd ca19 efb5 ae39675dfee3 which is unique to each fault Message ID SPT 8000 PX which can be used to obtain additional fault information from Knowledge Base articles 2 Use the message ID to obtain more information about this type of fault a Obtain the message ID from console output SPT 8000 PX in the example above b Go to https support oracle com and search on the message ID in the Knowledge ta...

Page 31: ...t Names Displayed by Diagnostic Software on page 32 For example show t SYS MB CM0 CMP MR3 BOB0 CH1 DIMM Target Property Value SYS MB CM0 CMP MR3 BOB0 CH1 DIMM type DIMM SYS MB CM0 CMP MR3 BOB0 CH1 DIMM ipmi name P0 M3 B0 C1 D0 SYS MB CM0 CMP MR3 BOB0 CH1 DIMM requested_config_state Enabled SYS MB CM0 CMP MR3 BOB0 CH1 DIMM current_config_state Enabled SYS MB CM0 CMP MR3 BOB0 CH1 DIMM disable_reason...

Page 32: ...ives SYS DBP HDD0 bottom SYS DBP HDD1 SYS DBP HDD2 SYS DBP HDD3 SYS DBP HDD4 SYS DBP HDD5 top Servicing Drives on page 63 Fan board SYS FANBD Servicing the Fan Board on page 137 Fan modules As viewed from front of server SYS FANBD F0 left SYS FANBD F1 center SYS FANBD F2 right Servicing Fan Modules on page 75 Memory risers SYS MB CM0 CMP MR0 SYS MB CM0 CMP MR1 SYS MB CM0 CMP MR2 SYS MB CM0 CMP MR3...

Page 33: ... page 28 Identify Faulted Components on page 29 Identify Disabled Components on page 31 Interpreting LEDs Use these steps to determine if an LED indicates that a component has failed Step Description Links 1 Check the LEDs on the front and rear of the server Front Panel Controls and LEDs on page 34 Rear Panel Controls and LEDs on page 36 2 Check the LEDs on the individual components Component LEDs...

Page 34: ... on the Locate indicator to identify a particular server When lit the LED displays as a fast blink The blinking will time out after 15 minutes Turn on the Locate indicator by pressing the Locate button or see Locate the Server on page 50 2 System Fault Service Action Required LED amber The fmadm faulty command provides details about any faults that cause this indicator to light See Identify Faulte...

Page 35: ...e conditions Off Steady state no service action is required Steady on A fan module failure event has been acknowledged and a service action is required on at least one of the fan modules 6 CPU Fault LED amber CPU Indicates these conditions Off Steady state no service action is required Steady on A fault has been detected on one or more host processors 7 Memory DIMM Fault LED amber MEM Indicates th...

Page 36: ...er supply is disabled or not within specification Steady on 12V DC output from this power supply is present and within specifications 3 PS Fault LED amber Indicates these conditions Off Steady state no service action is required Steady on A fault has been detected on this power supply 4 NET MGT Port Link and Activity LED green on left NET MGT Port Speed LED green on right LINK ACT SPD Indicates th...

Page 37: ...state No service actions are required Slow blink Server is running in standby mode and can be quickly returned to full function Fast blink A normal but transitory activity is taking place Fast blinking might indicate that server diagnostics are running or that the server is booting 8 Host Ethernet Port Link Activity LED green From left to right NET 1 NET 0 NET 3 and NET 2 Indicates these condition...

Page 38: ...n page 43 Check the Message Buffer The dmesg command checks the system buffer for recent diagnostic messages and displays the messages 1 Log in as superuser 2 Type dmesg Related Information View Log Files Oracle Solaris on page 38 View Log Files Oracle ILOM on page 39 POST Overview on page 40 View Log Files Oracle Solaris The error logging daemon syslogd automatically records various system warnin...

Page 39: ... are further rotated to messages 2 and messages 3 and then deleted 1 Log in as superuser 2 Type more var adm messages 3 To view all logged messages type more var adm messages Related Information Check the Message Buffer on page 38 View Log Files Oracle Solaris on page 38 POST Overview on page 40 View Log Files Oracle ILOM 1 View the event log show SP logs event list 2 View the audit log show SP lo...

Page 40: ...meters and values If POST detects a faulty component the component is disabled automatically If the server is able to run without the disabled component the server boots when POST completes its tests For example if POST detects a faulty processor core the core is disabled POST completes its test sequence and the server boots using the remaining cores Related Information Configure POST on page 40 O...

Page 41: ... running after an error reset error_verbosity Possible values none min normal max error_verbosity User role required for set r hw_change_level Diag level when running after a hw change hw_change_level Possible values off min max hw_change_level User role required for set r hw_change_verbosity Diag verbosity when running after a hw change hw_change_verbosity Possible values none min normal max hw_c...

Page 42: ...ity normal hw_change_level max hw_change_verbosity normal Commands cd set show Related Information POST Overview on page 40 Oracle ILOM Properties That Affect POST Behavior on page 42 Oracle ILOM Properties That Affect POST Behavior There are a number of Oracle ILOM commands that you can use to perform host diagnostic tests For details about using these commands refer to the chapter that describes...

Page 43: ... If no fault was detected you do not need to do anything else Do not perform the subsequent steps If a fault was detected continue to the next step 3 Clear the fault from all persistent fault records In some cases even though the fault is cleared some persistent fault information remains and results in erroneous fault messages at boot time To ensure that these messages are not displayed type fault...

Page 44: ... Center software You must manually clear the fault or incident For more information refer to the section on marking an incident repaired in the Oracle Enterprise Manager Ops Center Feature Reference Guide at http www oracle com pls topic lookup ctx oc122 7 If you are servicing a component return to the procedure for that component Related Information Checking for Faults on page 27 Interpreting LED...

Page 45: ...erviced Locate the Server on page 50 7 For cold service operations shut down the OS and remove power from the server Removing Power From the Server on page 51 8 Move the server out of the rack and gain access to internal components Accessing Server Components on page 54 9 Attach devices to the server to perform service procedures Attaching Devices During Service on page 61 Related Information Iden...

Page 46: ...rdous voltages are present To reduce the risk of electric shock and danger to personal health follow the instructions ESD Measures ESD sensitive devices such as the cards drives and DIMMS require special handling Caution Circuit boards and drives contain electronic components that are extremely sensitive to static electricity Ordinary amounts of static electricity from clothing or the work environ...

Page 47: ...s memory and other PCBs on an antistatic mat Related Information Prevent ESD Damage on page 55 Tools Needed For Service on page 47 Tools Needed For Service You need the following tools for most service operations Antistatic wrist strap Antistatic mat No 2 Phillips screwdriver 2 5 mm hex driver or key Pen or pencil to power on server Related Information Safety Information on page 45 Fillers A fille...

Page 48: ...ce Categories The server components and assemblies that can be replaced in the field fall into three categories Hot service replaceable by customer Cold service replaceable by customer Cold service replaceable by authorized service personnel Cold service procedures require that you shut the server down and unplug the power cables that connect the power supplies to the power source Although hot ser...

Page 49: ...n board Servicing the Fan Board on page 137 Motherboard Servicing the Motherboard on page 147 Transfer SCC PROM and SPM to new motherboard Drive backplane Servicing the Drive Backplane on page 159 Power supply backplane Servicing the PS Backplane on page 165 SPM Servicing the SPM on page 129 Related Information Identifying Components on page 13 Find the Server Serial Number You need the serial num...

Page 50: ... server from many other servers 1 At the Oracle ILOM prompt type set System locator_indicator on The white System Locate indicators one on the front panel and one on the rear panel blink 2 After locating the server with the blinking System Locate indicator turn it off by pressing the Locate button with a stylus Alternatively you can type an Oracle ILOM command to turn off the System Locate indicat...

Page 51: ...owering off the server 1 Log in as superuser or equivalent Depending on the type of problem you might want to view server status or log files You also might want to run diagnostics before you shut down the server 2 Notify affected users that the server will be shut down Refer to the Oracle Solaris system administration documentation for additional information 3 Save any open files and quit all run...

Page 52: ...wer off the server See Prepare to Power Off the Server on page 51 2 Switch from the system console to the Oracle ILOM prompt by typing the Hash Dot key sequence 3 Power off the server stop System Note You can also use the Server Power button on the front of the server to initiate a graceful server shutdown See Power Off the Server Server Power Button Graceful on page 53 This button is recessed to ...

Page 53: ...51 Power Off the Server Oracle ILOM on page 52 Power Off the Server Emergency Shutdown on page 53 Front Panel Components Service on page 13 Power Off the Server Emergency Shutdown Caution All applications and files will be closed abruptly without saving changes File system corruption might occur 1 Prepare to power off the server See Prepare to Power Off the Server on page 51 2 Press and hold the S...

Page 54: ...tton Graceful on page 53 Power Off the Server Emergency Shutdown on page 53 Rear Panel Components Service on page 15 Related Information Safety Information on page 45 Accessing Server Components These topics explain how to access components on the outside and the inside of the server Perform these tasks in this order as needed Prevent ESD Damage on page 55 Extend the Server to the Service Position...

Page 55: ...atic mat Antistatic bag used to wrap a replacement part ESD mat Disposable ESD mat shipped with some replacement parts or optional components 2 Attach an antistatic wrist strap When servicing or removing server components attach an antistatic strap to your wrist and then to a metal area on the chassis See Safety Information on page 45 Related Information Safety Information on page 45 Extend the Se...

Page 56: ...ed with the server is hinged to accommodate extending the server you should ensure that all cables and cords are capable of extending 2 From the front of the server release the two slide release latches Squeeze the green slide release latches to release the slide rails 3 While squeezing the slide release latches slowly pull the server forward until the slide rails latch 4 Release the CMA See Relea...

Page 57: ... the CMA For some service procedures such as replacing a power supply if you are using a CMA you might need to release the CMA to gain access to the rear of the chassis Note For instructions on how to install the CMA for the first time refer to Server Installation 1 Press and hold the tab Preparing for Service 57 ...

Page 58: ...rvice steps that require the CMA to be out of the way swing the CMA closed and latch it to the left rack rail Check that the CMA and the cables are functioning properly after completing service Related Information Extend the Server to the Service Position on page 55 Remove the Server From the Rack on page 59 Returning the Server to Operation on page 171 58 SPARC T8 2 Server Service Manual June 201...

Page 59: ... to the maintenance position See Extend the Server to the Service Position on page 55 5 Release the CMA from the rail assembly The CMA is still attached to the cabinet but the server chassis is now disconnected from the CMA See Release the CMA on page 57 6 From the front of the server pull the release tabs forward and pull the server forward until it is free of the rack rails A release tab is loca...

Page 60: ...re that the AC power cords are disconnected from the server power supplies 2 Unlatch the server top cover Insert your fingers under the two cover latches and simultaneously lift both latches in an upward motion as shown in panel 1 3 Lift the cover slightly and slide it toward the front of the server chassis about 0 5 inch 12 mm 4 Lift up and remove the top cover as shown in panel 2 A metal air baf...

Page 61: ...acle ILOM VGA_REAR_PORT policy set SP policy VGA_REAR_PORT enabled For more details on selecting an active video port refer to Accessing the Server in SPARC T8 Series Servers Administration Guide If you plan to connect to the Oracle ILOM software over the network connect an Ethernet cable to the Ethernet port labeled NET MGT Note The SPM uses the NET MGT out of band port by default You can configu...

Page 62: ...62 SPARC T8 2 Server Service Manual June 2019 ...

Page 63: ...age devices based on solid state memory using the NVMe software interface NVMe drives are supported in the top four drive slots while other drives are supported in any slot Any of these drives can be a boot device Note The terms drive and HDD are used in a generic sense to refer to internal storage devices These topics explain how to service drives Drive LEDs on page 64 Determine Which Drive Is Fa...

Page 64: ... idle and available for use 3 Activity SSDs Green Indicates the drive s availability for use On Read or write activity is in progress Off Drive is idle and available for use Flashes on and off This situation occurs during hot service operations You can ignore this situation Note The front and rear panel Service Action Required LEDs are also lit when the server detects a drive fault See Front Panel...

Page 65: ...age 33 2 From the front of the server check the drive LEDs to identify the faulty drive The amber Service Required LED is lit on the drive that needs to be replaced See Drive LEDs on page 64 3 Remove the faulty drive See Remove a Drive on page 65 Related Information Drive LEDs on page 64 Remove a Drive on page 65 Install a Drive on page 70 Verify a Drive on page 73 Detecting and Managing Faults on...

Page 66: ...ris prompt list all drives in the device tree including drives that are not configured cfgadm al This command lists dynamically reconfigurable hardware resources and shows their operational status In this case look for the status of the drive you plan to remove This information is listed in the Occupant column Ap_id Type Receptacle Occupant Condition c0 scsi bus connected configured unknown c0 dsk...

Page 67: ...removal procedure b Disable the NVMe drive hotplug disable SYS DBP NVME0 Check that the drive s state has changed from ENABLED to POWERED hotplug list lc c Power down the NVMe drive hotplug poweroff SYS DBP NVME0 Check that the drive s state has changed from POWERED to PRESENT hotplug list lc In this state the blue OK to Remove LED on the NVMe drive is lit Note Do not remove the drive unless the b...

Page 68: ...the drive out of the slot Caution When you remove a drive replace it with a filler or another drive Otherwise the server might overheat due to improper airflow 6 After you remove an NVMe drive check that the drive slot s state has changed to EMPTY hotplug list lc 7 Install a replacement drive or a drive filler See Install a Drive on page 70 or Install a Drive Filler on page 72 Related Information ...

Page 69: ...ve filler you want to remove complete the following tasks Caution The latch is not an ejector Do not bend it too far to the right Doing so can damage the latch a Push the release button to open the latch and unlock the drive panel by moving the latch to the right b Grasp the latch and pull the filler out of the drive slot Caution When you remove a drive filler replace it with another filler or a d...

Page 70: ...g a drive into a server is a two step process You must first install the drive into the drive slot and then configure that drive to the server Note If you removed an existing drive from a slot in the server you must install the replacement drive in the same slot as the drive that was removed Drives are physically addressed according to the slot in which they are installed 1 Take the necessary ESD ...

Page 71: ...e Power On the Server Oracle ILOM on page 174 or Power On the Server System Power Button on page 175 If you hot serviced the drive configure it using the cfgadm c configure command The following example shows the drive at c0 dsk c1t1d0 being configured cfgadm c configure c0 dsk c1t1d0 Replace c0 dsk c1t1d0 with the drive name that applies to your situation If you hot serviced an NVMe drive it shou...

Page 72: ...ive on page 73 Related Information Determine Which Drive Is Faulty on page 65 Remove a Drive on page 65 Remove a Drive Filler on page 69 Install a Drive Filler on page 72 Verify a Drive on page 73 Install a Drive Filler 1 Fully open the release lever on the drive filler 2 Install the drive by completing the following tasks 72 SPARC T8 2 Server Service Manual June 2019 ...

Page 73: ...erform administrative tasks to reinstall software before the server can boot Refer to the Oracle Solaris OS administration documentation for more information 2 At the Oracle Solaris prompt list all drives in the device tree including any drives that are not configured cfgadm al This command helps you identify the drive you installed Ap_id Type Receptacle Occupant Condition c0 scsi bus connected co...

Page 74: ...sk connected configured unknown usb0 1 unknown empty unconfigured ok usb0 2 unknown empty unconfigured ok 6 Perform one of the following tasks based on your verification results If the previous steps did not verify the drive see Detecting and Managing Faults on page 27 If the previous steps indicate that the drive is functioning properly perform the tasks required to configure the drive These task...

Page 75: ...from the rack to access the fan modules Each fan module is an integrated hot serviceable component These topics explain how to service faulty fan modules Fan Module LEDs on page 76 Determine Which Fan Module Is Faulty on page 77 Remove a Fan Module on page 77 Install a Fan Module on page 79 Verify a Fan Module on page 81 Related Information Preparing for Service on page 45 Servicing the Fan Board ...

Page 76: ...LED is on the fan module is faulty When the LED is off the server is powered on and the fan module is functioning correctly Related Information Determine Which Fan Module Is Faulty on page 77 Detecting and Managing Faults on page 27 76 SPARC T8 2 Server Service Manual June 2019 ...

Page 77: ...ule on page 77 Detecting and Managing Faults on page 27 Remove a Fan Module This is a hot service procedure that can be performed by a customer while the server is running Caution While the fan modules provide some cooling redundancy if a fan module fails replace it as soon as possible to maintain server availability When you remove one of the fan modules you must replace it within 30 seconds to p...

Page 78: ...n damage the fan board connectors Caution When changing fan modules you can only remove or replace the fan modules Do not service any other components in the fan compartment unless the server is shut down and the power cords are removed 4 Install a new fan module 78 SPARC T8 2 Server Service Manual June 2019 ...

Page 79: ... a hot service procedure that can be performed by a customer while the server is running Caution To ensure proper cooling ensure that you install the replacement fan module in the same slot from which the faulty fan module was removed 1 Take the necessary ESD precautions See Prevent ESD Damage on page 55 2 Align the fan module and slide it into the fan module slot Servicing Fan Modules 79 ...

Page 80: ...orrect orientation 3 Apply firm pressure to fully seat the fan module You hear a click when the fan module is properly seated 4 Return the server to the normal operating position See Return the Server to the Normal Operating Position on page 173 80 SPARC T8 2 Server Service Manual June 2019 ...

Page 81: ...ou want to start SP faultmgmt shell y n y faultmgmtsp 3 Type fmadm faulty to check for faults If faults are reported see Detecting and Managing Faults on page 27 If no faults are reported then the component has been replaced successfully 4 Consider these possibilities If any of the LEDs are illuminated see Interpreting LEDs on page 33 If none of the LEDs are illuminated the fan module has been rep...

Page 82: ...82 SPARC T8 2 Server Service Manual June 2019 ...

Page 83: ...cies refer to Servers Administration and the Oracle ILOM documentation These topics describe how to service power supply modules Power Supply LEDs on page 83 Determine Which Power Supply Is Faulty on page 85 Remove a Power Supply on page 85 Install a Power Supply on page 86 Verify a Power Supply on page 88 Related Information Servicing the PS Backplane on page 165 Power Supply LEDs Each power supp...

Page 84: ...n 3 AC Present Green AC voltage is applied to the power supply Note The front and rear panel Service Action Required LEDs are also lit when the server detects a power supply fault See Front Panel Components Service on page 13 and Rear Panel Components Service on page 15 Related Information Determine Which Power Supply Is Faulty on page 85 Verify a Power Supply on page 88 84 SPARC T8 2 Server Servi...

Page 85: ...r is running Caution Hazardous voltages are present To reduce the risk of electric shock and danger to personal health follow the instructions Caution If a power supply fails and you do not have a replacement available to ensure proper airflow leave the failed power supply installed in the server until you replace it with a new power supply 1 Prepare for servicing See Preparing for Service on page...

Page 86: ... supply to prevent it from falling 5 Install a new power supply See Install a Power Supply on page 86 Related Information Determine Which Power Supply Is Faulty on page 85 Install a Power Supply on page 86 Install a Power Supply This is a hot service procedure that can be performed by a customer while the server is running 86 SPARC T8 2 Server Service Manual June 2019 ...

Page 87: ...wer supply with the empty power supply chassis bay 3 Slide the power supply into the bay until it is fully seated 4 Move the release latch up to secure the power supply in place 5 Reconnect the power cord to the power supply 6 Verify power supply functionality See Verify a Power Supply on page 88 Related Information Remove a Power Supply on page 85 Verify a Power Supply on page 88 Servicing Power ...

Page 88: ...s are not lit See Interpreting LEDs on page 33 3 Consider these possibilities If any of the LEDs are illuminated see Interpreting LEDs on page 33 If none of the LEDs are illuminated the power supply has been replaced successfully Related Information Determine Which Power Supply Is Faulty on page 85 Front Panel Components Service on page 13 Rear Panel Components Service on page 15 88 SPARC T8 2 Ser...

Page 89: ...ify a DIMM on page 106 DIMM Configuration Errors on page 109 Memory Riser and DIMM Configuration The server includes eight memory risers each containing four DIMM slots Four memory risers are associated with each CPU Either 16 or 32 DIMMs may be installed in the server The memory configuration rules for the server are as follows All eight memory risers must be installed in all configurations In ha...

Page 90: ...ith CM0 and sixteen 64 Gbyte DIMMs associated with CM1 Related Information Identifying DIMMs on page 90 Memory Riser and DIMM FRU Names on page 91 Locate a Faulty DIMM LEDs on page 95 Remove a DIMM on page 100 Install a Memory Riser on page 104 Identifying DIMMs Each DIMM is affixed with an identifying label The first four characters on the label describe the DIMM memory capacity the second four c...

Page 91: ...r and DIMM FRU Names This server includes eight memory risers Four memory risers are associated with each CMP in the server A label is next to each memory riser that shows the number of the CMP and of the riser Four DIMM slots are on each memory riser Note The server fails to boot unless all memory riser slots are populated For more information about memory riser configuration see Memory Riser and...

Page 92: ...CMP MR0 BOB1 CH1 DIMM Black White Black White CM0 MR1 SYS MB CM0 CMP MR1 riser SYS MB CM0 CMP MR1 BOB0 CH0 DIMM SYS MB CM0 CMP MR1 BOB0 CH1 DIMM SYS MB CM0 CMP MR1 BOB1 CH0 DIMM SYS MB CM0 CMP MR1 BOB1 CH1 DIMM Black White Black White CM0 MR2 SYS MB CM0 CMP MR2 riser SYS MB CM0 CMP MR2 BOB0 CH0 DIMM SYS MB CM0 CMP MR2 BOB0 CH1 DIMM SYS MB CM0 CMP MR2 BOB1 CH0 DIMM SYS MB CM0 CMP MR2 BOB1 CH1 DIMM ...

Page 93: ...IMM Black White Black White CM1 MR3 SYS MB CM1 CMP MR3 riser SYS MB CM1 CMP MR3 BOB0 CH0 DIMM SYS MB CM1 CMP MR3 BOB0 CH1 DIMM SYS MB CM1 CMP MR3 BOB1 CH0 DIMM SYS MB CM1 CMP MR3 BOB1 CH1 DIMM Black White Black White Related Information Memory Riser and DIMM Configuration on page 89 Add Memory to the Server Caution These procedures require that you handle components that are sensitive to ESD Follo...

Page 94: ...f the existing DIMMs on the memory risers and the motherboard 7 Install the new DIMMs 8 Install the memory risers 9 Return the server to operation 10 Enable and verify the new DIMMs Locating and Replacing a Faulty DIMM You can locate a failed DIMM either by using the Oracle ILOM show faulty command or with the DIMM fault LEDs located on the motherboard and the memory risers Locate the memory riser...

Page 95: ...is example SYS MB CM0 CMP MR1 BOB1 CH0 DIMM indicates the memory riser that is second farthest from the power supplies and the DIMM in a slot with white handles and a black slot Related Information Locate a Faulty DIMM LEDs on page 95 Remove a DIMM on page 100 Locate a Faulty DIMM LEDs This procedure describes how to identify a faulty DIMM using buttons and LEDs on the motherboard and the two memo...

Page 96: ...middle of each slot ensures that the DIMM is correctly oriented 3 Memory Riser Power LED Green Amber Indicates that the riser is operating normally Indicates that the riser has a fault 4 Memory Riser Remind button Blue Push this button to identify the faulty or misconfigured DIMMs Note The front and rear panel Service Required LEDs are also lit when the server detects a DIMM fault Related Informat...

Page 97: ... DIMM on the motherboard or a memory riser 1 Identify the faulty DIMM to be removed using the ILOM show faulty command 2 Prepare the system for service 3 Unplug the power cords 4 Remove the appropriate memory riser To remove a DIMM from the motherboard you must remove the memory riser above that DIMM to enable access 5 Locate the faulty DIMM on the motherboard or memory riser using the DIMM fault ...

Page 98: ...e to ESD which can cause server components to fail Note Your server could include a memory riser that is secured with a flat head screw If that is the case use a No 1 flat blade screwdriver to service that memory riser 1 Prepare for servicing See Preparing for Service on page 45 2 Identify the memory riser with the faulty DIMM by pressing the Remind button on the air divider as shown in the follow...

Page 99: ...MMs on this riser are operating properly If the memory riser Service Action Required LED is on amber one or more of the DIMMs installed on this riser is faulty or misconfigured 3 Loosen the captive screw that secures the memory riser to the chassis Servicing Memory Risers and DIMMs 99 ...

Page 100: ...et Related Information Install a Memory Riser on page 104 Remove a DIMM on page 100 Remove a DIMM Caution This procedure requires handling components that are sensitive to ESD Follow antistatic practices to avoid damage or component failure DIMMs or DIMM fillers must be removed 100 SPARC T8 2 Server Service Manual June 2019 ...

Page 101: ...tion about cold service procedures Caution Whenever you remove a DIMM or a DIMM filler you should replace it with another DIMM or DIMM filler before powering on the server Otherwise the server might overheat due to improper airflow 1 Press down both DIMM slot ejector tabs as far as they can go 2 Carefully lift the DIMM straight up and place it on an antistatic mat Related Information Install a DIM...

Page 102: ...ver or are replacing a faulty memory riser without upgrading memory You can perform this procedure but the server must first be completely powered down and all power cords unplugged See Component Service Categories on page 48 for more information about cold service procedures Caution Whenever you remove a DIMM you should replace it with another DIMM before applying power to the server Otherwise th...

Page 103: ...MM ejector lever 3 Align each DIMM with the empty connector slot aligning the notch in the DIMM with the key in the connector The notch ensures that the DIMM is oriented correctly 4 Gently press the DIMM into the slot until the ejector tabs lock the DIMM in place Related Information Install a Memory Riser on page 104 Servicing Memory Risers and DIMMs 103 ...

Page 104: ...Memory Riser Note Your server might include a memory riser that is secured with a flat head screw If that is the case use a No 1 flat blade screwdriver to service that memory riser 1 Take the necessary ESD precautions See Prevent ESD Damage on page 55 104 SPARC T8 2 Server Service Manual June 2019 ...

Page 105: ...r 2 Push the memory riser module into the associated CPU memory riser slot until the riser module locks in place 3 Tighten the captive screw that secures the memory riser to the chassis Servicing Memory Risers and DIMMs 105 ...

Page 106: ...peration on page 171 Related Information Memory Riser and DIMM Configuration on page 89 Remove a DIMM on page 100 Enable and Verify a DIMM on page 106 Enable and Verify a DIMM 1 At the Oracle ILOM prompt type show faulty If the output indicates a POST detected fault go to step 2 106 SPARC T8 2 Server Service Manual June 2019 ...

Page 107: ...llowing steps to verify the new DIMM a Set the virtual keyswitch to diag so that POST runs in Service mode set HOST keyswitch_state Diag Set keyswitch_state to Diag b Stop the host stop System Are you sure you want to stop System y n y Stopping System c Check if the host has been powered off Allow approximately one minute before performing this step Type the show HOST command When the host is powe...

Page 108: ...9 4 Switch to the Oracle ILOM command shell 5 Type show faulty Target Property Value SP faultmgmt 0 fru SYS MB CMP0 CMP MR0 BOB1 CH0 DIMM SP faultmgmt 0 timestamp Nov 18 16 02 56 SP faultmgmt 0 sunw msg id SPSUN4V 8000 CQ faults 0 SP faultmgmt 0 uuid 7c7efb20 3333 e2d7 b8ea 986b3e9dbaa9 faults 0 SP faultmgmt 0 timestamp Nov 18 16 02 56 faults 0 If the show faulty command reports a fault with a UUI...

Page 109: ...fer to the service documentation for supported memory configurations In some cases the server boots a degraded state WARNING Running with a nonstandard DIMM configuration Refer to service document for details In other cases the configuration error is fatal Fatal configuration error forcing power down In addition to these general memory configuration errors one or more rule specific messages is dis...

Page 110: ...110 SPARC T8 2 Server Service Manual June 2019 ...

Page 111: ...before performing these procedures Replace the Battery on page 111 Related Information Detecting and Managing Faults on page 27 Preparing for Service on page 45 Disconnect Power Cords on page 54 Replace the Battery 1 Prepare the host for battery replacement To correctly reset the date and time before replacing a battery you must revent the host from automatically powering on and disable any NTP co...

Page 112: ...he battery Replacing the battery is a cold service procedure The server must be completely powered off and power cables disconnected before performing this procedure a Prepare the server for service b Remove memory risers CM0 MR0 CM0 MR2 and CM0 MR3 c Remove the old battery Gently push the battery toward the memory risers to release it from the retention clip 112 SPARC T8 2 Server Service Manual J...

Page 113: ...P clock datetime 081221302016 timezone EDT Set datetime to 081221302016 set timezone to EDT show d properties SP clock Properties datetime Mon Aug 22 13 20 16 2016 timezone EDT EST5EDT uptime 2 days 19 56 49 usentpserver disabled b If the SP policy HOST_AUTO_POWER_ON was enabled before you replaced the battery you must re enable it set SP policy HOST_AUTO_POWER_ON enabled c If the SP clock usentps...

Page 114: ...114 SPARC T8 2 Server Service Manual June 2019 ...

Page 115: ...aging Faults on page 27 Remove the eUSB Drive This is a cold service procedure that can be performed by a customer Power down the server completely before performing this procedure Caution This procedure requires that you handle components that are sensitive to electrostatic discharge Static discharges can cause the components to fail 1 Prepare the system for service See Preparing for Service on p...

Page 116: ... the eUSB drive up to disconnect it from the motherboard 5 Install a new eUSB drive See Install the eUSB Drive on page 116 Related Information Install the eUSB Drive on page 116 Install the eUSB Drive This is a cold service procedure that can be performed by a customer Power down the server completely before performing this procedure 116 SPARC T8 2 Server Service Manual June 2019 ...

Page 117: ...e the necessary ESD precautions See Prevent ESD Damage on page 55 2 Press the eUSB drive into the socket on the motherboard 3 Tighten the screw to secure the drive to the motherboard 4 Install memory risers CM0 MR0 CM0 MR2 and CM0 MR3 See Install a Memory Riser on page 104 5 Return the server to operation See Returning the Server to Operation on page 171 Servicing the eUSB Drive 117 ...

Page 118: ...Install the eUSB Drive Related Information Remove the eUSB Drive on page 115 118 SPARC T8 2 Server Service Manual June 2019 ...

Page 119: ...ur slots are also capable of supporting x16 PCIe cards All Slots x8 electrical interface Slots 1 2 7 and 8 x16 electrical interface To determine the slot in which to install a PCIe card follow these guidelines 1 Install cards that require a specific slot Refer to the SPARC T8 2 Server Product Notes and the documentation for each card to determine if there are slot requirements 2 Install the first ...

Page 120: ...rives Two drives to support a redundant NMVe configuration Use these tables and the labels on the NMVe cable to properly connect the NMVe switch cards to the disk backplane TABLE 1 Single NMVe Card Configuration DBP NVMe Connector NVMe Card Connectors Slot 1 3 3 2 2 1 1 0 0 TABLE 2 Dual NVMe Card Configuration DBP NVMe Connector NVMe Card Connectors Slot 1 NVMe Card Connectors Slot 2 3 3 2 2 1 3 0...

Page 121: ...0 pci 2 SYS MB PCIE3 PCIeSlot4 0 0 x8 pci 301 pci 2 SYS MB PCIE4 PCIeSlot5 1 3 x8 pci 302 pci 2 SYS MB PCIE5 PCIeSlot6 1 0 x8 pci 303 pci 2 SYS MB PCIE6 PCIeSlot7 1 2 x16 pci 304 pci 1 SYS MB PCIE7 PCIeSlot8 1 1 x16 pci 305 pci 1 SYS MB PCIE8 NET0 0 1 x8 pci 300 pci 1 network 0 SYS MB NET0 NET1 0 1 x8 pci 300 pci 1 network 0 1 SYS MB NET1 NET2 0 1 x8 pci 300 pci 1 network 0 2 SYS MB NET2 NET3 0 1 ...

Page 122: ...card Slot 1 Single NVMe Card Slot 2 Dual NVMe Switch Cards 0 0 x4 pci 306 pci 1 pci 0 pci 5 nvme 0 disk 1 pci 307 pci 1 pci 0 pci 5 nvme 0 disk 1 pci 306 pci 1 pci 0 pci 7 nvme 0 disk 1 NVMe2 Single NMVe card Slot 1 Single NVMe Card Slot 2 Dual NVMe Switch Cards 1 0 x4 pci 306 pci 1 pci 0 pci 6 nvme 0 disk 1 pci 307 pci 1 pci 0 pci 6 nvme 0 disk 1 pci 307 pci 1 pci 0 pci 6 nvme 0 disk 1 NVME3 Sing...

Page 123: ...paring for Service on page 45 2 Locate the PCIe card or filler that you want to remove See Rear Panel Components Service on page 15 for information about PCIe slots and their locations If you are removing a PCIe card filler go to step 5 3 If necessary note the slot location for each PCIe card you plan to remove 4 Unplug all data cables from the PCIe card Note the location of all cables for reinsta...

Page 124: ...if you are removing a PCIe card See these figures if you are removing a PCIe card filler 6 Disengage the PCIe card slot crossbar from its locked position by pulling it toward the interior of the chassis 124 SPARC T8 2 Server Service Manual June 2019 ...

Page 125: ...ntation for firmware update instructions 1 Take the necessary ESD precautions See Prevent ESD Damage on page 55 2 Ensure that the server is powered off and all power cords are disconnected from the server power supplies See Removing Power From the Server on page 51 3 Determine which slot to install the PCIe card in If you are not replacing an existing PCIe card and need information about deciding ...

Page 126: ...these figures if you are installing a PCIe card See these figures if you are installing a PCIe card filler 6 Return the server to operation See Returning the Server to Operation on page 171 126 SPARC T8 2 Server Service Manual June 2019 ...

Page 127: ...Verify a PCIe Card on page 127 Verify a PCIe Card 1 Verify that the System Service Required LEDs are not illuminated 2 Perform one of the following actions based on your verification results If any of the LEDs are illuminated see Interpreting LEDs on page 33 If none of the LEDs are illuminated configure the PCIe card as described in the documentation shipped with the card Related Information Insta...

Page 128: ...128 SPARC T8 2 Server Service Manual June 2019 ...

Page 129: ...ou must restore the configuration settings maintained in the SPM Before replacing the SPM save the configuration using the Oracle ILOM backup utility Refer to the Oracle ILOM documentation for instructions on backing up and restoring the Oracle ILOM configuration After replacing the SPM the new SPM firmware component and the existing host firmware component must be consistent with each other To en...

Page 130: ...itive to electrostatic discharge Static discharges can cause the components to fail The SP OK indicator on the front panel will be off when an SPM fault is detected 1 Back up the Oracle ILOM configuration before removing the SPM At the Oracle ILOM prompt type cd SP config dump destination uritarget where acceptable values for uri are tftp ftp sftp scp http https and target is the location where yo...

Page 131: ...tic You must reinstall the SPM on the new motherboard 5 Lift the SPM up and away from the motherboard panel 2 6 Install a new SPM See Install the SPM on page 131 Related Information SPM Firmware and Configuration on page 129 Install the SPM on page 131 Install the SPM Replacing the SPM is a cold service procedure that must be performed by qualified service personnel The server must be completely p...

Page 132: ...Server to Operation on page 171 4 Prior to powering on the server connect a terminal or a terminal emulator PC or workstation to the SPM SER MGT port Refer to Server Installation for instructions If the replacement SPM detects that the SPM firmware is not compatible with the existing host firmware further action will be suspended and the following message will be displayed Unrecognized Chassis Thi...

Page 133: ...replacing an SPM download the fallback miniroot image for your hardware and your Oracle Solaris version from My Oracle Support at https support oracle com Then follow the procedure Uploading a New Solaris Miniroot Package From SP to Host in the Oracle ILOM Administrator s Guide for Configuration and Maintenance 8 Restore the SPM configuration information you backed up earlier At the Oracle ILOM pr...

Page 134: ...erify the SPM on page 134 Related Information Oracle ILOM documentation Remove the SPM on page 130 Verify the SPM on page 134 Verify the SPM 1 Verify that the SPM Status LED is illuminated green The LED flashes green while the SPM initializes the Oracle ILOM firmware See Interpreting LEDs on page 33 for information about the status of the SPM LED 2 At the Oracle ILOM prompt start the fault managem...

Page 135: ...Verify the SPM Related Information Oracle ILOM documentation Install the SPM on page 131 Servicing the SPM 135 ...

Page 136: ...136 SPARC T8 2 Server Service Manual June 2019 ...

Page 137: ...e procedure that must be performed by qualified service personnel Power down the server completely before performing this procedure Caution This procedure requires that you handle components that are sensitive to ESD which can cause server components to fail 1 Prepare for servicing See Preparing for Service on page 45 2 Remove all fan modules See Remove a Fan Module on page 77 3 Remove all memory ...

Page 138: ...board cable and the power cable from motherboard panel 1 Caution When removing the ribbon cable from the motherboard grasp the cable connector on either side and pull straight up to disconnect the cable Do not rock the cable side to side Doing so could damage the connector Save the cables for use with the new fan board 7 Remove the front memory riser guide by pulling it up and out of the chassis p...

Page 139: ...Remove the Fan Board 8 Remove the air baffle by pulling it up and out of the chassis 9 Pull the fan board back and out of chassis Servicing the Fan Board 139 ...

Page 140: ...ard and the fan holder portions of the fan board should remain together 10 Install a new fan board See Install the Fan Board on page 141 Related Information Install the Fan Board on page 141 140 SPARC T8 2 Server Service Manual June 2019 ...

Page 141: ...s procedure Caution This procedure requires that you handle components that are sensitive to ESD which can cause server components to fail 1 Take the necessary ESD precautions See Prevent ESD Damage on page 55 2 Using the fan board cable and power cables from the faulty fan board plug the cables into the corresponding connectors on the replacement fan board Servicing the Fan Board 141 ...

Page 142: ...Install the Fan Board 3 Insert the fan board into the chassis moving it down and then toward the front of the server 142 SPARC T8 2 Server Service Manual June 2019 ...

Page 143: ...Install the Fan Board 4 Insert the air baffle aligning the cutouts in the bottom of the air baffle with the three captive screw holes in the chassis Servicing the Fan Board 143 ...

Page 144: ...on the connector before inserting the cable 7 Secure the fan board by reinserting and tightening the two screws on each side of the outside of the chassis panel 2 8 Tighten the three captive screws to hold the front memory riser guide in place panel 2 9 Reinstall all fan modules See Remove a Fan Module on page 77 10 Reinstall all memory risers See Install a Memory Riser on page 104 11 Return the s...

Page 145: ... page 137 Verify the Fan Board on page 145 Verify the Fan Board 1 At the Oracle ILOM prompt start the fault management shell start SP faultmgmt shell Are you sure you want to start SP faultmgmt shell y n y faultmgmtsp 2 Type fmadm faulty to check for faults If faults are reported see Detecting and Managing Faults on page 27 If no faults are reported then the fan board has been replaced successfull...

Page 146: ...146 SPARC T8 2 Server Service Manual June 2019 ...

Page 147: ... includes a top cover safety interlock switch These topics describe how to service the motherboard Remove the Motherboard on page 147 Install the Motherboard on page 151 Reactivate RAID Volumes on page 155 Verify the Motherboard on page 158 Related Information Component Service Categories on page 48 Servicing the SPM on page 129 Remove the Motherboard This is a cold service procedure that must be ...

Page 148: ...cific information stored on these modules Whenever you replace the motherboard or the SPM you must update the firmware so the portions of firmware in the SPM and on the motherboard are consistent 1 Prepare for servicing See Preparing for Service on page 45 2 Remove all PCIe cards See Remove a PCIe Card or Filler on page 123 3 If installed remove any NVMe cables that are connected to the drive back...

Page 149: ...ard power cable and the ribbon cable from the motherboard Caution When removing the ribbon cable from the motherboard grasp the cable connector on either side and pull straight up to disconnect the cable Do not rock the cable side to side Doing so could damage the connector d If necessary disconnect the four NVMe drive cables from the drive backplane Note the order in which the cables are connecte...

Page 150: ...PS backplane See Remove the PS Backplane on page 165 12 Position the drive end of the cables off to the side using the tab on the top of the plastic power supply cover 13 Remove the motherboard a Loosen the captive screw in the corner near the fans that secures the motherboard to the chassis panel 1 b Grasp the handle on the motherboard and slide it toward the front of the chassis panel 2 150 SPAR...

Page 151: ...ard and install these components on the new motherboard The SPM contains the Oracle ILOM system configuration data and the SCC PROM contains the system host ID and MAC address Transferring these components preserves the system specific information stored on these modules Whenever you replace the motherboard or the SPM you must update the firmware so the portions of firmware in the SPM and on the m...

Page 152: ...the power supplies back into place 7 Reattach all cables to the motherboard a In the center rear of the motherboard connect the fan board power cable and the ribbon cable to the motherboard Caution When connecting the ribbon cable to the motherboard take care to center the cable on the connector before inserting the cable b Near the drives connect two shorter cables to the motherboard One cable go...

Page 153: ...es properly 9 Reconnect all cables from the power supply backplane drive backplane and fan board to their original locations on the motherboard 10 Reinstall all memory risers See Install a Memory Riser on page 104 11 Install the SPM that you removed from the old motherboard See Install the SPM on page 131 12 Install the eUSB drive that you removed from the old motherboard See Install the eUSB Driv...

Page 154: ...mware to a newer version that supports this chassis Note Whenever you replace the motherboard or the SPM update the firmware on the server so the portions of firmware in the two components remain consistent 20 Prepare to download the system firmware If necessary configure the server s NET MGT port so that it can access the network Log in to the SPM through the NET MGT port Refer to the Oracle ILOM...

Page 155: ...Motherboard on page 158 Reactivate RAID Volumes Perform this task only if your server had RAID volumes prior to replacing the motherboard 1 Prior to powering on the server log in to the SPM Refer to Servers Administration for instructions 2 At the Oracle ILOM prompt disable auto boot so that the server will not boot the OS when the server powers on set HOST bootmode script setenv auto boot false 3...

Page 156: ... following output shows an inactive volume ok show volumes Volume 0 Target 389 Type RAID1 Mirroring WWID 03b2999bca4dc677 Optimal Enabled Inactive 2 Members 583983104 Blocks 298 GB Disk 1 Primary Optimal Target 9 HITACHI H103030SCSUN300G A2A8 Disk 0 Secondary Optimal Target c HITACHI H103030SCSUN300G A2A8 7 For each RAID volume listed as inactive type the following command to activate that volume ...

Page 157: ...03SSUN146G 0868 286739329 Blocks 146 SASDeviceName 5000c50016f75e4f SASAddress 5000c50016f75e4d PhyNum 1 Target 389 Volume 0 Unit 0 Disk LSI Logical Volume 3000 583983104 Blocks 298 GB VolumeDeviceName 33b2999bca4dc677 VolumeWWID 03b2999bca4dc677 pci 400 pci 1 pci 0 pci b pci 0 usb 0 2 hub 2 hub 3 storage 2 Unit 0 Removable Read Only device AMI Virtual CDROM 1 00 10 Set the auto boot OpenBoot PROM...

Page 158: ...t SP faultmgmt shell y n y faultmgmtsp 2 Type fmadm faulty to check for faults If faults are reported see Detecting and Managing Faults on page 27 If no faults are reported then the motherboard has been replaced successfully Related Information Install the Motherboard on page 151 Reactivate RAID Volumes on page 155 158 SPARC T8 2 Server Service Manual June 2019 ...

Page 159: ...lified service personnel Power down the server completely before performing this procedure Caution This procedure requires that you handle components that are sensitive to ESD which can cause server components to fail 1 Prepare for servicing See Preparing for Service on page 45 2 Remove all drives and fillers See Remove a Drive on page 65 Note Note the positions of the drives so you can return the...

Page 160: ... 1 7 Swing the drive backplane back and out of the chassis panel 2 8 Install a new drive backplane See Install the Drive Backplane on page 160 Related Information Install the Drive Backplane on page 160 Install the Drive Backplane This is a cold service procedure that must be performed by qualified service personnel Power down the server completely before performing this procedure 160 SPARC T8 2 S...

Page 161: ...ssis Angle the bottom of the backplane into position first then move the backplane forward to align the side hooks then press the backplane into position Verify that the drive backplane is seated properly at the bottom in the small slot 3 Lift up the metal hook and press the drive backplane to the front until it snaps into place 4 Replace the power cable ribbon data cable SAS cables and four NVMe ...

Page 162: ...r 6 Replace all memory risers you removed See Install a Memory Riser on page 104 7 Replace all drives and filler panels See Install a Drive on page 70 8 Return the server to operation See Returning the Server to Operation on page 171 Note Authorized service personnel might need to reprogram the product serial number on the drive backplane This number is used for service entitlement and warranty co...

Page 163: ...cle ILOM prompt start the fault management shell start SP faultmgmt shell Are you sure you want to start SP faultmgmt shell y n y faultmgmtsp 2 Type fmadm faulty to check for faults If faults are reported see Detecting and Managing Faults on page 27 If no faults are reported then the drive backplane has been replaced successfully Related Information Remove the Drive Backplane on page 159 Install t...

Page 164: ...164 SPARC T8 2 Server Service Manual June 2019 ...

Page 165: ...down the server completely before performing this procedure Caution Power is supplied to the PS backplane even when the server is powered off To avoid personal injury or damage to the server you must disconnect power cords before you service the PS backplane 1 Prepare for servicing See Preparing for Service on page 45 2 Pull both power supplies at least part way out of the chassis to disconnect th...

Page 166: ...PS backplane cover around two pins on the inside of the power supply cage a Lift the cover up a little to clear the first part of the slots b Push the cover a little towards the front of the chassis c Push the tooth at the bottom of the cover to clear the edge of the power supply cage d Lift the cover out of the chassis 8 Remove the four bus bar screws that secure the motherboard to the PS backpla...

Page 167: ...at must be performed by qualified service personnel Power down the server completely before performing this procedure Caution This procedure requires that you handle components that are sensitive to ESD which can cause server components to fail 1 Unpack the replacement PS backplane and place it on an antistatic mat 2 Hold the PS backplane at the end of the power supply cage at an angle and connect...

Page 168: ...ews until the PS backplane and the motherboard are securely fastened to the bus bars 6 Replace the PS backplane cover panel 3 a Align the PS backplane cover Ensure that the tooth at the bottom of the cover is clear of the power supply cage You must guide two slots on the PS backplane cover around two pins on the inside of the power supply cage b Fit the two slots on the cover around the two pins c...

Page 169: ...age 171 Related Information Remove the PS Backplane on page 165 Verify the PS Backplane on page 169 Verify the PS Backplane 1 At the Oracle ILOM prompt start the fault management shell start SP faultmgmt shell Are you sure you want to start SP faultmgmt shell y n y faultmgmtsp 2 Type fmadm faulty to check for faults If faults are reported see Detecting and Managing Faults on page 27 If no faults a...

Page 170: ...170 SPARC T8 2 Server Service Manual June 2019 ...

Page 171: ...ver to its normal operating position Replace the Top Cover on page 172 Return the Server to the Normal Operating Position on page 173 2 Connect the power cords to the server Attach Power Cords on page 174 3 Power on the server Power On the Server Oracle ILOM on page 174 Power On the Server System Power Button on page 175 Returning the Server to Operation 171 ...

Page 172: ... top cover toward the rear of the chassis until the rear cover lip engages with the rear of the chassis 3 Close the top cover by pressing down firmly on the cover with both hands on the two locations highlighted in green marked Push here to latch until both latches engage Caution Failure to completely secure the top cover may cause the server to malfunction 4 Return the server to its normal operat...

Page 173: ...lease tabs on the side of each rail 2 While pushing on the release tabs slowly push the server into the rack Ensure that the cables do not get in the way 3 Reconnect the cables to the rear of the server If the CMA is in the way disconnect the left CMA release and swing the CMA open See Release the CMA on page 57 4 Reconnect the CMA Swing the CMA closed and latch it to the left rack rail See Server...

Page 174: ...time 2 Power on the server See Power On the Server Oracle ILOM on page 174 or Power On the Server System Power Button on page 175 Related Information Power On the Server Oracle ILOM on page 174 Power On the Server System Power Button on page 175 Power On the Server Oracle ILOM Note If you are powering on the server following an emergency shutdown that was triggered by the top cover interlock switc...

Page 175: ... Fault LED is illuminated solid green when the SPM has successfully booted After the SPM has booted the Power LED on the front panel begins flashing slowly indicating that the host is in standby power mode 2 Press and release the recessed system Power button on the server front panel No Description 1 Power LED 2 Power button 3 SP Fault LED When main power is applied to the server the main Power LE...

Page 176: ...176 SPARC T8 2 Server Service Manual June 2019 ...

Page 177: ...stem recovery AWG American wire gauge B BMC Baseboard management controller BOB Memory buffer on board C chassis Server enclosure CMA Cable management arm SPARC T8 1 and SPARC T8 2 Cable management assembly SPARC T8 4 CMP Chip multiprocessor CRU Customer replaceable unit D DHCP Dynamic Host Configuration Protocol Glossary 177 ...

Page 178: ... runs the Oracle Solaris OS and other applications The term host is used to distinguish the primary computer from the SP See SP hot pluggable Describes a component that can be replaced with power applied but the component must be prepared for removal hot swappable Describes a component that can be replaced with power applied and no preparation is required I ID PROM Chip that contains system inform...

Page 179: ...hysical device address used for remote access configuration management See Oracle ILOMand SDM name name space Top level Oracle ILOM target NEBS Network Equipment Building System Netra products only NET MGT Network management port An Ethernet port on the server SP NIC Network interface card or controller NMI Nonmaskable interrupt NVMe Nonvolatile memory express controller The optional NVMe switch c...

Page 180: ...eral component interconnect PCIe PCI Express an industry standard bus architecture that supports high bandwidth peripherals and I O devices POST Power on self test PROM Programmable read only memory PSH Predictive self healing S SAS Serial attached SCSI SCC System configuration chip SCC PROM System configuration chip on programmable read only memory Removable module containing system configuration...

Page 181: ...gement control of the host Seehost SPM Service processor module This is the physical component that contains the service processor firmware SSD Solid state drive SSH Secure shell T Tma Maximum ambient temperature U U S NEC United States National Electrical Code UCP Universal connector port UI User interface UL Underwriters Laboratory Inc UTC Coordinated Universal Time UUID Universal unique identif...

Page 182: ...182 SPARC T8 2 Server Service Manual June 2019 ...

Page 183: ...0 controls front panel 34 D DB 15 video connector location of 15 diagnostics low level 40 DIMM configuration errors 109 DIMMs adding 93 enabling new 106 FRU names 91 identifying 90 installing 102 locating faulty LEDs 95 Oracle ILOM 94 physical layout 91 rank classification 90 removing 100 replacing faulty 97 disabled component detection checking for 31 dmesg command 38 drive backplane installing 1...

Page 184: ... locating LEDs 95 filler installing drives 72 removing drives 69 fmadm command 29 43 front panel components 13 controls and LED 34 G graceful shutdown defined 53 H hot service 48 I installing DIMMs 102 drive backplane 160 drive filler 72 drives 70 eUSB drive 116 fan board 141 fan modules 79 memory risers 104 motherboard 151 PCIe cards 125 power supplies 86 PS backplane 167 SPM 131 top cover 172 in...

Page 185: ...ng function of replaced 158 N NET MGT port Link and Activity LED 36 NET MGT port Speed LED 36 network NET ports location of 15 NVMe cards configuration rules 120 O Oracle ILOM checking for disabled components 31 checking for faults 29 fault management shell 29 locating failed DIMMs 94 logging in to 28 POST properties 42 target names 32 Overtemp LED 13 34 36 P PCIe cards configuration rules 119 ins...

Page 186: ...ty information topics 45 precautions 45 symbols 46 SCC PROM installing 153 removing 148 schematic diagrams 23 SER MGT port location of 15 serial number chassis locating 49 server locating 50 Service Action Required LED 13 Service Required LED 34 36 show disabled command 31 slide rail 55 SP fault LED location of 13 NET MGT port 15 SPM installing 131 removing 130 verifying function 134 standby power...

Page 187: ...ive backplane 163 drives 73 fan board 145 fan modules 81 motherboard 158 power supplies 88 PS backplane 169 SPM 134 video connector location of 13 viewing message log files Oracle ILOM 39 Oracle Solaris 38 187 ...

Page 188: ...188 SPARC T8 2 Server Service Manual June 2019 ...

Reviews:

No comments

Brands by name

Popular brands

Load more brands