background image

SPARC T5-2 Server Service Manual

Part No: E28856-13

February 2017

Summary of Contents for SPARC T5-2

Page 1: ...SPARC T5 2 Server Service Manual Part No E28856 13 February 2017 ...

Page 2: ......

Page 3: ...ous applications including applications that may create a risk of personal injury If you use this software or hardware in dangerous applications then you shall be responsible to take all appropriate fail safe backup redundancy and other measures to ensure its safe use Oracle Corporation and its affiliates disclaim any liability for any damages caused by use of this software or hardware in dangerou...

Page 4: ...s à risque notamment dans des applications pouvant causer des dommages corporels Si vous utilisez ce logiciel ou matériel dans le cadre d applications dangereuses il est de votre responsabilité de prendre toutes les mesures de secours de sauvegarde de redondance et autres mesures nécessaires à son utilisation dans des conditions optimales de sécurité Oracle Corporation et ses affiliés déclinent to...

Page 5: ... 21 I O Component Locations 22 Power Distribution and Fan Module Component Locations 24 System Schematic 25 Component Task Reference 28 Detecting and Managing Faults 31 Understanding Diagnostics 31 Diagnostics Process 32 Tool Availability 34 Log In to Oracle ILOM Service 35 Oracle ILOM Service Related Tools 35 Interpreting LEDs 36 Front Panel Controls and LEDs 37 Rear Panel Controls and LEDs 39 Co...

Page 6: ...ervice 55 Filler Panels 55 Find the Server Serial Number 56 Locate the Server 57 Component Service Categories 57 Removing Power From the Server 58 Prepare to Power Off the Server 59 Power Off the Server Oracle ILOM 60 Power Off the Server Power Button Graceful 60 Power Off the Server Emergency Shutdown 61 Disconnect Power Cords 61 Accessing Server Components 62 Prevent ESD Damage 62 Extend the Ser...

Page 7: ...lies 89 Power Supply LEDs 89 Locate a Faulty Power Supply 91 Remove a Power Supply 91 Install a Power Supply 93 Verify Power Supply Functionality 95 Servicing Memory Risers and DIMMs 97 Memory Riser and DIMM FRU Names 97 Memory Riser and DIMM Configuration 99 DIMM Rank Classification Labels 100 Locate a Failed DIMM LEDs 100 Locate a Failed DIMM Oracle ILOM 102 Remove a Memory Riser and DIMM 103 In...

Page 8: ...ctionality 133 Servicing the Fan Board 135 Remove the Fan Board 135 Install the Fan Board 137 Verify Fan Board Functionality 139 Servicing the Motherboard 141 Remove the Motherboard 141 Install the Motherboard 147 Reactivate RAID Volumes 153 Verify Motherboard Functionality 155 Servicing the Drive Backplane 157 Remove the Drive Backplane 157 Install the Drive Backplane 159 Verify Drive Backplane F...

Page 9: ... 167 Returning the Server to Operation 169 Replace the Top Cover 169 Return the Server to the Normal Operating Position 170 Attach Power Cords 172 Power On the Server Oracle ILOM 172 Power On the Server Power Button 173 Glossary 175 Index 181 9 ...

Page 10: ...10 SPARC T5 2 Server Service Manual February 2017 ...

Page 11: ...zed service providers Required knowledge Advanced experience troubleshooting and replacing hardware Product Documentation Library Documentation and resources for this product and related products are available at http www oracle com goto t5 2 docs Feedback Provide feedback about this documentation at http www oracle com goto docfeedback Using This Documentation 11 ...

Page 12: ...12 SPARC T5 2 Server Service Manual February 2017 ...

Page 13: ...t Locations on page 22 Power Distribution and Fan Module Component Locations on page 24 System Schematic on page 25 Component Task Reference on page 28 Related Information Detecting and Managing Faults on page 31 Preparing for Service on page 53 Front Panel Components Service The following figure shows the layout of the server front panel including the power and server locator buttons and the vari...

Page 14: ...P on page 129 6 Three Service Action Required LEDs amber for Fan Module FAN Processor CPU and Memory MEM Servicing Fan Modules on page 81 Servicing the Motherboard on page 141 Servicing Memory Risers and DIMMs on page 97 7 Power Supply PS Fault Service Action Required LED amber Servicing Power Supplies on page 89 8 Overtemperature LED amber Front Panel Controls and LEDs on page 37 9 Serial number ...

Page 15: ... O Component Locations on page 22 Power Distribution and Fan Module Component Locations on page 24 System Schematic on page 25 Rear Panel Components Service No Description Links 1 Power supply 0 status indicator LEDs Servicing Power Supplies on page 89 2 Power supply 0 AC inlet 3 Power supply 1 status indicator LEDs Servicing Power Supplies on page 89 4 Power supply 1 AC inlet 5 Server status LEDs...

Page 16: ...nects the safety interlock switch on the top cover to the power distribution board When the top cover is removed this connection is broken which causes the server to power down Power supply backplane signal cable 1 ribbon cable This cable carries signals between the power supply backplane and the power distribution board Motherboard signal cable 1 ribbon cable This cable carries signals between th...

Page 17: ...ent Locations on page 24 Internal Component Locations The following figures identify the replaceable component locations with the top cover removed Note The 2 processor server has eight memory risers The 1 processor server has four memory risers Identifying Components 17 ...

Page 18: ...Target Links 1 SP SYS MB SP Servicing the SP on page 129 2 PCIe card in slot 1 SYS MB PCIE1 SYS MB PCIE2 SYS MB PCIE3 SYS MB PCIE4 SYS MB PCIE5 SYS MB PCIE6 SYS MB PCIE7 SYS MB PCIE8 Servicing PCIe Cards on page 121 3 Power supplies SYS PS0 outer Servicing Power Supplies on page 89 18 SPARC T5 2 Server Service Manual February 2017 ...

Page 19: ...ge 141 9 Memory risers These memory risers are not present in the 1 processor server SYS MB CM0 CMP MR0 SYS MB CM0 CMP MR1 SYS MB CM0 CMP MR2 SYS MB CM0 CMP MR3 SYS MB CM1 CMP MR0 SYS MB CM1 CMP MR1 SYS MB CM1 CMP MR2 SYS MB CM1 CMP MR3 Servicing Memory Risers and DIMMs on page 97 10 Fan board SYS FANBD Servicing the Fan Board on page 135 11 Fan modules As viewed from front of server SYS FANBD F0 ...

Page 20: ...HDD3 SYS SASBP HDD4 SYS SASBP HDD5 top Related Information Motherboard Component Locations on page 21 I O Component Locations on page 22 Power Distribution and Fan Module Component Locations on page 24 System Schematic on page 25 20 SPARC T5 2 Server Service Manual February 2017 ...

Page 21: ...ing the SP on page 129 2 Memory riser SYS MB CMn CMP MRn Servicing Memory Risers and DIMMs on page 97 3 DIMMs SYS MB CMn CMP MRn BOBn CHn D0 Servicing Memory Risers and DIMMs on page 97 4 Motherboard SYS MB Servicing the Motherboard on page 141 5 Battery SYS MB BAT Servicing the Battery on page 117 Identifying Components 21 ...

Page 22: ... and DIMMs on page 97 Servicing the Motherboard on page 141 Servicing the Battery on page 117 I O Component Locations No Component Oracle ILOM Target LInks 1 Drives SYS SASBP HDD0 bottom SYS SASBP HDD1 SYS SASBP HDD2 SYS SASBP HDD3 Servicing Drives on page 69 22 SPARC T5 2 Server Service Manual February 2017 ...

Page 23: ...he Drive Backplane on page 157 3 DVD drive SYS SASBP DVD Servicing the DVD Drive on page 113 4 Drive backplane SYS SASBP Servicing the Drive Backplane on page 157 Related Information Component Service Categories on page 57 Servicing Drives on page 69 Servicing the DVD Drive on page 113 Servicing the Drive Backplane on page 157 Identifying Components 23 ...

Page 24: ...LOM Target Links 1 PS backplane and cover SYS PDB Servicing the PS Backplane on page 163 2 Power supplies SYS PS0 outer SYS PS1 inner Servicing Power Supplies on page 89 3 Fan modules SYS FANBD F0 SYS FANBD F1 SYS FANBD F2 SYS FANBD F3 SYS FANBD F4 Servicing Fan Modules on page 81 24 SPARC T5 2 Server Service Manual February 2017 ...

Page 25: ...1 Servicing the Fan Board on page 135 System Schematic These schematic diagrams show the connections between and among components and device slots on the 2 processor server and the 1 processor server Use these schematic diagrams to determine the optimum locations for optional cards or other peripherals based on your system s configuration and intended use Note For more detail on root complexes rel...

Page 26: ...System Schematic FIGURE 1 Schematic Diagram for a 2 Processor Server 26 SPARC T5 2 Server Service Manual February 2017 ...

Page 27: ...System Schematic FIGURE 2 Schematic Diagram for a 1 Processor Server Identifying Components 27 ...

Page 28: ...omponent Oracle ILOM Target Links Battery SYS MB BAT Servicing the Battery on page 117 DIMMs SYS MB CMn CMP MRn BOBn CHn D0 Servicing Memory Risers and DIMMs on page 97 Drive backplane SYS SASBP Servicing the Drive Backplane on page 157 Drives SYS SASBP HDD0 bottom SYS SASBP HDD1 SYS SASBP HDD2 SYS SASBP HDD3 SYS SASBP HDD4 SYS SASBP HDD5 top Servicing Drives on page 69 DVD drive SYS SASBP DVD Ser...

Page 29: ...DIMMs on page 97 Motherboard SYS MB Servicing the Motherboard on page 141 PCIe card in slot 1 SYS MB PCIE1 SYS MB PCIE2 SYS MB PCIE3 SYS MB PCIE4 SYS MB PCIE5 SYS MB PCIE6 SYS MB PCIE7 SYS MB PCIE8 Servicing PCIe Cards on page 121 Power supplies SYS PS0 outer SYS PS1 inner Servicing Power Supplies on page 89 PS backplane and cover SYS PDB Servicing the PS Backplane on page 163 SP SYS MB SP Servici...

Page 30: ...Component Task Reference I O Component Locations on page 22 Power Distribution and Fan Module Component Locations on page 24 30 SPARC T5 2 Server Service Manual February 2017 ...

Page 31: ...aults on page 46 Interpreting Log Files and System Messages on page 50 Related Information Identifying Components on page 13 Preparing for Service on page 53 Component Service Categories on page 57 Returning the Server to Operation on page 169 Understanding Diagnostics These topics explain the diagnostic process and tools Diagnostics Process on page 32 Tool Availability on page 34 Log In to Oracle...

Page 32: ...tics Process Depending on the fault you might need to perform all of the steps or just some of them You also might have to run diagnostic software that needs to be installed or enabled 32 SPARC T5 2 Server Service Manual February 2017 ...

Page 33: ...agnostic tools you use and the order in which you use them depend on the nature of the problem you are troubleshooting However for descriptive purposes this table follows the steps given in the illustration Detecting and Managing Faults 33 ...

Page 34: ... System Messages on page 50 4 Run Oracle VTS software To run Oracle VTS the server must be running the Oracle Solaris OS If Oracle VTS reports a faulty component replace it If Oracle VTS does not report a faulty component run POST Refer to the Oracle VTS software documentation Configuring POST on page 40 Contact technical support if the problem persists Related Information Tool Availability on pag...

Page 35: ...n page 34 Oracle ILOM Service Related Tools on page 35 Oracle ILOM Service Related Tools You can use these Oracle ILOM CLI commands when performing service related tasks Oracle ILOM Command Description help command Displays a list of all available Oracle ILOM commands with syntax and descriptions Specifying a command name as an option displays help for that command set HOST send_break_action break...

Page 36: ...ne if an LED indicates that a component has failed in the server Steps Description Links 1 Check the LEDs on the front and rear of the server Front Panel Controls and LEDs on page 37 Rear Panel Controls and LEDs on page 39 2 Check the LEDs on the individual components Note Component LEDs might not be lit even though the component is faulty Use the instructions in these links to determine if the co...

Page 37: ... for Faults on page 46 Under some fault conditions individual component fault LEDs are lit in addition to the Service Required LED 3 Power OK LED green Indicates these conditions Off Server is not running in its normal state Server power might be off The SP might be running Steady on Server is powered on and is running in its normal operating state No service actions are required Fast blink Server...

Page 38: ...ne of the fan modules 6 CPU Fault LED amber CPU Indicates these conditions Off Steady state no service action is required Steady on A fault has been detected on one or more host processors 6 Memory Fault LED amber MEM Indicates these conditions Off Steady state no service action is required Steady on A fault has been detected on one or more DIMMs 7 Power Supply Fault LED amber PS Indicates these c...

Page 39: ... DC output from this power supply is disabled or not within spec Steady on 12V DC output from this power supply is present and within specifications 3 Power Supply Fault LED amber Indicates these conditions Off Steady state no service action is required Steady on A fault has been detected on this power supply 4 NET MGT Port Link Activity LED green on left LINK ACT Indicates these conditions Off No...

Page 40: ...and is running in its normal operating state No service actions are required Fast blink Server is running in standby mode and can be quickly returned to full function Slow blink A normal but transitory activity is taking place Slow blinking might indicate that system diagnostics are running or that the system is booting 8 Host Ethernet Port Link Activity LED green These LEDs from left to right rep...

Page 41: ...ocessor core the core is disabled POST completes its test sequence and the server boots using the remaining cores Related Information Oracle ILOM Properties That Affect POST Behavior on page 41 Configure POST on page 43 Run POST With Maximum Testing on page 45 Oracle ILOM Properties That Affect POST Behavior Note The value of keyswitch_state must be normal when individual POST parameters are chang...

Page 42: ...erate amount of information including component names and test results debug Displays extensive debugging information none Disables the output error reset Default Runs POST if fatal errors are detected error_reset_level max default Runs the maximum set of tests min Runs a minimum set of tests error_reset_verbosity min default Displays the minimum level of output max Displays information for each s...

Page 43: ...OST on page 43 Run POST With Maximum Testing on page 45 Configure POST 1 Log in to Oracle ILOM See Log In to Oracle ILOM Service on page 35 2 Set the virtual keyswitch to the value that corresponds to the POST configuration you want to run Detecting and Managing Faults 43 ...

Page 44: ...r verbosity set the respective parameters Syntax set HOST diag property value See Oracle ILOM Properties That Affect POST Behavior on page 41 for a list of parameters and values Examples set HOST diag mode normal set HOST diag verbosity max 4 View the current values for settings Example show HOST diag HOST diag Targets Properties error_reset_level max error_reset_verbosity normal hw_change_level m...

Page 45: ...ee Log In to Oracle ILOM Service on page 35 2 Set the virtual keyswitch to diag so that POST runs in service mode set HOST keyswitch_state diag Set keyswitch_state to Diag 3 Reset the server so that POST runs There are several ways to initiate a reset This example shows a reset using the reset command reset SYS Are you sure you want to reset SYS y n y Resetting SYS Related Information POST Overvie...

Page 46: ...ssage ID to get additional information about the problem from the knowledge article database A PSH console message provides this information about each detected fault Type Severity Description Automated response Impact Suggested action for system administrator If PSH detects a faulty component use the fmadm faulty command to display information about the fault See Check for Faults on page 46 Relat...

Page 47: ...wn System Manufacturer Oracle Corporation Name SPARC T5 8 Part_Number 12345678 11 1 Serial_Number 1238BDC0DF Suspect 1 of 1 Fault class fault io pciex device interr corr Certainty 100 Affects hc chassis 0 motherboard 0 cpuboard 0 chip 0 hostbridge 0 pciexrc 0 Status faulted but still in service FRU Status faulty Location SYS PM0 Manufacturer Oracle Corporation Name TLA PN NRM T5 1 2 Part_Number 70...

Page 48: ...D 4e16c8d 5cdb c6ca c949 e24d3637ef27 which is unique to each fault Message identifier PCIEX 8000 8R which can be used to obtain additional fault information from Knowledge Base articles 3 Use the message ID to obtain more information about this type of fault a Obtain the message ID from console output b Go to https support oracle com and search on the message ID in the Knowledge tab 4 Follow the ...

Page 49: ...lse Do not perform the subsequent steps If a fault is reported continue to Step 3 3 Clear the fault from all persistent fault records In some cases even though the fault is cleared some persistent fault information remains and results in erroneous fault messages at boot time To ensure that these messages are not displayed type this PSH command fmadm acquit event ID 4 If required reset the server I...

Page 50: ...w the log files and system messages Check the Message Buffer on page 50 Understanding Diagnostics on page 31 Managing Faults on page 46 Check the Message Buffer The dmesg command checks the system buffer for recent diagnostic messages and displays them 1 Log in as superuser 2 Type dmesg Related Information View Log Files Oracle Solaris on page 50 View Log Files Oracle ILOM on page 51 View Log File...

Page 51: ...the messages are further rotated to messages 2 and messages 3 and then deleted 1 Log in as superuser 2 Type more var adm messages 3 To view all logged messages type more var adm messages Related Information Check the Message Buffer on page 50 View Log Files Oracle Solaris on page 50 View Log Files Oracle ILOM 1 View the event log show SP logs event list 2 View the audit log show SP logs audit list...

Page 52: ...52 SPARC T5 2 Server Service Manual February 2017 ...

Page 53: ...and remove power from the server Removing Power From the Server on page 58 8 Move the server out of the rack and gain access to internal components Accessing Server Components on page 62 9 Attach devices to the server to perform service procedures Attachment of Devices During Service on page 68 Related Information Identifying Components on page 13 Returning the Server to Operation on page 169 Safe...

Page 54: ...evices such as the cards drives and DIMMS require special handling Caution Circuit boards and drives contain electronic components that are extremely sensitive to static electricity Ordinary amounts of static electricity from clothing or the work environment can destroy the components located on these boards Do not touch the components along their connector edges Caution You must disconnect all po...

Page 55: ...ions Antistatic wrist strap Antistatic mat No 2 Phillips screwdriver No 1 flat blade screwdriver battery removal Pen or pencil to power on server Related Information Safety Information on page 53 Filler Panels A filler panel is an empty metal or plastic enclosure that is installed at the factory or in the field into a server component slot that does not contain a functioning component The filler p...

Page 56: ...ial Number You need the serial number of the server s chassis to obtain technical support for the system Note When a PDB fan board or drive backplane is replaced the chassis serial number and part number might need to be programmed into the new component This must be done in a special service mode by trained service personnel Locate the serial number using one of the following methods Read the ser...

Page 57: ...off Related Information Front Panel Components Service on page 13 Component Service Categories The server components and assemblies that can be replaced in the field fall into three categories Hot service replaceable by customer Cold service replaceable by customer Cold service replaceable by authorized service personnel Cold service procedures require that you shut the server down and unplug the ...

Page 58: ...ervicing Memory Risers and DIMMs on page 97 DVD drive Servicing the DVD Drive on page 113 Remove any media prior to replacement A drive must be installed to preserve proper interior air flow System battery Servicing the Battery on page 117 I O cards Servicing PCIe Cards on page 121 Cold service replaceable by authorized service personnel Fan board Servicing the Fan Board on page 135 Motherboard Se...

Page 59: ... status or log files You also might want to run diagnostics before you shut down the server 2 Notify affected users that the server will be shut down Refer to the Oracle Solaris system administration documentation for additional information 3 Save any open files and quit all running programs Refer to your application documentation for specific information on these processes 4 Shut down all logical...

Page 60: ...key sequence 3 Power off the server stop System Note You can also use the Power button on the front of the server to initiate a graceful server shutdown See Power Off the Server Power Button Graceful on page 60 This button is recessed to prevent accidental server power off Related Information Prepare to Power Off the Server on page 59 Power Off the Server Power Button Graceful on page 60 Power Off...

Page 61: ...ing changes File system corruption might occur 1 Prepare to power off the server See Prepare to Power Off the Server on page 59 2 Press and hold the Power button for five seconds Related Information Prepare to Power Off the Server on page 59 Power Off the Server Oracle ILOM on page 60 Power Off the Server Power Button Graceful on page 60 Front Panel Components Service on page 13 Disconnect Power C...

Page 62: ... the Service Position on page 63 Release the CMA on page 64 Remove the Server From the Rack on page 66 Remove the Top Cover on page 67 Related Information Safety Information on page 53 Prevent ESD Damage Many components housed within the chassis can be damaged by ESD To protect these components from damage perform the following steps before opening the chassis for service 1 Prepare an antistatic s...

Page 63: ...components with the server in the service position Drives DVD drive Power supplies Fan modules Fan boards Memory risers DIMMs PCIe cards SP card Battery Note You can replace the drives DVD drive and power supplies without extending the server into the service position 1 Verify that no cables will be damaged or will interfere when the server is extended Although the CMA that is supplied with the se...

Page 64: ...rmation Release the CMA on page 64 Remove the Server From the Rack on page 66 Release the CMA For some service procedures such as replacing a power supply if you are using a CMA you might need to release the CMA to gain access to the rear of the chassis Note For instructions on how to install the CMA for the first time refer to Server Installation 64 SPARC T5 2 Server Service Manual February 2017 ...

Page 65: ... is unattached 3 When you have finished the service steps that require the CMA to be out of the way swing the CMA closed and latch it to the left rack rail Check that the CMA and the cables are functioning properly after completing service Related Information Extend the Server to the Service Position on page 63 Remove the Server From the Rack on page 66 Preparing for Service 65 ...

Page 66: ...bles and power cords from the server 4 Extend the server to the maintenance position See Extend the Server to the Service Position on page 63 5 Release the CMA from the rail assembly The CMA is still attached to the cabinet but the server chassis is now disconnected from the CMA See Release the CMA on page 64 6 From the front of the server pull the release tabs forward and pull the server forward ...

Page 67: ...u replace the top cover 1 Ensure that the AC power cords are disconnected from the server power supplies 2 Unlatch the server top cover Insert your fingers under the two cover latches and simultaneously lift both latches in an upward motion as shown in panel 1 3 Lift the cover slightly and slide it toward the front of the server chassis about 0 5 inch 12 mm 4 Lift up and remove the top cover as sh...

Page 68: ...fer to Server Installation If you plan to connect to the Oracle ILOM software over the network connect an Ethernet cable to the Ethernet port labeled NET MGT Note The service processor SP uses the NET MGT out of band port by default You can configure the SP to share one of the sever s four Ethernet ports instead The SP uses only the configured Ethernet port If you plan to access the Oracle ILOM CL...

Page 69: ...emory Either type of drive can be a boot device The terms drive and HDD are used in a generic sense to refer to both types of internal storage devices These topics explain how to service drives Drive LEDs on page 70 Remove a Drive Filler Panel on page 74 Remove a Drive on page 71 Install a Drive on page 76 Install a Drive Filler Panel on page 77 Verify Drive Functionality on page 78 Related Inform...

Page 70: ...available for use 3 OK Activity SSDs Green Indicates the drive s availability for use On Read or write activity is in progress Off Drive is idle and available for use Flashes on and off This situation occurs during hot service operations You can ignore this situation Note The front and rear panel Service Action Required LEDs are also lit when the server detects a drive fault See Front Panel Compon...

Page 71: ...the drive is faulty replace it See Remove a Drive on page 71 3 If you are unable to identify the faulty drive seek further information See Detecting and Managing Faults on page 31 Related Information Drive LEDs on page 70 Remove a Drive on page 71 Install a Drive on page 76 Verify Drive Functionality on page 78 Detecting and Managing Faults on page 31 Remove a Drive A customer can perform this pro...

Page 72: ...ve you plan to remove This information is listed in the Occupant column Ap_id Type Receptacle Occupant Condition c0 scsi bus connected configured unknown c0 dsk c1t0d0 disk connected configured unknown c0 dsk c1t0d0 disk connected configured unknown usb0 1 unknown empty unconfigured ok usb0 2 unknown empty unconfigured ok You must unconfigure any drive whose status is listed as configured as descr...

Page 73: ...er on page 58 To hot service the drive take the drive offline using one of the procedures in Power Off the Server Power Button Graceful on page 60 This action removes the logical software links to the drive and prevents any applications from accessing it 5 If you are hot servicing the drive locate the drive that displays the amber Fault LED and ensure that the blue Ready to Remove LED is lit 6 Att...

Page 74: ... drive or a drive filler panel See Install a Drive on page 76 or Install a Drive Filler Panel on page 77 Related Information Install a Drive on page 76 Remove a Drive Filler Panel on page 74 Install a Drive Filler Panel on page 77 Verify Drive Functionality on page 78 Remove a Drive Filler Panel A customer can perform this procedure while the server is running See Component Service Categories on p...

Page 75: ...h and pull the filler panel out of the drive slot Caution When you remove a drive filler panel replace it with another filler panel or a drive Otherwise the server might overheat due to improper airflow 3 Install a drive or a replacement drive filler panel See Install a Drive Filler Panel on page 77 or Install a Drive on page 76 Related Information Locate a Faulty Drive on page 71 Remove a Drive o...

Page 76: ...ically addressed according to the slot in which they are installed 1 Remove a drive or a drive filler panel See Remove a Drive on page 71 or Remove a Drive Filler Panel on page 74 2 Unpack the drive and place it on an antistatic mat 3 Fully open the release lever on the drive 4 Install the drive by completing the following tasks a Slide the drive into the drive slot until it is fully seated b Clos...

Page 77: ...igure c0 dsk c1t1d0 Replace c0 dsk c1t1d0 with the drive name that applies to your situation 6 Verify the drive functionality See Verify Drive Functionality on page 78 Related Information Locate a Faulty Drive on page 71 Remove a Drive on page 71 Remove a Drive Filler Panel on page 74 Install a Drive Filler Panel on page 77 Verify Drive Functionality on page 78 Install a Drive Filler Panel 1 Remov...

Page 78: ...nstall a Drive on page 76 Remove a Drive Filler Panel on page 74 Verify Drive Functionality on page 78 Verify Drive Functionality 1 If the OS is shut down and the drive you replaced was not the boot device boot the OS Depending on the nature of the replaced drive you might need to perform administrative tasks to reinstall software before the server can boot Refer to the Oracle Solaris OS administr...

Page 79: ...figure c0 sd1 Replace c0 sd1 with the drive name for your configuration 4 Verify that the blue Ready to Remove LED is no longer lit on the drive that you installed See Locate a Faulty Drive on page 71 5 At the Oracle Solaris prompt list all drives in the device tree including any drives that are not configured cfgadm al The replacement drive is now listed as configured as shown in the following ex...

Page 80: ...rm the tasks required to configure the drive These tasks are covered in the Oracle Solaris OS administration documentation For additional drive verification you can run Oracle VTS Refer to the Oracle VTS documentation for details Related Information Locate a Faulty Drive on page 71 Remove a Drive on page 71 Install a Drive on page 76 80 SPARC T5 2 Server Service Manual February 2017 ...

Page 81: ...he fan modules Each fan module contains a single fan that is mounted in an integrated hot serviceable component These topics explain how to service faulty fan modules Fan Module LEDs on page 82 Locate a Faulty Fan Module on page 83 Remove a Fan Module on page 83 Install a Fan Module on page 86 Verify Fan Module Functionality on page 87 Related Information Preparing for Service on page 53 Servicing...

Page 82: ...reen The server is powered on and the fan module is functioning correctly Service Required Amber The fan module is faulty Related Information Locate a Faulty Fan Module on page 83 Detecting and Managing Faults on page 31 82 SPARC T5 2 Server Service Manual February 2017 ...

Page 83: ...e 13 Rear Panel Components Service on page 15 Extend the Server to the Service Position on page 63 Remove a Fan Module on page 83 Detecting and Managing Faults on page 31 Remove a Fan Module Caution While the fan modules provide some cooling redundancy if a fan module fails replace it as soon as possible to maintain server availability When you remove one of the fans in the rear row fans 3 4 or 5 ...

Page 84: ...nding Service Required LED The Service Action Required LEDs are located on the fan module as shown in Locate a Faulty Fan Module on page 83 3 Using your thumb and forefinger grasp the handle on the fan module and lift it out of the server Caution When removing a fan module do not rock it back and forth Rocking fan modules can damage the fan board connectors 84 SPARC T5 2 Server Service Manual Febr...

Page 85: ...Do not service any other components in the fan compartment unless the server is shut down and the power cords are removed 4 Install a new fan module See Install a Fan Module on page 86 Related Information Extend the Server to the Service Position on page 63 Install a Fan Module on page 86 Servicing Fan Modules 85 ...

Page 86: ...ot from which the faulty fan was removed 1 Remove a fan module See Remove a Fan Module on page 83 2 Unpack the replacement fan module and place it on an antistatic mat 3 Install the replacement fan module into the server by completing the following tasks a Align the fan module and slide it into the fan slot 86 SPARC T5 2 Server Service Manual February 2017 ...

Page 87: ...Required LED on the front of the server are not lit See Front Panel Controls and LEDs on page 37 Note If you are replacing a fan module when the server is powered down the LEDs might stay lit until power is restored to the server and the server can determine that the fan module is functioning properly 3 Use the Oracle ILOM show faulty command to verify that the fault has been cleared See Managing ...

Page 88: ... Module Functionality Related Information Locate a Faulty Fan Module on page 83 Front Panel Components Service on page 13 Rear Panel Components Service on page 15 88 SPARC T5 2 Server Service Manual February 2017 ...

Page 89: ...and working These topics describe how to service power supply modules Power Supply LEDs on page 89 Locate a Faulty Power Supply on page 91 Remove a Power Supply on page 91 Install a Power Supply on page 93 Verify Power Supply Functionality on page 95 Related Information Servicing the PS Backplane on page 163 Power Supply LEDs Each power supply has LEDs that indicate its state Servicing Power Suppl...

Page 90: ...n 3 AC Present Green AC voltage is applied to the power supply Note The front and rear panel Service Action Required LEDs are also lit when the server detects a power supply fault See Front Panel Components Service on page 13 and Rear Panel Components Service on page 15 Related Information Locate a Faulty Power Supply on page 91 Verify Power Supply Functionality on page 95 90 SPARC T5 2 Server Ser...

Page 91: ...Panel Components Service on page 13 Rear Panel Components Service on page 15 Remove a Power Supply on page 91 Remove a Power Supply Caution Hazardous voltages are present To reduce the risk of electric shock and danger to personal health follow the instructions Caution If a power supply fails and you do not have a replacement available to ensure proper airflow leave the failed power supply install...

Page 92: ...y out of the chassis Caution There is no catch mechanism on the power supply to prevent it from sliding completely out of the chassis Use care when removing the power supply to prevent it from falling Caution Whenever you remove a power supply you should replace it with another power supply Otherwise the server might overheat due to improper airflow If a new power supply is not available leave the...

Page 93: ...ly exhausts air from the rear of the server Do not install an A239 power supply which might cause the server to overheat and shut down 1 Remove a power supply See Remove a Power Supply on page 91 2 If necessary release the cable management arm to access the power supplies See Release the CMA on page 64 Do not allow the CMA to hang unsupported while it is unattached 3 Align the power supply with th...

Page 94: ... following LEDs are not lit Service Action Required LED on the power supply Front and rear Service Action Required LEDs Rear PS Failure LED on the bezel of the server See Interpreting LEDs on page 36 9 Verify power supply functionality See Verify Power Supply Functionality on page 95 Related Information Remove a Power Supply on page 91 Verify Power Supply Functionality on page 95 94 SPARC T5 2 Ser...

Page 95: ...faulty command 4 Perform one of the following tasks based on your verification results If the previous steps did not clear the fault see Detecting and Managing Faults on page 31 for information about the tools and methods you can use to diagnose component faults If the previous steps indicate that no faults have been detected then the component has been replaced successfully No further action is r...

Page 96: ...96 SPARC T5 2 Server Service Manual February 2017 ...

Page 97: ...includes eight memory risers The 1 processor server includes four memory risers Four memory risers are associated with each CMP in the server A label is next to each memory riser that shows the number of the CMP and of the riser Four DIMM slots are on each memory riser Note The server fails to boot unless all memory riser slots are populated For more information about memory riser configuration se...

Page 98: ... MB CM0 CMP MR2 BOB0 CH1 D0 SYS MB CM0 CMP MR2 BOB1 CH0 D0 SYS MB CM0 CMP MR2 BOB1 CH1 D0 Black Black White White Black White Black White CM0 MR3 SYS MB CM0 CMP MR3 riser SYS MB CM0 CMP MR3 BOB0 CH0 D0 SYS MB CM0 CMP MR3 BOB0 CH1 D0 SYS MB CM0 CMP MR3 BOB1 CH0 D0 SYS MB CM0 CMP MR3 BOB1 CH1 D0 Black Black White White Black White Black White CM1 MR0 Not on the 1 processor server SYS MB CM1 CMP MR0 ...

Page 99: ...on on page 99 DIMM Rank Classification Labels on page 100 Memory Riser and DIMM Configuration The memory riser configuration rules for the server are as follows The 2 processor server contains eight memory risers The 1 processor server contains four memory risers Four memory risers are supported per CPU Each of the memory riser slots in the server must be filled with a memory riser There are only ...

Page 100: ...te Single rank DIMMs are not currently offered DIMM Capacity DRAM Density Rank Classification Label 8 GB 4 GB Dual rank x4 2Rx4 16 GB 4 GB Dual rank x4 2Rx4 32 GB 4 GB Quad rank x4 4Rx4 Related Information Memory Riser and DIMM FRU Names on page 97 Memory Riser and DIMM Configuration on page 99 Locate a Failed DIMM LEDs on page 100 Remove a Memory Riser and DIMM on page 103 Install a DIMM and a Me...

Page 101: ...ch faulty or misconfigured DIMM when you press the memory riser remind button 2 DIMM slots A notch toward the middle of each slot ensures that the DIMM is correctly oriented If only two DIMMs are installed in each memory riser they must be in the black DIMM connectors labeled J701_ZA and J701ZB 3 Memory riser power LED Green Amber Indicates that the riser is operating normally Indicates that the r...

Page 102: ... 0 fru SYS MB CM0 CMP MR1 BOB1 CH0 D0 SP faultmgmt 0 timestamp Dec 21 16 40 56 SP faultmgmt 0 timestamp Dec 21 16 40 56 faults 0 SP faultmgmt 0 sp_detected_fault SYS MB CM0 CMP MR1 BOB1 CH0 D0 faults 0 Forced fail POST 2 Locate the DIMM that corresponds to the listed name See Memory Riser and DIMM FRU Names on page 97 In this example SYS MB CM0 CMP MR1 BOB1 CH0 D0 indicates the memory riser that i...

Page 103: ...ystem must be completely powered down before performing this procedure See Component Service Categories on page 57 for more information about cold service procedures 1 Prepare for servicing a Attach an antistatic wrist strap b Power off the server and unplug power cords from the power supplies See Removing Power From the Server on page 58 c Extend the server to the maintenance position See Extend ...

Page 104: ...divider as shown in the following figure If the memory riser Service Action Required LED is off all DIMMs on this riser are operating properly If the memory riser Service Action Required LED is on amber one or more of the DIMMs installed on this riser is faulty or misconfigured 104 SPARC T5 2 Server Service Manual February 2017 ...

Page 105: ...Service Action Required LED straight up to remove the memory riser from the memory module socket 4 Identify the faulty or misconfigured DIMMs by pressing the Remind button on the memory riser See Locate a Failed DIMM LEDs on page 100 Servicing Memory Risers and DIMMs 105 ...

Page 106: ...Otherwise the server might overheat due to improper airflow 6 Install DIMMs in the memory riser and return the memory riser to the server See Install a DIMM and a Memory Riser on page 106 Related Information Install a DIMM and a Memory Riser on page 106 Install a DIMM and a Memory Riser 1 Attach an antistatic wrist wrap and unpack the DIMMs and place them on an antistatic mat 2 Install the DIMMs i...

Page 107: ...1 DIMM connector slot 2 DIMM connector key 3 DIMM ejector lever a Ensure that the ejector levers at both ends of the memory module slot are in a fully open position b Align each DIMM with the empty connector slot aligning the notch in the DIMM with the key in the connector The notch ensures that the DIMM is oriented correctly Servicing Memory Risers and DIMMs 107 ...

Page 108: ...ejector tabs lock the DIMM in place Repeat these steps until each DIMM has been installed 3 Push the memory riser module into the associated CPU memory riser slot until the riser module locks in place 4 Return the server to operation 108 SPARC T5 2 Server Service Manual February 2017 ...

Page 109: ... Use the show faulty command to determine how to clear the fault If show faulty indicates a POST detected fault go to Step 3 If show faulty output displays a UUID which indicates a host detected fault skip Step 3 and go directly to Step 4 3 Use the set command to enable the DIMM that was disabled by POST In most cases replacement of a faulty DIMM is detected when the service processor is power cyc...

Page 110: ...onsole displays status Powered Off d Switch to the system console to view POST output Watch the POST output for possible fault messages The following output indicates that POST did not detect any faults start SYS console 0 0 0 INFO 0 0 0 POST Passed all devices 0 0 0 POST Return to VBSC 0 0 0 Master set ACK for vbsc runpost command and spin Note The server might boot automatically at this point If...

Page 111: ...timestamp Dec 14 22 43 59 SP faultmgmt 0 sunw msg id SUN4V 8000 DX faults 0 SP faultmgmt 0 uuid 3aa7c854 9667 e176 efe5 e487e520 faults 0 7a8a SP faultmgmt 0 timestamp Dec 14 22 43 59 faults 0 If the show faulty command reports a fault with a UUID go to Step 7 If show faulty does not report a fault with a UUID you are done with the verification process 7 Switch to the system console and type the f...

Page 112: ...112 SPARC T5 2 Server Service Manual February 2017 ...

Page 113: ... describe how to service a DVD drive Remove a DVD Drive on page 113 Install a DVD Drive on page 114 Related Information Filler Panels on page 55 Remove a DVD Drive A customer can perform this procedure The server must be completely powered down before performing this procedure See Component Service Categories on page 57 for more information about cold service procedures 1 Prepare for servicing a A...

Page 114: ... a new DVD drive See Install a DVD Drive on page 114 Related Information Install a DVD Drive on page 114 Install a DVD Drive A customer can perform this procedure The server must be completely powered down before performing this procedure See Component Service Categories on page 57 for more information about cold service procedures 1 Unpack the DVD drive Attach an antistatic wrist wrap and place t...

Page 115: ... the server to operation a Return the server to the normal operating position See Return the Server to the Normal Operating Position on page 170 b Reinstall the power cords to the power supplies and power on the server See Returning the Server to Operation on page 169 Servicing the DVD Drive 115 ...

Page 116: ...Install a DVD Drive Related Information Remove a DVD Drive on page 113 116 SPARC T5 2 Server Service Manual February 2017 ...

Page 117: ...s procedure requires that you handle components that are sensitive to ESD This sensitivity can cause the component to fail To avoid damage ensure that you follow antistatic practices as described in ESD Measures on page 54 A customer can perform this procedure The server must be completely powered down before performing this procedure See Component Service Categories on page 57 for more informatio...

Page 118: ...e battery holder by pulling back on the metal tab holding it in place and sliding the battery up and out of the battery holder 3 Install a new battery See Install the Battery on page 118 Related Information Install the Battery on page 118 Install the Battery 1 Remove the battery See Remove the Battery on page 117 118 SPARC T5 2 Server Service Manual February 2017 ...

Page 119: ...o the network Otherwise proceed to the next step 4 If the SP is not configured to use NTP you must reset the Oracle ILOM clock using the Oracle ILOM CLI or the web interface For instructions see the Oracle ILOM documentation 5 Return the server to operation a Return the server to the normal operating position See Return the Server to the Normal Operating Position on page 170 b Reinstall the power ...

Page 120: ...120 SPARC T5 2 Server Service Manual February 2017 ...

Page 121: ...ts 1 2 3 6 7 and 8 x8 electrical interface Slots 4 and 5 x8 electrical interface x16 connector To determine the slot in which to install a PCIe card follow these guidelines 1 Install cards that require a specific slot Refer to the SPARC T5 2 Server Product Notes and the documentation for each card to determine if there are slot requirements The following cards have certain requirements Sun Flash A...

Page 122: ...d 4 CPU1 IOS0 and PCIe Switch 1 connect to slot 8 On the 1 processor server the single CPU connects to all eight of the PCIe slots Each PCIe slot uses a specific I O subsystem IOS0 or IOS1 and PCIe Switch 0 or 1 CPU0 IOS1 and PCIe Switch 0 connect to slot 1 2 3 and 4 CPU0 IOS0 and PCIe Switch 1 connect to slots 5 6 7 and 8 Note For diagrams showing connections between PCIe slots and root complexes...

Page 123: ... 0 pci 300 pci 1 pci 0 pci 6 SYS MB PCIE3 4 0 1 0 pci 300 pci 1 pci 0 pci 7 SYS MB PCIE4 5 0 0 1 pci 340 pci 1 pci 0 pci 4 SYS MB PCIE5 6 0 0 1 pci 340 pci 1 pci 0 pci 5 SYS MB PCIE6 7 0 0 1 pci 340 pci 1 pci 0 pci 6 SYS MB PCIE7 8 0 0 1 pci 340 pci 1 pci 0 pci 7 SYS MB PCIE8 Related Information System Schematic on page 25 PCIe Card Configuration on page 121 Rear Panel Components Service on page 1...

Page 124: ...e Position on page 63 d Remove the top cover See Remove the Top Cover on page 67 2 Locate the PCIe card or filler panel that you want to remove See Rear Panel Components Service on page 15 for information about PCIe slots and their locations If you are removing a PCIe card slot filler panel go to Step 6 3 If necessary make a note of the slot location for each PCIe card you plan to remove 4 Unplug ...

Page 125: ...igures if you are removing a PCIe card slot filler panel a Disengage the PCIe card slot crossbar from its locked position by pulling it toward the interior of the chassis b Rotate the crossbar to an upright position panel 1 Servicing PCIe Cards 125 ...

Page 126: ...wrist strap unpack the PCIe card or PCIe card slot filler panel and place on an antistatic mat 3 Remove any transceivers from the PCIe card before installing the card 4 Ensure that the server is powered off and all power cords are disconnected from the server power supplies See Removing Power From the Server on page 58 5 Determine which slot to install the PCIe card in If you are not replacing an ...

Page 127: ...e these figures if you are installing a PCIe card See these figures if you are installing a PCIe card slot filler panel 8 Return the server to operation a Install the top cover See Replace the Top Cover on page 169 Servicing PCIe Cards 127 ...

Page 128: ...server See Power On the Server Oracle ILOM on page 172 or Power On the Server Power Button on page 173 9 Refer to the documentation shipped with the PCIe card for information about configuring the PCIe card including installing required operating systems To create or recover RAID configurations refer to the LSI MegaRAID SAS Software User s Guide Related Information Remove a PCIe Card or Filler Pan...

Page 129: ...n replacing the SP you must restore the configuration settings maintained in the SP Before replacing the SP save the configuration using the Oracle ILOM backup utility Refer to the Oracle ILOM documentation for instructions on backing up and restoring the Oracle ILOM configuration After replacig the SP the new SP firmware component and the existing host firmware component must be consistent with e...

Page 130: ...ures Before You Begin The amber SP OK Fault LED on the front panel will be lit when an SP fault is detected 1 If possible back up the Oracle ILOM configuration before removing the SP After you replace the SP restoring the SP configuration will be easier if you previously saved the configuration using the Oracle ILOM backup utility Refer to the Oracle ILOM documentation for instructions on backing ...

Page 131: ...he SP on the new motherboard a Grasp the SP by the two grasp points and lift up to disengage the SP from the connectors on the motherboard panel 1 b Lift the SP up and away from the motherboard panel 2 5 Install a new SP See Install the SP on page 131 Related Information SP Firmware and Configuration on page 129 Install the SP on page 131 Install the SP 1 Remove the SP See Remove the SP on page 13...

Page 132: ...l operating position See Return the Server to the Normal Operating Position on page 170 c Reconnect the power cords to the power supplies See Attach Power Cords on page 172 4 Prior to powering on the server connect a terminal or a terminal emulator PC or workstation to the SP SER MGT port Refer to Server Installation for instructions If the replacement SP detects that the SP firmware is not compat...

Page 133: ...ware download instructions in Servers Administration or the Oracle ILOM documentation Note You can load any supported system firmware version including the firmware version that was installed prior to replacing the SP 7 If you created a backup of your Oracle ILOM configuration use the Oracle ILOM restore utility to restore the configuration of the replacement SP Refer to the Oracle ILOM documentat...

Page 134: ...e show faulty command 3 Perform one of the following tasks based on your verification results If the previous steps did not clear the fault see Detecting and Managing Faults on page 31 for information about the tools and methods you can use to diagnose component faults If the previous steps indicate that no faults have been detected then the component has been replaced successfully No further acti...

Page 135: ...d damage ensure that you follow antistatic practices as described in ESD Measures on page 54 This is a cold service procedure that must be performed by qualified service personnel The server must be completely powered down before performing this procedure See Component Service Categories on page 57 for more information about this category of service procedures 1 Prepare for servicing a Attach an a...

Page 136: ...l memory risers See Remove a Memory Riser and DIMM on page 103 4 Disconnect any cables plugged into the USB or video connectors on the front of the server 5 Remove the fan board a Loosen the three captive screws connecting the front memory riser guide to the motherboard panel 1 136 SPARC T5 2 Server Service Manual February 2017 ...

Page 137: ...l 4 The circuit board and the fan holder portions of the fan board should remain together 6 Install a new fan board See Install the Fan Board on page 137 Related Information Install the Fan Board on page 137 Install the Fan Board 1 Remove the fan board See Remove the Fan Board on page 135 2 Unpack the replacement fan board and place it on an antistatic mat 3 Remove the fan board cable and power ca...

Page 138: ... power cable through the riser guide panels 2 and 3 c Plug the fan board cable and power cable into the connectors on the motherboard panel 3 d Secure the fan board by reinserting and tightening the two screws on each side of the outside of the chassis panel 3 e Tighten the three captive screws to hold the front memory riser guide in place panel 4 138 SPARC T5 2 Server Service Manual February 2017...

Page 139: ...rvice entitlement and warranty coverage The correct product serial number is located on a label on the front of the chassis Related Information Remove the Fan Board on page 135 Verify Fan Board Functionality on page 139 Verify Fan Board Functionality 1 Use the Oracle ILOM show faulty command to verify that the fault has been cleared See Check for Faults on page 46 for more information on using the...

Page 140: ...140 SPARC T5 2 Server Service Manual February 2017 ...

Page 141: ... 141 Install the Motherboard on page 147 Reactivate RAID Volumes on page 153 Verify Motherboard Functionality on page 155 Related Information Component Service Categories on page 57 Remove the Motherboard on page 141 Install the Motherboard on page 147 Verify Motherboard Functionality on page 155 Servicing the SP on page 129 Remove the Motherboard Caution Ensure that all power is removed from the ...

Page 142: ...onents preserves the system specific information stored on these modules Whenever you replace the motherboard or the SP you must update the firmware so the portions of firmware in the SP and on the motherboard are consistent 1 Prepare for servicing a Attach an antistatic wrist strap b Power off the server and unplug power cords from the power supplies See Removing Power From the Server on page 58 ...

Page 143: ...P You will reinstall the SP on the new motherboard See Remove the SP on page 130 5 Remove all memory risers See Remove a Memory Riser and DIMM on page 103 6 On a 1 processor motherboard remove the airflow baffle from the empty side of the center bracket Servicing the Motherboard 143 ...

Page 144: ...mbly air divider by lifting it up and away from the power supplies 8 Disconnect all cables connected to the motherboard a Disconnect two longer cables that connect the motherboard to the drive backplane Push down a metal tab on each connector and pull up b Disconnect two shorter cables from the motherboard One cable goes to the drive backplane The other is a ribbon cable to the power supply c Disc...

Page 145: ...the tooth at the bottom of the cover to clear the edge of the power supply cage d Lift the cover out of the chassis Notice the two cables that are now exposed Be prepared to move those cables out of the way when you lift the motherboard 10 Remove the four bus bar screws that secure the motherboard to the PS backplane See Remove the PS Backplane on page 163 11 Position the drive end of the cables o...

Page 146: ... Tilt up the end of the motherboard that is near the front of the chassis c Lift the motherboard out of the chassis Ensure that remaining cables do not get caught on edges of the motherboard 13 Remove the service processor from the motherboard so you can reinstall it on the new motherboard See Remove the SP on page 130 14 Install a new motherboard See Install the Motherboard on page 147 146 SPARC ...

Page 147: ...ce it on an antistatic mat Note On the 1 processor motherboard do not remove the protective covering on the unused processor and memory riser areas 2 Grasp the motherboard by the handle and place it into the chassis Ensure that remaining cables do not get caught on edges of the motherboard Set the motherboard towards the front of the chassis then slide it toward the rear of the chassis 3 Tighten t...

Page 148: ...cables between the motherboard and the drive backplane 8 Reinstall the System Remind button assembly air divider by sliding it into the chassis Caution After replacing the motherboard inspect the gasket on the air divider before installing the air divider securely This dividing wall maintains a pressurized seal between the server cooling zones Without this pressurized seal the power supply fans wi...

Page 149: ...Install the Motherboard The four hoops on the airflow baffle face away from the center bracket b Set the lower guide in the corner of the outer unused slots Servicing the Motherboard 149 ...

Page 150: ...snap firmly into place d Verify that the airflow baffle is securely attached to the center bracket 11 Reinstall all memory risers See Install a DIMM and a Memory Riser on page 106 12 Install the SP that you removed from the old motherboard 150 SPARC T5 2 Server Service Manual February 2017 ...

Page 151: ...ll a PCIe Card or Filler Panel on page 126 Remove all transcievers from a PCIe card before you install the card 15 Install the top cover See Replace the Top Cover on page 169 16 Return the server to the normal operating position See Return the Server to the Normal Operating Position on page 170 17 Reconnect the power cords to the power supplies Servicing the Motherboard 151 ...

Page 152: ...t it can access the network Log in to the SP through the NET MGT port Refer to the Oracle ILOM documentation for network configuration instructions 20 Download the system firmware Follow the firmware download instructions in the Oracle ILOM documentation Note You can load any supported system firmware version including the firmware version that was installed prior to replacing the motherboard 21 I...

Page 153: ... OS when the server powers on set HOST bootmode script setenv auto boot false 3 Power on the server See Power On the Server Oracle ILOM on page 172 or Power On the Server Power Button on page 173 4 At the OpenBoot prompt list the device paths on the server ok show devs pci 400 pci 2 pci 0 pci e scsi 0 You can also use the devalias command to locate device paths specific to your server ok devalias ...

Page 154: ... command to activate that volume ok inactive_volume activate volume where inactive_volume is the name of the RAID volume that you are activating For example ok 0 activate volume Volume 0 is now activated Note For more information on configuring hardware RAID on the server refer to Servers Administration 8 Unselect the SCSI device ok unselect dev 9 Confirm that you reactivated the volume ok probe s...

Page 155: ...on page 147 Verify Motherboard Functionality on page 155 Verify Motherboard Functionality 1 Use the Oracle ILOM show faulty command to verify that the fault has been cleared See Check for Faults on page 46 for more information on using the show faulty command 2 Perform one of the following tasks based on your verification results If the previous steps did not clear the fault see Detecting and Mana...

Page 156: ...156 SPARC T5 2 Server Service Manual February 2017 ...

Page 157: ... a cold service procedure that must be performed by qualified service personnel The server must be completely powered down before performing this procedure See Component Service Categories on page 57 for more information about this category of service procedures 1 Prepare for servicing a Attach an antistatic wrist strap b Power off the server and unplug power cords from the power supplies See Remo...

Page 158: ...ve one or more memory risers to have easier access to components in the drive area See Remove a Memory Riser and DIMM on page 103 5 Remove the System Remind button assembly air divider by lifting it up and away from the power supplies 6 Remove the drive backplane a Unplug the two SAS cables power cables and ribbon cable from the drive backplane panel 1 158 SPARC T5 2 Server Service Manual February...

Page 159: ...ve Backplane 1 Remove the drive backplane See Remove the Drive Backplane on page 157 2 Unpack the replacement drive backplane and place it on an antistatic mat 3 Insert the drive backplane into the chassis Verify that the drive backplane is seated properly at the bottom in the small slot near the DVD drive 4 Lift up the metal hook and press the drive backplane to the front until it snaps into plac...

Page 160: ...server The lower mini SAS connector on the disk backplane requires the standard four channel mini SAS cable for drive bays 0 to 3 6 Replace the System Remind button assembly air divider 7 Replace all memory risers you removed See Install a DIMM and a Memory Riser on page 106 8 Replace the DVD drive See Install a DVD Drive on page 114 9 Replace all drives and filler panels See Install a Drive on pa...

Page 161: ...e on page 157 Verify Drive Backplane Functionality on page 161 Verify Drive Backplane Functionality 1 Use the Oracle ILOM show faulty command to verify that the fault has been cleared See Check for Faults on page 46 for more information on using the show faulty command 2 Perform one of the following tasks based on your verification results If the previous steps did not clear the fault see Detectin...

Page 162: ...162 SPARC T5 2 Server Service Manual February 2017 ...

Page 163: ...amage to the server you must disconnect power cords before servicing the PS backplane This is a cold service procedure that must be performed by qualified service personnel The server must be completely powered down before performing this procedure See Component Service Categories on page 57 for more information about this category of service procedures 1 Prepare for servicing a Attach an antistat...

Page 164: ...4 Remove the air divider by pulling it up and out of the chassis 5 Remove the ribbon cable connecting the PS backplane to the motherboard panel 1 6 Remove the screw that holds the PS backplane cover in place panel 1 7 Remove the PS backplane cover panel 1 You must guide two slots on the PS backplane cover around two pins on the inside of the power supply cage a Lift the cover up a little to clear ...

Page 165: ... PS Backplane on page 165 Related Information Install the PS Backplane on page 165 Install the PS Backplane 1 Remove the PS backplane See Remove the PS Backplane on page 163 2 Unpack the replacement PS backplane and place it on an antistatic mat 3 Hold the PS backplane at the end of the power supply cage at an angle and connect the AC cables to the AC connectors on the PS backplane Ensure that eac...

Page 166: ...d to the bus bars 6 Replace the PS backplane cover panel 3 a Align the PS backplane cover Ensure that the tooth at the bottom of the cover is clear of the power supply cage You must guide two slots on the PS backplane cover around two pins on the inside of the power supply cage b Fit the two slots on the cover around the two pins c Lift up the cover a little to guide the two pins into the other pa...

Page 167: ...pplies and power on the server See Returning the Server to Operation on page 169 Related Information Remove the PS Backplane on page 163 Verify PS Backplane Functionality on page 167 Verify PS Backplane Functionality 1 Use the Oracle ILOM show faulty command to verify that the fault has been cleared See Check for Faults on page 46 for more information on using the show faulty command 2 Perform one...

Page 168: ...Verify PS Backplane Functionality Related Information Remove the PS Backplane on page 163 Install the PS Backplane on page 165 168 SPARC T5 2 Server Service Manual February 2017 ...

Page 169: ... Power On the Server Oracle ILOM on page 172 Power On the Server Power Button on page 173 Replace the Top Cover 1 Place the top cover on the chassis panel 1 A metal air baffle is attached to the rear inside surface of the top cover When you place the top cover on the server ensure that the air baffle does not catch on anything inside the server Set the cover down so that it is about 1 inch 2 5 cm ...

Page 170: ... hands until both latches engage Related Information Remove the Top Cover on page 67 Return the Server to the Normal Operating Position Before You Begin Caution The chassis is heavy To avoid personal injury use two people to lift the server and set it in the rack 170 SPARC T5 2 Server Service Manual February 2017 ...

Page 171: ...re that the cables do not get in the way 3 Reconnect the cables to the rear of the server If the CMA is in the way disconnect the left CMA release and swing the CMA open See Release the CMA on page 64 4 Reconnect the CMA Swing the CMA closed and latch it to the left rack rail See Server Installation for more detail about attaching the CMA Related Information Remove the Server From the Rack on page...

Page 172: ...Power Button on page 173 Power On the Server Oracle ILOM Before You Begin Note If you are powering on the server following an emergency shutdown that was triggered by the top cover interlock switch you must use the poweron command Type poweron at the Oracle ILOM prompt poweron You will see an alert message on the system console This message indicates that the server is reset You will also see a me...

Page 173: ... illuminated solid green when the SP has successfully booted After the SP has booted the Power OK LED on the front panel begins flashing slowly indicating that the host is in standby power mode 2 Press and release the recessed power button on the server front panel FIgure Legend 1 Power OK LED 2 Power button 3 SP OK Fault LED When main power is applied to the server the main Power OK LED begins to...

Page 174: ...174 SPARC T5 2 Server Service Manual February 2017 ...

Page 175: ...ard management controller BOB Memory buffer on board C chassis For servers refers to the server enclosure For server modules refers to the modular system enclosure CMA Cable management assembly CMM Chassis monitoring module server modules only The CMM is the service processor in the modular system that contains server modules Oracle ILOM runs on the CMM providing lights out management of the compo...

Page 176: ...t H HBA Host bus adapter host The part of the server or server module with the CPU and other hardware that runs the Oracle Solaris OS and other applications The term host is used to distinguish the primary computer from the SP See SP hot pluggable Describes a component that can be replaced with power applied but the component must be prepared for removal hot swappable Describes a component that ca...

Page 177: ...es storage modules NEMs and PCI EMs server modules only The modular system provides Oracle ILOM through its CMM MSGID Message identifier N name space Top level Oracle ILOM target NEBS Network Equipment Building System Netra products only NEM Network express module server modules only NEMs provide Ethernet and SAS connectivity to storage modules NET MGT Network management port An Ethernet port on t...

Page 178: ...ILOM Oracle Solaris OS Oracle Solaris operating system P PCI Peripheral component interconnect PEM PCIe ExpressModule server modules only Modular components that are based on the PCI Express industry standard form factor and offer I O features such as Gigabit Ethernet and Fibre Channel POST Power on self test PROM Programmable read only memory PSH Predictive self healing R REM RAID expansion modul...

Page 179: ...esses Oracle ILOM commands providing lights out management control of the host See host SSD Solid state drive SSH Secure shell storage module Modular component that provides computing storage to the server modules T TIA Telecommunications Industry Association Netra products only Tma Maximum ambient temperature U U S NEC United States National Electrical Code UCP Universal connector port UI User in...

Page 180: ...180 SPARC T5 2 Server Service Manual February 2017 ...

Page 181: ... diag_level parameter 41 diag_mode parameter 41 diag_trigger parameter 42 diag_verbosity parameter 42 diagnostics low level 41 DIMMs classification labels 100 enabling new 109 FRU names 97 installing 106 locating faulty LEDs 100 Oracle ILOM 102 physical layout 97 removing 103 dmesg command 50 drive backplane installing 159 removing 157 verifying function of replaced 161 drives about 69 filler pane...

Page 182: ...ump command 46 front panel controls and LEDs 37 front panel features location of 13 G graceful shutdown defined 60 H HD 15 video connector location of 15 hot service 57 I installing battery 118 DIMMs 106 drive backplane 159 drive filler panels 77 drives 76 DVD drive 114 fan board 137 fan modules 86 memory risers 106 motherboard 147 PCIe cards 126 power supplies 93 PS backplane 165 SP 131 top cover...

Page 183: ...D 39 NET ports Link and Activity LED 39 network NET ports location of 15 O Oracle ILOM locating failed DIMMs 102 Oracle Solaris files and commands 50 Oracle Solaris PSH checking for faults 46 clearing faults 49 overview 46 Oracle VTS using for fault diagnosis 32 Overtemperature LED 37 39 Overtemperature LED location of 13 P PCIe cards configuration rules 121 installing 126 removing 123 root comple...

Page 184: ...ns 53 symbols 54 schematic diagrams 25 SER MGT port location of 15 serial number chassis locating 56 server locating 57 Service Action Required LED 13 Service Required LED 37 39 show faulty command 49 slide rail 63 SP fault LED location of 13 installing 131 NET MGT port 15 removing 130 verifying function 133 standby power defined 60 status LEDs locations of 15 symbols safety 54 system schematics 2...

Page 185: ...Index SP 133 video connector location of 13 viewing message log files 50 185 ...

Page 186: ...186 SPARC T5 2 Server Service Manual February 2017 ...

Reviews: