background image

Servicing Motherboard Components

111

FIGURE:

Installing a PCIe Card (SPARC Enterprise T5240)

6. Insert the PCIe/XAUI card into the correct slot on the riser board.

7. Replace the PCIe/XAUI riser.

See

“Install a PCIe/XAUI Riser” on page 107

8. Install the top cover.

See

“Install the Top Cover” on page 177

9. Slide the server into the rack.

See

“Return the Server to the Normal Rack Position” on page 180

.

10. Connect any data cables required to the PCIe/XAUI card.

Route data cables through the cable management arm.

Summary of Contents for SPARC Enterprise T5140

Page 1: ......

Page 2: ......

Page 3: ...SPARC EnterpriseTM T5140 and T5240 Servers Service Manual Part No 875 4322 13 July 2009 Revision A Manual Code C120 E497 04EN ...

Page 4: ...demarks of Fujitsu Limited All SPARC trademarks are used under license and are registered trademarks of SPARC International Inc in the U S and other countries Products bearing SPARC trademarks are based upon architecture developed by Sun Microsystems Inc SPARC64 is a trademark of SPARC International Inc used under license by Fujitsu Microelectronics Inc and Fujitsu Limited SSH is a registered trad...

Page 5: ...ce et sont des marques de fabrique ou des marques déposées de SPARC International Inc aux Etats Unis et dans d autres pays Les produits portant les marques SPARC sont basés sur une architecture développée par Sun Microsystems Inc SPARC64 est une marques déposée de SPARC International Inc utilisée sous le permis par Fujitsu Microelectronics Inc et Fujitsu Limited SSH est une marque déposée registre...

Page 6: ......

Page 7: ...Servers 5 Rear Panel Components and Indicators on SPARC Enterprise T5140 Servers 8 Front Panel Controls and Indicators on SPARC Enterprise T5240 Servers 9 Rear Panel Components and Indicators on SPARC Enterprise T5240 Servers 12 Status LEDs for Ethernet Ports and the Network Management Port 14 Detecting and Managing Faults 15 Diagnostic Tools Overview 15 Service Processor Interfaces 16 Diagnostics...

Page 8: ...or Faults Detected by PSH Technology 30 Clear FRU Faults Manually 31 Display FRU Information With the show Command 32 Create an ALOM CMT Shell 32 Detecting Faults With POST 34 POST Overview 35 Managing POST Operations 35 ILOM Properties that Affect POST Behavior 35 Examples of POST Management 37 keyswitch_state Set to normal 38 keyswitch_state Set to diag 38 diag_mode Set to off 38 diag_mode Set t...

Page 9: ...rmation 57 Safety Symbols 57 Electrostatic Discharge Safety Measures 58 Antistatic Wrist Strap Use 58 Antistatic Mat 59 Essential Tools 59 Find the Chassis Serial Number 59 Removing Power From the System 60 Power Off the Server Service Processor Command 60 Power Off the Server Power Button Graceful 62 Power Off the Server Emergency Shutdown 62 Disconnect Power Cords From the Server 62 Positioning ...

Page 10: ...s 81 Servicing FB DIMMs 81 Memory Fault Handling Overview 82 Identify Faulty FB DIMMs Using the show faulty Command 83 Identify Faulty FB DIMMs Using the FB DIMM Fault Locator Button 83 Remove FB DIMMs 84 Install Replacement FB DIMMs 86 Verify Successful Replacement of Faulty FB DIMMs 88 Upgrade Memory Configuration With Additional FB DIMMs 91 FB DIMM Configuration Guidelines for SPARC Enterprise ...

Page 11: ... the SCC Module 117 Install the SCC Module 117 Servicing the Memory Mezzanine Assembly SPARC Enterprise T5240 118 Memory Mezzanine Assembly Overview 118 Remove a Memory Mezzanine Assembly 118 Install a Memory Mezzanine Assembly 120 Servicing the Motherboard Assembly 122 Motherboard Servicing Overview 122 Remove the Motherboard Assembly 123 Install the Motherboard Assembly 125 Servicing Fan Modules...

Page 12: ...Servicing DVD USB Modules 144 DVD USB Module Overview 145 Remove the DVD USB Module 145 Install the DVD USB Module 147 Servicing Fan Power Boards 148 Fan Power Board Overview 148 Remove the Fan Power Board 149 Install the Fan Power Board 150 Servicing the Hard Drive Cage 151 Hard Drive Cage Overview 151 Remove the Hard Drive Cage 152 Install the Hard Drive Cage 154 Servicing the Hard Drive Backpla...

Page 13: ...tall the Power Supply Backplane 173 Servicing Paddle Cards 174 Paddle Card Overview 175 Remove the Paddle Card 175 Install the Paddle Card 176 Returning the Server to Operation 177 Install the Top Cover 177 Reinstall the Server in the Rack 178 Return the Server to the Normal Rack Position 180 Connect Power Cords to the Server 181 Power On the Server Using the poweron Command 181 Power On the Serve...

Page 14: ...le SPARC Enterprise T5140 Servers 194 Identifying FRUs in SPARC Enterprise T5240 Servers 195 Motherboard Components in SPARC Enterprise T5240 Servers 196 Memory Mezzanine Components in SPARC Enterprise T5240 Servers 198 I O Components in SPARC Enterprise T5240 Servers 200 Power Distribution Fan Module Components in SPARC Enterprise T5240 Servers 202 Internal Cables for Onboard SAS Controller Cards...

Page 15: ...mation regarding the use and handling of this product Read this manual thoroughly Pay special attention to the section Notes on Safety on page xix Use the product according to the instructions and information available in this manual Keep this manual handy for further reference Keep this manual handy for further reference Fujitsu makes every effort to prevent users and bystanders from being injure...

Page 16: ...ns how to remove and install hard drives Servicing Motherboard Components Explains how to replace the motherboard and its components Servicing Fan Modules Explains how to service faulty fan modules Servicing Power Supplies Explains how to remove and replace power supply modules Servicing Boards and Components Explains how to service infrastructure boards and components Returning the Server to Oper...

Page 17: ...T5240 Server Getting Started Guide For Models That Run on DC Input Power Minimum steps to power on and boot the server that run on DC input power for the first time C120 E555 SPARC Enterprise T5140 and T5240 Servers Product Notes Information about the latest product updates and issues C120 E493 Important Safety Information for Hardware Systems Safety information that is common to all SPARC Enterpr...

Page 18: ...ng in to ILOM 3 0 for the first time and configuring a user account or a directory service C120 E576 Integrated Lights Out Manager ILOM 3 0 Web Interface Procedures Guide Information and procedures for accessing ILOM 3 0 functions using the ILOM web interface C120 E574 Integrated Lights Out Manager ILOM 3 0 CLI Procedures Guide Information and procedures for accessing ILOM 3 0 functions using the ...

Page 19: ...ting System documentation which is at http docs sun com Text Conventions The settings on your browser might differ from these settings Typeface Meaning Examples AaBbCc123 The names of commands files and directories on screen computer output Edit your login file Use ls a to list all files You have mail AaBbCc123 What you type when contrasted with on screen computer output su Password AaBbCc123 Book...

Page 20: ...ry potential hazard if the user does not perform the procedure correctly Caution This indicates a hazardous situation that could result in minor or moderate personal injury if the user does not perform the procedure correctly This signal also indicates that damage to the product or other property may occur if the user does not perform the procedure correctly Caution This indicates that surfaces ar...

Page 21: ...s regarding this product and the optional products provided from Fujitsu should only be performed by a certified service engineer Users must not perform these tasks Incorrect operation of these tasks may cause malfunction Also important alert messages are shown in Notes on Safety on page xix Notes on Safety Important Alert Messages This manual provides the following important alert signals Caution...

Page 22: ...andby power is always present in the system you must unplug the power cords before accessing any cold serviceable components The system supplies power to the power distribution board even when the server is powered off To avoid personal injury or damage to the server you must disconnect power cords before servicing the power distribution board The system supplies power to the power supply backplan...

Page 23: ...d contact Task Warning Maintenance Extremely hot Some components on the motherboard might be hot Use caution when handling the motherboard especially near the CPU heat sink FB DIMMs and heat sinks on the motherboard may be hot If you touch the heat sink when removing the bus bar screw you might get burned ...

Page 24: ...nterface cards Maintenance and inspections repairing and regular diagnosis and maintenance Caution The following tasks regarding this product and the optional products provided from Fujitsu should only be performed by a certified service engineer Users must not perform these tasks Incorrect operation of these tasks may cause malfunction Unpacking optional adapters and such packages delivered to th...

Page 25: ...Preface xxiii Alert Label The following is a label attached to this product Never peel off the label The following label provides information to the users of this product ...

Page 26: ...r requests regarding this document or if you find any unclear statements in the document please state your points specifically on the form at the following URL For Users in U S A Canada and Mexico https download computers us fujitsu com For Users in Other Countries http www fujitsu com global contact computing sparce_index ht ml ...

Page 27: ...Internal System Cables for SPARC Enterprise T5240 Servers on page 5 Front Panel Controls and Indicators on SPARC Enterprise T5140 Servers on page 5 Rear Panel Components and Indicators on SPARC Enterprise T5140 Servers on page 8 Front Panel Controls and Indicators on SPARC Enterprise T5240 Servers on page 9 Rear Panel Components and Indicators on SPARC Enterprise T5240 Servers on page 12 Status LE...

Page 28: ...e system This board is directly connected to the paddle card and to the motherboard via a bus bar and ribbon cable This board also supports a top cover safety interlock kill switch Paddle card This board serves as the interconnect between the power distribution board and the fan power boards disk drive backplane and front I O board Fan power boards 2 These boards carry power to the system fan modu...

Page 29: ... addition to the 16 slots provided on the motherboard Power distribution board This board distributes main 12V power from the power supplies to the rest of the system This board is directly connected to the paddle card and to the motherboard via a bus bar and ribbon cable This board also supports a top cover safety interlock kill switch Power supply backplane SPARC Enterprise T5240 Servers only Th...

Page 30: ...ard includes the connectors for the hard drives This board also contains the interconnect for the front I O board Power and Locator buttons and system component status LEDs Each drive has its own Power Activity Fault and Ready to Remove LEDs Front I O board This board connects directly to the hard drive backplane This board is packaged with the DVD drive as a single unit Cable Description Top cove...

Page 31: ...arious status and fault LEDs Note The front panel also provides access to internal hard drives the removable media drive and the two front USB ports Cable Description Top cover interlock cable This cable connects the safety interlock switch on the top cover to the power distribution board Ribbon cable This cable carries signals between the power supply backplane and the power distribution board Ri...

Page 32: ...FIGURE Front Panel Controls and Indicators on SPARC Enterprise T5140 Servers Figure Legend 1 Locator LED and button 5 Hard Drive map 2 Service Required LED 6 Power Supply Service Required LED 3 Power OK LED 7 Overtemp LED 4 Power button 8 Fan Module Service Required LED ...

Page 33: ...running in its normal operating state No service actions are required Fast blink System is running in standby mode and can be quickly returned to full function Slow blink A normal but transitory activity is taking place Slow blinking might indicate that system diagnostics are running or the system is booting Power button The recessed Power button toggles the system on or off Press once to turn the...

Page 34: ...rts PCIe ports 10 Gbit Ethernet XAUI ports if equipped and power supplies on the rear panel of SPARC Enterprise T5140 servers It also shows the locations of the rear panel LEDs FIGURE Rear Panel Components and Indicators on SPARC Enterprise T5140 Serves Figure Legend 1 PSU 0 7 Serial management port 2 PSU 1 8 Network management port 3 PCIe XAUI 0 9 Gigabit Ethernet ports 0 1 2 3 4 PCIe XAUI 1 10 U...

Page 35: ...ILOM command set SYS LOCATE value Fast_Blink Issuing the ALOM CMT command setlocator on Pressing the Locator button Service Required LED amber If on indicates that service is required POST and ILOM are two diagnostics tools that can detect a fault or failure resulting in this indication The ILOM show faulty command provides details about any faults that cause this indicator to light Under some fau...

Page 36: ...FIGURE Front Panel Controls and Indicators on SPARC Enterprise T5240 Servers Figure Legend 1 Locator LED and button 5 Power Supply Service Required LED 2 Service Required LED 6 Overtemp LED 3 Power OK LED 7 Fan Module Service Required LED 4 Power button 8 Hard Drive map ...

Page 37: ... running in its normal operating state No service actions are required Fast blink System is running in standby mode and can be quickly returned to full function Slow blink A normal but transitory activity is taking place Slow blinking might indicate that system diagnostics are running or the system is booting Power button The recessed Power button toggles the system on or off Press once to turn th...

Page 38: ...f the I O ports PCIe ports 10 Gbit Ethernet XAUI ports if equipped and power supplies on the rear panel FIGURE Rear Panel Components and Indicators on SPARC Enterprise T5240 Servers Figure Legend 1 PSU 1 8 PCIe 2 2 PSU 0 9 Rear panel status LEDs 3 PCIe 3 10 Serial management port 4 PCIe XAUI 0 11 Network management port 5 PCIe 4 12 Gigabit Ethernet ports 0 1 2 3 6 PCIe XAUI 1 13 USB ports 0 1 7 PC...

Page 39: ...red POST and ILOM are two diagnostics tools that can detect a fault or failure resulting in this indication The ILOM show faulty command provides details about any faults that cause this indicator to light Under some fault conditions individual component fault LEDs are lit in addition to the system Service Required LED Power OK LED green Provides the following indications Off System is not running...

Page 40: ...ated Information LED Overview on page 21 TABLE Network Management Port and Ethernet Port LEDs LED Color Description Left LED Amber or Green Speed indicator Amber on Operating as a Gigabit connection 1000 Mbps Green on Operating as a 100 Mbps connection Off Operating as a 10 Mbps connection The NET MGT port only operates in 100 Mbps or 10 Mbps so the speed indicator LED will be green or off never a...

Page 41: ...e 53 Related Information Identifying FRUs in SPARC Enterprise T5140 Servers on page 183 Identifying FRUs in SPARC Enterprise T5240 Servers on page 195 Diagnostic Tools Overview The service processor provides a range of system management and diagnostic tools that enable you to monitor server operations and troubleshoot server problems The following is a high level summary of the various diagnostic ...

Page 42: ...ions for repair The LEDs ILOM PSH and many of the log files and console messages are integrated For example when the Solaris software detects a fault it displays the fault logs it and passes information to ILOM where it is logged Depending on the fault one or more LEDs might also be illuminated Service Processor Interfaces There are three methods of interacting with the service processor ILOM shel...

Page 43: ... in under one account and at the same time issue ALOM CMT shell commands while operating in another account Related Information Diagnostics Tools Quick Reference on page 17 Diagnostics Tools Quick Reference The following flowchart illustrates the complementary relationship of the different diagnostic tools and indicates a default sequence of use ...

Page 44: ...18 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 FIGURE Diagnostics Flowchart ...

Page 45: ...nvironmental faults Solaris Predictive Self Healing PSH detected faults POST detected faults Faulty FRUs are identified in fault messages using the FRU name TABLE Service Related Commands on page 26 Faults Displayed by show faulty on page 29 Check the Solaris log files for fault information Flowchart item 3 The Solaris message buffer and log files record system events and provide information about...

Page 46: ...nowledge Article web site for additional information The Knowledge Article for the fault is located at the following link http www sun com msg message ID where message ID is the value of the sunw msg id property displayed by the show faulty command After the FRU is replaced perform the procedure to clear PSH detected faults Managing Faults Using the PSH Feature on page 43 Clear PSH Detected Faults...

Page 47: ...E System Faults and the Corresponding LED States Component Fault Fault LEDs Lit Additional Information Power supply Service Required LED front and rear panel Front panel Power Supply Fault LED Individual power supply Fault LED Power Supplies Overview on page 135 Remove a Power Supply on page 137 Install a Power Supply on page 140 Fan module Service Required LED front and rear panel Front panel Fan...

Page 48: ...71 Install a Hard Drive on page 73 FB DIMM Service Required LED front and rear panel FB DIMM Fault LED on motherboard when FB DIMM Locate button is pressed See these sections Servicing the Motherboard Assembly on page 122 Identify Faulty FB DIMMs Using the show faulty Command on page 83 Identify Faulty FB DIMMs Using the FB DIMM Fault Locator Button on page 83 Other components Service Required LED...

Page 49: ...s are identified in fault messages using the FRU name The service processor can detect when a fault is no longer present When this happens it clears the fault state in the FRU PROM and extinguishes the Service Required LED A fault condition can be removed in two ways Unaided recovery Faults caused by environmental conditions can clear automatically if the condition responsible for the fault improv...

Page 50: ... drive faults and will not light the fault LEDs on either the chassis or the hard drive itself Use the Solaris message files to view hard drive faults For general information about ILOM see the Integrated Lights Out Manager ILOM 3 0 Concepts Guide For detailed information about ILOM features that are specific to this server see the Integrated Lights Out Manager ILOM 3 0 Supplement for SPARC Enterp...

Page 51: ...rom the system console to the service processor How to Switch From the Service Processor to the System Console The following example showiest ILOM command for changing from the service processor to the system console If you are connected to the service processor using the ALOM CMT shell use the following command to change to the system console ok start SP console sc console ...

Page 52: ...e dump of the Solaris OS Takes the host server from the OS to either kmdb or OpenBoot PROM equivalent to a Stop A depending on the mode Solaris software was booted set SYS component clear_fault_action true clearfault UUID Manually clears host detected faults The UUID is the unique fault ID of the fault to be cleared start SP console console f f forces the console to have read and write capabilitie...

Page 53: ...repare_to_remove_action true removefru SYS PS0 SYS PS1 Indicates if it is okay to perform a hot swap of a power supply This command does not perform any action But this command provides a warning if the power supply should not be removed because the other power supply is not enabled reset SYS reset y c y enables you to skip the confirmation question c executes a console command after completion of...

Page 54: ...ys static information about system FRUs defaults to all FRUs unless one is specified d displays dynamic information about system FRUs defaults to all FRUs unless one is specified See Display FRU Information With the show Command on page 32 Displays information about the FRUs in the server show SYS keyswitch_state showkeyswitch Displays the status of the virtual keyswitch show SYS LOCATE showlocato...

Page 55: ...c System Recovery Commands on page 50 Faults Displayed by show faulty The ILOM show faulty command will display the following kinds of fault information Environmental faults Invalid configurations Faults detected during POST session Faults detected by predictive self healing PSH feature ...

Page 56: ...how faulty Target Property Value SP faultmgmt 0 fru SYS FANBD0 FM0 SP faultmgmt 0 timestamp Dec 14 23 01 32 SP faultmgmt 0 timestamp Dec 14 23 01 32 faults 0 SP faultmgmt 0 sp_detected_fault TACH at SYS FANBD0 FM0 F0 has faults 0 exceeded low non recoverable threshold show faulty Target Property Value SP faultmgmt 0 fru SYS MB CMP0 BR1 CH0 D0 SP faultmgmt 0 timestamp Dec 14 23 01 32 SP faultmgmt 0...

Page 57: ...ollowing a FRU replacement Note This procedure clears the fault from the service processor but not from the host If the fault persists in the host it must be manually cleared At the prompt enter the clear_fault_action property Related Info Clear PSH Detected Faults on page 47 show faulty Target Property Value SP faultmgmt 0 fru SYS MB CMP0 BR0 CH1 D0 SP faultmgmt 0 timestamp Dec 14 22 43 59 SP fau...

Page 58: ... processor is the ILOM shell You can use the ALOM CMT compatibility shell to emulate the ALOM CMT interface that was supported on an earlier generation of CMT servers show SYS MB CMP0 BR0 CH0 D0 SYS MB CMP0 BR0 CH0 D0 Targets R0 R1 SEEPROM SERVICE PRSNT T_AMB Properties type DIMM component_state Enabled fru_name 1024MB DDR2 SDRAM FB DIMM 333 PC2 5300 fru_description FBDIMM 1024 Mbyte fru_manufactu...

Page 59: ...appear when you enter your password You can combine the create and set commands on a single line login root Password Waiting for daemons to initialize Daemons ready Integrated Lights Out Manager Version 2 0 0 0 Copyright 2007 Sun Microsystems Inc All rights reserved Use is subject to license terms Warning password is set to factory default create SP users admin Creating user Enter new password Ent...

Page 60: ...unt using the ALOM CMT shell Related Information Diagnostics Tools Quick Reference on page 17 ILOM Troubleshooting Overview on page 23 Service Related ILOM Command Summary on page 26 Detecting Faults With POST These topics explain how to use POST as a diagnostic tool POST Overview on page 35 ILOM Properties that Affect POST Behavior on page 35 Examples of POST Management on page 37 POST Output Qui...

Page 61: ... operations For example you can specify the events that cause POST to run the level of testing POST performs and the amount of diagnostic information POST displays You use the ILOM set command to control the state of the applicable ILOM properties These properties are listed and described in ILOM Properties that Affect POST Behavior on page 35 Related Information Managing POST Operations on page 3...

Page 62: ...dates can be made diag_mode off POST does not run normal Runs POST according to diag_level value service Runs POST with preset values for diag_level and diag_verbosity diag_level max If diag_mode normal runs all the minimum tests plus extensive processor and memory tests min If diag_mode normal runs minimum set of tests diag_trigger none Does not run POST on reset user_reset Runs POST upon user in...

Page 63: ...roperties Used to Manage POST Operations Examples of POST Management This topic shows examples of the ILOM set command being used to configure POST behavior The examples illustrate only a subset of the ILOM properties that can be used to control POST operations ...

Page 64: ... virtual keyswitch property to diag diag_mode Set to off You can prevent POST from running by setting the diag_mode property to off diag_mode Set to service You force POST to run with a set of preconfigured values for diag_level and diag_verbosity by setting the diag_mode property to service Related Information ILOM Properties that Affect POST Behavior on page 35 Run POST in Maximum Mode on page 3...

Page 65: ...te The server takes about one minute to power off 3 Switch to the system console to view the POST output The following is an partial example of POST output set SYS keyswitch_state Diag Set keyswitch_state to Diag stop SYS Are you sure you want to stop SYS y n y Stopping SYS start SYS Are you sure you want to start SYS y n y Starting SYS start SP console 2007 12 19 22 01 17 810 0 0 0 INFO STATUS Ru...

Page 66: ...on If show faulty detects a fault the service processor logs the fault disables the faulty component and causes the Service Required LED to light In the following example FB DIMM module SYS MB CMP0 BR1 CH0 D0 is disabled 2007 12 19 22 01 32 004 0 0 0 End Neptune 1G Loopback Test Port 3 2007 12 19 22 01 32 012 0 0 0 INFO 2007 12 19 22 01 32 019 0 0 0 POST Passed all devices 2007 12 19 22 01 32 028 ...

Page 67: ...d In this case the fault is automatically cleared from the system This procedure describes how to identify a POST detected fault and if necessary manually clear the fault 1 After replacing a faulty FRU enter the show faulty command to identify any faults detected by POST POST detected faults are distinguished by the text Forced fail No UUID number is reported for POST detected The following exampl...

Page 68: ...he change to the component_state property to take effect 4 At the ILOM prompt use the show faulty command to verify that no faults are reported POST Output Quick Reference POST error messages use the following syntax In this syntax c the core number s the strand number Warning messages use the following syntax Informational messages use the following syntax set SYS MB CMP0 BR1 CH0 D0 component_sta...

Page 69: ...r corrective intervention before the failure occurs Solaris PSH Feature Overview on page 44 PSH Detected Fault Console Message on page 45 Identify PSH Detected Faults With fmdump on page 45 Clear PSH Detected Faults on page 47 7 2 7 2 ERROR TEST Data Bitwalk 7 2 H W under test SYS MB CMP0 BR1 CH0 D0 7 2 Repair Instructions Replace items in order listed by H W under test above 7 2 MSG Pin 149 faile...

Page 70: ...information about the problem from the knowledge article database The Predictive Self Healing technology covers the following server components Multicore processor Memory I O subsystem The PSH console message provides the following information about each detected fault Type Severity Description Automated response Impact Suggested action If the Solaris PSH facility detects a faulty component use th...

Page 71: ...ifies the faulty FRU for a particular EVENT_ID UUID Note The information fmdump displays is taken from the PSH event log which retains the fault data after the fault has been repaired For that reason fmdump cannot be used to verify that a FRU replacement has cleared a fault Instead use the fmadm faulty command to verify that the fault has cleared acceptable levels Refer to http sun com msg SUN4V 8...

Page 72: ...n about this type of fault a In a browser go to the Predictive Self Healing Knowledge Article web site http www sun com msg b Obtain the message ID from the console output or the ILOM show faulty command c Enter the message ID in the SUNW MSG ID field and click Lookup In the following example the message ID SUN4V 8000 JA provides information for corrective action fmdump v u fd940ac2 d21e c94a f258...

Page 73: ... presence of a sunw msg id and uuid property The next step depends on whether or not a fault was reported If show faulty does not report a fault stop Do not go on to the next step If a fault is reported perform Step 3 and Step 4 Impact System performance may be affected Suggested Action for System Administrator Schedule a repair procedure to replace the affected CPU the identity of which can be de...

Page 74: ... display OS messages from the message buffer and log files maintained by Solaris OS Check the Message Buffer on page 49 View the System Message Log Files on page 49 Check the Message Buffer 1 Log in as superuser 2 Type the dmesg command The dmesg command displays the most recent messages generated by the system View the System Message Log Files The error logging daemon syslogd automatically record...

Page 75: ...ype the following command Managing Components With Automatic System Recovery Commands These topics explain the role played by the Automatic System Recovery ASR feature and how to manage the components it controls ASR Overview on page 50 View the System Message Log Files on page 49 Display System Components on page 51 Disable System Components on page 52 Enable System Components on page 53 ASR Over...

Page 76: ...cores and memory are present Use the show components command to see the asrkeys on a given system After you enable or disable a component you must reset or power cycle the system for the component s change of state to take effect Related Information Display System Components on page 51 Disable System Components on page 52 Enable System Components on page 53 Display System Components The show compo...

Page 77: ... Disabled 2 Reset the server so that the ASR command takes effect show components Target Property Value SYS MB RISER0 component_state Enabled PCIE0 SYS MB RISER0 component_state Disabled PCIE3 SYS MB RISER1 component_state Enabled PCIE1 SYS MB RISER1 component_state Enabled PCIE4 SYS MB RISER2 component_state Enabled PCIE2 SYS MB RISER2 component_state Enabled PCIE5 SYS MB NET0 component_state Ena...

Page 78: ...mponent from the ASR blacklist 1 At the prompt set the component_state property to Enabled 2 Reset the server so that the ASR command takes effect Note In the ILOM shell there is no notification when the system is actually powered off Powering off takes about a minute Use the show HOST command to determine if the host has powered off Related Information View the System Message Log Files on page 49...

Page 79: ...dure description is based on use of the SunVTS software s browser interface which is the default interface SunVTS software also supports a TTY user interface and a command line interface CLI All three interfaces are described in the SunVTS Software User s Guide 1 Start the agent and Javabridge on the server 2 At the interface prompt choose C to start the SunVTS client 3 Start SunVTS browser enviro...

Page 80: ...ndividual tests Note Use the System Excerciser High Stress Mode to test system operations Use the Component Stress High setting for the highest stress possible SunVTS Tests Field Replaceable Units Exercised by Tests Memory Test FB DIMMs Processor Test CMP motherboard Disk Test Disks cables disk backplane DVD drive Network Test Network interface network cable CMP motherboard Interconnect Test Board...

Page 81: ... button 7 To check for SunVTS messages click on the Logs tab You can view any of the following logs Information Detailed versions of all the status and error messages that appear in the test messages area Test Error Detailed error messages from individual tests VTS Kernel vtsk Error Error messages pertaining to SunVTS software itself Look here if SunVTS software appears to be acting strangely espe...

Page 82: ...56 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 ...

Page 83: ...t Follow all cautions and instructions marked on the equipment and described in the documentation shipped with your system Follow all cautions and instructions marked on the equipment and described in the SPARC Enterprise T5140 and T5240 Servers Safety and Compliance Guide Ensure that the voltage and frequency of your power source match the voltage and frequency inscribed on the equipment s electr...

Page 84: ...sitive to static electricity Ordinary amounts of static electricity from clothing or the work environment can destroy the components located on these boards Do not touch the components along their connector edges Caution You must disconnect both power supplies before servicing any of the components documented in this chapter Antistatic Wrist Strap Use Wear an antistatic wrist strap and use an anti...

Page 85: ...ttery removal Pen or pencil to power on server Find the Chassis Serial Number If you require technical support for your system you will be asked to provide the server s chassis serial number You can find the chassis serial number on a sticker located on the front of the server and on another sticker on the side of the server If it is not convenient to read either sticker you can run the ILOM show ...

Page 86: ...t Power Cords From the Server on page 62 Related Information Servicing Motherboard Components on page 81 Servicing Boards and Components on page 143 Power Off the Server Service Processor Command You can use the service processor to perform a graceful shutdown of the server and to ensure that all of your data is saved and the server is ready for restart Properties type Host System keyswitch_state ...

Page 87: ...on these processes 4 Shut down all logical domains Refer to the Solaris system administration documentation for additional information 5 Shut down the Solaris OS Refer to the Solaris system administration documentation for additional information 6 Switch from the system console to the prompt by typing the Hash Period key sequence 7 At the prompt type the stop SYS command Note You can also use the ...

Page 88: ...m corruption might occur Press and hold the Power button for four seconds Related Information Power Off the Server Service Processor Command on page 60 Power Off the Server Power Button Graceful on page 62 Disconnect Power Cords From the Server Unplug all power cords from the server Caution Because 3 3v standby power is always present in the system you must unplug the power cords before accessing ...

Page 89: ...the set SYS LOCATE command from the prompt to locate the system that requires maintenance Once you have located the server press the Locator LED and button to turn it off 2 Verify that no cables will be damaged or will interfere when the server is extended Although the cable management arm CMA that is supplied with the server is hinged to accommodate extending the server you should ensure that all...

Page 90: ...slowly pull the server forward until the slide rails latch Remove the Server From the Rack The server must be removed from the rack to remove or install the following components Motherboard Power distribution board Power supply backplane SPARC Enterprise T5240 server Paddle card Disk cage Hard drive backplane Front panel light pipe assemblies ...

Page 91: ... maintenance position See Power Off the Server Service Processor Command on page 60 3 Press the metal lever that is located on the inner side of the rail to disconnect the cable management arm CMA from the rail assembly as shown in the following figure The CMA is still attached to the cabinet but the server chassis is now disconnected from the CMA FIGURE Metal Lever and Cable Management Arm ...

Page 92: ...o dismount and carry the chassis 4 From the front of the server pull the release tabs forward and pull the server forward until it is free of the rack rails as shown in the following figure A release tab is located on each rail FIGURE Release Tabs and Slide Assembly 5 Set the server on a sturdy work surface ...

Page 93: ...rform the following steps before opening the chassis for service 1 Prepare an antistatic surface to set parts on during the removal installation or replacement process Place ESD sensitive components such as the printed circuit boards on an antistatic mat The following items can be used as an antistatic mat Antistatic bag used to wrap a replacement part ESD mat A disposable ESD mat shipped with som...

Page 94: ...PARC Enterprise T5240 server is similar Note In newer versions of the top cover the release button is located closer to the edge of the cover Except for this difference in location the release mechanism operates in the same manner in both versions FIGURE Removing the Top Cover 3 Remove the top cover Lift up and remove the cover The figure above shows the SPARC Enterprise T5140 server The SPARC Ent...

Page 95: ...is running This feature referred to as being hot pluggable depends on how the hard drives are configured Note SPARC Enterprise T5140 and T5240 servers support both traditional disk based storage devices and flash SSDs diskless storage devices based on solid state memory The terms hard drive and HDD hard disk drive are used in a generic sense to refer to both types of internal storage devices To ho...

Page 96: ... 182 Four Drive Capable Backplane Configuration Reference on page 77 Eight Drive Capable Backplane Configuration Reference on page 78 Sixteen Drive Capable Backplane Configuration Reference on page 79 Hard Drive LEDs Each hard drive has a group of three status LEDs as shown in the following figure Both disk based hard drives and flash SSDs use the same set of LEDS Note The OK Activity LED has slig...

Page 97: ...nd then manually remove the drive from the chassis TABLE Status LEDs for Hard Drives LED Color Description 1 Ready to Remove Blue Indicates that a hard drive can be removed during a hot plug operation 2 Service Required Amber Indicates that the hard drive is has experienced a fault condition 3 OK Activity HDDs Green Indicates the HDD s availability for use On Drive is idle and available for use Of...

Page 98: ... the hard drive release button to open the latch cfgadm al Ap_id Type Receptacle Occupant Condition c0 scsi bus connected configured unknown c0 dsk c1t0d0 disk connected configured unknown c0 dsk c1t1d0 disk connected configured unknown usb0 1 unknown empty unconfigured ok usb0 2 unknown empty unconfigured ok usb0 3 unknown empty unconfigured ok usb1 1 unknown empty unconfigured ok usb1 2 unknown ...

Page 99: ...on page 73 Four Drive Capable Backplane Configuration Reference on page 77 Eight Drive Capable Backplane Configuration Reference on page 78 Sixteen Drive Capable Backplane Configuration Reference on page 79 Install a Hard Drive Installing a hard drive into the SPARC Enterprise T5140 and T5240 servers is a two step process You must first install a hard drive into the desired drive slot Then you mus...

Page 100: ...lign the replacement drive to the drive slot Hard drives are physically addressed according to the slot in which they are installed If you install a hard drive as a replacement for a drive that was removed the new drive must go into the same slot as the drive it is replacing FIGURE Installing a Hard Drive Illustrating Installation in a SPARC Enterprise T5240 Server 3 With the latch open slide the ...

Page 101: ... cfgadm al Ap_id Type Receptacle Occupant Condition c0 scsi bus connected configured unknown c0 dsk c1t0d0 disk connected configured unknown c0 sd1 disk connected unconfigured unknown usb0 1 unknown empty unconfigured ok usb0 2 unknown empty unconfigured ok usb0 3 unknown empty unconfigured ok usb1 1 unknown empty unconfigured ok usb1 2 unknown empty unconfigured ok usb1 3 unknown empty unconfigur...

Page 102: ...78 Sixteen Drive Capable Backplane Configuration Reference on page 79 cfgadm al Ap_id Type Receptacle Occupant Condition c0 scsi bus connected configured unknown c0 dsk c1t0d0 disk connected configured unknown c0 dsk c1t1d0 disk connected configured unknown usb0 1 unknown empty unconfigured ok usb0 2 unknown empty unconfigured ok usb0 3 unknown empty unconfigured ok usb1 1 unknown empty unconfigur...

Page 103: ...d Drive on page 73 Remove a Hard Drive on page 71 Eight Drive Capable Backplane Configuration Reference on page 78 Sixteen Drive Capable Backplane Configuration Reference on page 79 TABLE Physical Drive Locations in a Four Drive Capable Backplane DVD HDD0 HDD1 HDD2 HDD3 TABLE Physical Drive Locations FRU Names and Default Drive Pathnames for a Four Drive Capable Backplane Physical Location FRU Nam...

Page 104: ...page 71 Four Drive Capable Backplane Configuration Reference on page 77 Sixteen Drive Capable Backplane Configuration Reference on page 79 TABLE Physical Drive Locations in an Eight Drive Capable Backplane HDD1 HDD3 HDD5 DVD HDD0 HDD2 HDD4 HDD6 HDD7 TABLE Physical Drive Locations FRU Names and Default Drive Pathnames for an Eight Drive Capable Backplane Physical Location FRU Name OpenBoot PROM Sol...

Page 105: ...HDD11 HDD14 HDD1 HDD5 HDD9 DVD HDD0 HDD4 HDD8 HDD10 HDD13 TABLE Physical Drive Locations FRU Addresses and Default Drive Pathnames for a Sixteen Drive Capable Backplane Physical Location FRU Address OpenBoot PROM Solaris Default Drive Pathname HDD0 SYS HDD0 c0 dsk c1t0d0 HDD1 SYS HDD1 c0 dsk c1t1d0 HDD2 SYS HDD2 c0 dsk c1t2d0 HDD3 SYS HDD3 c0 dsk c1t3d0 HDD4 SYS HDD4 c0 dsk c1t4d0 HDD5 SYS HDD5 c0...

Page 106: ...kplane Configuration Reference on page 77 Eight Drive Capable Backplane Configuration Reference on page 78 HDD14 SYS HDD14 c0 dsk c1t14d0 HDD15 SYS HDD15 c0 dsk c1t15d0 DVD SYS DVD TABLE Physical Drive Locations FRU Addresses and Default Drive Pathnames for a Sixteen Drive Capable Backplane Continued Physical Location FRU Address OpenBoot PROM Solaris Default Drive Pathname ...

Page 107: ...ormation Infrastructure Boards in SPARC Enterprise T5140 Servers on page 2 Servicing FB DIMMs These topics explain how to identify locate and replace faulty FB DIMMs They also describe procedures for upgrading memory capacity and provide guidelines for achieving and maintaining valid memory configurations Memory Fault Handling Overview on page 82 Identify Faulty FB DIMMs Using the show faulty Comm...

Page 108: ...ulty FB DIMM POST disables half of physical memory in the system or half the physical memory and half the processor threads When this offlining process occurs in normal operation you must replace the faulty FB DIMMs based on the fault message and enable the disabled FB DIMMs with the ILOM command set device component_state enabled where device is the name of the FB DIMM being enabled for example s...

Page 109: ...rver to the maintenance position See Extend the Server to the Maintenance Position on page 63 2 Disconnect power from the server See Removing Power From the System on page 60 3 Remove the top cover See Remove the Top Cover on page 67 4 Open the air duct to gain to access the FB DIMM Fault Locator button 5 Press the FB DIMM Fault Locator button on the motherboard This will cause an amber LED associ...

Page 110: ... Related Information Identify Faulty FB DIMMs Using the show faulty Command on page 83 Remove FB DIMMs Before beginning this procedure ensure that you are familiar with the cautions and safety instructions described in General Safety Information on page 57 Caution Do not leave FB DIMM slots empty You must install filler panels in all empty FB DIMM slots If the server includes a memory mezzanine th...

Page 111: ...ble from its seat on the CMP air duct c Place the hard drive cable end out of the way of the air duct 5 Rotate the air duct up and toward the front of the system 6 Press the Fault Locator button on the motherboard to identify the FB DIMMs that need to be replaced Tip Make a note of the faulty FB DIMM location Note For memory configuration information see FB DIMM Configuration Guidelines for SPARC ...

Page 112: ...he empty slots Related Information Install Replacement FB DIMMs on page 86 Verify Successful Replacement of Faulty FB DIMMs on page 88 Install Replacement FB DIMMs Before beginning this procedure ensure that you are familiar with the information provided in these topics Preparing to Service the System on page 57 FB DIMM Configuration Guidelines for SPARC Enterprise T5140 Servers on page 94 Note If...

Page 113: ... of the way of the air duct 5 Unpackage the replacement FB DIMMs and place them on an antistatic mat 6 Ensure that the ejector tabs on the connector that will receive the FB DIMM are in the open position 7 Align the FB DIMM notch with the key in the connector Caution Ensure that the orientation is correct The FB DIMM might be damaged if the orientation is reversed FIGURE Installing FB DIMMs 8 Push...

Page 114: ...nnect Power Cords to the Server on page 181 Note As soon as the power cords are connected standby power is applied Depending on how the firmware is configured the system might boot at this time Related Information Remove FB DIMMs on page 84 Verify Successful Replacement of Faulty FB DIMMs on page 88 Verify Successful Replacement of Faulty FB DIMMs 1 Access the ILOM prompt Refer to the Integrated L...

Page 115: ... server takes about one minute to power off Use the show HOST command to determine when the host has been powered off The console will display status Powered Off c Switch to the system console to view POST output Watch the POST output for possible fault messages The following output indicates that POST did not detect any faults set SYS MB CMP0 BR0 CH0 D0 component_state Enabled set SYS keyswitch_s...

Page 116: ...uctions described in ILOM Troubleshooting Overview on page 23 for guidance in troubleshooting the fault 5 Switch to the ILOM command shell 6 Run the show faulty command If the show faulty command reports a fault with a UUID go on to Step 7 If show faulty does not report a fault with a UUID you are done with the verification process set SYS keyswitch_state Normal Set ketswitch_state to Normal fmadm...

Page 117: ...come familiar with the memory configuration guidelines described in FB DIMM Configuration Guidelines for SPARC Enterprise T5140 Servers on page 94 Caution Ensure that all power is removed from the server before installing FB DIMMs or damage to the FB DIMMs might occur Caution You must disconnect the power cords from the system before performing this procedure 1 Unpack the replacement FB DIMMs and ...

Page 118: ...Push the FB DIMM into the connector until the ejector tabs lock the FB DIMM in place FIGURE Installing FB DIMMs Note If the FB DIMM does not easily seat into the connector it may not have the correct orientation If the orientation is reversed damage to the FB DIMM might occur 8 Repeat Step 5 through Step 7 until all FB DIMMs are installed 9 Rotate the air duct back into its operating position The ...

Page 119: ...4 Power on the server See Power On the Server Using the poweron Command on page 181 or Power On the Server Using the Front Panel Power Button on page 182 15 Perform the following steps to verify that there are no faults a Set the virtual keyswitch to diag so that POST will run in Service mode b Power cycle the system Note The server takes about one minute to power off The ILOM console does not ind...

Page 120: ... DIMMs on page 86 Verify Successful Replacement of Faulty FB DIMMs on page 88 FB DIMM Configuration Guidelines for SPARC Enterprise T5140 Servers on page 94 FB DIMM Configuration Guidelines for SPARC Enterprise T5240 Servers on page 98 FB DIMM Configuration Guidelines for SPARC Enterprise T5140 Servers When planning FB DIMM upgrades to SPARC Enterprise T5140 servers observe the following memory co...

Page 121: ...nch must have the same capacity If the System Firmware is at least version 7 1 7 f the FB DIMM capacities on different CPUs can be different When replacing a faulty FB DIMM the replacement FB DIMM must have the same FRU part number as the FB DIMM being replaced If you are not able to obtain a replacement FB DIMM with the same FRU part number may need to replace all the FB DIMMs in the branch to en...

Page 122: ...96 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 FIGURE Physical FB DIMM Locations in SPARC Enterprise T5140 Servers ...

Page 123: ...ers Branch Name Channel Name FRU Name Motherboard FB DIMM Connector FB DIMM Installation Order Upgrade path DIMMs should be added with each group populated in the order shown CMP 0 Branch 0 Channel 0 SYS MB CMP0 BR0 CH0 D0 J0500 1 SYS MB CMP0 BR0 CH0 D1 J0600 2 Channel 1 SYS MB CMP0 BR0 CH1 D0 J0700 1 SYS MB CMP0 BR0 CH1 D1 J0800 2 CMP 0 Branch 1 Channel 0 SYS MB CMP0 BR1 CH0 D0 J0900 1 SYS MB CMP...

Page 124: ...Configuration on Motherboard SPARC Enterprise T5240 Servers on page 99 16 FB DIMMs Groups 1 2 and 3 in FIGURE FB DIMM Configuration on Motherboard SPARC Enterprise T5240 Servers on page 99 SPARC Enterprise T5240 servers can be equipped with a memory mezzanine assembly which provides an additional 16 FB DIMM slots All FB DIMMs within a single CMP branch must have the same capacity If the System Fir...

Page 125: ...erboard Components 99 FIGURE FB DIMM Configuration on Motherboard SPARC Enterprise T5240 Servers The following figure shows the physical location for the FB DIMMs on the motherboard in a SPARC Enterprise T5240 server ...

Page 126: ...l memory mezzanine assembly which provides an additional 16 FB DIMM slots Servers that have the memory mezzanine assembly can support for the following additional memory configuration groups 24 FB DIMMs Groups 1 2 3 and 4 fully populated motherboard 8 FB DIMM slots in the memory mezzanine assembly 32 FB DIMMs Groups 1 2 3 4 and 5 fully populated motherboard fully populated memory mezzanine assembl...

Page 127: ...ry capacity of a SPARC Enterprise T5240 server The rows representing FB DIMMs in the memory mezzanine assembly are shaded TABLE FB DIMM Configuration Installation Map SPARC Enterprise T5240 Servers Branch Name Channel Name FRU Name FB DIMM Connector FB DIMM Installation Order CMP 0 Branch 0 Channel 0 SYS MB CMP0 BR0 CH0 D0 J0500 1 SYS MB CMP0 BR0 CH0 D1 J0600 2 Channel 1 SYS MB CMP0 BR0 CH1 D0 J07...

Page 128: ...Channel 1 SYS MB CMP0 MR0 BR0 CH1 D2 J0401 4 SYS MB CMP0 MR0 BR0 CH1 D3 J0501 4 CMP 0 Branch 1 Channel 0 SYS MB CMP0 MR0 BR1 CH0 D2 J0601 4 SYS MB CMP0 MR0 BR1 CH0 D3 J0701 4 Channel 1 SYS MB CMP0 MR0 BR1 CH1 D2 J0801 4 SYS MB CMP0 MR0 BR1 CH1 D3 J0901 4 CMP 1 Branch 0 Channel 0 SYS MB CMP1 MR1 BR0 CH0 D2 J0201 5 SYS MB CMP1 MR1 BR0 CH0 D3 J0301 5 Channel 1 SYS MB CMP1 MR1 BR0 CH1 D2 J0401 5 SYS M...

Page 129: ...move the air duct before removing or installing the following components Power distribution board Power supply backplane SPARC Enterprise T5240 Fan module boards Paddle card Hard drive cage Hard drive backplane Motherboard Caution To prevent the system from overheating ensure that the air duct is correctly installed before powering on the server 1 Slide the system out of the rack See Extend the Se...

Page 130: ...l the top cover See Install the Top Cover on page 177 Related Information Remove the Air Duct on page 103 Install the Top Cover on page 177 Servicing PCIe XAUI Risers These topics explain how to service the riser units that support PCIe and XAUI cards and how to remove and install the I O cards themselves PCIe XAUI Riser Overview on page 105 Remove a PCIe XAUI Riser on page 105 Install a PCIe XAUI...

Page 131: ...rs when servicing the motherboard Remove a PCIe XAUI Riser 1 Power off the server See Removing Power From the System on page 60 2 Disconnect all power cables See Disconnect Power Cords From the Server on page 62 3 Attach an antistatic wrist strap 4 Disconnect any data cables connected to the cards on the PCIe XAUI riser being removed Label the cables to ensure proper connection later 5 Slide the s...

Page 132: ...Ie XAUI Riser SPARC Enterprise T5240 8 Loosen the captive screw securing the riser to the motherboard 9 Lift the riser up to remove it from the system Remove the riser and any PCIe XAUI cards attached to it as a unit Related Information Install a PCIe XAUI Riser on page 107 Remove a PCIe or XAUI Card on page 109 Install a PCIe or XAUI Card on page 109 ...

Page 133: ...tem Note PCIe XAUI and PCIe risers have keyed connectors to prevent incorrect installation on the motherboard The following figure illustrates this step for SPARC Enterprise T5140 servers FIGURE Installing the PCIe XAUI Riser SPARC Enterprise T5140 The following figure illustrates the same process for SPARC Enterprise T5240 servers ...

Page 134: ...rward over the PCIe XAUI risers Ensure that the cross beam is engaged with the standoffs on either side of the chassis rear panel PCI cross beam 5 Tighten the two captive Phillips screws securing the removable PCI cross beam to the chassis 6 Install the top cover 7 Slide the server into the rack See Return the Server to the Normal Rack Position on page 180 8 Connect any data cables you removed to ...

Page 135: ...AUI card on an antistatic mat 7 If you are not replacing the PCIe XAUI card install a PCIe XAUI filler panel SPARC Enterprise T5140 PCIe filler panels are located in the removable PCI cross beam Press the filler panel into the cross beam from the rear SPARC Enterprise T5240 PCIe filler panels are located on the riser board assembly Press the filler panel into the riser board back panel from the re...

Page 136: ...emove a PCIe XAUI Riser on page 105 5 Remove the PCI filler panel SPARC Enterprise T5140 servers PCIe filler panels are located in the removable PCI cross beam Press the filler panel in from the rear until it snaps into place as shown in the following figure FIGURE Installing a PCIe Card SPARC Enterprise T5140 SPARC Enterprise T5240 servers PCIe filler panels are located on the riser board assembl...

Page 137: ...riser board 7 Replace the PCIe XAUI riser See Install a PCIe XAUI Riser on page 107 8 Install the top cover See Install the Top Cover on page 177 9 Slide the server into the rack See Return the Server to the Normal Rack Position on page 180 10 Connect any data cables required to the PCIe XAUI card Route data cables through the cable management arm ...

Page 138: ...nterprise T5140 server as viewed from the rear of the system TABLE FB DIMM Configuration Installation Map SPARC Enterprise T5240 Servers PCIe 0 XAUI 0 PCIe 1 XAUI 1 PCIe 2 TABLE PCIe and XAUI Support SPARC Enterprise T5140 Servers Slot PCIe Controller Supported Device Types FRU Name PCIe 0 or XAUI 0 Slots 0 and 1 are shared PCIe XAUI slots You can only install one or the other type of card 1 PCIe ...

Page 139: ... and XAUI Support SPARC Enterprise T5240 Servers Slot PCIe Controller Supported Device Types FRU Name PCIe 0 or XAUI 0 Slots 0 and 1 are shared PCIe XAUI slots You can only install one or the other type of card 1 PCIe controller 1 also supports the on board Ethernet controller for the NET0 NET1 NET2 and NET3 ports x8 PCIe operating at x8 XAUI expansion card SYS MB RISER0 PCIE0 SYS MB RISER0 XAUI0 ...

Page 140: ...115 Install a Battery on page 116 System Battery Overview The battery maintains system time when the server is powered off and a time server is unavailable If the server fails to maintain the proper time when it is powered off and not connected to a network replace the battery The following figure shows the battery location on the SPARC Enterprise T5140 The SPARC Enterprise T5240 is in a similar l...

Page 141: ...n Remove a Battery on page 115 Install a Battery on page 116 Remove a Battery 1 Remove PCIe XAUI riser 2 See Remove a PCIe XAUI Riser on page 105 2 Using a No 1 flat blade screwdriver press the clip away from the battery and pull the battery up and out of its holder Related Information Install a Battery on page 116 ...

Page 142: ...s Out Manager ILOM 3 0 Supplement for SPARC Enterprise T5140 and T5240 Servers 5 After returning the server to operation check and reset the Solaris OS date Related Information Remove a Battery on page 115 Servicing the SCC Module These topics explain how to replace a faulty SCC module SCC Module Overview on page 116 Remove the SCC Module on page 117 Install the SCC Module on page 117 SCC Module O...

Page 143: ...le and its connector are keyed 3 Press the SCC module down until it seats 4 Install PCIe XAUI riser 2 See Install a PCIe XAUI Riser on page 107 5 Install the top cover See Install the Top Cover on page 177 6 Slide the server into the rack See Reinstall the Server in the Rack on page 178 7 Connect the power supplies Connect Power Cords to the Server on page 181 Note As soon as the power cords are c...

Page 144: ...118 Install a Memory Mezzanine Assembly on page 120 Memory Mezzanine Assembly Overview The memory mezzanine assembly must be removed in order to access the following components Motherboard FB DIMMs Motherboard Power distribution board Power supply backplane SPARC Enterprise T5240 server Paddle card Related Information Remove a Memory Mezzanine Assembly on page 118 Install a Memory Mezzanine Assemb...

Page 145: ... 4 Remove the shipping bracket Note The shipping bracket is not required for normal system operation Some systems might not have a shipping bracket installed 5 Open the release levers on either side of the memory mezzanine assembly FIGURE Removing the Memory Mezzanine Assembly 6 Lift the memory mezzanine assembly up and out of the system Place the memory mezzanine assembly on an antistatic mat ...

Page 146: ...stem on page 60 Remove the Top Cover on page 67 Install a Memory Mezzanine Assembly Caution This procedure requires that you handle components that are sensitive to static discharge Static discharges can cause the components to fail 1 Remove any filler panels from the memory mezzanine connector slots if necessary Store the filler panels in a safe place You will reuse the filler panels if you remov...

Page 147: ... the levers to lock the memory mezzanine assembly into place 5 Install the memory riser air duct FIGURE Installing the Memory Mezzanine Air Duct 6 Optional Install the shipping bracket Two captive screws secure the shipping bracket 7 Install the top cover See Install the Top Cover on page 177 ...

Page 148: ...oweron Command on page 181 Power On the Server Using the Front Panel Power Button on page 182 Servicing the Motherboard Assembly These topics explain how to remove and install the motherboard assembly Motherboard Servicing Overview on page 122 Remove the Motherboard Assembly on page 123 Install the Motherboard Assembly on page 125 Motherboard Servicing Overview The motherboard assembly must be rem...

Page 149: ... PROM prompt 3 Run the printenv command to make a note of any OpenBoot PROM variables that have been modified 4 Power off the server See Removing Power From the System on page 60 5 Remove the server from the rack See Remove the Server From the Rack on page 64 6 Attach an antistatic wrist strap 7 Remove the top cover See Remove the Top Cover on page 67 8 Remove the air duct See Remove the Air Duct ...

Page 150: ...onfiguration so that you can install the FB DIMMs in the replacement motherboard SCC PROM 13 Using a No 2 Phillips screwdriver remove the four screws that secure the motherboard assembly to the bus bar Caution If you touch the heat sink when removing the bus bar screw you might get burned Note Set the four screws aside You must use these screws to attach the motherboard to the bus bar during insta...

Page 151: ...n an antistatic mat Related Information Install the Motherboard Assembly on page 125 Install the Motherboard Assembly Caution This procedure requires that you handle components that are sensitive to static discharge Static discharges can cause the components to fail 1 Position the motherboard so that its screw holes align with the chassis standoffs ...

Page 152: ...ndles If the board moves upward then it is not correctly seated Ensure that the motherboard tray sits flush with the chassis floor Also check for binds and ensure that the bus bar screw holes are correctly aligned with the bus bar at the front of the motherboard 3 Tighten the captive screw that secures the motherboard to the front of its tray in the chassis 4 Install the four No 2 Phillips screws ...

Page 153: ...PARC Enterprise T5140 Servers on page 190 Internal Cables for Onboard SAS Controller Cards in SPARC Enterprise T5240 Servers on page 204 7 Install the air duct See Install the Air Duct on page 104 8 Reinstall the motherboard to power distribution board ribbon cable 9 Reinstall the PCIe and XUAI risers See Install a PCIe XAUI Riser on page 107 10 Install the top cover See Install the Top Cover on p...

Page 154: ...128 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 ...

Page 155: ...he top cover door The default number of fan modules installed in the server is different for the two server models SPARC Enterprise T5140 Servers contain at least six fan modules SPARC Enterprise T5240 Servers contain at least five fan modules Each fan module contains two fans mounted in an integrated hot swappable CRU If a fan module fails replace it as soon as possible to maintain server availab...

Page 156: ...rs This information applies to both the eight hard drive capable and sixteen hard drive capable version of the system TABLE Fan Module Locations and FRU Names for SPARC Enterprise T5140 Servers With a 4 Disk Capable Backplane SYS FANBD1 FM0 SYS FANBD1 FM1 SYS FANBD1 FM2 Empty SYS FANBD0 FM0 SYS FANBD0 FM1 SYS FANBD0 FM2 Empty Front of System TABLE Fan Module Locations and FRU Names for SPARC Enter...

Page 157: ...Information Front Panel Controls and Indicators on SPARC Enterprise T5140 Servers on page 5 Rear Panel Components and Indicators on SPARC Enterprise T5140 Servers on page 8 Front Panel Controls and Indicators on SPARC Enterprise T5240 Servers on page 9 Rear Panel Components and Indicators on SPARC Enterprise T5240 Servers on page 12 Remove a Fan Module 1 Extend the server into the maintenance posi...

Page 158: ...ervers the Fan Fault LEDs are located on the fan board On SPARC Enterprise T5240 servers the Fan Fault LEDs are located on the fan modules 4 Pull up on the green fan module label until you remove the fan module from the chassis Caution When changing the fan modules only the fan modules may be removed or replaced Do not service any other components in the fan compartment unless the system is shut d...

Page 159: ...ensure proper system cooling be certain to install the replacement fan module in the same slot from which the faulty fan was removed 1 With the top cover door open install the replacement fan module into the server The fan modules are keyed to ensure that they are installed facing in the correct direction FIGURE Installing a Fan Module ...

Page 160: ...door 5 Verify that the system Fan Fault LED Service Required LEDs and the individual fan module Fault LED are off 6 Run the ILOM show faulty command to verify that the fan fault has been cleared See Detecting Faults With ILOM on page 22 for more information on using the show faulty command Related Information Extend the Server to the Maintenance Position on page 63 Faults Displayed by show faulty ...

Page 161: ...er models use DC input power For input power specifications for both AC and DC models refer to the SPARC Enterprise T5140 and T5240 Server Site Planning Guide The server models that run on DC input power require you to build the input power cable to specific safety guidelines For instructions on building the DC power cables and the safety guidelines refer to the SPARC Enterprise T5140 and T5240 Se...

Page 162: ... available leave the failed power supply installed to ensure proper airflow in the server TABLE Power Supply Status LEDs Legend LED Icon Color 1 OK Green This LED lights when the power supply DC voltage from the PSU to the server is within tolerance 2 Fault Amber This LED is lit when the power supply is faulty 3 AC Present AC For DC PSUs this symbol is either DC or a power connector Green This LED...

Page 163: ...lth follow the instructions 1 Move to the rear of the server chassis so you can view the power supply status LEDs The amber Fault LED on the failed power supply will be on 2 Optional You can verify the status indicated by the Fault LED by running the ILOM show faulty command The Fault LED indication is verified if the show faulty command lists that power supply as faulty 3 Locate and release the c...

Page 164: ...AC server models Disconnect the power cord from the faulty power supply DC server models Turn off the power using the circuit breaker on the power source Caution For server models with DC input power do not disconnect the power cable at the Wago connector on the server DC power supply unit Instead turn off the power at the circuit breaker on the power source 5 Grasp the power supply handle and pre...

Page 165: ...ervicing Power Supplies 139 FIGURE Power Supply Release Handle SPARC Enterprise T5140 Servers FIGURE Power Supply Release Handle SPARC Enterprise T5240 Servers 6 Pull the power supply out of the chassis ...

Page 166: ...rvice Manual July 2009 Install a Power Supply 1 Align the replacement power supply with the empty power supply chassis bay 2 Slide the power supply into the bay until it is fully seated FIGURE Installing a Power Supply SPARC Enterprise T5140 Server ...

Page 167: ...reaker at the power source Caution For server models with DC input power do not disconnect and reconnect the power cable at the Wago connector on the server DC power supply unit Instead control the input power using the circuit breaker at the power source Verify that the PSU OK LED is lighted 4 Close the CMA inserting the end of the CMA into the rear left rail bracket 5 Verify that the Fault LED o...

Page 168: ...y Configuration Reference The following table describes the FRU device names for power supplies in the servers Note Power supply names in ILOM messages are displayed with the full FRU name such as SYS PS0 TABLE Power Supply FRU Names Physical Device FRU Name PS0 SYS PS0 PS1 SYS PS1 ...

Page 169: ...es SPARC Enterprise T5240 Servers on page 170 Servicing Paddle Cards on page 174 Important Safety Instructions This topic provides a summary of the safety precautions you need to follow when servicing circuit boards and other components contained the server chassis Most components housed within the chassis must never be serviced while power is present in the chassis The following table identifies ...

Page 170: ...VD USB Modules These topics explain how to remove and install DVD USB modules DVD USB Module Overview on page 145 Remove the DVD USB Module on page 145 Install the DVD USB Module on page 147 Hard drive backplane Servicing the Hard Drive Backplane on page 156 Front control panel light pipe Servicing Front Control Panel Light Pipe Assemblies on page 160 Power distribution board Servicing Power Distr...

Page 171: ...nding on when it was manufactured Servers that contain a SATA compatible backplane have a SATA label on the front bezel Servers with the older PATA compatible backplanes do not have any DVD label on the bezel Note SATA compatible backplanes have special keying that prevents full insertion of a PATA DVD When installing a PATA type DVD do not force the module if it resists full insertion It may be t...

Page 172: ... Backplane Configuration Reference on page 77 8 disk capable backplane remove HDD7 See Eight Drive Capable Backplane Configuration Reference on page 78 16 disk capable backplane remove HDD13 See Sixteen Drive Capable Backplane Configuration Reference on page 79 5 Release the DVD USB module from the hard drive backplane Use the finger indentation in the hard drive bay below the DVD USB module to ex...

Page 173: ...n the DVD type and Hard Drive backplane are compatible both are SATA or both are PATA types Special keying will resist installation of a PATA DVD into a SATA type DVD bay Do not force the module if you meet resistance or you may damage the backplane DVD USB Module or both 1 Slide the DVD USB module into the front of the chassis until it seats FIGURE Installing the DVD USB Module Illustrates instal...

Page 174: ...These topics explain how to remove and install fan power boards Fan Power Board Overview on page 148 Remove the Fan Power Board on page 149 Install the Fan Power Board on page 150 Related Information Remove the Hard Drive Backplane on page 157 Fan Power Board Overview Fan power boards carry power to the system fan modules They also contain fan module status LEDs and carry status and control data f...

Page 175: ...e position See Extend the Server to the Maintenance Position on page 63 Note If you are removing the fan power boards to service the paddle card or hard drive cage you must remove the server from the rack See the topic Remove the Server From the Rack on page 64 4 Attach an antistatic wrist strap 5 Remove the top cover See Remove the Top Cover on page 67 6 Remove the fan modules Note If you are rep...

Page 176: ... 9 Remove the fan power board from the system and place it on an antistatic mat Related Information Install the Fan Power Board on page 150 Install the Fan Power Board 1 Lower the board into its mushroom standoffs in the chassis floor and slide the board to the right into the paddle card FIGURE Installing a Fan Power Board Illustrates installation in a SPARC Enterprise T5140 server 2 Secure the bo...

Page 177: ...m See Power On the Server Using the poweron Command on page 181 or Power On the Server Using the Front Panel Power Button on page 182 Related Information Remove the Fan Power Board on page 149 Servicing the Hard Drive Cage These topics explain how to remove and install the hard drive cage Hard Drive Cage Overview on page 151 Remove the Hard Drive Cage on page 152 Install the Hard Drive Cage on pag...

Page 178: ...ver from the rack Place the server on a hard flat surface See Remove the Server From the Rack on page 64 4 SPARC Enterprise T5140 Remove the inner glides from the server Each inner glide is secured with a locking tab Release the tab and slide each inner glide off the server mounting studs 5 Attach an antistatic wrist strap 6 Remove the top cover See Remove the Top Cover on page 67 7 If you are ser...

Page 179: ...age to each side of the chassis FIGURE Removing a Hard Drive Cage Illustrating Removal From a SPARC Enterprise T5140 Server 11 Slide the hard drive cage forward to disengage the backplane from the paddle cards 12 Disconnect the hard drive data cables a Press the release button b Remove the plug from the connector on the hard drive backplane Caution The hard drive data cables are delicate Ensure th...

Page 180: ...stall the Hard Drive Cage Before performing any installation steps review the proper cable routing and connections The following topics contain detailed cable routing information Internal Cables for Onboard SAS Controller Cards in SPARC Enterprise T5140 Servers on page 190 Internal Cables for Onboard SAS Controller Cards in SPARC Enterprise T5240 Servers on page 204 1 Position the hard drive cage ...

Page 181: ... the hard drive cage perform this step after Step 4 3 SPARC Enterprise T5140 server 8 disk capable Remove fan FM1 4 Slide the hard drive cage back until the hard drive backplane engages with the paddle card connector 5 Replace the No 2 Phillips screws securing the hard drive cage to the chassis Two screws secure the disk cage to each side of the chassis 6 SPARC Enterprise T5240 server Install the ...

Page 182: ...te Take care to be certain you are installing the hard drives in the correct drive bays See Install a Hard Drive on page 73 12 Install the DVD USB module See Install the DVD USB Module on page 147 13 Connect the power cords Note As soon as the power cords are connected standby power is applied Depending on how the firmware is configured the system might boot at this time 14 Power on the system See...

Page 183: ...e Each drive has its own Power Activity Fault and Ready to Remove LEDs Related Information Remove the Hard Drive Backplane on page 157 Install the Hard Drive Backplane on page 159 Remove the Hard Drive Backplane 1 Remove the hard drive cage See Remove the Hard Drive Cage on page 152 2 Remove the No 1 Phillips screws securing the backplane to the hard drive cage Two screws secure the backplane in t...

Page 184: ...T5240 Servers Service Manual July 2009 FIGURE Removing a Hard Drive Backplane Illustrating removal from a SPARC Enterprise T5140 server FIGURE Removing a Hard Drive Backplane Illustrating removal from a SPARC Enterprise T5240 server ...

Page 185: ...d Drive Backplane 1 Slide the backplane under the retention hooks on the hard drive cage 2 Install the No 1 Phillips screws that secure the backplane to the hard drive cage Two screws secure the backplane in the SPARC Enterprise T5140 server See the first figure below Four screws secure the backplane in the SPARC Enterprise T5240 server See the second figure below FIGURE Installing a Hard Drive Ba...

Page 186: ...on page 154 Related Information Remove the Hard Drive Backplane on page 157 Servicing Front Control Panel Light Pipe Assemblies These topics explain how to remove and install front control panel light pipe assemblies Front Control Panel Light Pipe Assemblies Overview on page 161 Remove the Front Control Panel Light Pipe Assemblies on page 161 Install the Front Control Panel Light Pipe Assemblies o...

Page 187: ...the Front Control Panel Light Pipe Assemblies 1 Remove the hard drive cage See Remove the Hard Drive Cage on page 152 2 Remove the No 1 Phillips screws securing the front control panel light pipe assembly to the hard drive cage Two screws secure the assembly to the hard drive cage in the SPARC Enterprise T5140 server Three screws secure the assembly to the hard drive cage in the SPARC Enterprise T...

Page 188: ...y into the control panel 2 Align the control panel light pipe assembly with the mounting holes on the hard drive cage Two screws secure the assembly to the hard drive cage in the SPARC Enterprise T5140 server Three screws secure the assembly to the hard drive cage in the SPARC Enterprise T5240 server The following figure illustrates installation of the front control panel light pipe on a SPARC Ent...

Page 189: ...e on page 154 Related Information Remove the Front Control Panel Light Pipe Assemblies on page 161 Servicing Power Distribution Boards The following topics explain how to remove and install power distribution boards They also provide important safety information related to working with power distribution boards Power Distribution Board Overview on page 164 Remove the Power Distribution Board on pa...

Page 190: ...ssembly to the new power distribution board If you replace a faulty power distribution board you must program the new power distribution board with the chassis serial number and part number These numbers are needed for obtaining product support Caution The system supplies power to the power distribution board even when the server is powered off To avoid personal injury or damage to the server you ...

Page 191: ...See Remove a Memory Mezzanine Assembly on page 118 4 Disconnect the top cover interlock cable from the power distribution board 5 SPARC Enterprise T5240 server Disconnect the ribbon cable between the power distribution board and the power supply backplane See Panel 1 in the following figure FIGURE Removing a Power Distribution Board From a SPARC Enterprise T5240 Server ...

Page 192: ... board to the chassis as shown in the following figure FIGURE Removing the Power Distribution Board From a SPARC Enterprise T5140 Server 8 Grasp the bus bar and pull the power distribution board bus bar assembly to the left away from the paddle card 9 Lift the power distribution board bus bar assembly up and out of the system 10 Place the power distribution board bus bar assembly on an antistatic ...

Page 193: ...or of the chassis 2 Slide the power distribution board bus bar assembly to the right until it plugs into the paddle card FIGURE Installing a Power Distribution Board in a SPARC Enterprise T5140 Server 3 Install the No 2 Phillips screw to secure the power distribution board to the chassis 4 SPARC Enterprise T5240 server Attach the four No 2 Phillips screws securing the power distribution board to t...

Page 194: ...0 Server 5 SPARC Enterprise T5240 server Connect the power supply backplane ribbon cable to its plug on the power distribution board 6 Connect the top cover interlock cable to the power distribution board 7 SPARC Enterprise T5140 server Install the power supplies 8 Slide each power supply into its bay until the power supply locks into place ...

Page 195: ...board and powering on the system you must run the ALOM CMT setcsn and setcpn commands to set the electronically readable chassis serial number and server part number 11 At the ALOM CMT command line interface use the setcsn command to set the chassis serial number and the setcpn command to set the server part number on the power distribution board The following is an example of the command line dia...

Page 196: ...s Power supply backplanes are not used in SPARC Enterprise T5140 servers Power Supply Backplane Overview on page 171 Related Information Servicing Power Distribution Boards on page 163 sc setsc sc_servicemode true Warning misuse of this mode may invalidate your warranty sc setcsn c chassis_serial_number Are you sure you want to permanently set the Chassis Serial Number to chassis_serial_number y n...

Page 197: ...ower to the power supply backplane even when the server is powered off To avoid personal injury or damage to the server you must disconnect the power cords before servicing the power supply backplane Remove the Power Supply Backplane Note the chassis serial number and server part number They are printed on a label located on the side of the chassis 1 Remove the motherboard assembly See Remove the ...

Page 198: ...on board See Remove the Power Distribution Board on page 164 4 Remove the No 2 Phillips screw securing the power supply backplane to the power supply bay 5 Lift the power supply backplane up and off its standoffs and out of the system FIGURE Removing a Power Supply Backplane From a SPARC Enterprise T5240 Server 6 Place the power supply backplane on an antistatic mat ...

Page 199: ...over its standoffs Press down toward the floor of the chassis FIGURE Installing a Power Supply Backplane Illustrating an Installation in a SPARC Enterprise T5240 Server 2 Secure the power supply backplane with one No 2 Phillips screw 3 Install the power distribution board See Install the Power Distribution Board on page 167 4 Install the power supplies Slide each power supply into its bay until th...

Page 200: ...r 5 Install the motherboard assembly See Install the Motherboard Assembly on page 125 Related Information Remove the Power Supply Backplane on page 171 Servicing Paddle Cards These topics explain how to remove and install paddle cards in SPARC Enterprise T5140 and T5240 servers Paddle Card Overview on page 175 Remove the Paddle Card on page 175 Install the Paddle Card on page 176 ...

Page 201: ... 1 Remove the motherboard assembly See Remove the Motherboard Assembly on page 123 2 Remove the power distribution board See Remove the Power Distribution Board on page 164 3 Remove the fan power boards Remove the Fan Power Board on page 149 4 Remove the two No 1 Phillips screws securing the paddle card to the chassis FIGURE Removing a Paddle Card Illustrating Removal From a SPARC Enterprise T5140...

Page 202: ...chassis FIGURE Installing a Paddle Card Illustrating Installation Into a SPARC Enterprise T5140 Server 2 Slide the paddle card forward to plug it into the hard drive backplane 3 Secure the paddle card with two No 1 Phillips screws 4 Install the fan power boards See Install the Fan Power Board on page 150 5 Install the power distribution board See Install the Power Supply Backplane on page 173 6 In...

Page 203: ...ck on page 178 Return the Server to the Normal Rack Position on page 180 Connect Power Cords to the Server on page 181 Power On the Server Using the poweron Command on page 181 Power On the Server Using the Front Panel Power Button on page 182 Install the Top Cover 1 Place the top cover on the chassis Set the cover down so that it hangs over the rear of the server by about an inch 25 4 mm 2 Slide ...

Page 204: ...ommand to restart the system See Power On the Server Using the poweron Command on page 181 for more information about the poweron command Related Information Power On the Server Using the poweron Command on page 181 Reinstall the Server in the Rack Caution The chassis is heavy To avoid personal injury use two people to lift it and set it in the rack 1 Place the ends of the chassis mounting bracket...

Page 205: ...rver to the Rack 2 Slide the server into the rack until the brackets lock into place The server is now in the extended maintenance position Related Information Return the Server to the Normal Rack Position on page 180 Connect Power Cords to the Server on page 181 ...

Page 206: ...release tabs on the side of each rail FIGURE Release Tabs on the Rail 2 While pushing on the release tabs slowly push the server into the rack Ensure that the cables do not get in the way 3 Reconnect the cables to the back of the server If the CMA is in the way disconnect the left CMA release and swing the CMA open 4 Reconnect the CMA Swing the CMA closed and latch it to the left rack rail ...

Page 207: ...er cords to the power supplies Note As soon as the power cords are connected standby power is applied Depending on how the firmware is configured the system might boot at this time Related Information Power On the Server Using the poweron Command on page 181 Power On the Server Using the Front Panel Power Button on page 182 Power On the Server Using the poweron Command Note If you are powering on ...

Page 208: ...ied in the default scr file that was previously configured For example Related Information Power On the Server Using the Front Panel Power Button on page 182 Power On the Server Using the Front Panel Power Button Use a pointed object such as a pen or pencil to press the Power button on the front panel See Power On the Server Using the Front Panel Power Button on page 182 for more information on th...

Page 209: ...ower Distribution Fan Module Components in SPARC Enterprise T5140 Servers on page 188 Internal Cables for Onboard SAS Controller Cards in SPARC Enterprise T5140 Servers on page 190 HDD Data Cable Routing for SAS RAID Controller Cards in Four Disk Capable SPARC Enterprise T5140 Servers on page 193 HDD Data Cable Routing for SAS RAID Controller Cards in Eight Disk Capable SPARC Enterprise T5140 Serv...

Page 210: ...184 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 Motherboard Components in SPARC Enterprise T5140 Servers FIGURE Motherboard Components SPARC Enterprise T5140 Servers ...

Page 211: ...Risers on page 104 Remove this component to service PCIe XAUI risers and cards N A 3 PCIe filler panel Servicing PCIe XAUI Risers on page 104 Must be installed in blank PCI slots N A 4 FB DIMMs Identify Faulty FB DIMMs Using the show faulty Command on page 83 Identify Faulty FB DIMMs Using the FB DIMM Fault Locator Button on page 83 See configuration rules before upgrading FB DIMMs See FB DIMM Con...

Page 212: ...186 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 I O Components in SPARC Enterprise T5140 Servers FIGURE I O Components SPARC Enterprise T5140 Servers ...

Page 213: ... Hard drive cage and hard drive backplane Servicing the Hard Drive Cage on page 151 Servicing the Hard Drive Backplane on page 156 Hard drive cage must be removed to service hard drive backplane and front control panel light pipes SYS SASBP 4 Hard drives Remove a Hard Drive on page 71 Install a Hard Drive on page 73 Hard drives must be removed to service the hard drive backplane See Four Drive Cap...

Page 214: ...nterprise T5140 and T5240 Servers Service Manual July 2009 Power Distribution Fan Module Components in SPARC Enterprise T5140 Servers FIGURE Power Distribution Fan Module Components SPARC Enterprise T5140 Servers ...

Page 215: ...serial number using the setscn command SYS PDB Paddle card Servicing Paddle Cards on page 174 Includes the top cover interlock switch SYS CONNBD Fan power boards Servicing Fan Power Boards on page 148 Must be removed to service the paddle card SYS FANBD0 SYS FANBD1 Power supplies Servicing Power Supplies on page 135 Two power supplies provide N 1 redundancy SYS PS0 SYS PS1 Fan modules Servicing Fa...

Page 216: ...ntroller card options for the SPARC Enterprise T5140 and T5240 servers both options support RAID The standard option uses the on board SAS controller card preinstalled on every server The second option is a StorageTek SAS RAID Internal Host Bus Adapter HBA PCIe card The internal cabling of your server will be different depending on the SAS controller card option you choose ...

Page 217: ... cover safety interlock 2 Motherboard to PDB cable 3 Hard drive data cable TABLE Data Cable Routing Details Four Disk Capable SPARC Enterprise T5140 Servers Item FRU Connections Routing notes 3 HDD data cable From J4101 SAS0 on the motherboard to J0301 P1 on the hard drive backplane Routed along CMP Module 1 CMP1 then over the chassis center wall and then over the fan power boards ...

Page 218: ...le SPARC Enterprise T5140 Servers Item FRU Connections Routing notes 3 HDD data cable Lower cable in the figure From J4101 SAS0 on the motherboard to J0301 P2 on the hard drive backplane Routed between CMP Module 0 CMP0 and CMP Module 1 CMP1 then under the chassis center wall and then under the fan power board 3 HDD data cable Upper cable in the figure From J4102 SAS1 on the motherboard to J0302 P...

Page 219: ...y server The second option is a StorageTek SAS RAID Internal Host Bus Adapter HBA PCIe card The internal cabling of your server will be different depending on the SAS controller card option you choose FIGURE Hard Drive Data Cable Routing for SAS RAID Controller Card in Four Disk Capable SPARC Enterprise T5140 Servers Figure Legend 1 Routing the cable through the right channel on the motherboard ha...

Page 220: ...nd option is a StorageTek SAS RAID Internal Host Bus Adapter HBA PCIe card The internal cabling of your server will be different depending on the SAS controller card option you choose FIGURE Hard Drive Data Cable Routing for SAS RAID Controller Card in Eight Disk Capable SPARC Enterprise T5140 Servers Figure Legend 1 Routing the data cable through the left channel on the motherboard handle 2 Routi...

Page 221: ...SPARC Enterprise T5240 Servers on page 198 I O Components in SPARC Enterprise T5240 Servers on page 200 Power Distribution Fan Module Components in SPARC Enterprise T5240 Servers on page 202 Internal Cables for Onboard SAS Controller Cards in SPARC Enterprise T5240 Servers on page 204 HDD Data Cable Routing for SAS RAID Controller Cards in SPARC Enterprise T5240 Servers on page 207 Related Informa...

Page 222: ...196 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 Motherboard Components in SPARC Enterprise T5240 Servers FIGURE Motherboard Components in SPARC Enterprise T5240 Servers ...

Page 223: ... Servicing PCIe XAUI Risers on page 104 Remove this to service PCIe XAUI risers and cards N A 4 FB DIMMs Identify Faulty FB DIMMs Using the show faulty Command on page 83 Identify Faulty FB DIMMs Using the FB DIMM Fault Locator Button on page 83 See configuration rules before upgrading FB DIMMs See FB DIMM Configuration Guidelines for SPARC Enterprise T5240 Servers on page 98 5 Motherboard assembl...

Page 224: ...8 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 Memory Mezzanine Components in SPARC Enterprise T5240 Servers FIGURE Memory Mezzanine Assembly Components SPARC Enterprise T5240 Servers ...

Page 225: ... 118 Optional component Must be installed if shipping the system to another location N A 3 FB DIMMs Identify Faulty FB DIMMs Using the show faulty Command on page 83 Identify Faulty FB DIMMs Using the FB DIMM Fault Locator Button on page 83 See configuration rules before upgrading FB DIMMs See FB DIMM Configuration Guidelines for SPARC Enterprise T5240 Servers on page 98 4 Auxiliary air vent Servi...

Page 226: ...200 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 I O Components in SPARC Enterprise T5240 Servers FIGURE I O Components SPARC Enterprise T5240 Servers ...

Page 227: ...t be removed to service hard drive backplane and front control panel light pipes N A 4 Left control panel light pipe assembly Servicing Front Control Panel Light Pipe Assemblies on page 160 Metal light pipe bracket is not a FRU N A 5 Hard drives Remove a Hard Drive on page 71 Install a Hard Drive on page 73 Hard drives must be removed to service the hard drive backplane See Eight Drive Capable Bac...

Page 228: ...nterprise T5140 and T5240 Servers Service Manual July 2009 Power Distribution Fan Module Components in SPARC Enterprise T5240 Servers FIGURE Power Distribution Fan Module Components SPARC Enterprise T5240 Servers ...

Page 229: ...ution board and bus bar N A 3 Power distribution board bus bar Servicing Power Distribution Boards on page 163 Bus bar is attached to the PDB with four screws If replacing a defective PDB you must move the bus bar to the new board and program the chassis serial number SYS PDB 4 Paddle card Servicing Paddle Cards on page 174 Includes the top cover interlock switch SYS CONNBD 5 Fan power boards Serv...

Page 230: ...ntroller card options for the SPARC Enterprise T5140 and T5240 servers both options support RAID The standard option uses the on board SAS controller card preinstalled on every server The second option is a StorageTek SAS RAID Internal Host Bus Adapter HBA PCIe card The internal cabling of your server will be different depending on the SAS controller card option you choose ...

Page 231: ...Disk Capable SPARC Enterprise T5240 Servers Item FRU Connections Routing notes 4 HDD data cable Lower cable in the figure From J4101 SAS0 on the motherboard to J0301 on the hard drive backplane Routed between CMP Module 0 CMP0 and CMP Module 1 CMP1 then under the chassis center wall and then under the fan power board 4 HDD data cable Upper cable in the figure From J4102 SAS1 on the motherboard to ...

Page 232: ... 2 PDB to power supply backplane cable 3 Motherboard to PDB cable 4 Hard drive data cable TABLE Data Cable Routing Details Eight Disk Capable SPARC Enterprise T5240 Servers Item FRU Connections Routing notes 4 HDD data cable From J4101 SAS0 on the motherboard to J0301 on the hard drive backplane Routed between CMP Module 0 CMP0 and CMP Module 1 CMP1 then under the chassis center wall and then unde...

Page 233: ...ternal Host Bus Adapter HBA PCIe card The internal cabling of your server will be different depending on the SAS controller card option you choose FIGURE HDD Data Cable Routing for SAS RAID Controller Cards in Eight or Sixteen Disk Capable SPARC Enterprise T5240 Servers Figure Legend 1 Routing the first hard drive cable through the right notch on the motherboard handle 2 Routing the second hard dr...

Page 234: ...208 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 ...

Page 235: ...of 50 displaying using showcomponent command 51 console command 26 39 94 consolehistory command 26 D DC server models 138 141 diag_level parameter 36 diag_mode parameter 36 diag_trigger parameter 36 diag_verbosity parameter 36 diagnostics low level 35 running remotely 23 dmesg command 49 DVD drive FRU name 187 201 E electrostatic discharge ESD preventing using an antistatic mat 59 preventing using...

Page 236: ...8 installing PCIe XAUI riser 107 SCC module 117 L latch power supply 138 slide rail 63 LED AC Present power supply LED 19 141 Fan Fault system LED 21 134 Fault fan module LED 21 134 Fault hard drive LED 22 Fault power supply LED 21 137 FB DIMM Fault motherboard LEDs 22 Overtemp system LED 21 Power OK system LED 19 Power Supply Fault system LED 21 141 Service Required system LED 21 22 136 LEDs fan ...

Page 237: ...ng POST commands 39 resetsc command 27 S SCC module FRU name 185 197 installing 117 removing 117 service processor prompt 61 Service Required system LED 22 cleared by enablecomponent command 42 interpreting to diagnose faults 21 22 triggered by ILOM 23 triggered by power supply fault 136 set command and component_state property 42 setdate command 116 setkeyswitch parameter 27 93 setlocator command...

Page 238: ...idelines 1 15 57 69 81 129 135 143 177 183 195 troubleshooting AC OK LED state 19 by checking Solaris OS log files 19 FB DIMMs 82 Power OK LED state 19 using POST 19 20 using SunVTS 19 using the show faulty command 19 U Universal Unique Identifier UUID 44 USB ports also see DVD USB module USB ports front FRU name 187 201 V virtual keyswitch 93 W Wago connector 141 ...

Page 239: ......

Page 240: ......

Reviews: