manualshive.com logo in svg

Sun Oracle Netra SPARC T3-1B, Service Manual

Share
Download
Sun Oracle Netra SPARC T3-1B Service Manual Download Page 104

92

SPARC T3-1B Server Module Service Manual • July 2012

4. Lower the card and press the card into place.

If the card has rubber bumpers you can press directly on them to seat the card into
the connectors.

5. Return the server module to operation.

See

“Returning the Server Module to Operation” on page 111

.

Related Information

■

“Remove a FEM” on page 89

Summary of Contents for Netra SPARC T3-1B

Page 1: ...SPARC T3 1B Server Module Service Manual Part No E29280 02 July 2012 ...

Page 2: ...t concédés sous licence et soumis à des restrictions d utilisation et de divulgation Sauf disposition de votre contrat de licence ou de la loi vous ne pouvez pas copier reproduire traduire diffuser modifier breveter transmettre distribuer exposer exécuter publier ou afficher le logiciel même partiellement sous quelque forme et par quelque procédé que ce soit Par ailleurs il est interdit de procéde...

Page 3: ...acle ILOM 12 Oracle ILOM Troubleshooting Overview 12 Fault Management 13 Fault Clearing 13 Oracle Solaris Fault Manager Commands in Oracle ILOM 14 HDD Faults 14 Access the SP Oracle ILOM 15 Display FRU Information show Command 17 Check for Faults show faulty Command 18 Check for Faults fmadm faulty Command 20 Clear Faults clear_fault_action Property 21 Service Related Oracle ILOM Command Summary 2...

Page 4: ... POST 31 POST Overview 32 Oracle ILOM Properties That Affect POST Behavior 33 Configure How POST Runs 35 Run POST With Maximum Testing 37 Interpret POST Fault Messages 39 Clear POST Detected Faults 40 POST Error Message Syntax 42 Managing Components ASR Commands 44 ASR Overview 44 Display System Components 45 Disable System Components 47 Enable System Components 48 Checking if Oracle VTS Software ...

Page 5: ...wer Button Standby Mode 57 Power Off the Server Module Emergency Shutdown 58 Prepare the Server Module for Removal 58 Remove the Server Module From the Modular System 59 Remove the Cover 62 Servicing Hard Drives 63 Drive Hot Plugging Rules 63 Remove a Drive 64 Replace or Add a Drive 65 Remove a Drive Filler 67 Install a Drive Filler 67 Servicing Memory 69 Memory Faults 69 Locate a Faulty DIMM LEDs...

Page 6: ...vice Processor Card 94 Servicing the ID PROM 97 Remove the ID PROM 97 Install the ID PROM 98 Verify the ID PROM 99 Servicing a USB Flash Drive 101 Remove a USB Flash Drive 101 Install a USB Flash Drive 102 Servicing the Battery 105 Replace the Battery 105 Replacing the Server Module Enclosure Assembly 107 Transfer Components to Another Enclosure Assembly 108 Returning the Server Module to Operatio...

Page 7: ...Contents vii Start the Server Module Host 114 Glossary 115 Index 121 ...

Page 8: ...viii SPARC T3 1B Server Module Service Manual July 2012 ...

Page 9: ...cians system administrators authorized service providers and users who have advanced experience troubleshooting and replacing hardware Product Notes on page ix Product Notes on page ix Feedback on page x Support and Accessibility on page xi Product Notes For late breaking information and known issues about this product refer to the product notes at http www oracle com pls topic lookup ctx SPARCT3 ...

Page 10: ...oracle com pls topic lookup ctx SPARCT3 1B Sun Blade 6000 modular system http www oracle com pls topic lookup ctx E19938 01 Oracle Integrated Lights Out Manager Oracle ILOM http www oracle com pls topic lookup ctx ilom30 Oracle Solaris OS and other system software http www oracle com technetwork indexes documentation sys_sw Oracle VTS software http www oracle com pls topic lookup ctx OracleVTS7 0 ...

Page 11: ...ption Links Access electronic support through My Oracle Support http support oracle com For hearing impaired http www oracle com accessibility support html Learn about Oracle s commitment to accessibility http www oracle com us corporate accessibility index html ...

Page 12: ...xii SPARC T3 1B Server Module Service Manual July 2012 ...

Page 13: ...module focusing on the components that can be removed and replaced for service Front and Rear Panel Components on page 2 Illustrated Parts Breakdown on page 3 Related Information Detecting and Managing Faults on page 5 Replacing the Server Module Enclosure Assembly on page 107 ...

Page 14: ...nce switch 2 Blue LED Ready to Remove 3 Amber LED Service Action Required 4 Green LED OK 5 Power button 6 Reset button NMI for service use only 7 Green LED Drive OK 8 Amber LED Drive Service Action Required 9 Blue LED Drive Ready to Remove 10 RFID sticker indicates serial number of the server module 11 Universal connector port UCP 12 Chassis power connector 13 Chassis data connector ...

Page 15: ...cs LEDs on page 10 Illustrated Parts Breakdown on page 3 Illustrated Parts Breakdown This topic identifies components in the server module that you can install or remove and replace The following table provides information about the replaceable components ...

Page 16: ...Assembly on page 107 SYS MB 3 Service processor card Servicing a Service Processor Card on page 93 SYS MB SP 4 DIMMs Servicing Memory on page 69 SYS MP CMP0 BOBn CHn Dn 5 FEM card Servicing a FEM on page 89 SYS MB FEMn 6 REM card Servicing a REM on page 85 SYS MB REM 7 Clock battery Servicing the Battery on page 105 SYS MB BAT 8 Connector cover Remove before inserting the server module in a slot 9...

Page 17: ...nformation Preparing for Service on page 51 Diagnostics Overview You can use a variety of diagnostic tools commands and indicators to monitor and troubleshoot a server module LEDs Provide a quick visual notification of the status of the server module and of some of the FRUs Oracle ILOM This firmware runs on the SP In addition to providing the interface between the hardware and OS Oracle ILOM also ...

Page 18: ...s hardware validation and discloses possible faulty components with recommendations for repair The LEDs Oracle ILOM PSH and many of the log files and console messages are integrated For example when the Oracle Solaris software detects a fault it displays the fault logs it and passes information to Oracle ILOM where it is logged Depending on the fault one or more LEDs might also be illuminated The ...

Page 19: ...Detecting and Managing Faults 7 Diagnostics Process The following flowchart illustrates the complementary relationship of the different diagnostic tools and indicates a default sequence of use ...

Page 20: ...nformation on a reported fault including possible corrective action go to this web site http www sun com msg message ID where message ID is the message contained in the fault message Service Related Oracle ILOM Command Summary on page 21 Check for Faults show faulty Command on page 18 Flowchart item 3 Check the Oracle Solaris log files for fault information The Oracle Solaris message buffer and lo...

Page 21: ...e For additional information on a reported fault including possible corrective action go to this web site http www sun com msg message ID where message ID is the message contained in the fault message After the FRU is replaced perform the procedure to clear PSH detected faults Managing Faults Oracle Solaris PSH on page 25 Clear PSH Detected Faults on page 30 Flowchart item 8 Determine if the fault...

Page 22: ...n the LED blinks rapidly There are two methods for turning a Locator LED on Issuing the Oracle ILOM command set SYS LOCATE value Fast_Blink Pressing the Locator button The Locator LED functions as the physical presence switch Ready to Remove LED Blue Steady state If LED is off it is not safe to remove the server module from the modular system chassis You must use Oracle ILOM to shut down the serve...

Page 23: ... System is running in standby mode and can be quickly returned to full function Slow blink A normal but transitory activity is taking place Slow blinking might indicate that system diagnostics are running or the system is booting On Standby button n a The recessed Power button toggles the system on or off Press once to turn the system on Press once to shut the system down to a standby state Press ...

Page 24: ...ing Log Files and System Messages on page 23 Managing Faults Oracle Solaris PSH on page 25 Managing Faults POST on page 31 Managing Components ASR Commands on page 44 Checking if Oracle VTS Software Is Installed on page 48 POST Overview on page 32 Oracle ILOM Properties That Affect POST Behavior on page 33 Oracle ILOM Troubleshooting Overview The Oracle ILOM firmware enables you to remotely run di...

Page 25: ... alerts for that condition Faults When the fault manager determines that a particular FRU has an error condition that is permanent that error is classified as a fault This condition causes the Service Action Required LEDs to be turned on the FRUID PROMs updated and a fault message logged If the FRU has status LEDs the Service Action Required LED for that FRU will also be turned on You must replace...

Page 26: ...ROM The SP can automatically detect when a FRU is removed In many cases the SP does this even if you remove the FRU while the SP is not running for example if you unplug the system power cables during service procedures This function enables Oracle ILOM to sense that a fault diagnosed to a specific FRU has been repaired Note Oracle ILOM does not automatically detect hard drive replacement Oracle S...

Page 27: ...with terminal emulation to the serial management port On the CMM this connector is labeled SER MGT Set up your terminal device for 9600 baud 8 bit no parity 1 stop bit and no handshaking and use a null modem configuration transmit and receive signals crossed over to enable DTE to DTE communication The crossover adapters supplied with the server module provide a null modem configuration Network man...

Page 28: ...show faulty Command on page 18 Note You can use fmadm faulty in the Oracle ILOM faultmgmt shell as an alternative to show faulty clear_fault_action property of the set command Manually clears PSH detected faults See Clear Faults clear_fault_action Property on page 21 Related Information Oracle Integrated Lights Out Manager ILOM 3 0 Concepts Guide Display FRU Information show Command on page 17 Che...

Page 29: ...7 Access the SP Oracle ILOM on page 15 Check for Faults show faulty Command on page 18 Check for Faults fmadm faulty Command on page 20 Clear Faults clear_fault_action Property on page 21 Service Related Oracle ILOM Command Summary on page 21 show SYS MB CMP0 BOB0 CH0 D0 SYS MB CMP0 BOB0 CH0 D0 Targets T_AMB SERVICE Properties Type DIMM ipmi_name B0 C0 D0 component_state Enabled fru_name 2048MB DD...

Page 30: ...displayed check the output to determine the nature of the fault The following examples show the different kinds of output that might be displayed Example of the show faulty command when no faults are present Example of the show faulty command displaying a fault when one of the AC inputs for power supply PS0 is not plugged in show faulty Target Property Value show faulty Target Property Value SP fa...

Page 31: ...w Command on page 17 Check for Faults fmadm faulty Command on page 20 Clear Faults clear_fault_action Property on page 21 Service Related Oracle ILOM Command Summary on page 21 SP faultmgmt 0 chassis_serial_number 0000000 0000000000 faults 0 show faulty Target Property Value SP faultmgmt 0 fru SYS MB CMP0 BOB1 CH0 D0 SP faultmgmt 0 timestamp Oct 12 16 40 56 faults 0 SP faultmgmt 0 sp_detected_faul...

Page 32: ... faultmgmt shell 2 At the faultmgmtsp prompt type the fmadm faulty command 3 Type the exit command when you are finished using the Oracle ILOM faultmgt shell Related Information Diagnostics Process on page 7 Access the SP Oracle ILOM on page 15 Display FRU Information show Command on page 17 Check for Faults show faulty Command on page 18 Clear Faults clear_fault_action Property on page 21 Service...

Page 33: ...ut not from the host If the fault persists in the host clear it manually as described in Clear PSH Detected Faults on page 30 At the prompt use the set command with the clear_fault_action True property Example Related Information Diagnostics Process on page 7 Access the SP Oracle ILOM on page 15 Display FRU Information show Command on page 17 Check for Faults show faulty Command on page 18 Check f...

Page 34: ...SYS Powers off the host server module and then powers on the host server module stop SYS Powers off the host server module start SYS Powers on the host server module reset SYS Generates a hardware reset on the host server module reset SP Reboots the SP set SYS keyswitch_state value Sets the virtual keyswitch value is normal standby diag or locked set SYS LOCATE value value Turns the Locator LED on...

Page 35: ... files and commands available for collecting information and for troubleshooting If POST or the Oracle Solaris PSH features do not indicate the source of a fault check the message buffer and log files for notifications for faults Hard disk drive faults are usually captured by the Oracle Solaris message files Check the Message Buffer dmesg Command on page 24 View the System Message Log Files on pag...

Page 36: ...les These messages can alert you to system problems such as a device that is about to fail The var adm directory contains several message files The most recent messages are in the var adm messages file After a period of time usually every week a new message file is automatically created The original contents of the messages file are rotated to a file named messages 0 Over a period of time the mess...

Page 37: ...cle Solaris PSH The following topics describe the Oracle Solaris PSH feature Oracle Solaris PSH Technology Overview on page 26 PSH Detected Fault Example on page 27 Check for PSH Detected Faults on page 28 Clear PSH Detected Faults on page 30 Related Information Diagnostics Overview on page 5 Diagnostics Process on page 7 prtdiag System Configuration Sun Microsystems sun4v SPARC T3 1B Memory size ...

Page 38: ...tes an error the daemon correlates the error with data from previous errors and other relevant information to diagnose the problem Once diagnosed the fault manager daemon assigns a UUID to the error This value distinguishes this error across any set of systems When possible the fault manager daemon initiates steps to self heal the failed component and take the component offline The daemon also log...

Page 39: ...ed Information Oracle Solaris PSH Technology Overview on page 26 Check for PSH Detected Faults on page 28 Clear PSH Detected Faults on page 30 SUNW MSG ID SUN4V 8000 DX TYPE Fault VER 1 SEVERITY Minor EVENT TIME Wed Jun 17 10 09 46 EDT 2009 PLATFORM SUNW system_name CSN HOSTNAME server48 37 SOURCE cpumem diagnosis REV 1 5 EVENT ID f92e9fbe 735e c218 cf87 9e1720a28004 DESC The number of errors asso...

Page 40: ... additional fault information SUN4V 8002 6E fmadm faulty TIME EVENT ID MSG ID SEVERITY Aug 13 11 48 33 21a8b59e 89ff 692a c4bc f4c5cccca8c8 SUN4V 8002 6E Major Platform sun4v Chassis_id Product_sn Fault class fault cpu generic sparc strand Affects cpu cpuid serial faulted and taken out of service FRU SYS MB hc product id product sn server id chassis id serial revision 05 chassis 0 motherboard 0 fa...

Page 41: ...om msg SUN4V 8002 6E The following example shows the message ID SUN4V 8002 6E and provides information for corrective action 3 Follow the suggested actions to repair the fault Related Information PSH Detected Fault Example on page 27 Clear PSH Detected Faults on page 30 Correctable strand errors exceeded acceptable levels Type Fault Severity Major Description The number of correctable errors assoc...

Page 42: ...hing else Do not perform the subsequent steps If a fault is reported continue to the next step fmadm faulty TIME EVENT ID MSG ID SEVERITY Aug 13 11 48 33 21a8b59e 89ff 692a c4bc f4c5cccca8c8 SUN4V 8002 6E Major Platform sun4v Chassis_id Product_sn Fault class fault cpu generic sparc strand Affects cpu cpuid serial faulted and taken out of service FRU SYS MB hc product id product sn server id chass...

Page 43: ...page 26 PSH Detected Fault Example on page 27 Clear PSH Detected Faults on page 30 Managing Faults POST These topics explain how to use POST as a diagnostic tool POST Overview on page 32 Oracle ILOM Properties That Affect POST Behavior on page 33 Configure How POST Runs on page 35 Run POST With Maximum Testing on page 37 Interpret POST Fault Messages on page 39 Clear POST Detected Faults on page 4...

Page 44: ... other aspects of POST operations For example you can specify the events that cause POST to run the level of testing POST performs and the amount of diagnostic information POST displays These properties are listed and described in Oracle ILOM Properties That Affect POST Behavior on page 33 If POST detects a faulty component the component is disabled automatically If the system is able to run witho...

Page 45: ...ST but no flash updates can be made HOST diag mode off POST does not run normal Runs POST according to diag level value service Runs POST with preset values for diag level and diag verbosity HOST diag level max If diag mode normal runs all the minimum tests plus extensive processor and memory tests min If diag mode normal runs minimum set of tests HOST diag trigger none Does not run POST on reset ...

Page 46: ...trates the same set of Oracle ILOM set command variables The following table shows combinations of Oracle ILOM parameters and associated POST modes max POST displays all test informational and some debugging messages debug none No POST output is displayed Parameter Values Description ...

Page 47: ...ecution Service Mode Using the Keyswitch_state keyswitch_state The keyswitch_state parameter when set to diag overrides all the other POST variables normal normal diag HOST diag mode normal Off N A HOST diag level max N A N A HOST diag trigger hw change error reset none N A HOST diag verbosity normal N A N A Description of POST Execution This is the default POST configuration This configuration te...

Page 48: ...mode level verbosity or trigger set the respective parameters Syntax set HOST diag property value See Oracle ILOM Properties That Affect POST Behavior on page 33 for a list of parameters and values Examples or 4 To see the current values for settings use the show command Example showing default values set SYS keyswitch_state normal Set keyswitch_state to Normal set HOST diag mode normal set HOST d...

Page 49: ... ILOM on page 15 2 Set the virtual keyswitch to diag so that POST will run in service mode 3 Reset the system so that POST runs There are several ways to initiate a reset The following example shows a reset by issuing commands that will power cycle the host Note The server module takes about one minute to power off Type the show HOST command to determine when the host has been powered off The cons...

Page 50: ... Oracle and or its affiliates All rights reserved 0 0 0 POST enabling CMP 0 threads ffffffff ffffffff ffffffff ffffffff 0 0 0 Diag mode 1 Normal 0 0 0 Diag level 1 Max 0 0 0 Diag verbosity 2 Normal 0 0 0 Test Memory Done 0 0 0 Setup POST Mailbox Done 0 0 0 Master CPU Tests Basic Done 0 0 0 Init MMU 0 0 0 Setup POST Mailbox Done 0 0 0 L2 Tests Done 0 0 0 Extended CPU Tests Done 0 0 0 Scrub Memory D...

Page 51: ...In this syntax c the core number s the strand number Warning and informational messages use the following syntax INFO message or WARNING message Example 3 2 ERROR TEST Data Bitwalk 3 2 H W under test SYS MB BOB1 CH0 D0 3 2 Repair Instructions Replace items in order listed by H W under test above 3 2 MSG Pin 149 failed on SYS MB BOB1 CH0 D0 J1101 3 2 END_ERROR 3 2 Decode of Dram Error Log Reg Chann...

Page 52: ...tects a faulty component POST logs the fault and automatically takes the failed component out of operation by placing the component in the ASR blacklist See Managing Components ASR Commands on page 44 Usually when a faulty component is replaced the replacement is detected when the SP is reset or power cycled Then the fault is automatically cleared from the system 1 After replacing a faulty FRU at ...

Page 53: ...The fault is cleared and should not show up when you run the show faulty command Additionally the front panel Fault Service Action Required LED is no longer on 4 Reset the server module You must reboot the server module for the component_state property to take effect 5 At the Oracle ILOM prompt use the show faulty command to verify that no faults are reported Example Related Information POST Overv...

Page 54: ...of Disrupting Error Status Reg DESR HW Corrected bits 00300000 00000000 2010 07 03 18 44 13 517 0 7 2 1 DESR_SOCSRE SOC non local sw_recoverable_error 2010 07 03 18 44 13 638 0 7 2 1 DESR_SOCHCCE SOC non local hw_corrected_and_cleared_error 2010 07 03 18 44 13 773 0 7 2 2010 07 03 18 44 13 836 0 7 2 Decode of NCU Error Status Reg bits 00000000 22000000 2010 07 03 18 44 13 958 0 7 2 1 NESR_MCU1SRE ...

Page 55: ...for Branch 1 00000000 00000800 2010 07 03 18 44 15 842 0 7 2 DRAM Error Syndrome Reg for Branch 1 dd1676ac 8c18c045 2010 07 03 18 44 15 967 0 7 2 DRAM Error Retry Reg for Branch 1 00000000 00000004 2010 07 03 18 44 16 086 0 7 2 DRAM Error RetrySyndrome 1 Reg for Branch 1 a8a5f81e f6411b5a 2010 07 03 18 44 16 218 0 7 2 DRAM Error Retry Syndrome 2 Reg for Branch 1 a8a5f81e f6411b5a 2010 07 03 18 44 ...

Page 56: ...Messages on page 23 Managing Faults Oracle Solaris PSH on page 25 Managing Faults POST on page 31 Checking if Oracle VTS Software Is Installed on page 48 ASR Overview The ASR feature enables the server module to automatically configure failed components out of operation until they can be replaced In the server module ASR manages the following components CPU strands Memory DIMMs I O subsystem The d...

Page 57: ...on Display System Components on page 45 Disable System Components on page 47 Enable System Components on page 48 Display System Components The show components command displays the system components asrkeys and reports their status At the prompt type the show components command In the following example one of the DIMMs BOB1 CH0 D0 is shown as disabled TABLE ASR Commands Command Description show com...

Page 58: ...IU0 component_state Enabled SYS MB CMP0 NIU1 component_state Enabled SYS MB CMP0 component_state Enabled NIU_CORE SYS MB CMP0 PEX component_state Enabled SYS MB CMP0 PEU0 component_state Enabled SYS MB CMP0 PEU1 component_state Enabled SYS MB CMP0 BOB0 component_state Enabled CH0 D0 SYS MB CMP0 BOB0 component_state Enabled CH1 D0 SYS MB CMP0 BOB1 component_state Disabled CH0 D0 SYS MB CMP0 BOB1 co...

Page 59: ... Reset the server module so that the ASR command takes effect Note In the Oracle ILOM shell there is no notification when the system is actually powered off Powering off takes about a minute Use the show HOST command to determine if the host has powered off Related Information View the System Message Log Files on page 24 Display System Components on page 45 Enable System Components on page 48 SWIT...

Page 60: ...as powered off Related Information View the System Message Log Files on page 24 Display System Components on page 45 Disable System Components on page 47 Checking if Oracle VTS Software Is Installed Oracle VTS previously named SunVTS is a validation test suite that you can use to test this server module This section provides an overview and a way to check if VTS is installed For comprehensive VTS ...

Page 61: ...devices for this server module VTS provides these kinds of test categories Audio Communication serial and parallel Graphic and video Memory Network Peripherals hard disk drives CD DVD devices and printers Processor Storage Use VTS to validate a system during development production receiving inspection troubleshooting periodic maintenance and system or subsystem stressing You can run VTS through a ...

Page 62: ...en VTS software is installed If you receive messages reporting ERROR information for package was not found then VTS is not installed You must take action to install the software before you can use it You can obtain the VTS software from the following places Oracle Solaris OS media kit DVDs As a download from the web Related Information Oracle VTS documentation pkginfo l SUNWvts SUNWvtsr SUNWvtsts ...

Page 63: ...over on page 62 Related Information Returning the Server Module to Operation on page 111 General Safety Information For your protection observe the following safety precautions when setting up your equipment Follow all cautions and instructions marked on the equipment Follow all cautions and instructions described in the documentation that shipped with your system and in the SPARC T3 1B Server Mod...

Page 64: ...s hard drives and DIMMs require special handling Caution Circuit boards and hard drives contain electronic components that are extremely sensitive to static electricity Ordinary amounts of static electricity from clothing or the work environment can destroy the components located on these boards Do not touch the components along their connector edges Antistatic Wrist Strap Use Wear an antistatic w...

Page 65: ...filler panel Related Information General Safety Information on page 51 Find the Modular System Serial Number To obtain support for your server module you need the serial number of the Sun Blade 6000 modular system in which the server module is located not the serial number of the server module The serial number of the modular system is provided on a label on the upper left edge of the front bezel ...

Page 66: ...ated not the serial number of the server module See Find the Modular System Serial Number on page 53 The serial number of the server module is located on a sticker on the RFID mounted in the center of the front panel However this label is not present on a system that has been moved into a new enclosure assembly You also can type the Oracle ILOM show SYS command to display the number Access the Ora...

Page 67: ...the server module with a blinking white LED 4 Once you locate the server module press the Locator LED to turn it off Note Alternatively you can turn off the Locator LED by typing the Oracle ILOM set SYS LOCATE value off command Related Information Remove the Server Module From the Modular System on page 59 Removing the Server Module From the Modular System for Service Perform the following tasks S...

Page 68: ...tation for additional information 3 Save any open files and quit all running programs Refer to the application documentation for specific information on these processes 4 If applicable Shut down all logical domains Refer to the Oracle Solaris system administration and Oracle VM Manager for SPARC documentation for additional information 5 Shut down the Oracle Solaris OS and reach the ok prompt Refe...

Page 69: ... on page 58 Prepare the Server Module for Removal on page 58 Power Off the Server Module Power Button Standby Mode This procedure places the server module in the power standby mode In this mode the Power OK LED blinks rapidly Press and release the recessed Power button Use a stylus or the tip of a pen to operate this button See Front and Rear Panel Components on page 2 Related Information Shut Dow...

Page 70: ...the Server Module Power Button Standby Mode on page 57 Prepare the Server Module for Removal on page 58 Prepare the Server Module for Removal 1 Log in to Oracle ILOM on the server module you plan to remove 2 Ensure the server module is in standby mode with the host powered off Type If you do not see this message check that you have performed all the steps in Shut Down the Oracle Solaris OS on page...

Page 71: ...ower Off the Server Module Emergency Shutdown on page 58 Remove the Server Module From the Modular System Before performing this task review the following cautions Caution A server module can weigh as much as 17 pounds 8 0 kg During removal hold the server module firmly with both hands Caution Do not stack server modules higher than five units tall Caution Insert a filler panel into the empty serv...

Page 72: ...60 SPARC T3 1B Server Module Service Manual July 2012 2 Open both ejector arms panel 2 Squeeze both latches on each of the two ejector arms ...

Page 73: ...odule with two hands 6 Place the server module on an antistatic mat or surface 7 Insert a filler panel into the empty chassis slot Note When the modular system is operating you must fill every slot with a filler panel or a server module within 60 seconds Related Information Remove the Cover on page 62 Install the Server Module Into the Modular System on page 112 ...

Page 74: ...r wrist and then to a metal area on the server module 2 While pressing the cover release button slide the cover toward the rear of the server module about half an inch 1 cm 3 Lift the cover off the server module chassis Related Information Illustrated Parts Breakdown on page 3 Replace the Cover on page 111 ...

Page 75: ... hot plugged if The drive provides the operating system and the operating system is not mirrored on another drive The drive cannot be logically isolated from the online operations of the server module Description Links Determine if you can remove and replace a drive using hot plugging capabilities Drive Hot Plugging Rules on page 63 Replace a drive Remove a Drive on page 64 Replace or Add a Drive ...

Page 76: ... your drives For example you might need to unmount file systems or perform certain RAID commands One command that is commonly used to take a drive offline is the cfgadm command For more information refer to the Solaris cfgadm man page Shut down the Solaris OS If the drive cannot be taken offline shut down the Solaris OS on the server module See Shut Down the Oracle Solaris OS on page 56 3 Verify w...

Page 77: ...page 67 Replace or Add a Drive on page 65 Replace or Add a Drive The physical address of a hard drive is based on he hard drive is physically addressed based on the slot in which it is installed 1 Identify the slot in which to install the drive If you are replacing a drive ensure that you install the replacement drive in the same slot as the drive you removed If you are adding an additional drive ...

Page 78: ...rform at this point depend on how your data is configured You might need to partition the drive create file systems load data from backups or have data updated from a RAID configuration The following commands might apply to your circumstances You can use the Solaris command cfgadm al to list all disks in the device tree including unconfigured disks If the disk is not in the list such as with a new...

Page 79: ...d by either a drive or a filler 1 Open the filler lever panels 1 and 2 2 Pull to remove the filler panel 3 Related Information Replace or Add a Drive on page 65 Install a Drive Filler on page 67 Install a Drive Filler All drive bays must be populated by either a drive or a filler ...

Page 80: ...ual July 2012 1 Extend the filler handle then align the filler to the empty drive bay panel 1 2 Push the filler into place 3 Close the filler lever panels 2 and 3 Related Information Remove a Drive on page 64 Remove a Drive Filler on page 67 ...

Page 81: ...rver module deals with memory faults The server module uses advanced ECC technology that corrects up to 4 bits in error on nibble boundaries as long as the bits are all in the same DRAM On some DIMMs if a DRAM fails the DIMM continues to function Description Links Understand memory faults Memory Faults on page 69 Replace a faulty DIMM Locate a Faulty DIMM LEDs on page 70 Remove a DIMM on page 73 L...

Page 82: ...ge 75 Oracle Solaris PSH technology A feature of the Solaris OS PSH uses the fault manager daemon fmd to watch for various kinds of faults When a fault occurs the fault is assigned a UUID and logged PSH reports the fault and suggests a replacement for the DIMMs associated with the fault If you suspect that the server module has a memory problem follow the Diagnostics Process on page 7 The flowchar...

Page 83: ...t If the System Fault LED is not lit and you suspect there is a problem see Diagnostics Process on page 7 If the System Fault LED is lit go to the next step 2 If needed Prepare for service See Shut Down the Oracle Solaris OS on page 56 Prepare the Server Module for Removal on page 58 Remove the Server Module From the Modular System on page 59 Remove the Cover on page 62 ESD Safety Measures on page...

Page 84: ...E Locating Faulty DIMMs 4 Remove the faulty DIMM See Remove a DIMM on page 73 Related Information DIMM Configuration Reference on page 81 Remove a DIMM on page 73 Figure Legend 1 DIMM 1 BOB0 CH1 D0 2 Fault LED for DIMM 1 3 Locate button for LEDs of faulty DIMMs ...

Page 85: ... 56 Prepare the Server Module for Removal on page 58 Remove the Server Module From the Modular System on page 59 Remove the Cover on page 62 ESD Safety Measures on page 52 2 If needed Locate the faulty DIMM See Locate a Faulty DIMM LEDs on page 70 3 Remove the DIMM from the motherboard as described in the following steps a Push down on the ejector tabs on each side of the DIMM until the DIMM is re...

Page 86: ...it boards Caution Components inside the chassis might be hot Use caution when servicing components inside the chassis 1 If needed Prepare the server module for service and remove the faulty DIMM See Remove a DIMM on page 73 2 Unpackage the replacement DIMM and set it on an antistatic mat 3 Ensure that the DIMM ejector tabs are in the open position panel 1 4 Line up the replacement DIMM with the co...

Page 87: ... Verify additional memory See Verify DIMM Functionality on page 79 Related Information Remove a DIMM on page 73 DIMM Configuration Reference on page 81 Clear the Fault and Verify the Functionality of the Replacement DIMM This procedure describes how to clear a memory fault and how to verify the functionality of the replacement DIMM Ensure that the following conditions are met The server module is ...

Page 88: ...If the fault is still displayed by the show faulty command then use the set command to enable the DIMM and clear the fault Example 3 Perform the following steps to verify the repair show faulty Target Property Value SP faultmgmt 0 fru SYS MB CMP0 BOB0 CH0 D0 SP faultmgmt 0 timestamp Dec 14 22 43 59 SP faultmgmt 0 sunw msg id SUN4V 8000 DX faults 0 SP faultmgmt 0 uuid 3aa7c854 9667 e176 efe5 e487e5...

Page 89: ...lts Note Depending on the configuration of Oracle ILOM variables that affect POST and whether POST detected faults or not the system might boot or the system might remain at the ok prompt If the system is at the ok prompt type boot d Return the virtual keyswitch to Normal mode set SYS keyswitch_state Diag Set keyswitch_state to Diag stop SYS Are you sure you want to stop SYS y n y Stopping SYS sta...

Page 90: ...steps did not clear the fault Type the set command 7 Only if previous steps did not clear the fault Switch to the system console and type the fmadm repair command with the UUID Use the same UUID that was displayed from the output of the Oracle ILOM show faulty command Related Information Install a Replacement DIMM on page 74 fmadm faulty show faulty Target Property Value SP faultmgmt 0 fru SYS MB ...

Page 91: ...s power cycled In those cases the fault is automatically cleared from the system If show faulty still displays the fault the set command will clear it 4 For a host detected fault perform the following steps to verify the new DIMM a Set the virtual keyswitch to diag so that POST will run in Service mode b Power cycle the server module host Note Use the show HOST command to determine when the host h...

Page 92: ...If the server module remains at the ok prompt type boot e Return the virtual keyswitch to Normal mode f Switch to the system console and type the Oracle Solaris OS fmadm faulty command If any faults are reported see the diagnostics instructions in Oracle ILOM Troubleshooting Overview on page 12 5 Switch to the Oracle ILOM command shell start HOST console 0 7 2 INFO 0 7 2 POST Passed all devices 0 ...

Page 93: ...Reference This topic provides configuration guidelines and the relationships between the DIMM physical locations and FRU names DIMM configuration guidelines There are 16 DIMM slots that support industry standard DIMMs You can install quantities of 4 8 or 16 DIMMs Supported DIMM capacities 2 Gbyte 4 Gbyte and 8 Gbyte Refer to the SPARC T3 1B Server Module Product Notes for the latest information sh...

Page 94: ... server module must be the same capacity FIGURE DIMM Slot Locations Figure Legend 1 DIMM slots controlled by BOB0 2 DIMM slots controlled by BOB1 3 DIMM slots controlled by BOB3 4 DIMM slots controlled by BOB2 5 Fault remind button 6 Memory fault LED for the adjacent DIMM ...

Page 95: ...ment DIMM on page 74 DIMM Location From top to bottom when viewed with the front panel of the server module on your left Slot Color Slot Is Used For This Quantity of DIMMs FRU Name all start with SYS MB CMP0 1 Blue 4 8 16 BOB0 CH1 D0 2 Black 16 BOB0 CH1 D1 3 White 8 16 BOB0 CH0 D0 4 Black 16 BOB0 CH0 D1 5 Black 16 BOB1 CH0 D1 6 White 8 16 BOB1 CH0 D0 7 Black 16 BOB1 CH1 D1 8 Blue 4 8 16 BOB1 CH1 D...

Page 96: ...84 SPARC T3 1B Server Module Service Manual July 2012 Clear the Fault and Verify the Functionality of the Replacement DIMM on page 75 ...

Page 97: ...age 5 Preparing for Service on page 51 Remove a REM 1 Prepare for service See Shut Down the Oracle Solaris OS on page 56 Prepare the Server Module for Removal on page 58 Remove the Server Module From the Modular System on page 59 Remove the Cover on page 62 ESD Safety Measures on page 52 2 Lift up on the REM lever panel 1 Description Links Replace a REM Remove a REM on page 85 Install a REM on pag...

Page 98: ...stall a REM See Install a REM on page 86 Related Information Install a REM on page 86 Install a REM This task describes how to install a REM onto the server module For information about specific configuration tasks for your REM refer to the REM documentation 1 Prepare for service by performing the following tasks Shut Down the Oracle Solaris OS on page 56 ...

Page 99: ...the connector under the tabs of the plastic standoff panel 2 4 Press the REM until the connector is fully seated on the motherboard panel 3 If there is a rubber bumper on the REM you can press down on it directly to seat the connector 5 Return the server module to operation See Returning the Server Module to Operation on page 111 6 Configure or verify the RAID after installing the REM Refer to the...

Page 100: ...88 SPARC T3 1B Server Module Service Manual July 2012 Related Information Remove a REM on page 85 ...

Page 101: ...when you replace a FEM you might need to remove a FEM in the FEM 1 connector to access the clock battery 1 Prepare for service See Shut Down the Oracle Solaris OS on page 56 Prepare the Server Module for Removal on page 58 Remove the Server Module From the Modular System on page 59 Remove the Cover on page 62 ESD Safety Measures on page 52 2 Lift the lever to eject the card panel 1 Description Lin...

Page 102: ... FEM on an antistatic mat 5 Install a FEM See Install a FEM on page 90 Related Information Install a FEM on page 90 Install a FEM This procedure applies to any of the form factors of FEM cards that are supported by this server module 1 Prepare for service by performing the following tasks Shut Down the Oracle Solaris OS on page 56 ...

Page 103: ... a FEM on page 89 2 Determine the correct set of motherboard FEM connectors for your FEM An L shaped FEM card 1 uses connectors FEM X and FEM 0 A rectangular double width FEM card 2 uses connectors FEM 0 and FEM 1 A rectangular single width FEM card 3 uses connector FEM 0 3 Insert the FEM edge into the bracket and carefully align the FEM so that the card connects with the correct motherboard conne...

Page 104: ...d and press the card into place If the card has rubber bumpers you can press directly on them to seat the card into the connectors 5 Return the server module to operation See Returning the Server Module to Operation on page 111 Related Information Remove a FEM on page 89 ...

Page 105: ...ce on page 51 Remove the Service Processor Card 1 If possible save the configuration information for the SP Refer to the related procedures using Oracle ILOM in the SPARC T3 Series Servers Administration Guide 2 Prepare for service See Shut Down the Oracle Solaris OS on page 56 Prepare the Server Module for Removal on page 58 Remove the Server Module From the Modular System on page 59 Remove the C...

Page 106: ...et the card on an antistatic mat 5 Continue to install the new card See Install the Service Processor Card on page 94 Related Information Install the Service Processor Card on page 94 Install the Service Processor Card 1 If needed Remove the service processor card See Remove the Service Processor Card on page 93 ...

Page 107: ...3 Lower the service processor card until it is aligned with the connector panel 3 4 Seat the service processor card into the connector by pressing the card toward the tabs while pressing down panel 4 When the service processor card is in place the lever will close 5 Return the server module to the chassis See Returning the Server Module to Operation on page 111 ...

Page 108: ...If you see this message go to Step 7 Otherwise go to Step 8 7 Download the system firmware Refer to the Oracle ILOM documentation for instructions 8 If you created a backup of the SP configuration use the Oracle ILOM restore utility to restore the configuration 9 Return the server module to operation Related Information Remove the Service Processor Card on page 93 Unrecognized Chassis This module ...

Page 109: ...re assembly to the replacement enclosure assembly This action ensures that your server module will maintain the same host ID and MAC address Remove the ID PROM on page 97 Install the ID PROM on page 98 Verify the ID PROM on page 99 Related Information Detecting and Managing Faults on page 5 Preparing for Service on page 51 Remove the ID PROM 1 Prepare for service See Shut Down the Oracle Solaris O...

Page 110: ...lace the ID PROM on an antistatic mat 4 Install the ID PROM See Install the ID PROM on page 98 Related Information Install the ID PROM on page 98 Verify the ID PROM on page 99 Install the ID PROM 1 If needed Remove the ID PROM See Remove the ID PROM on page 97 2 Locate the ID PROM socket on the motherboard ...

Page 111: ...on on page 111 5 Verify the ID PROM See Verify the ID PROM on page 99 Related Information Remove the ID PROM on page 97 Verify the ID PROM on page 99 Verify the ID PROM The host MAC address and the Host ID values are stored in the ID PROM This task describes ways to display these values 1 Display the MAC address that is stored in the ID PROM Example using the Oracle ILOM show command show HOST mac...

Page 112: ...mation Remove the ID PROM on page 97 Install the ID PROM on page 98 HOST Properties macaddress 00 21 28 34 29 9c hostid 857f6844 ifconfig a lo0 flags 2001000849 UP LOOPBACK RUNNING MULTICAST IPv4 VIRTUAL mtu 8232 index 1 inet 127 0 0 1 netmask ff000000 igb0 flags 1004843 UP BROADCAST RUNNING MULTICAST DHCP IPv4 mtu 1500 index inet 10 6 91 117 netmask fffffe00 broadcast 10 6 91 255 ether 0 21 28 7f...

Page 113: ...e Oracle Solaris OS on page 56 Prepare the Server Module for Removal on page 58 Remove the Server Module From the Modular System on page 59 Remove the Cover on page 62 ESD Safety Measures on page 52 2 Locate the USB flash drive at the rear of the server module panel 1 Description Links Replace a USB flash drive Remove a USB Flash Drive on page 101 Install a USB Flash Drive on page 102 Add a USB fl...

Page 114: ... server module has a USB port on the motherboard The USB port accepts USB flash drives that do not exceed a length of 39 mm 1 Prepare for service See Shut Down the Oracle Solaris OS on page 56 Prepare the Server Module for Removal on page 58 Remove the Server Module From the Modular System on page 59 Remove the Cover on page 62 ESD Safety Measures on page 52 If needed Remove a USB Flash Drive on p...

Page 115: ...ive into the upper port of the USB connector panels 1 and 2 Do not use the lower port of this connector 4 Return the server module to operation See Returning the Server Module to Operation on page 111 Related Information Remove a USB Flash Drive on page 101 ...

Page 116: ...104 SPARC T3 1B Server Module Service Manual July 2012 ...

Page 117: ...dule fails to maintain the proper time when it is powered off replace the battery 1 Prepare for service by performing the following tasks Shut Down the Oracle Solaris OS on page 56 Prepare the Server Module for Removal on page 58 Remove the Server Module From the Modular System on page 59 Remove the Cover on page 62 ESD Safety Measures on page 52 2 Remove a FEM card using connector FEM 1 if presen...

Page 118: ...0 6 Return the server module to operation See Returning the Server Module to Operation on page 111 7 Use an Oracle ILOM command to set the clock s day and time For example Related Information Servicing a FEM on page 89 Returning the Server Module to Operation on page 111 set SP clock datetime 061716192010 show SP clock SP clock Targets Properties datetime Thu JUN 17 16 19 56 2010 timezone GMT GMT ...

Page 119: ...d in this service manual replace the enclosure assembly of the faulty server module with a new enclosure assembly Note This procedure must be performed by an Oracle field service representative When you use an enclosure assembly you must move the following parts from the original server module to the same locations in the replacement enclosure assembly Drives drive fillers DIMMs REM FEMs SP ID PRO...

Page 120: ...er the drive fillers from the original server module to the enclosure assembly See Remove a Drive Filler on page 67 and Install a Drive Filler on page 67 5 Transfer the DIMMs from the original server module to the enclosure assembly Move each DIMM to the same slot in the enclosure assembly See Servicing Memory on page 69 6 Transfer the REM from the original server module to the enclosure assembly ...

Page 121: ...the SP Oracle ILOM on page 15 If the replacement service processor detects that the service processor firmware is not compatible with the existing host firmware further action is suspended and the following message is displayed If you see this message go to Step 15 Otherwise go to Step 16 15 Download the system firmware Refer to the Oracle ILOM documentation for instructions 16 Perform diagnostics...

Page 122: ... any customer database that contains RFID data to include data from the RFID on the new enclosure assembly The RFID on the original server module contained different values Related Information Detecting and Managing Faults on page 5 Identifying Components on page 1 ...

Page 123: ...1 Install the Server Module Into the Modular System on page 112 Start the Server Module Host on page 114 Related Information Preparing for Service on page 51 Replace the Cover Perform this task after completing installation or servicing of components inside the server module 1 Set the cover on the server module panel 1 The cover edge hangs over the rear of the server module by about half an inch 1...

Page 124: ... Into the Modular System on page 112 Remove the Cover on page 62 Install the Server Module Into the Modular System Caution Insert a filler panel into an empty modular system slot within 60 seconds of server module removal to ensure proper chassis cooling Caution Hold the server module firmly with both hands so that you do not drop it The server module weighs approximately 17 pounds 8 0 kg 1 Remove...

Page 125: ...e into the chassis panel 2 5 Close both latches simultaneously locking the server module in the modular system chassis panel 3 Once installed the following server module activities take place Standby power is applied The front panel LEDs blinks three times then the green OK LED on the front panel blinks for a few minutes Oracle ILOM is initialized on the server module SP and ready to use but the s...

Page 126: ...server module See Front and Rear Panel Components on page 2 to locate the Power button Access Oracle ILOM on the server module and run the start SYS command Note The server module power on process can take several minutes to complete depending on the amount of installed memory and the configured diagnostic level By default the server module boots the Oracle Solaris OS 2 Perform any diagnostics tha...

Page 127: ...e Generic term for server modules and storage modules blade server Server module C chassis Modular system enclosure CLI Command line interface CMM Chassis monitoring module ILOM runs on the CMM providing lights out management of the components in the modular system chassis See ILOM CMM ILOM ILOM that runs on the CMM See ILOM ...

Page 128: ... module FEMs enable server modules to use the 10GbE connections provided by certain NEMs See NEM FRU Field replaceable unit H HBA Host bus adapter See REM I ILOM Oracle Integrated Lights Out Manager ILOM firmware is preinstalled on a variety of Oracle systems ILOM enables you to remotely manage your Oracle servers regardless of the state of the host system ID PROM Chip that contains system informa...

Page 129: ...M target NEM Network express module NEMs provide 10 100 1000 Ethernet 10GbE Ethernet ports and SAS connectivity to storage modules NET MGT Network management port An Ethernet port on the CMM and on server module service processors NMI Non maskable interrupt O OBP OpenBoot PROM P PCI EM PCIe ExpressModule Modular components that are based on the PCI Express industry standard form factor and offer I...

Page 130: ...ment port A serial port on the CMM and on server modules service processors server module Modular component that provides the main compute resources CPU and memory in a modular system Server modules might also have onboard storage and connectors that hold REMs and FEMs SP Service processor SSH Secure shell storage module Modular component that provides computing storage to the server modules U UCP...

Page 131: ...Glossary 119 W WWID World wide identifier A unique number that identifies a SAS target ...

Page 132: ...120 SPARC T3 1B Server Module Service Manual July 2012 ...

Page 133: ...e 111 components disabled automatically by POST 44 displaying using showcomponent command 45 front and rear panel 2 identifying 1 location 3 managing with ASR 44 configuration guidelines memory 81 configuration reference DIMMs 81 configuring how POST runs 35 cover installing 111 removing 62 D default ILOM password 15 detecting faults 5 diag_level parameter 33 diag_mode parameter 33 diag_trigger pa...

Page 134: ... 14 FEM installing 90 removing 89 topics 89 field replaceable units FRUs displaying status of 25 flash drive installing 102 removing 101 topics 101 fmadm command 30 75 fmadm faulty command 20 fmdump command 28 FRU ID PROMs 13 FRU information displaying 17 FRU names DIMMs 81 H hard drives 63 HDD 63 hot plugging 63 I I O subsystem 32 44 ID PROM 13 installing 98 removing 97 topics 97 verifying 99 ide...

Page 135: ...s 35 configuring 35 faults detected by 8 32 interpreting POST fault messages 39 and memory faults 69 modes and ILOM parameters 33 output 42 overview running 31 running in Diag Mode 37 troubleshooting with 9 using for fault diagnosis 8 POST detected faults 18 power button 57 58 powering on 114 power on self test See POST Predictive Self Healing See PSH Predictive Self Healing PSH see PSH preparing ...

Page 136: ...s DIMMs 81 Solaris OS shutting down 56 Solaris Predictive Self Healing PSH and memory faults 69 SP 93 standby mode 57 58 supported DIMMs 81 system components see components system message log files 24 T time setting 105 tools for service 53 troubleshooting by checking Oracle Solaris OS log files 8 using POST 8 9 using the show faulty command 8 using VTS 8 U Universal Unique Identifier UUID 28 USB ...

Reviews:

No comments

Brands by name

Popular brands

Load more brands