manualshive.com logo in svg

Oracle EXADATA X5-2, Service Manual, Page: 128 / 262

Share
Download
Oracle EXADATA X5-2 Service Manual Download Page 128

Install the Oracle Storage 12 Gb/s SAS PCIe RAID HBA Card

To ensure proper SAS cable connections, see 

“Install SAS Storage Drive

Cables” on page 121

.

4.

Insert the Oracle Storage 12 Gb/s SAS PCIe RAID HBA card into slot 6, and

rotate the PCIe locking mechanism to secure the PCIe HBA card in place [2].

Note - 

PCIe slot 6 is the primary slot for the Oracle Storage 12 Gb/s SAS PCIe RAID HBA

card. The card is required for controlling and managing the SAS storage drives.

5.

Install the super capacitor in the chassis.

a.   

Lower the air baffle to the installed position.

128

Oracle Exadata Storage Server X5-2 High Capacity Service Manual • January 2018

Summary of Contents for EXADATA X5-2

Page 1: ...Oracle Exadata Storage Server X5 2 High Capacity Service Manual Part No E55080 05 January 2018 ...

Page 2: ......

Page 3: ...variety of information management applications It is not developed or intended for use in any inherently dangerous applications including applications that may create a risk of personal injury If you use this software or hardware in dangerous applications then you shall be responsible to take all appropriate fail safe backup redundancy and other measures to ensure its safe use Oracle Corporation a...

Page 4: ...n des informations Ce logiciel ou matériel n est pas conçu ni n est destiné à être utilisé dans des applications à risque notamment dans des applications pouvant causer un risque de dommages corporels Si vous utilisez ce logiciel ou ce matériel dans le cadre d applications dangereuses il est de votre responsabilité de prendre toutes les mesures de secours de sauvegarde de redondance et autres mesu...

Page 5: ...iagnostics 21 Troubleshooting Server Component Hardware Faults 21 Troubleshooting Server Hardware Faults 22 Troubleshooting and Diagnostic Information 26 Troubleshooting Using the Server Front and Rear Panel Status Indicators 26 Troubleshooting System Cooling Issues 31 Troubleshooting Power Issues 33 Managing Server Hardware Faults Through the Oracle ILOM Fault Management Shell 36 Troubleshooting ...

Page 6: ...Down the Server 51 Disconnect Cables From the Server 54 Extend the Server to the Maintenance Position 55 Remove the Server From the Rack 56 Take Antistatic Measures 57 Remove the Server Top Cover 58 Remove the Fan Assembly Door From the Server 59 Servicing Components That Do Not Require Server Power Off 61 Servicing Storage Drives and Rear Drives 61 Storage Drives Hot Plug Conditions 62 Remove a S...

Page 7: ...h Drive 94 Servicing the Battery 96 Remove the Battery 96 Install the Battery 97 Servicing Processors 99 Processor Removal and Replacement Tool 99 Remove a Processor 100 Install a Processor 106 Servicing the Storage Drive Backplanes 112 Remove the Storage Drive Backplane 112 Install the Storage Drive Backplane 116 Servicing SAS Cables 118 Remove SAS Storage Drive Cables 118 Install SAS Storage Dri...

Page 8: ...69 Network Management Port 170 Serial Management Port 171 Video Connector 173 USB Ports 174 Setting Up BIOS Configuration Parameters 177 Managing the BIOS Configuration 177 Accessing the BIOS Setup Utility 178 BIOS Setup Utility Menus 178 BIOS Key Mappings 179 Access BIOS Setup Utility Menus 179 Navigate BIOS Setup Utility Menus 181 Using UEFI 183 Selecting Legacy BIOS or UEFI Boot Mode 183 Switch...

Page 9: ...Console Redirection Options 211 BIOS Advanced Menu Trusted Computing Options 213 BIOS Advanced Menu Network Stack Options 214 BIOS Advanced Menu BMC Network Configuration Options 214 BIOS Advanced Menu iSCSI Configuration Options 218 BIOS Advanced Menu Ethernet Controller Options 220 BIOS IO Menu Selections 221 BIOS IO Menu PCI Subsystem Settings Options 222 BIOS IO Menu IO Virtualization Options ...

Page 10: ...re Components 239 Hard Disk Drive Components 239 Identifying SNMP Trap Messages 241 Environmental Events 241 Hard Disk Drive Events 243 Power Events 244 Fan Events 248 Memory Events 249 Entity Presence Events 255 Physical Security Events 256 Index 257 10 Oracle Exadata Storage Server X5 2 High Capacity Service Manual January 2018 ...

Page 11: ... service personnel who have been instructed on the hazards within the equipment and qualified to remove and replace hardware Required knowledge Advanced experience troubleshooting and replacing hardware Product Documentation Library Documentation and resources for this product and related products are available at http www oracle com goto x5 2l docs Feedback Provide feedback about this documentati...

Page 12: ...12 Oracle Exadata Storage Server X5 2 High Capacity Service Manual January 2018 ...

Page 13: ...connectors on the server About Controls and Connectors on page 14 Review system components About System Components on page 16 Product Description The Oracle Exadata Storage Server X5 2 High Capacity is an enterprise class two rack unit 2U server It supports the following components Two Intel E5 2630 8 core 2 4 GHz 85W processors Four 16 GB DIMMs and four 8 GB DIMMs for a total of 96 GB of memory O...

Page 14: ...age 14 Rear Panel Components and Cable Connections on page 15 Related Information About System Components on page 16 Illustrated Parts Breakdown on page 16 Troubleshooting Using the Server Front and Rear Panel Status Indicators on page 26 Front Panel Components Figure Legend Description 1 Locator LED Locator button white 14 Oracle Exadata Storage Server X5 2 High Capacity Service Manual January 20...

Page 15: ...ation Troubleshooting Using the Server Front and Rear Panel Status Indicators on page 26 Rear Panel Components and Cable Connections Figure Legend Description 1 2 Rear storage drive 0 HDD SSD and storage drive 1 HDD SSD 3 4 10 11 PCIe slots 1 2 4 5 These slots contain the Oracle Flash Accelerator F160 NVMe PCIe Add In Card 5 PCIe slot 3 This slot contains the Sun Dual Port QDR InfiniBand Host Chan...

Page 16: ...sing the Server Front and Rear Panel Status Indicators on page 26 Disconnect Cables From the Server on page 54 Reconnect Power and Data Cables on page 167 Identifying the Server Ports on page 169 About System Components These sections describe the components of the server Illustrated Parts Breakdown on page 16 Field Replaceable Units on page 18 Field Replaceable Units on page 18 Related Informatio...

Page 17: ...em Components Figure Legend Description 1 Twelve 3 5 inch storage drives 2 Front disk backplane for twelve 3 5 inch drives 3 Left LED indicator module About the Oracle Exadata Storage Server X5 2 High Capacity 17 ...

Page 18: ...ent Instructions Battery Lithium coin cell battery that powers the CMOS BIOS and real time clock Servicing the Battery on page 96 DIMMs Add or replace memory in the system Servicing the DIMMs on page 77 Storage drives Replace one of the twelve 3 5 inch hot pluggable SAS HDDs Servicing Storage Drives and Rear Drives on page 61 Fan modules Contains four fan modules for cooling the server components ...

Page 19: ...Ie RAID HBA manages SAS storage drives Servicing the Oracle Storage 12 Gb s SAS PCIe RAID HBA Card on page 123 Front LED USB indicator modules Contain the push button circuitry and LEDs that are displayed on the bezel of the chassis Servicing the Front LED USB Indicator Modules on page 130 Motherboard assembly Provides connectors for the DIMMs processors PCIe risers and other components Servicing ...

Page 20: ...20 Oracle Exadata Storage Server X5 2 High Capacity Service Manual January 2018 ...

Page 21: ...Oracle support Getting Help on page 44 Troubleshooting Server Component Hardware Faults This section contains maintenance related information and procedures that you can use to troubleshoot and repair server hardware issues The following topics are covered Description Section Links Troubleshooting overview information and procedure Troubleshooting Server Hardware Faults on page 22 Resources for tr...

Page 22: ...subsystem containing the fault You can use Oracle ILOM to identify the failed component 2 Prepare the server for service using Oracle ILOM If you have determined that the hardware fault requires service physical access to the server use Oracle ILOM to power off the server activate the Locate LED and take the server offline 3 Prepare the service work space Before servicing the server prepare the wo...

Page 23: ... web interface and command line interface CLI However the procedure can be performed using only the Oracle ILOM CLI interface For more information about the Oracle ILOM web interface and CLI refer to the Oracle ILOM documentation Before beginning this procedure obtain the latest version of the system product notes 1 On a system with network access to the server open a browser window 2 In the web b...

Page 24: ... server subsystem that requires service In the above example the Status screen shows that the Memory subsystem requires service This indicates that a hardware component within the subsystem is in a fault state 5 To identify the component click on Memory in the Status section 24 Oracle Exadata Storage Server X5 2 High Capacity Service Manual January 2018 ...

Page 25: ...des a chronological list of all the system events and faults that have occurred since the log was last reset and includes additional information such as severity levels and error counts The System Log also includes information on devices not reported in the Subsystem Summary screen To access the System Log click the System Log link In this example the hardware fault with DIMM 8 of CPU 0 requires l...

Page 26: ...panel status indicators Troubleshooting Using the Server Front and Rear Panel Status Indicators on page 26 Information about how to manage server hardware faults using the Oracle ILOM Fault Management Shell Managing Server Hardware Faults Through the Oracle ILOM Fault Management Shell on page 36 Troubleshooting Using the Server Front and Rear Panel Status Indicators These sections describe the sta...

Page 27: ...s off and the SP OK LED remains lit no blinking 2 When the server has successfully booted the Power OK LED remains lit When the Power OK LED and the SP OK LED indicators remain lit the server is in full power mode Note The green Power OK LED indicator and the green SP OK indicator remain lit no blinking when the server is in a normal operating state Server System Level Status Indicators There are ...

Page 28: ...host is booting the operating system OS or the server host is running the OS SP OK Green Indicates the state of the service processor OFF Service processor SP is not running SLOW BLINK SP is booting STEADY ON SP is fully operational Top Fan Top Amber Indicates that one or more of the internal fan modules have failed OFF Indicates steady state no service is required STEADY ON Indicates service requ...

Page 29: ...ivity Status indicator LED blinks on and off to indicate activity Service Required Amber OFF The storage drive is operating normally STEADY ON The system has detected a fault with the storage drive OK to Remove Blue STEADY ON The storage drive can be removed safely during a hot plug operation OFF The storage drive has not been prepared for removal If a rear backplane hard disk s OK Activity LED sh...

Page 30: ...k Management Port Status Indicators Status Indicator Name Location Color State and Meaning Activity Top right Green ON Link up OFF No link or down link FLASHING Packet activity Link speed Top left Green Green ON 1000BASE T link OFF 10 100BASE T link Ethernet Ports Status Indicators The server has four Gigabit Ethernet ports NET 3 NET 2 NET 1 and NET 0 There are two status indicators on each port T...

Page 31: ...d from the super capacitor that powers the fault LEDs on the motherboard This LED lights to indicate that the fault remind circuitry is working properly in cases where no components have failed and as a result none of the component fault LEDs illuminate For more information on the fault remind status indicator and the location of the Fault Remind Button see Using the Storage Server Fault Remind Bu...

Page 32: ...de any changes to the server space for example added additional servers The temperature must be consistent and stable Airflow Blockage The server cooling system uses fans to pull cool air in from the server front intake vents and exhaust warm air out the server back panel vents If the front or back vents are blocked the airflow through the server is disrupted and the cooling system fails to functi...

Page 33: ...state Additionally some components such as processors might overheat when they are failing which can also generate an over temperature event To reduce the risk related to component failure power supplies and fan modules are installed in pairs to provide redundancy Redundancy ensures that if one component in the pair fails the other functioning component can continue to maintain the subsystem For e...

Page 34: ... indicator panels which are located at the back of the server on the power supplies Lit green AC OK indicators show a properly functioning power supply An amber AC OK indicator indicates that the AC power to the power supply is insufficient Prevention Use the AC power cord Velcro retaining clips and position the cords to minimize the risk of accidental disconnection Ensure that the AC circuits tha...

Page 35: ... an unexpected shutdown due to a failed power supply The redundancy allows the server to continue to operate if one of the power supplies fails However when a server is being powered by a single power supply the redundancy no longer exists and the risk for downtime or an unexpected shutdown increases When installing a power supply ensure that it is fully seated and engaged with its connector insid...

Page 36: ...d Never operate the server without the top cover installed Managing Server Hardware Faults Through the Oracle ILOM Fault Management Shell The Oracle ILOM Fault Management Shell enables you to view and manage fault activity on a managed servers and other types of devices For more information about how to use the Oracle ILOM Fault Management Shell refer to the Oracle ILOM User s Guide for System Mon...

Page 37: ...operating system is not running Local but remote serial access is possible if the SP serial port is connected to a network accessible terminal server Hardware based LED indicators Hardware and SP firmware Indicates status of overall system and particular components Available when system power is available Local but sensor and indicators are accessible from Oracle ILOM web interface or command line...

Page 38: ...Servers Diagnostics Guide http www oracle com goto x86admindiag docs System indicators and sensors This document Troubleshooting Using the Server Front and Rear Panel Status Indicators on page 26 U Boot or UEFI Diags Oracle x86 Servers Diagnostics Guide http www oracle com goto x86admindiag docs Oracle VTS Oracle VTS software and documentation http docs oracle com cd E19719 01 index html Attaching...

Page 39: ...l Connector Locations on page 39 3 To access the Oracle ILOM command line interface CLI locally using the management port connect a serial null modem cable to the RJ 45 serial port labeled SER MGT See Rear Panel Connector Locations on page 39 4 To interact with the system console locally connect a mouse and keyboard to the USB connectors and a monitor to the DB 15 video connector See Rear Panel Co...

Page 40: ...nnection to the Oracle ILOM service processor The NET MGT port is configured by default to use Dynamic Host Configuration Protocol DHCP The service processor NET MGT port uses an RJ 45 cable for a 10 100 1000BASE T connection 3 Serial management port SER MGT The service processor SER MGT port uses an RJ 45 cable and is the default connection to the Oracle ILOM service processor This port supports ...

Page 41: ...o the SP you need to restore access to the serial port on the server For more details about restoring access to the server port on your server see the Oracle Integrated Lights Out Manager ILOM 3 2 Documentation Library at http www oracle com goto ilom docs You can assign serial port output using either the Oracle ILOM web interface or the command line interface CLI For instructions see the followi...

Page 42: ...the screen 3 Select the Serial Port tab The Serial Port Settings page appears Note The serial port sharing setting by default is Service Processor 4 In the Serial Port Settings page select Host Server as the serial port owner 5 Click Save for the changes to take effect 6 Connect a serial host to the server Ethernet Port Boot Order and Device Naming This section contains information about the boot ...

Page 43: ...y by different interfaces and operating systems The following table shows BIOS physical and operating system logical naming conventions used for each interface These naming conventions might vary depending on conventions of your operating system and which devices are installed in the server Port BIOS Solaris Linux Windows example default names see note below NET 0 3A00 ixgbe 0 eth 0 Ethernet NET 1...

Page 44: ...t NMI Oracle Service use only Getting Help The following sections describe how to get additional help to resolve server related problems Contacting Support on page 45 Locating the Chassis Serial Number on page 45 44 Oracle Exadata Storage Server X5 2 High Capacity Service Manual January 2018 ...

Page 45: ... and a secondary contact Street address where the system is located Superuser password Summary of the problem and the work being done when the problem occurred Other Useful Information IP address Server name system host name Network or internet domain name Proxy server configuration Related Information Locating the Chassis Serial Number on page 45 Locating the Chassis Serial Number You might need ...

Page 46: ...4 The serial number is recorded on the service label that is attached to the top cover of the system The serial number is recorded on the yellow Customer Information Sheet CIS that is attached to your storage server packaging Using Oracle ILOM From the command line interface CLI type the command show System From the web interface view the serial number on the System Information screen 46 Oracle Ex...

Page 47: ...down the server and prepare for servicing Preparing the Server for Component Replacement on page 50 Related Information Returning the Server to Operation on page 161 Safety Precautions For your protection observe the following safety precautions when setting up your equipment Follow all standard cautions warnings and instructions marked on the equipment and described in Oracle Exadata Storage Serv...

Page 48: ... instructions Related Information Safety Precautions on page 47 Electrostatic Discharge Safety on page 48 Electrostatic Discharge Safety Devices that are sensitive to electrostatic discharge ESD such as the motherboard PCIe cards drives processors and memory DIMMs require special handling Caution The boards and drives contain electronic components that are extremely sensitive to static electricity...

Page 49: ...static bag used to wrap an Oracle replacement part An Oracle ESD mat orderable item A disposable ESD mat shipped with some replacement parts or optional system components Related Information Safety Precautions on page 47 Safety Symbols on page 48 Preparing the Server for Component Replacement on page 50 Returning the Server to Operation on page 161 FRU Key Identity Properties KIP Automated Update ...

Page 50: ...wer Supplies on page 71 Servicing the Storage Drive Backplanes on page 112 Servicing the Motherboard Assembly on page 145 Required Tools The server can be serviced with the following tools Antistatic wrist strap Antistatic mat No 2 Phillips screwdriver Related Information Preparing for Service on page 47 Servicing Components That Do Not Require Server Power Off on page 61 Servicing Components That...

Page 51: ...or From the Server on page 59 Related Information Returning the Server to Operation on page 161 Powering Down the Server Determine how you want to power down the server by reviewing the options in the following table Description Link If the server is not responding or you must shut down the server quickly perform an immediate shutdown Power Down the Server for Immediate Shutdown Using the Power Bu...

Page 52: ... Caution When you power down the server using the Power button the server enters standby power mode Power is still directed to the service processor remote management subsystem and power supply fans To completely power off the server you must disconnect the power cords from the power supplies Related Information Server System Level Status Indicators on page 27 Power On the Server on page 167 Power...

Page 53: ...e Server for Immediate Shutdown Using the Oracle ILOM Web Interface on page 53 Power On the Server on page 167 Power Down the Server for Immediate Shutdown Using the Oracle ILOM Web Interface Caution This procedure quickly forces the server main power off You might corrupt your system data during an immediate power down so use this procedure to power down the server only after attempting the grace...

Page 54: ...ies standby power to the circuit boards even when the system is powered off 1 Depending on the components that you are servicing either extend the server to the maintenance position or remove the server from the rack 2 Power down the server See Powering Down the Server on page 51 3 Disconnect the power cords from the rear of the server 4 Disconnect all data cables from the rear of the server 5 Det...

Page 55: ...lt devices For instructions for stabilizing the rack refer to Stabilize the Rack for Installation in Oracle Exadata Storage Server X5 2 High Capacity Installation Guide 2 Verify that no cables will be damaged or will interfere when the server is extended Although the cable management arm CMA that is supplied with the server is hinged to accommodate extending the server you should ensure that all c...

Page 56: ... now in the extended maintenance position Related Information Disconnect Cables From the Server on page 54 Remove the Server From the Rack on page 56 Reinstall the Server in the Rack on page 164 Remove the Server From the Rack Caution The server weighs approximately 63 pounds 28 5 kg Two people are required to unmount and carry the chassis 1 Disconnect all the cables and power cords from the serve...

Page 57: ...he server and pull the server out of the rack until is free of the rack rails 1 and 2 A slide rail release tab is located on each slide rail 5 Set the server on a sturdy work surface Related Information Disconnect Cables From the Server on page 54 Extend the Server to the Maintenance Position on page 55 Reinstall the Server in the Rack on page 164 Take Antistatic Measures 1 Prepare an antistatic s...

Page 58: ...ponents Related Information Extend the Server to the Maintenance Position on page 55 Remove the Server From the Rack on page 56 Remove the Server Top Cover on page 58 Remove the Fan Assembly Door From the Server on page 59 Remove Antistatic Measures on page 164 Remove the Server Top Cover Caution If you remove the top cover without first removing the AC power cords then not only will the server ho...

Page 59: ... up and remove the top cover 2 Related Information Take Antistatic Measures on page 57 Remove the Fan Assembly Door From the Server on page 59 Install the Server Top Cover on page 161 Remove the Fan Assembly Door From the Server Before you service the server s storage drive backplane you should first remove the server s front fan assembly door 1 Ensure that the AC power cords are disconnected from...

Page 60: ...ssis 1 3 Slide the fan assembly door toward the rear of the server and lift and remove the door from the chassis 2 Related Information Take Antistatic Measures on page 57 Remove the Server Top Cover on page 58 Install the Server Top Cover on page 161 Install the Fan Assembly Door on page 163 60 Oracle Exadata Storage Server X5 2 High Capacity Service Manual January 2018 ...

Page 61: ...n page 61 Service fan modules Servicing Fan Modules on page 66 Service power supplies Servicing Power Supplies on page 71 Related Information Servicing Components That Require Server Power Off on page 77 Servicing Storage Drives and Rear Drives These sections describe how to remove and install storage drives Storage Drives Hot Plug Conditions on page 62 Remove a Storage Drive on page 62 Install a ...

Page 62: ... Drive Indicators on page 29 Remove a Storage Drive on page 62 Install a Storage Drive on page 65 Remove a Storage Drive 1 Prepare the system for the drive removal Refer to Take Antistatic Measures on page 57 2 Type the operating system commands required to stop the server from using the drive The exact commands required depend on the configuration of your drives Unmount file systems or issue RAID...

Page 63: ...and Boot Drive Indicators on page 29 Figure Legend Description Figure Legend Description 1 Storage drive 8 HDD 7 Storage drive 10 HDD 2 Storage drive 4 HDD 8 Storage drive 6 HDD 3 Storage drive 0 HDD 9 Storage drive 2 HDD 4 Storage drive 9 HDD 10 Storage drive 11 HDD 5 Storage drive 5 HDD 11 Storage drive 7 HDD 6 Storage drive 1 HDD 12 Storage drive 3 HDD Servicing Components That Do Not Require S...

Page 64: ...en the drive latch 1 2 Figure Legend Description 1 Pressing the latch release button 2 Opening the latch Caution The latch is not an ejector Do not open the latch too far to the right Doing so can damage the latch 64 Oracle Exadata Storage Server X5 2 High Capacity Service Manual January 2018 ...

Page 65: ... with another storage drive otherwise the server might overheat due to improper airflow Related Information Storage and Boot Drive Indicators on page 29 Storage Drives Hot Plug Conditions on page 62 Install a Storage Drive on page 65 Install a Storage Drive 1 Remove the replacement drive from its packaging and place the drive on an antistatic mat 2 If necessary remove the drive filler panel Servic...

Page 66: ...oved 4 Slide the drive into the slot until the drive is fully seated 5 Close the drive latch to lock the drive in place 6 Perform administrative procedures to reconfigure the drive Related Information Storage and Boot Drive Indicators on page 29 Storage Drives Hot Plug Conditions on page 62 Remove a Storage Drive on page 62 Servicing Fan Modules The fan modules are located in the front of the serv...

Page 67: ...ll it right away 1 Extend the server to the maintenance position See Extend the Server to the Maintenance Position on page 55 2 To access the fan modules open the top cover fan assembly door Caution Close the top cover fan assembly door within 60 seconds to maintain adequate airflow to properly cool the server Leaving the door open for more than 60 seconds while the server is running will cause th...

Page 68: ...n in the following figure LED Color and State Meaning Amber The fan module is faulty The front Top Fan LED and the front and rear panel Service Required LEDs are also lit if the system detects a fan module fault Green Indicates that the fan module is correctly installed and operating within specification 68 Oracle Exadata Storage Server X5 2 High Capacity Service Manual January 2018 ...

Page 69: ...at 2 Caution When removing a fan module do not rock it back and forth Rocking the fan module can cause damage to the motherboard connectors Caution Do not service any other components in the fan compartment unless the system is shut down and the power cords are removed 6 Consider your next step If you removed the fan assembly as part of another procedure return to that procedure Otherwise continue...

Page 70: ... an antistatic mat 2 With the top cover fan assembly door open install the replacement fan module into the server 1 The fan modules are keyed to ensure that they are installed in the correct orientation 3 Press down on the fan module and apply firm pressure to fully seat the fan module 70 Oracle Exadata Storage Server X5 2 High Capacity Service Manual January 2018 ...

Page 71: ...Power Supplies The server s redundant power supplies support concurrent maintenance which enables you to remove and replace a power supply without shutting down the server provided that the other power supply is online and working The server supports model A258 1000 watt power supplies The A258 power supply unit PSU provides conversion from the AC lines to the system accepting ranges from 100 240 ...

Page 72: ...y power supply Rear Power Supply Fault LED located on the server front panel If a power supply fails and you do not have a replacement available leave the failed power supply installed to ensure proper airflow in the server For more information refer to the following sections Power Supply Status Indicators on page 29 Remove a Power Supply on page 73 Install a Power Supply on page 75 Related Inform...

Page 73: ...nto the Oracle Solaris OS and issue the fmadm faulty command or log into the Oracle ILOM service processor from the Oracle ILOM Fault Management Shell and issue the fmadm faulty command Note The fans of a failed power supply might still be spinning when the system is powered on The fans will stop spinning when you disconnect the power cords 2 Gain access to the rear of the server where the faulty ...

Page 74: ...u have reconnected both of the left side connectors 4 Disconnect the power cord from the faulty power supply 5 Grasp the power supply handle and push the power supply latch to the left 1 6 Pull the power supply out of the chassis 2 Caution Whenever you remove a power supply you should replace it with another power supply otherwise the server might overheat due to improper airflow 7 Continue to Ins...

Page 75: ...lacement power supply with the empty power supply slot 3 Slide the power supply into the slot until it is fully seated You will hear an audible click when the power supply fully seats 4 Reconnect the power cord to the power supply 5 Verify that the amber Service Required LED on the replaced power supply and the Service Required LEDs are not lit on the front and rear panels Servicing Components Tha...

Page 76: ... Power Supply 1 does not contain FRU TLI data and therefore does not require an SP reset after replacement 6 Reconnect the two CMA left side connectors For instructions for reconnecting the CMA left side connectors see Install the Cable Management Arm in Oracle Exadata Storage Server X5 2 High Capacity Installation Guide Related Information Rear Panel Components and Cable Connections on page 15 Po...

Page 77: ... and rear storage drive backplanes Servicing the Storage Drive Backplanes on page 112 Service SAS cables Servicing SAS Cables on page 118 Service the Sun Storage 12 Gb SAS PCIe RAID HBA card and super capacitor Servicing the Oracle Storage 12 Gb s SAS PCIe RAID HBA Card on page 123 Service the front indicator LED USB modules Servicing the Front LED USB Indicator Modules on page 130 Service the mot...

Page 78: ...ading DIMMs DIMM and Processor Physical Layout on page 78 DIMM Population Rules on page 79 DIMM Rank Classification Labels on page 79 Inconsistencies Between DIMM Fault Indicators and the BIOS Isolation of Faulty DIMMs on page 80 Using the Storage Server Fault Remind Button on page 80 Identify and Remove a Faulty DIMM on page 81 Install a DIMM on page 84 Related Information Servicing Processors on...

Page 79: ...MMs RDIMMs on Processor 0 and four 8 GB single rank SR Registered DIMMs RDIMMs on Processor 1 Within a memory channel DIMMs must be populated in the black sockets The storage server does not support DIMMs in the white sockets or the black sockets with white tabs DIMM Rank Classification Labels DIMMs come in a variety of ranks single dual or quad Each DIMM is shipped with a label identifying its ra...

Page 80: ... fault status indicator LED associated with the failed DIMM lights The fault LEDs for the other DIMMs in the memory channel remain off Therefore you can correctly identify the failed DIMM Using the Storage Server Fault Remind Button When the server Fault Remind button is pressed an LED located next to the Fault Remind button lights green to indicate that there is sufficient voltage present in the ...

Page 81: ...e server power supplies See Powering Down the Server on page 51 b Extend the server into the maintenance position See Extend the Server to the Maintenance Position on page 55 c Attach an antistatic wrist strap to your wrist and then to a metal area on the chassis See Electrostatic Discharge Safety on page 48 Servicing Components That Require Server Power Off 81 ...

Page 82: ... DIMM by pressing the Fault Remind button on the motherboard I O card See Using the Storage Server Fault Remind Button on page 80 Faulty DIMMs are identified with a corresponding amber LED on the motherboard If the DIMM fault LED is off then the DIMM is operating properly If the DIMM fault LED is on amber then the DIMM is faulty and should be replaced 1 82 Oracle Exadata Storage Server X5 2 High C...

Page 83: ...emove it from the socket 4 Replace each faulty DIMM with either another DIMM of the same rank size dual rank or single rank or leave the socket empty For DIMM replacement instructions see Install a DIMM on page 84 Related Information DIMM and Processor Physical Layout on page 78 DIMM Population Rules on page 79 DIMM Rank Classification Labels on page 79 Install a DIMM on page 84 Servicing Componen...

Page 84: ... DIMM Population Rules on page 79 3 Install a DIMM a Ensure that the ejector tabs are in the open position b Align the notch in the replacement DIMM with the connector key in the connector socket The notch ensures that the DIMM is oriented correctly c Push the DDR4 DIMM into the connector socket until the ejector tabs lock the DIMM in place 84 Oracle Exadata Storage Server X5 2 High Capacity Servi...

Page 85: ...eat Step 3 until all replacement DIMMs are installed 5 Return the server to operation a Lower the air baffle to the installed position b Install the server top cover See Install the Server Top Cover on page 161 c Return the server to the normal rack position See Return the Server to the Normal Rack Position on page 165 d Reconnect the power cords and data cables to the server Servicing Components ...

Page 86: ...scribe how to service and install PCIe cards Refer to your PCIe card documentation for complete software and cabling information about your card Caution The procedures in this section should not be used to service the Oracle Storage 12 Gb SAS PCIe RAID HBA card that is located in PCIe slot 6 Caution These procedures require that you handle components that are sensitive to electrostatic discharge T...

Page 87: ...erator F160 NVMe PCIe Add In Card 2 PCIe slot 2 Contains the Oracle Flash Accelerator F160 NVMe PCIe Add In Card 3 PCIe slot 3 Contains the Sun Dual Port QDR InfiniBand Host Channel Adapter for PCIExpress Gen 3 4 PCIe slot 4 Contains the Oracle Flash Accelerator F160 NVMe PCIe Add In Card 5 PCIe slot 5 Contains the Oracle Flash Accelerator F160 NVMe PCIe Add In Card 6 PCIe slot 6 Contains the Orac...

Page 88: ...ttach an antistatic wrist strap See Electrostatic Discharge Safety on page 48 d Remove the server top cover See Remove the Server Top Cover on page 58 e Swivel the air baffle into the upright position to allow access to PCIe cards 2 Locate the PCIe card that you want to remove See PCIe Slot Locations on page 87 3 If necessary make a note of where the PCIe cards are installed 4 Unplug all data cabl...

Page 89: ... and then lift up on the PCIe card to disengage it from the motherboard connectors 2 6 Place the PCIe card on an antistatic mat Related Information PCIe Slot Locations on page 87 Install a PCIe Card on page 90 Servicing Components That Require Server Power Off 89 ...

Page 90: ...static mat 2 Locate the proper PCIe slot for the card you are replacing 3 If necessary remove the PCIe filler panel from the slot Note Save this filler panel in case you ever need to remove the PCIe card from the system 90 Oracle Exadata Storage Server X5 2 High Capacity Service Manual January 2018 ...

Page 91: ...PCIe locking mechanism to secure the PCIe card in place 2 5 Reconnect the cables to the PCIe card that you unplugged during the removal procedure 2 6 Return the server to operation a Lower the air baffle to the installed position Servicing Components That Require Server Power Off 91 ...

Page 92: ...faults For information on how to use the Oracle ILOM web interface or the CLI to clear server faults see the Oracle Integrated Lights Out Manager ILOM 3 2 Documentation Library at http www oracle com goto ilom docs 8 To determine whether additional steps are required to complete the installation of the PCIe card refer to the storage server product notes for the type of PCIe card you installed Rela...

Page 93: ...ated Information USB Ports on page 174 Remove the Internal USB Flash Drive 1 Prepare the server for service a Power off the server and disconnect the power cords from the server power supplies See Powering Down the Server on page 51 b Extend the server into maintenance position See Extend the Server to the Maintenance Position on page 55 c Attach an antistatic wrist strap to your wrist and then to...

Page 94: ...rasp the flash drive and pull it from the slot Related Information Install the Internal USB Flash Drive on page 94 Install the Internal USB Flash Drive 1 Unpack the replacement USB flash drive 94 Oracle Exadata Storage Server X5 2 High Capacity Service Manual January 2018 ...

Page 95: ... to the normal rack position See Return the Server to the Normal Rack Position on page 165 c Reconnect the power cords to the server power supplies and power on the server See Reconnect Power and Data Cables on page 167 and Power On the Server on page 167 Verify that the AC OK LED is lit Related Information Remove the Internal USB Flash Drive on page 93 Servicing Components That Require Server Pow...

Page 96: ... Remove the Battery on page 96 Install the Battery on page 97 Remove the Battery 1 Prepare the server for service a Power off the server and disconnect the power cords from the server power supplies See Powering Down the Server on page 51 b Extend the server into the maintenance position See Extend the Server to the Maintenance Position on page 55 c Attach an antistatic wrist strap to your wrist a...

Page 97: ...etainer 3 Lift the battery up and out of its retainer Related Information Install the Battery on page 97 Install the Battery 1 Unpack the replacement battery 2 Press the new battery into the battery retainer with the positive side facing the server chassis side wall Servicing Components That Require Server Power Off 97 ...

Page 98: ...S Setup Utility to reprogram the host clock For the BIOS Main menu that supports this procedure refer to the Oracle X5 Series Servers Administration Guide at http www oracle com goto x86admindiag docs 4 Return the server to operation a Lower the air baffle to the installed position b Install the server top cover See Install the Server Top Cover on page 161 c Return the server to the normal rack po...

Page 99: ...or on page 100 Install a Processor on page 106 Related Information Servicing the DIMMs on page 77 Processor Removal and Replacement Tool Caution The correct color coded processor removal and replacement tool part number G29477 002 or later must be used to remove and replace a processor otherwise the processor or the processor socket might be damaged The Oracle Exadata Storage Server X5 2 High Capa...

Page 100: ...ver to the maintenance position See Extend the Server to the Maintenance Position on page 55 d Remove the server top cover See Remove the Server Top Cover on page 58 e Swivel the air baffle into the upright position to allow access to the processors 2 Identify the location of the faulty processor by pressing the Fault Remind button on the motherboard I O card Note When the Fault Remind button is p...

Page 101: ...essors If the processor Fault LED is off then the processor is operating properly If the processor Fault LED is on amber then the processor is faulty and should be replaced Figure Legend Description 1 Fault Remind button 2 Fault Remind LED 3 Processor 0 LED 4 Processor 1 LED Servicing Components That Require Server Power Off 101 ...

Page 102: ... the heatsink using a No 2 Phillips screwdriver 2 Turn the screws counterclockwise alternately one and one half turns until they are fully released 4 To separate the heatsink from the top of the processor gently twist the heatsink left and right while pulling upward and then lift off the heatsink and place it upside down on a flat surface 102 Oracle Exadata Storage Server X5 2 High Capacity Servic...

Page 103: ... side away from the processor and then rotating the lever upward 3 8 To lift the ILM assembly load plate off of the processor socket rotate the processor release lever on the right side of the processor toward the closed position the ILM assembly load plate is lifted up as the release lever is lowered toward the closed position and carefully swing the ILM load plate to the fully open position 4 Ca...

Page 104: ...l to release the center button and engage the processor 3 An audible click indicates that the processor is engaged d Grasp the tool by the sides and remove it from the server 4 e Turn the tool upside down and verify that it contains the processor 5 f While holding the processor tool upside down press the center button on the tool to release the processor 5 g Carefully grasp the processor by the fr...

Page 105: ...Remove a Processor h Carefully clean the thermal grease off the top of the processor Related Information Install a Processor on page 106 Servicing Components That Require Server Power Off 105 ...

Page 106: ...adata Storage Server X5 2 High Capacity Installation Guide 4 Ensure that the two processor ILM assembly levers and the ILM assembly load plate are in the fully open position For instructions for opening the processor ILM assembly levers and the load plate see Step 6 through Step 8 of Remove a Processor on page 100 5 To install the replacement processor into the processor removal replacement tool a...

Page 107: ...ower it into place 4 To properly position the tool in the processor socket rotate the tool until the green triangle on the side of the tool is facing the front of the server and it is over the left side of the processor socket when viewing the server from the front and lower the tool into the processor socket e Press the center button on the tool down to release the processor so that it is install...

Page 108: ...or removal replacement tool 6 6 Visually check the alignment of the processor in the socket When properly aligned the processor sits flat in the processor socket 108 Oracle Exadata Storage Server X5 2 High Capacity Service Manual January 2018 ...

Page 109: ...essive downward pressure Do not forcibly seat the processor into the socket Excessive downward pressure might damage the socket pins 7 Swing the processor ILM assembly load plate into the closed position 2 Ensure that the load plate sits flat around the periphery of the processor Servicing Components That Require Server Power Off 109 ...

Page 110: ...ent the heatsink so that the screws line up with the mounting posts 4 Note The processor heatsink is not symmetrical 13 Carefully position the heatsink on the processor aligning it with the mounting posts to reduce movement after it makes initial contact with the layer of thermal grease 4 Caution Avoid moving the heatsink after it has contacted the top of the processor Too much movement could dist...

Page 111: ...s shell 0 SYS MB P0 Properties Commands cd show Alternatively to list all known faults in the server log into the Oracle Solaris OS and issue the fmadm faulty command or log into the Oracle ILOM service processor from the Oracle ILOM Fault Management Shell and issue the fmadm faulty command b To clear the fault identified in Step 16a type the following command set SYS MB P0 clear_fault_action true...

Page 112: ...tall the Storage Drive Backplane on page 116 Related Information Servicing Storage Drives and Rear Drives on page 61 Servicing SAS Cables on page 118 Remove the Storage Drive Backplane 1 Prepare the server for service a Power off the server and disconnect the power cords from the power supplies See Powering Down the Server on page 51 b Extend the server into the maintenance position See Extend the...

Page 113: ...storage drives from the server simply pull them out far enough to disengage them from the disk backplane If you do remove the storage drives from the server make a note of their locations so that you can reinstall them in the same locations 3 Disconnect the cables from the storage drive backplane a Disconnect the SAS cable from the storage drive backplane to the rear mounted storage drives and the...

Page 114: ...drive backplane 2 4 Using a No 2 Phillips screwdriver loosen the right side spring mounted screw that secures the storage drive backplane to the chassis 3 5 Lift the storage drive backplane up to release it from the standoff hooks 4 114 Oracle Exadata Storage Server X5 2 High Capacity Service Manual January 2018 ...

Page 115: ...ge drive backplane away from the standoff hooks and out of the chassis 5 7 Place the storage drive backplane on an antistatic mat Related Information Install the Storage Drive Backplane on page 116 Servicing Components That Require Server Power Off 115 ...

Page 116: ...backplane into the server and position it to engage the standoff hooks 1 2 Using a No 2 Phillips screwdriver install and tighten the right side spring mounted screw to secure the storage drive backplane to the chassis 2 116 Oracle Exadata Storage Server X5 2 High Capacity Service Manual January 2018 ...

Page 117: ... proper SAS cable connections see Install SAS Storage Drive Cables on page 121 4 Return the server to operation a Install the fan assembly door top cover See Install the Fan Assembly Door on page 163 b Install the fan modules and close the fan assembly door See Install a Fan Module on page 70 c Install all storage drives into the storage drive cage See Install a Storage Drive on page 65 d Return t...

Page 118: ...cing SAS Cables Caution The system supplies power to the cables even when the server is powered off To avoid personal injury or damage to the server you must disconnect power cords before servicing the cables This section covers the following topics Remove SAS Storage Drive Cables on page 118 Install SAS Storage Drive Cables on page 121 Related Information Servicing Storage Drives and Rear Drives ...

Page 119: ...67 f Swivel the air baffle into the upright position to allow access to the SAS storage drive cables g Remove the server s front fan assembly door cover See Remove the Fan Assembly Door From the Server on page 59 2 Disconnect the SAS cables a To disconnect the SAS cables between the Oracle Storage 12 Gb s SAS PCIe RAID HBA card in PCIe slot 6 and the front storage drive backplane press each latch ...

Page 120: ...backplane press each latch and then pull out to disengage the cable from each SAS connector 1 3 Remove the SAS cables from the server Carefully remove the SAS cable bundles from the chassis mid wall Be careful not to snag the cables on the server components 120 Oracle Exadata Storage Server X5 2 High Capacity Service Manual January 2018 ...

Page 121: ...nnect the SAS cables a To reconnect the SAS cables between the front storage drive backplane and the Oracle Storage 12 Gb s SAS PCIe RAID HBA card plug each cable into its SAS connector until you hear an audible click 1 See also Install the Oracle Storage 12 Gb s SAS PCIe RAID HBA Card on page 127 Use the following table to ensure proper SAS cable connections System Disk Configuration Disk Backpla...

Page 122: ...torage drive backplane and rear storage drive backplane 3 Return the server to operation a Install the server s front fan assembly door cover See Install the Fan Assembly Door on page 163 b Lower the air baffle to the installed position 122 Oracle Exadata Storage Server X5 2 High Capacity Service Manual January 2018 ...

Page 123: ...Cables on page 118 Servicing the Oracle Storage 12 Gb s SAS PCIe RAID HBA Card These sections describe how to service and install the Oracle Storage 12 Gb s SAS PCIe RAID HBA card Caution These procedures require that you handle components that are sensitive to electrostatic discharge This sensitivity can cause the components to fail To avoid damage ensure that you follow antistatic practices as d...

Page 124: ...intenance position See Extend the Server to the Maintenance Position on page 55 c Attach an antistatic wrist strap See Electrostatic Discharge Safety on page 48 d Remove the server top cover See Remove the Server Top Cover on page 58 2 Remove the super capacitor from the chassis a Grasp both ends of the cable connector press in on the release latch and then unplug the connector 1 The HBA super cap...

Page 125: ...rd Place the super capacitor on an antistatic mat 3 Swivel the air baffle into the upright position to allow access to the super capacitor cable and the Oracle Storage 12 Gb s SAS PCIe RAID HBA card Servicing Components That Require Server Power Off 125 ...

Page 126: ...nd the SAS cables from the Oracle Storage 12 Gb s SAS PCIe RAID HBA card 2 See also Remove SAS Storage Drive Cables on page 118 6 Lift and remove the Oracle Storage 12 Gb s SAS PCIe RAID HBA card and super capacitor cable from the chassis 7 Place the Oracle Storage 12 Gb s SAS PCIe RAID HBA card and super capacitor cable on an antistatic mat 126 Oracle Exadata Storage Server X5 2 High Capacity Ser...

Page 127: ...orage 12 Gb s SAS PCIe RAID HBA card and super capacitor and place them on an antistatic mat 2 Swivel the air baffle into the upright position and install the super capacitor cable along the left sidewall of the chassis 3 Connect the super capacitor cable to the Oracle Storage 12 Gb s SAS PCIe RAID HBA and then reconnect the SAS cables that you unplugged during the removal procedure 1 Servicing Co...

Page 128: ...6 and rotate the PCIe locking mechanism to secure the PCIe HBA card in place 2 Note PCIe slot 6 is the primary slot for the Oracle Storage 12 Gb s SAS PCIe RAID HBA card The card is required for controlling and managing the SAS storage drives 5 Install the super capacitor in the chassis a Lower the air baffle to the installed position 128 Oracle Exadata Storage Server X5 2 High Capacity Service Ma...

Page 129: ...closable fastener to the underside of the super capacitor c Align the reclosable fastener on the super capacitor with the reclosable fastener on the air baffle and press down 1 d Connect the super capacitor s cable 2 Servicing Components That Require Server Power Off 129 ...

Page 130: ...e ILOM web interface or the command line interface CLI to manually clear faults For information on how to use the Oracle ILOM web interface or the CLI to clear server faults see the Oracle Integrated Lights Out Manager ILOM 3 2 Documentation Library at http www oracle com goto ilom docs Related Information Remove the Sun Storage 12 Gb s SAS PCIe RAID HBA Card on page 124 Servicing the Front LED US...

Page 131: ...onnect the power cords from the power supplies See Powering Down the Server on page 51 b Extend the server into the maintenance position See Extend the Server to the Maintenance Position on page 55 c Attach an antistatic wrist strap to your wrist and then to a metal area on the chassis See Take Antistatic Measures on page 57 d Remove the server top cover See Remove the Server Top Cover on page 58 ...

Page 132: ...y to the server chassis 4 Remove the fan modules from the server See Remove a Fan Module on page 67 5 Disconnect all cables from the front storage drive backplane See the procedures for your storage drive configuration in Servicing the Storage Drive Backplanes on page 112 132 Oracle Exadata Storage Server X5 2 High Capacity Service Manual January 2018 ...

Page 133: ... and 2 7 Slide the disk cage assembly forward and then gently lift the disk cage assembly from the chassis 3 Set the disk cage assembly on an anti static mat 8 Remove the left LED indicator module a Remove the two No 2 Phillips screws that secure the LED indicator module to the server front panel 1 Servicing Components That Require Server Power Off 133 ...

Page 134: ... the side of the disk cage assembly b Remove the LED indicator module from the server front panel 2 Related Information Server System Level Status Indicators on page 27 Install the Left LED Indicator Module on page 135 134 Oracle Exadata Storage Server X5 2 High Capacity Service Manual January 2018 ...

Page 135: ... the LED indicator module and cable through the left LED housing on the server front panel 1 If necessary use a piece of capping tape to secure the cable to the side of the disk cage assembly Note Cable part number 7064122 is required for the left LED indicator module Servicing Components That Require Server Power Off 135 ...

Page 136: ...server chassis to ensure that the disk cage screw holes are correctly aligned with the server chassis 3 Reconnect the left LED indicator module cable and the right LED USB indicator module cable to the motherboard 2 and 3 4 Reconnect all cables to the front storage drive backplane See the procedures for your storage drive configuration in Servicing the Storage Drive Backplanes on page 112 136 Orac...

Page 137: ...a Install the server top cover See Install the Server Top Cover on page 161 b Return the server to the normal rack position See Return the Server to the Normal Rack Position on page 165 c Reconnect the power cords to the power supplies and power on the server See Reconnect Power and Data Cables on page 167 and Power On the Server on page 167 Verify that the power supply AC OK LED is lit Related In...

Page 138: ...ion on page 55 c Attach an antistatic wrist strap to your wrist and then to a metal area on the chassis See Take Antistatic Measures on page 57 d Remove the server top cover See Remove the Server Top Cover on page 58 2 Remove the server fan assembly door See Remove the Fan Assembly Door From the Server on page 59 3 Remove the four remaining No 2 Phillips screws two on each side of the chassis that...

Page 139: ...ation in Servicing the Storage Drive Backplanes on page 112 6 Disconnect the left LED indicator module cable and the right LED USB indicator module cable from the motherboard 1 and 2 7 Slide the disk cage assembly forward and then gently lift the disk cage assembly from the chassis 3 Set the disk cage assembly on an anti static mat 8 Remove the right LED USB indicator module Servicing Components T...

Page 140: ...LED USB indicator module to the server front panel 1 If present remove the capping tape that secures the cable to the side of the disk cage assembly b Remove the LED USB indicator module from the server front panel 2 140 Oracle Exadata Storage Server X5 2 High Capacity Service Manual January 2018 ...

Page 141: ...on page 141 Install the Right LED USB Indicator Module 1 Install the right LED USB indicator module a Push the LED USB indicator module and cable through the right LED housing on the server front panel 1 If necessary use a piece of capping tape to secure the cable to the side of the disk cage assembly Servicing Components That Require Server Power Off 141 ...

Page 142: ...ht LED USB indicator module b Insert and tighten the two No 2 Phillips screws to secure the LED USB indicator module to the server front panel 2 2 Gently lift the disk cage assembly and set it into the server chassis 1 142 Oracle Exadata Storage Server X5 2 High Capacity Service Manual January 2018 ...

Page 143: ...e left LED indicator module cable and the right LED USB indicator module cable to the motherboard 2 and 3 4 Reconnect all cables to the front storage drive backplane See the procedures for your storage drive configuration in Servicing the Storage Drive Backplanes on page 112 5 Install the fan modules in the server See Install a Fan Module on page 70 Servicing Components That Require Server Power O...

Page 144: ...erver Top Cover on page 161 b Return the server to the normal rack position See Return the Server to the Normal Rack Position on page 165 c Reconnect the power cords to the power supplies and power on the server See Reconnect Power and Data Cables on page 167 and Power On the Server on page 167 Verify that the power supply AC OK LED is lit Related Information Server System Level Status Indicators ...

Page 145: ... that you follow the antistatic practices as described in Electrostatic Discharge Safety on page 48 This section covers the following topics Remove the Motherboard Assembly on page 145 Install the Motherboard Assembly on page 154 Related Information About System Components on page 16 Remove the Motherboard Assembly 1 Prepare the server for service a Power off the server and disconnect the power co...

Page 146: ...led into the slots from which they were removed otherwise the server key identity properties KIP data might be lost When a server requires service the KIP is used by Oracle to verify that the warranty on the server has not expired For more information on KIP see FRU Key Identity Properties KIP Automated Update on page 49 Fan modules See Remove a Fan Module on page 67 SAS storage drive cables See R...

Page 147: ...gnal cable from the motherboard to the front storage drive backplane 2 See Servicing the Storage Drive Backplanes on page 112 8 Disconnect the power cable from the motherboard to the front storage drive backplane 2 See Servicing the Storage Drive Backplanes on page 112 Servicing Components That Require Server Power Off 147 ...

Page 148: ... Using a No 2 Phillips screwdriver remove the screw on each side of the chassis that secures the mid wall to the chassis 3 b Using a No 2 Phillips screwdriver loosen the four green captive screws that secure the chassis mid wall to the bottom of the chassis 4 148 Oracle Exadata Storage Server X5 2 High Capacity Service Manual January 2018 ...

Page 149: ...remove the motherboard from the server with all reusable components that populate the motherboard in place a Carefully slide the motherboard forward and lift it out of the chassis 6 b Place the motherboard assembly on an antistatic mat and next to the replacement motherboard Servicing Components That Require Server Power Off 149 ...

Page 150: ...ts If you do not reinstall the DIMMs in the same slots server performance might be reduced and some DIMMs might not be used USB flash drives See Remove the Internal USB Flash Drive on page 93 and Install the Internal USB Flash Drive on page 94 13 Remove the processors from the failed motherboard See Remove a Processor on page 100 14 Remove the processor socket covers from the replacement motherboa...

Page 151: ...sor and then rotating the lever upward 1 c To lift the processor ILM assembly load plate off of the processor socket rotate the ILM assembly hinge lever on the right side of the processor toward the closed position the load plate is lifted up as the hinge lever is lowered and carefully swing the load plate to the fully open position 2 d Grasp the top and underside of the processor socket cover wit...

Page 152: ...page 106 f Repeat Step a through Step e above to remove the second processor socket cover from the replacement motherboard and install the second processor 15 Install the processor socket covers on the faulty motherboard Caution The processor socket covers must be installed on the faulty motherboard otherwise damage might result to the processor sockets during handling and shipping Caution Be care...

Page 153: ...Remove the Motherboard Assembly a Open one of the processor ILM assemblies on the faulty motherboard 1 and 2 Servicing Components That Require Server Power Off 153 ...

Page 154: ...de of the processor socket cover into the load plate 3 c Close the processor ILM assembly load plate 4 and 5 d Repeat Step a through Step c above to install the second processor socket cover on the faulty motherboard Related Information About System Components on page 16 Field Replaceable Units on page 18 Install the Motherboard Assembly on page 154 Install the Motherboard Assembly 1 Attach an ant...

Page 155: ...upply assembly level the motherboard and place it into the server chassis then slide it to the rear of the server to engage the mushroom shaped standoffs 3 Install the mid wall into the chassis a Lift and place the mid wall into the chassis 2 Servicing Components That Require Server Power Off 155 ...

Page 156: ...is 3 c Using a No 2 Phillips screwdriver insert and tighten the screw on each side of the chassis to secure the mid wall in the chassis 4 4 Reconnect the power cable to the motherboard from the rear storage drive backplane 5 See Servicing the Storage Drive Backplanes on page 112 156 Oracle Exadata Storage Server X5 2 High Capacity Service Manual January 2018 ...

Page 157: ...ng the Storage Drive Backplanes on page 112 6 Reconnect the ribbon cables from left and right LED USB indicator modules to the motherboard 6 See Servicing the Front LED USB Indicator Modules on page 130 7 Reconnect the power cable to the motherboard from the front storage drive backplane 6 Servicing Components That Require Server Power Off 157 ...

Page 158: ... on page 90 SAS storage drive cables See Install SAS Storage Drive Cables on page 121 Fan modules See Install a Fan Module on page 70 10 Install the air baffle Install the air baffle by placing it into the server and lowering it to its installed position 11 Install the Oracle Storage 12 Gb s SAS PCIe RAID HBA card and its associated super capacitor See Install the Oracle Storage 12 Gb s SAS PCIe R...

Page 159: ...oved other quorum member components you might need to manually program the product serial number PSN into the new motherboard For more information refer to FRU Key Identity Properties KIP Automated Update on page 49 Related Information About System Components on page 16 Field Replaceable Units on page 18 Field Replaceable Units on page 18 Remove the Motherboard Assembly on page 145 Servicing Compo...

Page 160: ...160 Oracle Exadata Storage Server X5 2 High Capacity Service Manual January 2018 ...

Page 161: ...o the Normal Rack Position on page 165 Reconnect power and data cables Reconnect Power and Data Cables on page 167 Power on the server Power On the Server on page 167 Related Information Preparing for Service on page 47 Install the Server Top Cover 1 Place the top cover on the chassis Set the cover down so that it hangs over the rear of the server by about 1 inch 25 mm and the side latches align w...

Page 162: ...he cover toward the front of the chassis until it latches into place with an audible click As you slide the cover toward the front of the server watch the green release button You will hear an audible click when the green release button pops up indicating that the cover is locked Related Information Remove the Server Top Cover on page 58 162 Oracle Exadata Storage Server X5 2 High Capacity Service...

Page 163: ...into place 1 3 Use a No 2 Phillips screwdriver to install and secure the fan assembly door 2 If your system is configured with twelve 3 5 inch storage drives install and tighten the two screws on each side of the chassis and the three screws on top of the chassis If your system is configured with twenty four 2 5 inch storage drives install and tighten the two screws on each side of the chassis Rel...

Page 164: ... Guide for the installation instructions specific to your rackmount kit 2 If the cable management arm CMA is not installed that is you removed it because you removed the server completely out of the rack install the CMA For installation instructions for the CMA refer to Install the Cable Management Arm in Oracle Exadata Storage Server X5 2 High Capacity Installation Guide 3 If the cables are disco...

Page 165: ... this procedure to return the server to the normal rack position 1 Push the server back into the rack as described in the following steps a Simultaneously pull and hold the two green release tabs one on each side of the slide rails on the server toward the front of the server while you push the server into the rack As you push the server into the rack verify that the cable management arm CMA retra...

Page 166: ...A is not installed that is you removed it because you removed the server completely out of the rack install the CMA For installation instructions for the CMA refer to Install the Cable Management Arm in Oracle Exadata Storage Server X5 2 High Capacity Installation Guide 3 If the cables are disconnected from the rear of the server that is you disconnected the cables because you extended the server ...

Page 167: ...ary reinstall the cables into the cable management arm and secure them with Velcro straps 4 Power on the server See Power On the Server on page 167 Related Information Disconnect Cables From the Server on page 54 Reinstall the Server in the Rack on page 164 Return the Server to the Normal Rack Position on page 165 Power On the Server on page 167 Power On the Server As soon as the power cords are c...

Page 168: ...command at the Oracle ILOM prompt start System When the server is powered on and the power on self test POST code checkpoint tests have completed the green Power OK status indicator LED on the front panel of the server lights and remains lit Related Information Powering Down the Server on page 51 Reconnect Power and Data Cables on page 167 168 Oracle Exadata Storage Server X5 2 High Capacity Servi...

Page 169: ...4 Related Information About the Oracle Exadata Storage Server X5 2 High Capacity on page 13 Gigabit Ethernet Ports The server has four auto negotiating 100 1000 10GBASE T Gigabit Ethernet GbE system domain ports All four Ethernet ports use a standard RJ 45 connector The transfer rates are shown in the following table TABLE 8 Ethernet Port Transfer Rates Connection Type IEEE Terminology Transfer Ra...

Page 170: ...ons on page 15 Server System Level Status Indicators on page 27 Disconnect Cables From the Server on page 54 Reconnect Power and Data Cables on page 167 Network Management Port The server has one auto negotiating 10 100 1000BASE T Ethernet management domain interface labeled NET MGT For information about configuring this port for managing the server with Oracle ILOM refer to the Oracle Integrated ...

Page 171: ...ons on page 15 Server System Level Status Indicators on page 27 Disconnect Cables From the Server on page 54 Reconnect Power and Data Cables on page 167 Serial Management Port The serial management connector labeled SER MGT is an RJ 45 connector that can be accessed from the rear panel This port is the default connection to the server Use this port only for server management TABLE 11 Default Seria...

Page 172: ...ect to the SER MGT port using a cable with either a DB 9 or a DB 25 connector follow the pin descriptions in the tables to create a crossover adapter appropriate for your serial connection TABLE 13 RJ 45 to DB 9 Adapter Crossovers Wiring Reference Serial Port RJ 45 Connector DB 9 Adapter Pin Signal Description Pin Signal Description 1 RTS 8 CTS 2 DTR 6 DSR 3 TXD 2 RXD 4 Signal ground 5 Signal grou...

Page 173: ...nd 7 Signal ground 6 RXD 2 TXD 7 DSR 20 DTR 8 CTS 4 RTS Related Information Rear Panel Components and Cable Connections on page 15 Disconnect Cables From the Server on page 54 Reconnect Power and Data Cables on page 167 Video Connector The video connector is a DB 15 connector that can be accessed from the back panel TABLE 15 Video Connector Signals Pin Signal Description Pin Signal Description 1 R...

Page 174: ...onents and Cable Connections on page 15 Disconnect Cables From the Server on page 54 Reconnect Power and Data Cables on page 167 USB Ports The server has six USB ports for attaching supported USB 2 0 compliant devices Two USB ports are on the rear panel two USB ports are on the front panel and two USB ports are located on the motherboard TABLE 16 USB Port Signals Pin Signal Description 1 5 V 2 DAT...

Page 175: ...B Ports Related Information Rear Panel Components and Cable Connections on page 15 Disconnect Cables From the Server on page 54 Reconnect Power and Data Cables on page 167 Identifying the Server Ports 175 ...

Page 176: ...176 Oracle Exadata Storage Server X5 2 High Capacity Service Manual January 2018 ...

Page 177: ... how to perform common BIOS setup procedures Common BIOS Setup Utility Tasks on page 187 Related Information BIOS Setup Utility Menu Options on page 203 Managing the BIOS Configuration The BIOS configuration parameters on an Oracle x86 server are manageable from the BIOS Setup Utility and Oracle ILOM For information about using these tools to manage the BIOS configuration refer to Oracle ILOM Main...

Page 178: ...Summary Menu Description Main General product information including memory time date security settings system serial number and CPU and DIMM information Advanced Configuration information for the CPU trusted computing USB and other information Set the IP address for the server SP Note When operating in UEFI Boot Mode Runtime UEFI driver configuration settings let you manage PCIe drivers for all co...

Page 179: ...rl Q Not applicable Activate the Setup Utility Help menu F2 Ctrl E Enter BIOS Setup Utility while the system is performing the power on self test POST Not applicable F7 Ctrl D Not applicable Discard changes Not applicable to UEFI Driver Control menu F8 Ctrl P Activate the BIOS Boot Menu Not applicable F9 Ctrl O Not applicable Activate Load Optimal Values pop up menu Not applicable to UEFI Driver C...

Page 180: ...e server From the local server press the Power button on the front panel of the server to power off the server and then press the Power button again to power on the server From the Oracle ILOM web interface click Host Management Power Control and select Reset from the Select Action list From the Oracle ILOM CLI type reset System The power on self test POST sequence begins 2 To enter the BIOS Setup...

Page 181: ...te BIOS Setup Utility Menus To navigate the menus or options listed on a menu use the arrow keys The currently selected option or sub menu is highlighted For further instructions on how to navigate and change settings in the BIOS Setup Utility refer to the online information provided on the menu 1 Access the BIOS Setup Utility See Access BIOS Setup Utility Menus on page 179 Setting Up BIOS Configu...

Page 182: ...5 Press the Esc key to return from a sub menu screen to the previous menu screen Pressing Esc from a top level menu is equivalent to selecting the Discard Changes and Exit option from the Save Exit Menu 6 Modify parameters as needed 7 Press the F10 key to save your changes and exit the BIOS Setup Utility Alternatively you can select the Exit Menu and then select the Save Changes and Reset to save ...

Page 183: ... the BIOS Setup Utility The boot candidates from the new mode appear in the Boot Options Priority List only after you select Save Changes and Reset from the BIOS Setup Utility menu Use the Oracle ILOM BIOS Backup and Restore function to preserve the BIOS configuration in case you want to switch back to the previously selected mode For information refer to the Oracle Integrated Lights Out Manager I...

Page 184: ...e your changes and reset the host and in the next boot to the BIOS Setup Utility Because the settings for a given mode do not persist after a transition between modes you should use the BIOS Backup and Restore feature to capture and preserve the BIOS configuration if you intend to switch back to the previous boot mode and want to retain your previous BIOS settings For information about the BIOS Ba...

Page 185: ... Add In Cards The method for interacting with configuration utilities for add in cards and system resident I O adapters differs depending on whether Legacy BIOS Boot Mode or UEFI BIOS Boot Mode is used In Legacy BIOS Boot Mode I O adapter utilities are invoked during BIOS POST progression using hot keys identified by the adapter Option ROM during POST When the hot key is pressed the adapter specif...

Page 186: ...age similar to the following message in the Oracle ILOM event log Option ROM Space Exhausted Device XXX Disabled By default all on board Legacy Options ROMs are enabled in the BIOS However you can disable most of these Option ROMs unless they are required to support booting from the associated device or to provide some other boot time function For example it is not necessary to load the Option ROM...

Page 187: ...ult Settings In the BIOS Setup Utility you return the BIOS settings to the optimal factory default values as well as view and edit settings as needed Any changes that you make in the BIOS Setup Utility using the F2 key persist until the next time you change the settings Before you begin ensure that the following requirements are met A hard disk drive or solid state drive is properly installed in t...

Page 188: ...xit the BIOS Setup Utility by navigating to the Exit Menu and selecting Save Changes and Reset Related Information Access BIOS Setup Utility Menus on page 179 BIOS Setup Utility Menus on page 178 BIOS Key Mappings on page 179 Select Legacy BIOS or UEFI BIOS Boot Mode The BIOS firmware supports both Legacy BIOS BOOT Mode and UEFI BIOS Boot Mode The default setting is Legacy BIOS Boot Mode For more ...

Page 189: ...roperly populate the Boot Options Priority list with devices that support the chosen boot mode 4 Use the up and down arrow keys to select the appropriate Legacy or UEFI mode and then press Enter 5 Press F10 to save the changes and exit the BIOS Setup Utility Related Information BIOS Setup Utility Menus on page 178 BIOS Key Mappings on page 179 Setting Up BIOS Configuration Parameters 189 ...

Page 190: ... again to power on the server From the Oracle ILOM web interface click Host Management Power Control and select Reset from the Select Action list From the Oracle ILOM CLI type reset System The server resets 2 Press the F8 key or Ctrl P from a serial connection when prompted while the BIOS is running the power on self test POST The Please Select Boot Device dialog box appears 3 In the dialog select...

Page 191: ...lementing this feature refer to the Windows Trusted Platform Module Management documentation provided by your operating system or third party software vendor 1 Access the BIOS Setup Utility menus See Access BIOS Setup Utility Menus on page 179 2 In the BIOS Setup Utility menus navigate to the Advanced Menu The Advanced Menu screen appears 3 In the Advanced Menu screen select Trusted Computing The ...

Page 192: ...Disabled it is disabled by default Select TPM Support and press Enter A TPM Support dialog box appears 5 In the dialog box set TPM Support to Enable and then press Enter 192 Oracle Exadata Storage Server X5 2 High Capacity Service Manual January 2018 ...

Page 193: ...ation Configure SP Network Settings Choose one of the following methods to specify service processor SP network settings BIOS Assign the IP address for the server SP from the BIOS Setup Utility on the Advanced Menu Oracle ILOM For instructions on setting the IP address for the server SP using Oracle ILOM refer to the Oracle Integrated Lights Out Manager ILOM 3 2 Documentation Library at http www o...

Page 194: ...page 179 2 In the BIOS Setup Utility menus navigate to the Advanced Menu The Advanced Menu screen appears 3 In the Advanced Menu select BMC Network Configuration and then press Enter The BMC Network Configuration screen appears 194 Oracle Exadata Storage Server X5 2 High Capacity Service Manual January 2018 ...

Page 195: ...onfigure SP Network Settings The BMC is the Baseboard Management Controller 4 Select Refresh and then press Enter to display the current BMC network settings Setting Up BIOS Configuration Parameters 195 ...

Page 196: ...alues 6 Press the F10 key to save the changes and exit the BIOS Setup Utility Related Information BIOS Setup Utility Menus on page 178 Configure Option ROM Settings 1 Access the BIOS Setup Utility menus See Access BIOS Setup Utility Menus on page 179 2 In the BIOS Setup Utility menus navigate to the IO Menu 196 Oracle Exadata Storage Server X5 2 High Capacity Service Manual January 2018 ...

Page 197: ... screen appears 3 In the IO Menu select either Internal Devices or Add In Cards and press Enter to display the internal device or add in card slot for which you want to enable or disable Option ROM Setting Up BIOS Configuration Parameters 197 ...

Page 198: ...OM Settings The Internal Devices or Add In Cards screen appears 4 Select the internal device or add In card slot that you want to configure 198 Oracle Exadata Storage Server X5 2 High Capacity Service Manual January 2018 ...

Page 199: ...owing Select Enabled to enable the Option ROM setting Select Disabled to disable the Option ROM setting 6 Press the F10 key to save the changes and exit the BIOS Setup Utility Related Information Legacy Option ROM Allocation on page 186 Access BIOS Setup Utility Menus on page 179 BIOS Setup Utility Menus on page 178 Setting Up BIOS Configuration Parameters 199 ...

Page 200: ... the following Select Enabled to enable I O resource allocation for the I O card Select Disabled to disable I O resource allocation for the I O card 6 Press the F10 key to save the changes and exit the BIOS Setup Utility Related Information Access BIOS Setup Utility Menus on page 179 BIOS Setup Utility Menus on page 178 Exit BIOS Setup Utility 1 Use the left and right arrow keys to navigate to the...

Page 201: ...settings and selecting Save Changes and Exit from the Exit Menu the subsequent reboot might take longer than a typical reboot where no settings were modified The additional delay is required to ensure that changes to the BIOS settings are synchronized with Oracle ILOM Related Information Access BIOS Setup Utility Menus on page 179 BIOS Setup Utility Menus on page 178 Setting Up BIOS Configuration ...

Page 202: ...202 Oracle Exadata Storage Server X5 2 High Capacity Service Manual January 2018 ...

Page 203: ...anced Menu Selections on page 207 Review the BIOS IO Menu selections BIOS IO Menu Selections on page 221 Review the Boot Menu selections BIOS Boot Menu Selections on page 225 Review the BIOS Exit Menu selections BIOS Exit Menu Selections on page 226 Related Information Oracle X5 Series Servers Administration Guide at http www oracle com goto x86admindiag docs Setting Up BIOS Configuration Paramete...

Page 204: ...entifier used to reference a specific BIOS release Format is XXYYZZPP which indicates XX Unique project platform code YY BIOS major release ZZ BIOS minor release PP Build number Example 18 01 04 01 System Date Current date is displayed You can change the date setting Example Thu 06 20 2014 System Time Current time is displayed You can change the time setting Example 13 38 27 204 Oracle Exadata Sto...

Page 205: ... 2 0 0 r84011 PRODUCT INFORMATION R O Product information is displayed Product Name Product name is displayed Example Oracle Exadata Storage Server X5 2 High Capacity Product Serial Number Product serial number is displayed Example 1134FML00V Board Serial Number Board serial number is displayed Example 0328MSL 1132U900 CPU INFORMATION R O Attributes of a single processor CPU are defined A separate...

Page 206: ...her Intel Virtualization Technology is supported L1 Data Cache Example 448 L1 Code Cache Example 448 L2 Cache Example 3584 KB L3 Cache Example 35840 KB Socket 1 CPU Information R O If CPU socket 1 is populated the same options as Socket 0 CPU Information are displayed Otherwise displays Not Present DIMM INFORMATION R O Memory module DIMM presence and size information are displayed Socket 0 DIMMs R...

Page 207: ...that follow Options in the tables that are marked as R O are read only information and cannot be changed The following sections describe the BIOS Advanced Menu options BIOS Advanced Menu Processor Configuration Options on page 208 BIOS Advanced Menu CPU Power Management Configuration Options on page 209 BIOS Advanced Menu Memory Configuration Option on page 210 BIOS Advanced Menu USB Ports Options...

Page 208: ... is available Active Processor Cores A minimum of one up to the maximum number of cores available in the processor package All The number of cores to enable in each processor package Execute Disable Bit Disabled Enabled Enabled When disabled forces XD features flag to always return 0 Hardware Prefetcher Disabled Enabled Enabled Enable the mid level cache MLC streamer prefetcher MSR 1A4h bit 0 Adja...

Page 209: ...edStep Technology EIST Turbo Mode Enabled Disabled Enabled Enabled mode is supported only if Turbo Mode is supported in the CPU Enabled mode also requires that Enhanced Multi Threaded Thermal Monitoring EMTTM be enabled on the CPU CPU C3 report Enabled Disabled Disabled Enable disable the CPU C3 ACPI C3 report to the operating system CPU C6 report Enabled Disabled Enabled Enable disable the CPU C6...

Page 210: ...ts options TABLE 23 BIOS Advanced Menu USB Ports Setup Options Options Defaults Description EHCI Hand off Disabled Enabled Disabled Enable or disable Enhanced Host Controller Interface EHCI hand off support This is a workaround for operating systems without EHCI hand off support The EHCI change of ownership should be claimed by the EHCI driver Port 60 64 Emulation Disabled Enabled Enabled Enable I...

Page 211: ...direction Options The following table describes the BIOS Advanced Menu serial port console redirection options TABLE 24 BIOS Advanced Menu Serial Port Console Redirection Options Setup Options Options Defaults Description EMS Console Redirection Disabled Enabled Disabled Enable or disable console redirection for Windows Emergency Management Service EMS administration Console Redirection Disabled E...

Page 212: ...is odd Mark Parity bit is always 1 Space Parity bit is always 0 Mark and Space parity do not allow for error detection They can be used as an additional data bit Stop Bits 1 2 1 Stop bits indicate the end of a serial data packet A start bit indicates the beginning of a serial data packet The standard setting is 1 stop bit Communication with slow devices may require more than 1 stop bit Flow Contro...

Page 213: ...hether TPM Support is enabled Note This option is available only if TPM Support is set to enabled Pending Operation None Enable Take Ownership Disable Take Ownership TPM Clear None Used to schedule an operation for the security device Note Your computer will reboot during restart in order to change the state of a security device Current Status Information If TPM Support is disabled Current Status ...

Page 214: ...stack Ipv4 PXE Support Disabled Enabled Enabled Enable or disable IPv4 PXE Boot support If disable the IPv4 Boot Option will not be created Ipv6 PXE Support Disabled Enabled Disabled Enable or disable IPv6 PXE Boot support If disable the IPv6 Boot Option will not be created BIOS Advanced Menu BMC Network Configuration Options The following table describes the BIOS Advanced Menu BMC network configu...

Page 215: ...DHCP Current IPv4 address in BMC R O NA NA Displays the current IPv4 address in the BMC Current IPv4 MAC Address in BMC R O NA NA If IPv4 Assignment is set to Static set the IPv4 address for the service processor Example 172 31 255 255 Current IPv4 Subnet Mask in BMC R O NA NA If the IPv4 Assignment is set to Static set the IPv4 subnet mask Example 255 255 255 0 Current IPv4 Default Gateway in BMC...

Page 216: ...ros with a double colon For example 2001 db0 0 82a1 1234 abcd Channel Number R O 1 Current channel number is displayed Current IPv6 State R O Enabled Disabled Enabled Current IPv6 state is displayed Current IPv6 Auto Configuration R O Stateful Stateless Stateless Current IPv6 autoconfiguration parameters are displayed Link Local IPv6 Address R O Current link local IPv6 address is displayed Example...

Page 217: ... disabled only the Link Local address is set None of the autoconfiguration options to configure an IPv6 address are run Stateless When enabled the IPv6 Stateless autoconfiguration is run to learn the IPv6 addresses for the device Dhcpv6_stateless When enabled the Dhcpv6_stateless autoconfiguration is run to learn the DNS and domain information for the device Dhcpv6_stateful When enabled the Dhcpv6...

Page 218: ...ss multiple ports Internet Protocol IP4 IP6 Autoconfigure IP4 Can be set to IP4 IP6 or Autoconfigure The initiator IP address is assigned by the system to IP6 In Autoconfigure mode the iSCSI driver attempts to connect to the iSCSI target using the IPv4 stack If this fails then the iSCSI driver attempt to connect using the IPv6 stack Connection Retry Count 0 to 16 0 The count range is 0 to 16 If se...

Page 219: ...0 0 None Use to set target IP address in dotted decimal notation Target Port 3260 Use to change target port number Boot LUN 0 Use to set the hexadecimal representation of the boot logical unit number LUN Example 4752 3A4F 6b7e 2F99 Authentication Type CHAP None CHAP Define the Challenge Handshake Authentication Protocol CHAP Available settings are CHAP Kerberos and None CHAP Type One Way Mutual On...

Page 220: ...Note This option is not supported Wake on LAN Disable Enabled NA Enable or disable wake on LAN Note This option is not supported Blink LEDs 0 1 2 3 0 Use to identify the physical network port by blinking the associated LED Port Configuration Information Displays and specifies the port settings for the network device UEFI Driver R O NA NA Identifies the UEFI driver Adapter PBA R O NA NA Product boa...

Page 221: ...ecifies the link status of the network port MAC Address R O NA None Lists the MAC address of the network interface card NIC Related Information BIOS Main Menu Selections on page 203 BIOS IO Menu Selections on page 221 BIOS Boot Menu Selections on page 225 BIOS Exit Menu Selections on page 226 BIOS IO Menu Selections This section includes a screenshot of the BIOS IO Menu The options that are availa...

Page 222: ...ons on page 224 BIOS IO Menu PCI Subsystem Settings Options The following table describes the BIOS IO Menu PCI subsystem settings options TABLE 30 BIOS IO Menu PCI Subsystem Settings Options Setup Options Options Defaults Description PCI 64 Bit Resources Allocation Disabled Enabled Enabled Enable or disable 64 bit capable devices to be decoded in above 4G address space This setting is available on...

Page 223: ...re devices into multiple virtual devices that can be used on virtual OS installations If supported by the hardware and set to enabled all devices within the system that are SR IOV capable are configured to support SR IOV and I O resources are allocated to the device as normal If set to disabled I O resources are not allocated to the device ARI Disabled Enabled Disabled If Alternate Routing ID ARI ...

Page 224: ...e settings OpROM Enable Disabled Enabled Enabled Enable or disable Option ROM If set to enabled Option ROM for the card executes as normal If set to disabled Option ROM for the card is not copied into memory and the execution of the Option ROM is inhibited NET1 NET2 and NET3 See NET0 description BIOS IO Menu Add In Cards Options The following table describes the BIOS IO Menu add in cards options T...

Page 225: ...ain Menu Selections on page 203 BIOS Advanced Menu Selections on page 207 BIOS Boot Menu Selections on page 225 BIOS Exit Menu Selections on page 226 BIOS Boot Menu Selections This section includes a screenshot of the BIOS Boot Menu The options that are available from the Boot Menu are described in the table that follows BIOS Setup Utility Menu Options 225 ...

Page 226: ...attempts have failed If set to disabled the system halts and displays the error message Network Boot Failed when all PXE boots failed If set to Boot List fail over to the main Boot Options Priority list Persistent Boot Support Disabled Enabled Disabled If enabled the Persistent Boot feature is enabled If disabled system reverts back to the default boot handling from the next boot Legacy Boot Optio...

Page 227: ...etup Utility without saving changes Discard Changes Discard any changes made to the setup options Restore Defaults Restore load the optimal default values for all of the setup options Related Information BIOS Main Menu Selections on page 203 BIOS Advanced Menu Selections on page 207 BIOS IO Menu Selections on page 221 BIOS Boot Menu Selections on page 225 BIOS Setup Utility Menu Options 227 ...

Page 228: ...228 Oracle Exadata Storage Server X5 2 High Capacity Service Manual January 2018 ...

Page 229: ...toring Component Health and Faults Using Oracle ILOM The Oracle ILOM 3 2 interfaces provide easy to view information about the health status of system components From the Oracle ILOM web interface or in the Oracle ILOM command line interface CLI you can collect system specific information about the server determine the health state of discrete components and view any open problems on the server Or...

Page 230: ...omponent name used in management interfaces to refer to a specific sensor indicator or FRU The IPMI name is a shortened form of the component name and is indicated by the boldface portion of the component name IPMI Type Indicates the type of sensor indicator or FRU represented Description Describes the particular component name reference Values Defines the states of the sensor indicator or FRU ent...

Page 231: ...MAC address Used for PXE boot and licensing SYS ACPI State sensor Advanced Configuration and Power Interface hidden 01h ACPI_ON_WORKING 20h ACPI_SOFT_OFF SYS VPS Threshold sensor Virtual power sensor Watts SYS VPS_CPUS Threshold sensor Virtual power sensor CPUs Watts SYS VPS_MEMORY Threshold sensor Virtual power sensor Memory Watts SYS VPS_FANS Threshold sensor Virtual power sensor Fans Watts SYS ...

Page 232: ...ver requires service SYS LOCATE Indicator Locator LED Color White Location Front and rear panels Off Normal Fast blink Locate function is activated self extinguishes after 30 minutes SYS HOST_ERR Discrete sensor Host asserted error sensor 01h Deasserted 02h Asserted SYS PS_FAULT Indicator Rear Power Supply Fault LED Color Amber Location Mainboard Off Normal On General power supply fault SYS FAN_FA...

Page 233: ...plicable SYS MB FM 0 3 FRU Fan module FRU SYS MB FM 0 3 F 0 x FRU Individual fan SYS MB FM 0 3 PRSNT Discrete sensor Fan module is present 01h ENTITY_ABSENT 02h ENTITY_PRESENT SYS MB FM 0 3 F 0 x TACH Threshold sensor Fan module fan speed RPM SYS MB FM 0 3 SERVICE Indicator Fan Service Required LED Color Amber Location Mainboard Off Normal On Fan module was diagnosed as faulty Related Information ...

Page 234: ... Celsius SYS DBP HDD 0 x Pseudo Hard disk drives SYS DBP HDD 0 x PRSNT Discrete sensor Hard disk drive presence 01h ENTITY_ABSENT 02h ENTITY_PRESENT SYS DBP HDD 0 x STATE State sensor Hard disk drive state 02h DRIVE_FAULT 04h PREDICTIVE_FAILURE 08h HOT_SPARE SYS DBP HDD 0 x SERVICE Indicator Service Required LED Color Amber Location Hard disk drive HDD Off Normal On HDD was diagnosed as faulty SYS...

Page 235: ...MI Type Description Values if applicable SYS MB P 0 x D 0 11 FRU Host CPU DIMM FRU SYS MB P 0 x D 0 11 PRSNT Discrete sensor Host CPU DIMM is present 01h ENTITY_ABSENT 02h ENTITY_PRESENT SYS MB P 0 x D 0 11 SERVICE Indicator Host CPU DIMM Service Required LED Color Amber Location Mainboard Off Normal On DIMM was diagnosed as faulty Related Information System Chassis Components on page 231 Cooling ...

Page 236: ...ply input lost or out of range Power supply input out of range Configuration error SYS PS 0 1 P_IN Power sensor Input power draw Watts SYS PS 0 1 P_OUT Power sensor Output power Watts SYS PS 0 1 V_IN Voltage sensor Input voltage Volts SYS PS 0 1 V_12V Voltage sensor 12V output voltage Volts SYS PS 0 1 V_12V_STBY Voltage sensor 12V standby output voltage Volts SYS PS 0 1 T_OUT Temperature sensor Am...

Page 237: ...CE Indicator Host CPU Service Required LED Color Amber Location Mainboard Off Normal On Processor was diagnosed as faulty SYS MB P 0 x V_DIMM Static sensor CPU DIMM bank operating voltage 1 2V Related Information System Chassis Components on page 231 Cooling Unit Components on page 233 Disk Backplane Components on page 234 Memory Device Components on page 235 Power Unit Components on page 236 Syst...

Page 238: ..._NET01 Threshold sensor Gigabit Ethernet controller die temperature CPU 0 NET 0 1 Degrees Celsius SYS MB T_CORE_NET23 Threshold sensor Gigabit Ethernet controller die temperature CPU 1 NET 2 3 Degrees Celsius SYS MB T_IN_PS Threshold sensor PSU inlet temperature Degrees Celsius SYS SP FRU Service processor FRU SYS SP OK Indicator SP OK LED Color Green Location Front panel On SP is operating Off SP...

Page 239: ...ssor Components on page 237 System Board Components on page 237 Hard Disk Drive Components on page 239 Hard Disk Drive Components The following table lists the hard disk drive HDD components Component Name Oracle ILOM CLI Targets IPMI Type Description Values if applicable SYS MB RHDD 0 1 FRU Rear hard disk drive FRU From host SYS MB RHDD 0 1 PRSNT Discrete sensor Rear hard disk drive presence 01h ...

Page 240: ...iscrete sensor Writable multistate slot connector sensor type per IPMI 02h DRIVE_FAULT 04h PREDICTIVE_FAILURE 08h HOT_SPARE SYS DBP HDD 0 x SERVICE Indicator Hard disk drive Service Required LED Color Amber Location HDD Off Normal On Hard disk drive was diagnosed as faulty SYS DBP HDD 0 x OK2RM Indicator Hard disk drive OK to Remove LED Color Blue Location HDD Off Normal On OK to remove SYS DBP NV...

Page 241: ...acle ILOM Environmental Events on page 241 Hard Disk Drive Events on page 243 Power Events on page 244 Fan Events on page 248 Memory Events on page 249 Entity Presence Events on page 255 Physical Security Events on page 256 Environmental Events The following table lists environmental events Messages and Descriptions Component Name SNMP Trap sunHwTrapTempFatalThresholdExceeded Oracle ILOM Event Mes...

Page 242: ...asserted Oracle ILOM Event Message Upper critical threshold no longer exceeded Severity and Description Informational A temperature sensor has reported that its value has gone below an upper critical threshold setting or above a lower critical threshold setting The sunHwTrapThresholdType object indicates whether the threshold was an upper or lower threshold SYS PS 0 1 T_OUT SYS MB T_IN_ZONE0 SYS M...

Page 243: ... A temperature sensor has reported that its value has gone below an upper critical threshold setting or above a lower critical threshold setting The sunHwTrapThresholdType object indicates whether the threshold was an upper or lower threshold SYS MB T_CORE_NET01 SYS MB T_CORE_NET23 SYS MB T_IN_PS Related Information System Chassis Components on page 231 Cooling Unit Components on page 233 Disk Bac...

Page 244: ...vents The following table lists power events Messages and Descriptions Component Name SNMP Trap sunHwTrapPowerSupplyError Oracle ILOM Event Message PS_PRESENCE ASSERT Severity and Description Major A power supply sensor has detected an error SYS PS 0 1 STATE SNMP Trap sunHwTrapPowerSupplyError Oracle ILOM Event Message PS_PRESENCE DEASSERT Severity and Description Major A power supply sensor has d...

Page 245: ...T_ERROR ASSERT Severity and Description Major A power supply sensor has detected an error SYS PS 0 1 STATE SNMP Trap sunHwTrapPowerSupplyError Oracle ILOM Event Message PS_INPUT_ERROR DEASSERT Severity and Description Major A power supply sensor has detected an error SYS PS 0 1 STATE SNMP Trap sunHwTrapPowerSupplyError Oracle ILOM Event Message PS_INPUT_RANGE_ERROR ASSERT Severity and Description ...

Page 246: ...lower SYS VPS_FANS SYS PS 0 1 P_IN SYS PS 0 1 P_OUT SNMP Trap sunHwTrapSensorThresholdOk Oracle ILOM Event Message Upper noncritical threshold no longer exceeded Severity and Description Informational A sensor has reported that its value is in the normal operating range This generic sensor trap is generated when the SNMP agent does not recognize the component type SYS VPS_FANS SYS PS 0 1 P_IN SYS ...

Page 247: ...hold no longer exceeded Severity and Description Informational A voltage sensor has reported that its value has gone below an upper fatal threshold setting or above a lower fatal threshold setting The sunHwTrapThresholdType object indicates whether the threshold was an upper or lower threshold SYS PS 0 1 V_12V SYS PS 0 1 V_12V_STBY SYS PS 0 1 V_IN SYS MB P 0 x V_DIMM SNMP Trap sunHwTrapVoltageCrit...

Page 248: ...page 233 Disk Backplane Components on page 234 Memory Device Components on page 235 Power Unit Components on page 236 Processor Components on page 237 System Board Components on page 237 Hard Disk Drive Components on page 239 Fan Events The following table lists fan events Messages and Descriptions Component Name SNMP Trap sunHwTrapFanSpeedCritThresholdExceeded Oracle ILOM Event Message Lower crit...

Page 249: ...P Trap sunHwTrapFanSpeedFatalThresholdDeasserted Oracle ILOM Event Message Lower fatal threshold no longer exceeded Severity and Description Informational A fan speed sensor has reported that its value has gone below an upper fatal threshold setting or above a lower fatal threshold setting The sunHwTrapThresholdType object indicates whether the threshold was an upper or lower threshold SYS MB FM 0...

Page 250: ...lt cpu intel quickpath link_slow The Quickpath Interconnect QPI link is operating below normal speed Severity and Description Informational A memory component fault has been cleared SYS MB SNMP Trap sunHwTrapMemoryFault Oracle ILOM Event Message event fault cpu intel quickpath unknown errcode An unknown error code from the Quickpath Interconnect QPI reference code has been detected Severity and De...

Page 251: ... Event Message event fault memory intel dimm ddr3u unsupported An unsupported DDR3 ultra low voltage memory DIMM has been detected Severity and Description Major A memory component is suspected of causing a fault SYS MB SNMP Trap sunHwTrapMemoryFaultCleared Oracle ILOM Event Message event fault memory intel dimm ddr3u unsupported An unsupported DDR3 ultra low voltage memory DIMM has been detected ...

Page 252: ... 11 SNMP Trap sunHwTrapMemoryFaultCleared Oracle ILOM Event Message event fault memory intel dimm 4gb fused An unsupported 4 gb memory DIMM has been detected Severity and Description Informational A memory component fault has been cleared SYS MB P 0 x D 0 11 SNMP Trap sunHwTrapMemoryFault Oracle ILOM Event Message event fault memory intel dimm 8gb fused An unsupported 8 gb memory DIMM has been det...

Page 253: ... Severity and Description Informational A memory component fault has been cleared SYS MB P 0 x D 0 11 SNMP Trap sunHwTrapMemoryFault Oracle ILOM Event Message event fault memory intel dimm numranks unsupported A memory DIMM with an unsupported number of ranks has been detected Severity and Description Major A memory component is suspected of causing a fault SYS MB P 0 x D 0 11 SNMP Trap sunHwTrapM...

Page 254: ...lled Severity and Description Informational A memory component fault has been cleared SYS MB P 0 x D 0 11 SNMP Trap sunHwTrapMemoryFault Oracle ILOM Event Message event fault memory intel dimm out of order Severity and Description Major A memory component is suspected of causing a fault SYS MB P 0 x D 0 11 SNMP Trap sunHwTrapMemoryFaultCleared Oracle ILOM Event Message event fault memory intel dim...

Page 255: ...etected an error Device absent SYS MB P 0 x PRSNT SNMP Trap sunHwTrapProcessorOk Oracle ILOM Event Message ENTITY_PRESENT DEASSERT Severity and Description Major A processor sensor has returned to its normal state Device present SYS MB P 0 x PRSNT SNMP Trap sunHwTrapProcessorError Oracle ILOM Event Message ENTITY_DISABLED ASSERT Severity and Description Major A processor sensor has detected an err...

Page 256: ... and Descriptions Component Name SNMP Trap sunHwTrapSecurityIntrusion Oracle ILOM Event Message Assert Severity and Description Major General Chassis intrusion asserted SYS INTSW 256 Oracle Exadata Storage Server X5 2 High Capacity Service Manual January 2018 ...

Page 257: ...ility accessing 179 Advanced screen 207 boot mode 183 Boot screen 225 Exit screen 226 exiting from 200 function keys 179 IO screen 221 legacy boot mode 183 Main screen 203 menus accessing 179 navigating menu options 181 service processor network settings 193 setup screens summary 178 shortcut key sequences 179 TPM support 191 UEFI boot mode 183 UEFI compliant description 183 board components 231 b...

Page 258: ...nts 239 disk drives See drive drive description 18 hot plugging 62 identification 62 installing 65 latch release button 64 removing 62 E electrostatic discharge prevention 57 safety precautions 48 entity presence events 255 environmental events 241 Ethernet cables connecting 39 Ethernet ports booting priority 42 42 device and driver naming 42 pinout 170 Exit BIOS screen 226 exploded view of server...

Page 259: ...removing 131 LED USB indicator module right installing 141 removing 138 LED USB indicator modules replacing 130 LEDs boot drive 29 power supply 29 72 73 storage drive 29 system status 27 Legacy BIOS Boot Mode selecting 183 switching between UEFI Boot Mode 184 locating chassis serial number 45 Locator LED button 27 M Main BIOS screen 203 memory device components 235 memory events 249 menus BIOS Set...

Page 260: ...36 power on self test POST code checkpoint tests 28 Power OK indicator 28 processor components 237 processor removal replacement tool 99 processor socket cover installing 145 removing 145 processor s physical layout 78 processors identifying faulty processor 100 installing 106 maximum DIMMs supported 79 removal replacement tool 99 removing 100 replacing 99 PSU See power supply R removing antistati...

Page 261: ...utting down the system immediately using Oracle ILOM CLI 52 immediately using Oracle ILOM web interface 53 immediately using the Power button 52 Simple Network Management Protocol SNMP Traps generated by system 241 standby power 52 53 54 54 start command 168 storage drive LEDs 29 storage drive backplanes replacing 112 Sun Storage 12 Gb s SAS PCIe RAID HBA card removing 124 support for product 45 s...

Page 262: ...Index V video port pinout 173 W weight of server 56 262 Oracle Exadata Storage Server X5 2 High Capacity Service Manual January 2018 ...

Reviews:

No comments