manualshive.com logo in svg

Oracle X5-4, Service Manual

Share
Download
Oracle X5-4 Service Manual Download Page 122

Prepare an NVMe Storage Drive for Removal

■

For a list of the virtual PCIe slots of NVMe drives as seen by the operating system, see

“NVMe Storage Drive Virtual PCIe Slot Designation” on page 115

. Note that the virtual

PCIe slot name is not the same as the name on the server front panel label.

1.

Log in to the Oracle Solaris host.

2.

Find the NVMe drive virtual PCIe slot number. Type:

# 

hotplug list –lc

This command produces output similar to the following for each of the NVMe drives installed

in the server:

# hotplug list -lc
Connection           State           Description
Path                          
-------------------------------------------------------
pcie100              ENABLED         PCIe-Native
/pci@0,0/pci8086,2f06@2,2/pci111d,80b5@0/pci111d,80b5@4
pcie101              ENABLED         PCIe-Native
/pci@0,0/pci8086,2f06@2,2/pci111d,80b5@0/pci111d,80b5@5
pcie102              ENABLED         PCIe-Native
/pci@0,0/pci8086,2f06@2,2/pci111d,80b5@0/pci111d,80b5@6
pcie103              ENABLED         PCIe-Native
/pci@0,0/pci8086,2f06@2,2/pci111d,80b5@0/pci111d,80b5@7

3.

Prepare the NVMe drive for removal by powering off the drive slot.

For example, to prepare NVMe0 for removal, type the following commands:
# 

hotplug poweroff pcie100

# 

hotplug list –lc

The following output appears for the NVMe0 drive that has been unmounted:

# hotplug list -lc
Connection           State           Description
Path                          
-------------------------------------------------------
pcie100              PRESENT         PCIe-Native
/pci@0,0/pci8086,2f06@2,2/pci111d,80b5@0/pci111d,80b5@4
pcie101              ENABLED         PCIe-Native
/pci@0,0/pci8086,2f06@2,2/pci111d,80b5@0/pci111d,80b5@5
pcie102              ENABLED         PCIe-Native
/pci@0,0/pci8086,2f06@2,2/pci111d,80b5@0/pci111d,80b5@6
pcie103              ENABLED         PCIe-Native
/pci@0,0/pci8086,2f06@2,2/pci111d,80b5@0/pci111d,80b5@7

4.

Verify that the blue OK to Remove indicator on the NVMe drive is lit.

122

Oracle Server X5-4 Service Manual • December 2015

Summary of Contents for X5-4

Page 1: ...Oracle Server X5 4 Service Manual Part No E56396 03 December 2015 ...

Page 2: ......

Page 3: ...ation management applications It is not developed or intended for use in any inherently dangerous applications including applications that may create a risk of personal injury If you use this software or hardware in dangerous applications then you shall be responsible to take all appropriate fail safe backup redundancy and other measures to ensure its safe use Oracle Corporation and its affiliates...

Page 4: ...des informations Ce logiciel ou matériel n est pas conçu ni n est destiné à être utilisé dans des applications à risque notamment dans des applications pouvant causer un risque de dommages corporels Si vous utilisez ce logiciel ou ce matériel dans le cadre d applications dangereuses il est de votre responsabilité de prendre toutes les mesures de secours de sauvegarde de redondance et autres mesure...

Page 5: ...ubsystem 25 Cooling Subsystem 25 Power Subsystem 28 Storage Subsystem 30 Input Output I O Subsystem 31 System Management Subsystem 34 Troubleshooting and Diagnostics 37 Troubleshooting Server Hardware Component Faults 37 Troubleshooting Hardware Faults Using Oracle ILOM 38 Troubleshooting Using the Front Panel Indicators 40 Troubleshooting Using the Fault Remind Test Circuits 51 Troubleshooting Sy...

Page 6: ...ceable Components 70 Component Designations 73 Performing Electrostatic Discharge and Static Prevention Measures 79 Using an Anti static Wrist Strap 80 Using an Anti Static Mat 80 Tools and Equipment 81 Component Filler Panels 81 Locating a Failed Memory Riser Card DIMM or CPU 82 Fault Remind Circuits and Internal Fault Indicator Locations 82 DIMM Fault Remind Circuit Components 85 Locate a Failed...

Page 7: ...e CRU 115 Install a Storage Drive CRU 118 Install a Storage Drive Filler Panel CRU 119 Storage Drive Reference 119 Removing and Replacing an NVMe Storage Drive Using Oracle Solaris 121 Prepare an NVMe Storage Drive for Removal 121 Remove an NVMe Storage Drive From the Server 123 Verify Removal of an NVMe Storage Drive 123 Install an NVMe Storage Drive in the Server 124 Power On an NVMe Storage Dri...

Page 8: ... Plate FRU 181 Install a CPU Cover Plate 183 Remove a Heatsink and CPU FRU 186 Install a Heatsink and CPU FRU 193 Servicing the Factory Installed SAS 12 Gb s Internal HBA and ESM 200 Replace the SAS 12 Gb s Internal HBA FRU 200 Replace the SAS 12 Gb s Internal HBA ESM Module FRU 203 Replace the SAS 12 Gb s Internal HBA SAS Cables FRU 204 Replace the SAS 12 Gb s Internal HBA ESM Cable FRU 209 Servi...

Page 9: ...the BIOS Setup Utility 273 BIOS Setup Utility Screens 273 Access the BIOS Setup Utility 338 POST and Checkpoint Codes 341 AMI Checkpoint Ranges 341 Standard Checkpoints SEC Phase 342 SEC Beep Codes 342 PEI Phase 342 PEI Error Codes 344 S3 Resume Progress Codes 344 S3 Resume Error Codes 344 Recovery Progress Codes 345 Recovery Error Codes 345 PEI Beep Codes 345 DXE Phase DXE Status Codes 346 DXE Er...

Page 10: ...10 Oracle Server X5 4 Service Manual December 2015 ...

Page 11: ...ame identifies the following X identifies an x86 product The first number 5 identifies the generation of the server The second number 4 identifies the number of processor sockets in the server Getting the Latest Firmware and Software Firmware drivers and other hardware related software for each Oracle x86 server are updated periodically You can obtain the latest version in the following ways Oracl...

Page 12: ...http www oracle com goto docfeedback About This Documentation This documentation set is available in both PDF and HTML The information is presented in topic based format similar to online help and therefore does not include chapters appendixes or section numbering Contributors Primary Authors Ray Angelo Mark McGothigan Ralph Woodley Michael Bechler Contributors Kenny Tung Johnny Hui Prafull Singha...

Page 13: ...res Servicing the Server on page 69 Procedures for preparing to service the server Preparing to Service the Server on page 93 Procedures for servicing customer replaceable units CRUs Servicing CRU Components on page 113 Procedures for servicing field replaceable units FRUs Servicing FRU Components on page 179 Procedures for preparing the server for operation Returning the Server to Operation on pa...

Page 14: ...14 Oracle Server X5 4 Service Manual December 2015 ...

Page 15: ...ilities of the server Description Link Server overview statement Server Overview on page 16 Components and features of the server front and back panels External Components and Features on page 17 Server subsystem components Server Subsystems Overview on page 19 Oracle Server X5 4 Overview 15 ...

Page 16: ...ur of the six drive bays 2 through 5 can also support NVMe SSD drives Note NVMe drive support requires the purchase an optional PCIe NVMe Switch card during the initial factory order of the server It cannot be added later An optional tray load DVD RW drive on the front of the server below the drive bays Oracle Storage 12 Gb s SAS RAID PCIe HBA Internal This card supports RAID levels 0 1 5 6 10 50 ...

Page 17: ...nt over subscription Cooling fans Six hot swappable redundant fans at chassis front top loading Two redundant fans one in each power supply Management software The following options are available Oracle Integrated Lights Out Manager ILOM on the Service Processor Oracle System Assistant OSA on an optional internal USB flash drive Oracle Hardware Management Pack Oracle Enterprise Management Ops Cent...

Page 18: ...er Supply PS Fault Service Action Required indicator amber 8 Over Temperature Warning indicator amber 9 USB 2 0 connectors 2 10 DB 15 video connector 11 SATA DVD drive optional 12 17 Storage drive slots 0 5 from bottom to top Slots 0 and 1 support only SAS drives mechanical or SSD Slots 2 5 support both SAS and NVMe drives Server Back Panel Features The following illustration shows the server back...

Page 19: ...NET0 NET3 8 USB 2 0 connectors 2 9 PCIe card slots 7 11 10 Service processor SP RJ 45 network management NET MGT port 11 Service processor SP RJ 45 serial management SER MGT port 12 DB 15 video connector Server Subsystems Overview This section provides information about the server subsystems System Block Diagrams on page 20 Processor Subsystem on page 22 Memory Subsystem on page 25 Cooling Subsyst...

Page 20: ...ge 31 System Management Subsystem on page 34 System Block Diagrams The server can be configured with two or four CPUs This section shows the system block diagrams for these two server configurations Two CPU Block Diagram on page 21 Four CPU Block Diagram on page 22 20 Oracle Server X5 4 Service Manual December 2015 ...

Page 21: ...Server Subsystems Overview Two CPU Block Diagram Oracle Server X5 4 Overview 21 ...

Page 22: ...am Processor Subsystem The Oracle Server X5 4 uses the Intel Xeon E7 8895 v3 18 core 2 6 GHz processor and supports two CPU based configurations a two CPU configuration and a four CPU configuration 22 Oracle Server X5 4 Service Manual December 2015 ...

Page 23: ...ory riser cards and an air baffle to control airflow for maximum cooling The following illustration shows the components in a two CPU server configuration Callout Description 1 Air baffle 2 CPU P1 3 CPU P0 4 Memory riser card P1 MR1 5 Memory riser card P1 MR0 6 Memory riser card P0 MR1 7 Memory riser card P0 MR0 For more information see Two CPU Block Diagram on page 21 Oracle Server X5 4 Overview ...

Page 24: ...card P0 MR1 2 Memory riser card P3 MR0 8 Memory riser card P0 MR0 3 Memory riser card P2 MR1 9 CPU P3 4 Memory riser card P2 MR0 10 CPU P2 5 Memory riser card P1 MR1 11 CPU P1 6 Memory riser card P1 MR0 12 CPU P0 The four CPU configuration offers a greater level of resiliency with redundant QPI interconnects that allow working CPUs to route around a disabled CPU as the system starts For more infor...

Page 25: ...PU configuration has 96 slots eight MR cards Memory Channels and Buffers MR cards contain twelve DIMM slots four DDR3 channels and two memory buffer ASICs Each memory buffer has two channels A and B and links to three DIMM slots per channel Each memory buffer is connected to the processor s built in memory controller by an SMI 2 link Memory Performance For balanced performance each channel for eac...

Page 26: ...reas have separate air pressures The pressures are maintained by a plastic divider that combined with the top cover creates a seal between the two areas It is important to maintain this seal because separate pressurizations for each area is the key to maintaining the integrity of the cooling system and the health of the server Cooling Zones and Temperature Sensors The two cooling areas are divided...

Page 27: ...emperature sensor TS_OUT U4506 2 Cooling zone 2 8 Temperature sensor TS_TVL_1 U4002 3 Cooling zone 3 power supply backplane area 9 Temperature sensor TS_TVL_0 U4302 4 Temperature sensor TS_PS U4603 10 Temperature sensor TS_ZONE0_B U4509 5 Temperature sensor TS_ZONE1 U4507 11 Temperature sensor TS_ZONE0_A U4508 Oracle Server X5 4 Overview 27 ...

Page 28: ...he server fault indicator for the component and logs an event in the system event log SEL When a fault event occurs address the issue immediately For information about troubleshooting the server cooling subsystem see Troubleshooting System Cooling Issues on page 52 Power Subsystem The server is equipped with two 1030 2060 watt auto ranging hot swappable power supplies that support a two CPU config...

Page 29: ...down use the server OS Oracle ILOM or the server front panel Power button A Graceful shutdown via the Power button is done with a single momentary press However an Immediate Emergency shutdown via the power button is done by pressing and holding the power button for 5 seconds Immediate Shutdown An immediate shutdown of the server also referred to as an emergency shutdown should be used only in sit...

Page 30: ... power source allow the SP to boot and then reapply full power See Also Power On the Server on page 271 Powering Off the server on page 101 Resetting the Host or Service Processor on page 63 Storage Subsystem The server storage subsystem consists of the following Six 2 5 inch Drive Bays on page 30 SATA DVD RW Drive on page 31 Six 2 5 inch Drive Bays The six 2 5 inch storage drive bays are located ...

Page 31: ...s For slot designations see DVD Storage Drive and USB Designations on page 78 SATA DVD RW Drive An optional DVD RW SATA Gen3 drive is located at the front of the server below the drive bays A SATA3 port on the motherboard connects to the disk backplane through a SATA cable bundled with the HBA SAS1 cable For DVD designation see DVD Storage Drive and USB Designations on page 78 Input Output I O Sub...

Page 32: ...ant USB device The Oracle System Assistant provides a separately bootable device that aids in the installation of the primary host OS server hardware configuration and the firmware upgrade process Do not use the Oracle System Assistant USB drive as the primary host boot device or as server storage If installed in your server the Oracle System Assistant USB drive must be installed in the port label...

Page 33: ...erfaces is reported differently by different interfaces and operating systems The following illustration explains the logical operating system and physical BIOS naming conventions used for each interface Note Naming used by the interfaces might vary from that listed below depending on which devices are installed in the system Port BIOS Solaris Linux Windows Net 3 8101 igb 3 eth 3 net 4 Net 2 8100 ...

Page 34: ...server Oracle ILOM runs independently of the server OS and is accessible in both full power and standby power modes The SP Oracle ILOM is accessible through the SP 100 1000 10000 Ethernet NET MGT port located on the server back panel or through one of the host s four built in 10 GigabitEthernet ports using sideband management Oracle System Assistant Your server might also come equipped with Oracle...

Page 35: ...re Management Pack provides scriptable command line tools that help you manage and configure your Oracle servers from the host operating system Hardware Management Pack enables you to do the following using command line tools Configure BIOS Legacy and UEFI RAID volumes and Oracle Integrated Lights Out Manager ILOM Upgrade server component firmware Access the service processor and perform managemen...

Page 36: ...36 Oracle Server X5 4 Service Manual December 2015 ...

Page 37: ...the Server on page 59 Information on resetting the host or service processor including the Oracle ILOM root password and account Resetting the Host or Service Processor on page 63 Information about contacting Oracle support Getting Help on page 66 Troubleshooting Server Hardware Component Faults This section describes maintenance related information and provides procedures that you can use to trou...

Page 38: ...rdware fault event occurs the system lights the Service Action Required indicator and captures the event in the system event log SEL If you have set up notification through Oracle ILOM you also receive an alert through the notification method you chose When you become aware of a hardware fault you should address it immediately 1 Log in to the server SP Oracle ILOM web interface Open a browser and ...

Page 39: ...le the Status screen shows that the Memory subsystem requires service This indicates that a hardware component within the subsystem is in a fault state 3 To identify the component click on the subsystem name The subsystem screen appears The above example shows the processor information screen and indicates that CPU 0 has a problem Troubleshooting and Diagnostics 39 ...

Page 40: ...server Product Notes document for information related to the issue or the component The Product Notes document contains up to date information about the server including hardware related issues 6 To prepare the server for service See Preparing to Service the Server on page 93 7 Service the component Note After servicing the component you might need to clear the fault in Oracle ILOM For more inform...

Page 41: ...e service processor SP boots As the SP boots its indicator blinks at the slow blink rate and the System OK indicator is off For indicator blink rate information see Indicator Blink Rates on page 46 2 When the SP has successfully booted the SP indicator is on steady and the System OK indicator blinks at the single blink rate This indicates that the server is in standby power mode see Power Subsyste...

Page 42: ...blinks at the fast blink rate For indicator blink rate information see Indicator Blink Rates on page 46 For information on remotely turning on the Locator indicator see Managing the Locator Indicator on page 107 Over Temperature Condition For a server in an over temperature state the amber Service Action Required and Temperature indicators are on steady The green OK indicator and the green SP indi...

Page 43: ...indicator and the green SP indicator are on steady In addition the Service Action Required indicator on the failed PSU as seen from the back of the system will also light Memory Failure For a server with a failure in the memory subsystem the amber Service Action Required and MEM TOP indicators are on steady The green OK indicator and the green SP indicator are on steady Troubleshooting and Diagnos...

Page 44: ...er can boot successfully The server might not be able to boot out of standby power mode For indicator blink rate information see Indicator Blink Rates on page 46 Fan Module Failure For a server with a fan module fault the amber Service Action Required and the FAN TOP indicators are on steady The green OK indicator and the green SP indicator are on steady For more information on fan indicators see ...

Page 45: ... on steady The green OK indicator and the green SP indicator are off Front Panel Lamp Test To perform a lamp test of all front panel indicators press and hold down the Locate button for at least five seconds All the indicators light up and remain on steady for 15 seconds see Unison Steady On on page 49 Troubleshooting and Diagnostics 45 ...

Page 46: ...age 48 Single Standby Blink Rate on page 48 Slow Unison Blink Rate on page 49 Insertion Blink on page 49 Unison Steady On on page 49 Alternating Invalid FRU Blink Rate on page 50 Feedback Flash on page 51 Data Blink Rate on page 51 Sequential Diagnostic Blink Rate on page 51 Steady On For the steady on state an indicator is continually on lit and does not blink This indicates a continuing conditio...

Page 47: ...a subsystem not in a fault state unlit amber Service Action Required indicator Slow Blink Rate For the slow blink rate the indicator typically green repeatedly lights for half a second during a one second interval 1 Hz and turns off for half a second The slow blink rate indicates an on going activity For example the slow blink rate occurs when a device is rebuilding booting or in transition from o...

Page 48: ... Single Standby Blink Rate For the single blink rate the indicator repeatedly flashes once at the beginning of a three second interval This indicates a component or system in standby mode For example the single blink rate occurs when a server is in standby power mode or a when hot spare device is waiting to be used also used with amber indicators to indicate a predicted fault 48 Oracle Server X5 4...

Page 49: ...ered system confirming the power connection Insertion Blink The insertion blink is three successive blinks of a hot swap component s primary status indicator for example the green OK indicator The insertion blink occurs immediately after three successive unison blinks see Slow Unison Blink Rate on page 49 of all the component indicators Unison Steady On For the unison steady on all indicators are ...

Page 50: ... Indicates that a component has an incorrect version or mismatch for example a power supply with a lower rating than the one specified Also used for an unsupported component a component in an unsupported slot or a blade server module that causes a power supply to be oversubscribed for that system 50 Oracle Server X5 4 Service Manual December 2015 ...

Page 51: ...sively lights for 0 5 sec each to indicate that diagnostics are running This blink rate is used only on systems or components capable of running diagnostics for example blade servers Troubleshooting Using the Fault Remind Test Circuits The sever has two internal test circuits the System Fault Remind Circuit and the DIMM Fault Remind Circuit The circuits help you locate failed components Use the Sy...

Page 52: ... might be one of following External Ambient Temperature Too High on page 52 Airflow Blockage on page 53 Internal Pressures Compromised on page 53 Hardware Component Failure on page 53 External Ambient Temperature Too High Server component cooling relies on the movement of cool ambient air pulled into the server from its external environment If the ambient temperature of the server s external envir...

Page 53: ...need to be in place for the server to function as a sealed system If the internal pressures are compromised the server cooling system which relies on the movement of cool air through the server cannot function properly and the airflow inside the server becomes chaotic and non directional Action Inspect the server interior to ensure that the air divider and air baffle Two CPU Configuration on page ...

Page 54: ...er Connection on page 54 Power Supplies PSUs on page 55 Top Cover on page 56 AC Power Connection The AC power cords are the direct connection between the server power supplies and the power sources The server power supplies need separate stable AC circuits Insufficient voltage levels or fluctuations in power can cause server power problems The power supplies are designed to operate at a particular...

Page 55: ...e unplugged or disengaged from the internal connectors the server cannot power on Action Check that the AC cables are connected to both PSUs and that the PSUs are operational the PSU indicator panel should have a lit green AC OK indicator If not ensure that the PSU is properly installed A PSU that is not fully engaged with its internal connector does not have power applied and does not have a lit ...

Page 56: ...rd The other component is mounted on the underside of the top cover When the cover is installed these two components align closing the switch and allowing power to the server When the cover is removed the switch opens removing power from the server If the cover is removed while the server is powered on to full power mode power to the server is immediately switched off Action If the server does not...

Page 57: ...for your server range in complexity from a comprehensive validation test suite Oracle VTS to a chronological event log Oracle ILOM System Log The selection of diagnostic tools also include standalone software packages firmware based tests and hardware based LED indicators The following table summarizes the diagnostic tools that you can use when troubleshooting or monitoring your server Diagnostic ...

Page 58: ...stics System BIOS The UEFI diagnostics can test and detect problems on all CPU memory disk drives and network ports It is used on systems that support UEFI You can use either the Oracle ILOM web interface or the command line interface CLI to run UEFI diagnostics Remote access through Oracle ILOM Remote Console Oracle Solaris commands Operating system software Displays various kinds of system infor...

Page 59: ...9 01 index html Attaching Devices to the Server This section describes server port information and provides procedures for attaching devices to the server Attach Devices to the Server on page 59 Back Panel Connector Locations on page 60 Configuring Serial Management Port Ownership on page 61 Four Onboard 10GbE Ports on page 32 Attach Devices to the Server This section provides information about co...

Page 60: ...o interact with the system console locally connect a monitor 1 keyboard 2 and mouse 3 to the server front panel connectors as shown in the illustration below Back Panel Connector Locations The following illustration shows and describes the locations of the back panel connectors Use this information to set up the server so you can access diagnostic tools and manage the server during service 60 Orac...

Page 61: ...erial management port SER MGT for serial console output Using Oracle ILOM you can specify that the host be assigned as owner of the serial management port configured as COM1 This feature is useful for Windows kernel debugging as it enables you to view non ASCII character traffic from the host console You can assign ownership of the serial management port using either the Oracle ILOM web interface ...

Page 62: ... where ipadress is the IP address of the server SP For more information refer to the Oracle X5 Series Servers Administration Guide at http www oracle com goto x86AdminDiag docs The Oracle ILOM CLI prompt appears 2 To set the serial port owner to the host type set SP serial portsharing owner host Note The serial port sharing value by default is owner SP 3 To set the serial port owner back to the SP...

Page 63: ... the server SP Log in as root or a user with administrator privileges Refer to the Oracle X5 Series Servers Administration Guide at http www oracle com goto x86AdminDiag docs The Summary screen appears 2 In the ILOM web interface select ILOM Administration Connectivity from the navigation menu on the left side of the screen 3 Select the Serial Port tab The Serial Port Settings page appears Note Th...

Page 64: ...om the Oracle ILOM CLI enter the command reset SP From the Oracle ILOM web interface click ILOM Administration Maintenance Reset SP Note Resetting the Oracle ILOM SP disconnects your current Oracle ILOM session You must log in again to continue working in Oracle ILOM 3 Reset the host using one of the following methods From the Oracle ILOM CLI enter the command reset System From the Oracle ILOM web...

Page 65: ...erform either action you need a local serial management port SER MGT connection to Oracle ILOM In addition if the Physical Presence State is enabled the default in Oracle ILOM you must prove that you are physically present at the server as described in the following procedure To recover the root account or root account password perform these steps 1 Establish a local serial management connection t...

Page 66: ...ssword 5 Reset the root account password or re create the root account Refer to the Oracle ILOM documentation for details on creating user accounts at http www oracle com goto ILOM docs Getting Help This sections describes how to get additional help to resolve server related problems Contacting Support on page 66 Locating the System Serial Number on page 67 Contacting Support If the troubleshootin...

Page 67: ...ou might need to have your system serial number when you ask for service on your system Record this number for future use Use one of the following methods to locate your server serial number On the front panel of the server look at the bottom left of the bezel to locate the server serial number Locate the yellow Customer Information Sheet CIS attached to your server packaging This sheet includes t...

Page 68: ...68 Oracle Server X5 4 Service Manual December 2015 ...

Page 69: ...d required tools for servicing the server Tools and Equipment on page 81 Information about component filler panels Component Filler Panels on page 81 Procedures for using the fault remind test circuits Locating a Failed Memory Riser Card DIMM or CPU on page 82 Procedures about clearing hardware faults in Oracle ILOM Clear Hardware Fault Messages on page 91 Component Serviceability Locations and De...

Page 70: ...e component The following table lists the components their service designations and their serviceability Component Service Designation Serviceability Storage drives CRU Hot Fan modules CRU Hot Power supplies CRU Hot Memory risers and DIMMs CRU Cold PCIe cards CRU Cold DVD drive CRU Cold System or RTC battery CRU Cold CPUs and heatsinks FRU Cold SAS 12 Gb s HBA and cables HBA to disk backplane FRU ...

Page 71: ...ents Callout Description Callout Description 1 Motherboard 10 HBA SAS cables 2 2 SP card 11 Storage drive backplane board 3 HBA card 12 Heatsinks and CPUs 2 or 4 4 PCIe NVMe Switch card 13 Memory riser cards 4 or 8 5 Power supplies 2 14 Fan modules 6 6 System battery 15 Fan board 7 Power supply backplane 16 DVD Drive Servicing the Server 71 ...

Page 72: ...llout Description Callout Description 8 ESM 17 Storage drive slots 6 9 NVMe cables 4 Components Exploded View Callout Description Callout Description 1 Power supplies 11 Air baffle 2 CPU configuration only 72 Oracle Server X5 4 Service Manual December 2015 ...

Page 73: ...e naming designations for internal and external slots Fan Module Slot Designations on page 73 CPUs and Memory Riser Card Slots Designations on page 74 DIMM Slot Designations on page 75 Power Supply Designations on page 76 PCIe Slot Designations on page 77 DVD Storage Drive and USB Designations on page 78 Fan Module Slot Designations The six fan module slots are at the front of the server and are s...

Page 74: ...he leftmost socket is CPU 3 designated as P3 The eight memory riser MR card slots are located between the fan module slots and the CPU sockets Consecutively from right to left the rightmost slot is slot 0 and the leftmost slot is slot 7 The slots are also designated by their association with the four CPU sockets P0 P3 Two slots are assigned to each CPU socket For example slots 0 and 1 are paired w...

Page 75: ...ard slot P2 MR0 10 CPU 2 P2 5 MR card slot P1 MR1 11 CPU 1 P1 6 MR card slot P1 MR0 12 CPU 0 P0 DIMM Slot Designations The DIMM slots are located on the memory riser cards The DIMMs are arranged in two banks of six slots for a total of 12 slots The slots are designated numerically from top to bottom The left bank of slots are designated as D0 D6 The right bank of slots are designated as D7 D11 Ser...

Page 76: ...lot D10 6 Slot D5 12 Slot D11 Power Supply Designations The two power supply slots are located on the right side of the server from the front of the server and are designated from right to left The slots are accessible from the back of the server From the back of the server the left slot is designated as PS 0 and the right slot is PS 1 76 Oracle Server X5 4 Service Manual December 2015 ...

Page 77: ...e back As viewed from the front of the server the slots are divided into two groups a group of six on the right of the SP card and a group of five on the left of the SP card The slots are designated from right to left The six slots on the right side are designated as PCI 1 to PCI 6 The five slots on the left are designated as PCI 7 to PCI 11 Servicing the Server 77 ...

Page 78: ...er front side of the front of the server The six storage drive slots are on the right side of the server and are designated consecutively from bottom to top The bottommost slot is designated as HDD 0 and the topmost slot is HDD 5 The two internal USB slots are located between the disk backplane board and the power supply backplane board An optional Oracle System Assistant flash drive is installed ...

Page 79: ...D5 NVMe3 6 HDD0 2 HDD4 NVMe2 7 DVD 3 HDD3 NVMe1 8 OSA USB port 4 HDD2 NVMe0 9 USB port 5 HDD1 Performing Electrostatic Discharge and Static Prevention Measures Electrostatic discharge ESD sensitive devices such as the PCIe cards hard drives CPUs and memory cards require special handling Servicing the Server 79 ...

Page 80: ...tials between you and the server Note An anti static wrist strap is not shipped with the servers However anti static wrist straps are included with customer replaceable units CRUs field replaceable units FRUs and optional components Using an Anti Static Mat In addition to wearing an anti static wrist strap when handling components create an ESD free work place by using an anti static mat as a work...

Page 81: ...or CPUs storage drives HDD or SSD the DVD drive and the PCIe cards A filler panel is an empty metal or plastic enclosure that does not contain any functioning system hardware or cable connectors The filler panels are installed at the factory and must remain in the server until you replace them with components This seals system and provides noise EMI and airflow containment If you remove a filler p...

Page 82: ...Remind Circuits and Internal Fault Indicator Locations on page 82 DIMM Fault Remind Circuit Components on page 85 Locate a Failed Memory Riser Card DIMM or CPU on page 86 Fault Remind Circuits and Internal Fault Indicator Locations This section describes the locations of the system Fault Remind circuit components System Fault Remind Button and Charge Status Indicator on page 83 Memory Riser Card a...

Page 83: ...Fault Remind Button is located on the divider between the cooling zone 1 and cooling zone 2 The Charge Status Indicator is located next to the button Memory Riser Card and CPU Fault Indicators The memory riser card Fault indicators are visible through the small hole on top of the card Servicing the Server 83 ...

Page 84: ... and the CPU To see a lit CPU Fault indicator look down from the top of the server and sight through the memory riser cards and the support bracket near the CPU The following illustration shows the location of the CPU Fault indicators Note When a CPU fails the fault indicators of its two memory riser cards also light making it easier to identify the failed CPU 84 Oracle Server X5 4 Service Manual ...

Page 85: ...d Circuit Components The DIMM Fault Remind Test Circuit is located on the memory riser card The Fault Remind Button and Charge Status Indicator are located near the right side bank of DIMM slots at the front edge of the card The DIMM Fault indicators are located next to the DIMM slots Servicing the Server 85 ...

Page 86: ...the failed component is a DIMM the indicators identify the memory riser card containing the DIMM Then to locate the failed DIMM you need to remove the memory riser card and use the card s DIMM Fault Remind circuitry For more information about the system and DIMM Fault Remind circuits see Troubleshooting Using the Fault Remind Test Circuits on page 51 Before You Begin To troubleshoot faulty hardwar...

Page 87: ... power indicator illuminates green to indicate that the remind circuitry is usable 4 Look for the lit Fault indicators If the circuit is usable identify the failed component by the lit Fault indicators Use the information in the following table to help you find the component Faulted Component Memory Riser Indicator CPU Indicator DIMM Indicator CPU On The indicators for both memory riser cards asso...

Page 88: ...lt Remind button is pressed The following illustration shows the lit indicators for a failed CPU P0 In this example the Fault indicators for memory riser cards P0 MR0 and P0 MR1 are lit as is the Fault indicator for CPU P0 For more information see CPU Fault Indicators on page 84 To locate a failed MR card look for the MR card Fault indicator When an MR card is in a fault state the Fault indicator ...

Page 89: ...r card P1 MR1 For more information see Memory Riser Card and CPU Fault Indicators on page 83 To locate a failed DIMM look for an MR card Fault indicator When a DIMM is in a fault state the Fault indicator for the MR card containing the DIMM lights when the system Fault Remind button is pressed Servicing the Server 89 ...

Page 90: ... more information see DIMM Fault Remind Circuit Components on page 85 5 Replace the failed component To replace a failed CPU see Replace a Faulty CPU FRU on page 180 To replace a failed memory riser card or a DIMM see Replace a Faulty Memory Riser Card on page 144 Next Steps Replace a Faulty CPU FRU on page 180 or Remove a Memory Riser Card on page 145 or Replace a Faulty DIMM on page 143 90 Oracl...

Page 91: ...ide at http www oracle com goto ILOM docs Before You Begin This procedure requires the use of the Oracle ILOM CLI interface 1 Open an SSH session and at the command line log in to the SP Oracle ILOM CLI Log in as a user with root or administrator privileges For example ssh root ipadress where ipadress is the IP address of the server SP For more information on accessing Oracle ILOM refer to the Ora...

Page 92: ...tive faulty components a Show active faulty components f Show active faulty FRUs r Show active fault FRUs and their fault management states s Show a one line fault summary for each fault event u uuid Show fault diagnosis events that match a specific universal unique identifier uuid For command specifics see the Oracle ILOM User s Guide for System Monitoring and Diagnostics for your version of Orac...

Page 93: ... the server on page 101 Procedural information for using the Locator indicator Managing the Locator Indicator on page 107 Procedural information for the server cover Remove the Server Cover on page 110 Prepare the Server for Hot Service The following hot service components can be removed and replaced while the server is operating in full power mode Storage drives Fan modules Power supplies For mor...

Page 94: ...press the Locator indicator button to deactivate the indicator See Manage the Locator Indicator Locally on page 110 4 Set up an ESD safe space at the service location See Performing Electrostatic Discharge and Static Prevention Measures on page 79 Next Steps The following components can be hot serviced Servicing Storage Drives CRU on page 113 Servicing Fan Modules CRU on page 130 Servicing Power S...

Page 95: ... interface Type the server SP IP address into a web browser and log in as a user with root or administrator privileges For more information refer to the Oracle X5 Series Servers Administration Guide at http www oracle com goto x86AdminDiag docs b In the Actions section of the Summary screen click the Power State Turn Off button This action powers off the server to standby power mode For more power...

Page 96: ...formed without removing the server entirely from the rack Instead the server can be slid out of the rack on its support rails to an extended and locked position called the maintenance position a At the back of the server verify that the cables have sufficient length and clearance to extend the server to the maintenance position without damaging or overextending the cables The cable management arm ...

Page 97: ...n latches inward d Slowly pull the server forward until both slide rails lock at the fully extended maintenance position The locking action is accompanied by an audible click The server is now in the maintenance position and ready for service 5 Optional Remove the server entirely from the rack See Optional Remove the Server from the Rack on page 99 6 Set up an ESD safe service location Preparing t...

Page 98: ...xtremely sensitive to static electricity Do not touch or handle components unless you are wearing a properly grounded anti static wrist strap Next Steps For component cold service procedures see Servicing CRU Components on page 113 Servicing FRU Components on page 179 Release the CMA If you are using a cable management arm CMA to gain additional access to the back of the server release and reposit...

Page 99: ...rver from the Rack To perform some service procedures you might find it necessary or more convenient to completely remove the server from the rack rather than work on the server while it is the maintenance position These optional steps show you how to remove the server entirely from the rack Preparing to Service the Server 99 ...

Page 100: ...sure that the server is in the maintenance position 3 Set up an ESD safe service location Caution Component ESD damage Circuit boards and hard drives contain electronic components that are extremely sensitive to static electricity Do not touch or handle components unless you are wearing a properly grounded anti static wrist strap See Performing Electrostatic Discharge and Static Prevention Measure...

Page 101: ... the rack Slide the server out of the rack and onto a mechanical lift 6 Place the server chassis on an anti static mat before servicing internal components 7 Remove the top cover See Remove the Server Cover on page 110 Powering Off the server This section provides procedures for powering off the server Power Off Graceful Power Button on page 102 Preparing to Service the Server 101 ...

Page 102: ... page 28 Power Off Graceful Power Button Note This procedure is performed locally and requires access to the server front panel Powering off the server by pressing the front panel Power button causes operating systems with Advanced Configuration and Power Interface ACPI to perform an orderly shutdown of the OS Non ACPI enabled operating systems might ignore this event and not shut down the host If...

Page 103: ...in standby power mode See Also Power Subsystem on page 28 Power Off Immediate Power Button Use this procedure to immediately power off the server to standby power mode An immediate shutdown should be used in emergency situations or when you know that the loss of data is nonexistent or acceptable Caution Data loss All applications and files close abruptly without saving Warn users and close all app...

Page 104: ...ff Remote Oracle ILOM CLI You can use the Oracle ILOM SP command line interface CLI to remotely power off the server to standby power mode 1 Open an SSH session and log in to the Oracle ILOM CLI Log in as a user with root or administrator privileges For example ssh root ipadress where ipadress is the IP address of the server SP For more information refer to the Oracle X5 Series Servers Administrat...

Page 105: ...ower mode 1 Log in to the Oracle ILOM web interface To log in open a web browser and enter the IP address of the server SP Log in as root or a user with administrator privileges For more information refer to the Oracle X5 Series Servers Administration Guide at http www oracle com goto x86AdminDiag docs The Summary screen appears 2 In the Actions section of the Summary screen verify that the power ...

Page 106: ...e for cold servicing 1 Place the server in standby power mode Use one of the power off methods See Powering Off the server on page 101 2 If necessary do the following a Extend the server to the maintenance position b Position the CMA 3 Access the back of the server 4 Remove the power cord retainer clips by lifting them up to disengage them from the power cords 106 Oracle Server X5 4 Service Manual...

Page 107: ...supplies For information about cold resets see Power Subsystem on page 28 Managing the Locator Indicator This section provides procedures for turning the Locator indicator on and off remotely using Oracle ILOM and locally using the front panel Locator button Turn On the Locator Indicator Remotely Oracle ILOM CLI on page 108 Turn On the Locator Indicator Remotely Oracle ILOM Web Interface on page 1...

Page 108: ...ation Guide at http www oracle com goto x86AdminDiag docs The Oracle ILOM CLI prompt appears 2 To turn on the Locator indicator type the following command at the prompt set System locator_indicator on Note To turn off the Locator indicator type set System locator_indicator off 3 To verify the status of the Locator indicator type show System locator_indicator The output of the command appears Syste...

Page 109: ...rface To log in open a web browser and direct it using the IP address of the server SP Log in as root or a user with administrator privileges For more information refer to the Oracle X5 Series Servers Administration Guide at http www oracle com goto x86AdminDiag docs The Summary screen appears 2 In the Actions section verify that the Locator indicator is off and then click the Turn On button 3 Cli...

Page 110: ...cator indicator button To turn on the Locator indicator press the Locator indicator button Note Some Oracle ILOM security procedures require that you turn on the Locator indicator locally as part of a physical presence verification step To perform a lamp test of all front panel indicator LEDs press the Locator indicator three times within a five second period All of the front panel LEDs light up a...

Page 111: ...f data and possible component damage Caution Loss of data and possible component damage Do not remove the server top cover until the server has been shut down to standby power mode Removing the top cover from a fully powered on server results in an immediate server power off 1 Ensure that the AC power cords are disconnected from the server power supplies 2 To unlatch the server top cover simultane...

Page 112: ...s and lift it away from the server Caution Component damage Part of the power interlock switch is mounted on the underside of the cover It can be damaged or misaligned if the cover is dropped or the component jarred Take care not to damage the switch 112 Oracle Server X5 4 Service Manual December 2015 ...

Page 113: ...page 160 DVD drive Servicing the DVD Drive CRU on page 168 Server system battery Replace the System Battery CRU on page 172 Servicing Storage Drives CRU This section describes server storage drives and provides procedures for removing and installing storage drives and slot filler panels Storage Drives Hot Plug Conditions on page 114 Storage Drive Failure and RAID on page 114 Remove a Storage Drive...

Page 114: ... then you must shut down the system before you replace the drive See Powering Off the server on page 101 Note Replacing a storage drive does not require removing the server from a rack Storage Drive Failure and RAID A single storage drive failure does not cause a data failure if the storage drives are configured as a RAID level 1 or higher The storage drive can be removed and a new storage drive i...

Page 115: ...abel Virtual PCIe Slot Number NVMe0 PCIe slot 100 NVMe1 PCIe slot 101 NVMe2 PCIe slot 102 NVMe3 PCIe slot 103 Remove a Storage Drive Filler Panel CRU For information about component filler panels see Component Filler Panels on page 81 1 Prepare the server for service See Preparing to Service the Server on page 93 2 If necessary press the Locator indicator button to deactivate the indicator 3 Ident...

Page 116: ...e online operations of the server 2 Do one of the following To hot plug a SAS drive a Take the drive offline This removes the logical software links to the drive and prevents any applications from accessing it To take a storage drive offline use OS specific commands or the HBA software MegaRAID or StorCLI b Prepare the server for service See Prepare the Server for Hot Service on page 93 To hot plu...

Page 117: ... See Storage Drive Reference on page 119 5 Push the storage drive s release button to open the latch 6 Grasp the latch and pull the drive out of the drive slot 7 Consider your next steps If you are replacing the drive continue to Install a Storage Drive CRU on page 118 If you are not replacing the drive Install a Storage Drive Filler Panel CRU on page 119 in the empty drive slot to maintain proper...

Page 118: ...re physically addressed according to the slot in which they are installed Before You Begin For serviceability considerations see Component Serviceability on page 70 For storage drive designation information see DVD Storage Drive and USB Designations on page 78 1 Prepare the server For hot service see Prepare the Server for Hot Service on page 93 For cold service see Prepare the Server for Cold Ser...

Page 119: ...u perform at this point depend on how your data is configured You might need to partition the drive create file systems load data from backups or have the drive updated from a RAID configuration See Also Storage Drive Reference on page 119 Install a Storage Drive Filler Panel CRU For information about component filler panels see Component Filler Panels on page 81 1 Verify that the release lever on...

Page 120: ...e information see Indicator Blink Rates on page 46 OK to Remove Indicator Blue indicator Indicates that the storage drive can be removed safely during a hot service operation Service Action Required Indicator Amber indicator Indicates that the storage drive is faulty The front and back panel Service Action Required indicators are also lit if the system detects a storage drive fault 120 Oracle Serv...

Page 121: ... drive must be powered off before replacement The power off procedure is done using operating system commands Failure to power off the virtual PCIe slot for an NVMe drive before a hotplug action can not only cause data loss but it can also crash the operating system This section provides instructions for how to remove and replace an NVMe storage drive on a server that is running the Oracle Solaris...

Page 122: ...e102 ENABLED PCIe Native pci 0 0 pci8086 2f06 2 2 pci111d 80b5 0 pci111d 80b5 6 pcie103 ENABLED PCIe Native pci 0 0 pci8086 2f06 2 2 pci111d 80b5 0 pci111d 80b5 7 3 Prepare the NVMe drive for removal by powering off the drive slot For example to prepare NVMe0 for removal type the following commands hotplug poweroff pcie100 hotplug list lc The following output appears for the NVMe0 drive that has b...

Page 123: ...onsider your next steps If you are replacing the drive continue to Install an NVMe Storage Drive in the Server on page 124 If you are not replacing the drive install a filler panel in the empty drive slot to maintain proper airflow and perform administrative tasks to configure the server to operate without the drive For information on how to install a storage drive filler panel see Install a Stora...

Page 124: ...t drive with the drive slot The drive is physically addressed according to the slot in which it is installed It is important to install a replacement drive in the same slot as the drive that was removed 4 Slide the drive into the slot until the drive is fully seated See Install a Storage Drive CRU on page 118 5 Close the drive latch to lock the drive in place Power On an NVMe Storage Drive Before ...

Page 125: ...ta low level format etc type nvmeadm list Related Information Storage Drive Reference on page 119 Storage Drives Hot Plug Conditions on page 114 Storage Drive Failure and RAID on page 114 DVD Storage Drive and USB Designations on page 78 Removing and Replacing an NVMe Storage Drive Using Oracle Linux Note NVMe storage drives are only supported on servers running the Oracle Solaris or Oracle Linux ...

Page 126: ...rive Virtual PCIe Slot Designation on page 115 Note that the virtual PCIe slot name is not the same as the name on the server front panel label 1 Log in to Oracle Linux that is running on the server 2 Obtain information about available NVMe storage devices a Obtain the PCIe addresses Bus Device Function of enabled NVMe drives Type find sys devices egrep nvme 0 9 0 9 This commands returns output si...

Page 127: ...d be dev nvme0n1p1 b Remove the device from any multiple device md and Logical Volume Manager LVM volume using it If the device is a member of an LVM Volume group then it may be necessary to move data off the device using the pvmove command then use the vgreduce command to remove the physical volume and optionally pvremove to remove the LVM meta data from the disk c If the device uses multipathing...

Page 128: ...are replacing the drive continue to Verify Removal of an NVMe Storage Drive on page 128 If you are not replacing the drive install a filler panel in the empty drive slot to maintain proper airflow and perform administrative tasks to configure the server to operate without the drive For information on how to install a storage drive filler panel see Install a Storage Drive Filler Panel CRU on page 1...

Page 129: ...hich it is installed It is important to install a replacement drive in the same slot as the drive that was removed 4 Slide the drive into the slot until the drive is fully seated See Install a Storage Drive CRU on page 118 5 Close the drive latch to lock the drive in place Power On an NVMe Storage Drive Before You Begin Linux NVMe hot plug requires the kernel boot argument pci pcie_bus_perf be set...

Page 130: ...ront row and a back row to provide redundancy If you remove a fan module replace it immediately Fan modules are hot serviceable components It is not necessary to power off the server or to remove the server cover to service a fan module However depending on server rack configuration it might be necessary to partially extend the server from the rack to access the fan modules Optional steps for part...

Page 131: ...have sufficient length and clearance to extend the server The cable management arm CMA that is supplied with the server is hinged to facilitate extending the server to the maintenance position However ensure that the cables do not impede the sliding movement and are not damaged or overextended by it b At the front of the server release the slide rails by pushing the two green latches inward 3 Iden...

Page 132: ...page 135 4 Lift the green handle on the fan module and use it to pull the module straight up and out of the server Caution Component damage Excessive movement or rocking of the fan module during removal can cause damage to the internal connector on the fan module board When removing a fan module do not rock it back and forth Next Steps Install a Fan Module on page 133 132 Oracle Server X5 4 Servic...

Page 133: ...le on page 130 1 If you are installing a replacement fan module for one that has failed check the indicator of the failed fan slot to ensure the fault indicator is no longer lit This is necessary to ensure the indicator status is cleared before you insert the new fan See Fan Module Reference on page 135 for fan module indicator locations 2 Orient the fan module so the connector on the bottom of th...

Page 134: ...label until the fan module is fully seated 5 Verify that the green OK indicator is lit 6 Verify that the Top Fan indicator and the Service Action Required indicator on the server front panel are not lit See Server Front Panel Features on page 17 and Server Back Panel Features on page 18 for locations of system indicators 7 If necessary return the server to the normal rack position 134 Oracle Serve...

Page 135: ...nt overheating of the server Note If a failed fan is replaced too quickly the fan indicator might still show a fault even after the new fan is installed When replacing a faulty fan wait for the fan indicator to turn off after removing the old fan and before installing the new fan This will only take a few seconds The functions of the fan module status indicators is described below Front and Back P...

Page 136: ...the fan module is functioning correctly Service Action Required Indicator Amber indicator The fan module is faulty The server front and back panel Service Action Required indicators are also lit if the system detects a fan module fault 136 Oracle Server X5 4 Service Manual December 2015 ...

Page 137: ...y on page 70 For power supply designation information see Component Designations on page 73 The server can be configured to use low line 110VAC input voltage in a 2 processor configuration however 4 processor configurations require power supplies to be configured with high line 220VAC input 1 Prepare the server For hot service see Prepare the Server for Hot Service on page 93 For cold service see ...

Page 138: ...slide it partially out of the chassis until you can support it with your free hand and remove it completely Next Steps Install a Power Supply on page 138 Install a Power Supply This procedure describes how to install a power supply PSU When installing a PSU ensure that the pawl near the hinge of the latch engages the slot in the sidewall of the PSU bay The pawl supplies the necessary leverage to s...

Page 139: ...ower supply handle is in the open position 2 Align the power supply with the empty power supply bay 3 Slide the power supply into the bay until it stops 4 To seat the power supply rotate the release handle upward until it locks in place Note The pawl at the hinge of the handle must engage the slot at the bottom of the power supply bay This action of rotating the handle upward draws the power suppl...

Page 140: ...llowing the server to operate when one of the power supplies fails However when the server is operating on one power supply redundancy no longer exists and the risk for an unexpected shut down and a loss of data is high When a power supply or any component that is part of a redundant configuration fails replace it immediately Power Supply Indicators Each power supply contains an indicator panel Th...

Page 141: ... Description 1 Amber Service Action Required 2 Green DC OK 3 Green AC OK Service Action Required Indicator Amber indicator Indicates that the power supply is faulty and service related action is required Servicing CRU Components 141 ...

Page 142: ... Servicing Memory Riser Cards and DIMMs CRU This section provides instructions for removing and installing memory riser cards and DIMMs Removing and Installing Memory Riser Cards and DIMMs on page 142 Memory Riser Card and DIMM Reference on page 154 Removing and Installing Memory Riser Cards and DIMMs Use the following procedures to remove and install memory risers DIMMs and filler panels Replace ...

Page 143: ...mponent Serviceability on page 70 For DIMM designation information see Component Designations on page 73 For reference information see Memory Riser Card and DIMM Reference on page 154 1 Identify the MR card containing the faulty DIMM See Locate a Failed Memory Riser Card DIMM or CPU on page 86 2 Remove the MR card See Remove a Memory Riser Card on page 145 3 Identify the faulty DIMM See Identify a...

Page 144: ...ference information see Memory Riser Card and DIMM Reference on page 154 1 Identify the faulty MR card See Locate a Failed Memory Riser Card DIMM or CPU on page 86 2 Remove the MR card See Remove a Memory Riser Card on page 145 3 Set the faulty card next to the replacement card on an ESD safe work space Tip Position the cards in the same orientation This makes it easier to transfer the DIMMs 4 Mak...

Page 145: ...IMM on page 148 b Install the DIMM on the replacement card See Install a DIMM on page 150 c Repeat the above steps until all DIMMs are transferred from the faulty card to the replacement card 6 Install the MR card See Install a Memory Riser Card on page 152 7 Prepare the server for operation See Prepare the Server for Operation on page 259 Remove a Memory Riser Card When servicing the components i...

Page 146: ...es upward to disengage the connector from the motherboard and carefully lift the memory riser straight up and out of the server The MR card is designed to fit tightly into the MR connector on the motherboard Th handles on the MR card provide leverage against the chassis to disengage the card s edge connector from the connector on the motherboard Next Steps Install a Memory Riser Card on page 152 o...

Page 147: ...are Faults Using Oracle ILOM on page 38 Oracle ILOM can provide the memory riser card and DIMM designations for the failed DIMM 2 If Oracle ILOM is showing multiple DIMMs in a failed state see Troubleshooting a Multi DIMM Failure State on page 159 3 Identify the memory riser card that contains the failed DIMM See Locate a Failed Memory Riser Card DIMM or CPU on page 86 4 Remove the MR card See Rem...

Page 148: ...the faulty DIMM Next Steps Remove a DIMM on page 148 Remove a DIMM When servicing the components in this section unplug the AC power cords and use ESD protection Note DIMMs are cold service components The server must be completely removed from its power source 148 Oracle Server X5 4 Service Manual December 2015 ...

Page 149: ...emory Riser Card and DIMM Reference on page 154 1 If necessary identify the faulty DIMM See Identify a Faulty DIMM on page 146 2 To remove the DIMM do the following a Rotate both DIMM slot ejector levers outward as far as they will go The action unlocks the DIMM and expels it from the socket b Carefully lift the DIMM straight up to remove it from the socket 3 Repeat the above steps until all fault...

Page 150: ...see Component Designations on page 73 For reference information see Memory Riser Card and DIMM Reference on page 154 1 Ensure that the DIMM ejector levers at both ends of the DIMM slot are in their fully open position 2 Align the DIMM with the empty slot Align the notch on the DIMM with the protrusion on the DIMM slot to ensure that the DIMM is installed correctly 3 Gently and evenly push the DIMM...

Page 151: ...DIMMs are installed Caution Component damage Ensure that all levers are closed and locked Open DIMM ejector levers can break off during the installation of the memory riser MR card All populated and unpopulated DIMM slot ejector levers on the MR card must be in the fully closed position before installing the card in the server Next Steps Install a Memory Riser Card on page 152 Servicing CRU Compon...

Page 152: ...age Open DIMM ejector levers can break off during the installation of the memory riser MR card All populated and unpopulated DIMM slot ejector levers on the MR card must be in the fully closed and locked position before installing the card in the server 2 Install the MR card as follows a Ensure that the MR card ejector levers are in the closed position The ejector levers are only used to remove a ...

Page 153: ... Press here to insert label on the metal bracket on top of the card This action seats the card in the connector on the motherboard 3 Prepare the server for operation See Prepare the Server for Operation on page 259 See Also Replace the Motherboard FRU on page 247 Servicing CRU Components 153 ...

Page 154: ...on page 155 Memory Riser Card Population Rules on page 156 Supported DIMMs and DIMM Population Rules on page 157 Troubleshooting a Multi DIMM Failure State on page 159 Memory Riser Card Components The following illustration shows the components of the memory riser card Callout Description Callout Description 1 Connector 5 DIMM ejector locking levers two on each slot 154 Oracle Server X5 4 Service ...

Page 155: ...s associated CPU are located inside the server on labels affixed to the rear MR card bracket The cards are designated as MR and the CPUs are designated as P The slots and CPUs are labeled from right to left when viewed from the front of the server as follows Note Each CPU has two assigned card slots MR0 and MR1 P0 MR0 rightmost slot P0 MR1 P1 MR0 P1 MR1 P2 MR0 P2 MR1 P3 MR0 P3 MR1 leftmost slot Th...

Page 156: ...each installed CPU must contain a memory riser card A two CPU system must contain four memory riser cards A four CPU system must contain eight memory riser cards 3 When populating the server with memory riser cards First populate riser slot MR0 for each CPU starting with the lowest numbered CPU P0 Then populate riser slot MR1 for each CPU starting with the lowest numbered CPU P0 156 Oracle Server ...

Page 157: ...supported Supported DIMM types and sizes available from Oracle Note DIMM system performance speed maximum is 1600 MHz in one or two DIMM per channel configuration or up to 1333 MHz in three DIMM per channel configuration even if the DIMMs are rated higher DIMM Size Type Organization 16 GB DDR3 1600 LV RDIMM Dual rank by 4 2Rx4 32 GB DDR3 1600 LV LRDIMM Quad rank by 4 4Rx4 Population rules Only one...

Page 158: ...and D10 black white slots This provides two DIMMs per channel 3 And finally populate riser slots D2 D5 D8 and D11 white white slots This provides three DIMMs per channel The memory slots and ejector levers are color coded using a black and white color scheme Slots can have a black slot with black levers black black slots black slot with white levers black white slots or white slot with white lever...

Page 159: ...mory riser card to become disabled or appear as if they have failed When a DIMM failure occurs check the Oracle ILOM system event log SEL to Identify the first DIMM that failed Note any additional DIMM failures occurring closely after the initial DIMM failure Identify the memory riser card that contains the failed DIMM Note the channel s in which any additional DIMM failures have occurred If anoth...

Page 160: ...the same memory buffer ASIC Additionally all of the DIMMs in both channels might have been disabled by the system This scenario could be an instance of a multi DIMM failure state How to Troubleshoot a Multi DIMM Failure State To troubleshoot this issue replace only the DIMM that logged the initial failure and return the server to operation to see if the multi DIMM failure state persists If a multi...

Page 161: ...nformation see Component Designations on page 73 1 Prepare for service See Prepare the Server for Cold Service on page 94 2 Locate the PCIe card that you want to remove See Server Back Panel Features on page 18 for information about PCIe slots and their locations 3 If are replacing a PCIe card with a card of the same type make a note of where the PCIe card is installed A list of supported PCIe car...

Page 162: ...ove a PCIe Card 5 To disengage the PCIe card retaining bar push down on the bar move it away from the server back wall and lift it to an upright position 162 Oracle Server X5 4 Service Manual December 2015 ...

Page 163: ...ld replace it with another PCIe card or a filler panel otherwise the server might overheat 7 If you are not installing a card in the slot install a PCIe slot filler 8 Return the PCIe card slot crossbar to its closed and locked position Next Steps Install a PCIe Card on page 164 or Replace the Motherboard FRU on page 247 Servicing CRU Components 163 ...

Page 164: ...l a PCIe card Caution Component damage Ensure that all power is removed from the server before removing or installing PCIe cards You must disconnect the power cables before performing this procedure Before You Begin For serviceability considerations see Component Serviceability on page 70 For PCIe slot designation information see Component Designations on page 73 1 Unpack the PCIe card and place i...

Page 165: ...CIe card retaining bar push down on the bar move it away from the server back wall and lift it to an upright position 4 If the slot has a PCIe filler panel remove it 5 Install the PCIe card into the PCIe card slot Servicing CRU Components 165 ...

Page 166: ...d in the Product Notes for the server 6 Return the PCIe card slot crossbar to its closed and locked position 7 Attach cables to the PCIe card as needed 8 Prepare the server for operation See Prepare the Server for Operation on page 259 9 If the PCIe card being installed is replacing a faulty PCIe card manually clear the PCIe card fault using Oracle ILOM 166 Oracle Server X5 4 Service Manual Decemb...

Page 167: ...Length and Capabilities The server contains 11 low profile PCIe 2 0 card slots which have the following length and capabilities Slots 1 2 3 4 5 6 7 9 and 10 have x8 connectors x8 electrical interface Slots 8 and 11 have x16 connectors x8 or x16 electrical interface PCIe Card Slot Population Order The total number of PCIe cards and the slot population order depends on the server CPU configuration A...

Page 168: ...r CPU configured server first determine if slot 11 is available If it is available install the card in the slot If it is not available determine if slot 8 is available If slot 8 is not available determine if slot 6 is available Continue this process with slots 4 10 7 5 3 9 and 1 until you find an available slot PCIe Cards With Boot Devices If the server has several PCIe cards that provide boot dev...

Page 169: ...re describes how to remove the DVD drive or a DVD drive filler panel Before You Begin For serviceability considerations see Component Serviceability on page 70 1 Prepare for service See Prepare the Server for Cold Service on page 94 To replace the DVD drive the server must be disconnected from the power source 2 At the front of the server push down on the latch on the top left corner of the DVD dr...

Page 170: ...eplace it with another DVD drive or a filler panel otherwise the server might overheat due to improper airflow Next Steps Install the DVD Drive or DVD Drive Filler Panel on page 170 Install the DVD Drive or DVD Drive Filler Panel When servicing the components in this section unplug the AC power cords and use ESD protection 170 Oracle Server X5 4 Service Manual December 2015 ...

Page 171: ...DVD drive You must disconnect the power cables before performing this procedure This procedure describes how to install the DVD drive or a DVD drive filler panel Before You Begin Remove the DVD Drive or DVD Drive Filler Panel on page 168 1 Unpack the DVD drive or filler panel If it is a DVD drive place it on an anti static mat Servicing CRU Components 171 ...

Page 172: ...ront of the chassis until it seats 3 Prepare the server for operation See Prepare the Server for Operation on page 259 Replace the System Battery CRU This section provides instructions for replacing the server system RTC battery 172 Oracle Server X5 4 Service Manual December 2015 ...

Page 173: ...C power Use the following procedures to remove and replace the system battery when it has failed Caution Ensure that all power is removed from the server before removing or installing the battery You must disconnect the power cables from the system before performing these procedures 1 Prepare for service See Prepare the Server for Cold Service on page 94 2 Locate the system battery Servicing CRU C...

Page 174: ...ard in slot 1 You might need to remove the card to access the battery See Remove a PCIe Card on page 161 4 Remove the battery from the battery holder by pushing the back of the battery negative side toward the metal tab on the positive side and lifting the battery up and out of the battery holder Take care not to deform the tab when pushing against it 174 Oracle Server X5 4 Service Manual December...

Page 175: ...l tab on the positive side of the battery The metal tab maintains the positive battery connection and secures the battery in the holder 5 Press the new battery into the battery holder with the positive side facing the metal tab that holds it in place Servicing CRU Components 175 ...

Page 176: ... with a network time server using the Network Time Protocol NTP the Oracle ILOM clock resets as soon as the server is powered on and connected to the network For instructions see the Oracle Integrated Lights Out Manager 3 2 x Documentation Library at http www oracle com goto ILOM docs 7 Prepare the server for operation See Prepare the Server for Operation on page 259 8 Use the BIOS Setup Utility t...

Page 177: ...Replace the System Battery CRU Refer to BIOS Setup Utility Menu Options on page 273 for information about using the BIOS Setup Utility Servicing CRU Components 177 ...

Page 178: ...178 Oracle Server X5 4 Service Manual December 2015 ...

Page 179: ...cedures and reference information for the optional factory installed PCIe NVMe Switch card Servicing the Factory Installed PCIe NVMe Switch Card on page 212 Replacement procedures and reference information for the server fan board Replace the Fan Board FRU on page 221 Replacement procedures and reference information for the server power supply backplane board Replace the Power Supply Backplane Boa...

Page 180: ...ink and CPU FRU on page 186 Install a Heatsink and CPU FRU on page 193 Replace a Faulty CPU FRU Disconnect the server from the AC power and protect components from ESD by wearing an antistatic wrist strap For processor overview information see Processor Subsystem on page 22 Before You Begin For serviceability considerations see Component Serviceability on page 70 For CPU designation information se...

Page 181: ...board remove the covers and install them on the failed board Before You Begin For serviceability considerations see Component Serviceability on page 70 For CPU designation information see Component Designations on page 73 1 Prepare the server for service See Prepare the Server for Cold Service on page 94 2 Disengage the CPU load plate release levers by pushing them down and moving them slightly to...

Page 182: ... is in its fully open position the load plate is unlocked 4 To open the load plate lift the unhinged end to its fully open position A black plastic cover CPU cover plate is attached to the load plate 182 Oracle Server X5 4 Service Manual December 2015 ...

Page 183: ... cover is snap fitted into the opening in the load plate Next Steps Install a CPU Cover Plate on page 183 Install a Heatsink and CPU FRU on page 193 Install a CPU Cover Plate When servicing the components in this section unplug the AC power cords and use ESD protection Servicing FRU Components 183 ...

Page 184: ...gnation information see Component Designations on page 73 1 Prepare the server for service See Prepare the Server for Cold Service on page 94 2 Disengage the CPU load plate release levers by pushing them down and moving them slightly toward the CPU socket and away from their retaining clips The levers are numbered with their required order of operation The left side lever when viewed from the fron...

Page 185: ...move the CPU using the CPU replacement tool See Remove a Heatsink and CPU FRU on page 186 6 To install the CPU cover plate push it onto the top side of the load plate The cover snap into the opening in the load plate Servicing FRU Components 185 ...

Page 186: ... AC power cords and use ESD protection When replacing a failed CPU use this procedure to remove a heatsink and CPU Before You Begin For serviceability considerations see Component Serviceability on page 70 For CPU designation information see Component Designations on page 73 1 Prepare for service 186 Oracle Server X5 4 Service Manual December 2015 ...

Page 187: ...6 3 Remove the two memory riser cards associated with the failed CPU 4 Remove the heatsink a Unscrew the four Phillips screws from the heatsink Turn the screws alternately one and one half turns until they are fully removed A thermal compound applied to the top of the CPU facilitates heat transfer to the heatsink and acts as an adhesive Servicing FRU Components 187 ...

Page 188: ...eal created by the thermal compound by slightly twisting the heatsink left and right while pulling it upward Do not allow the thermal compound to contaminate other components Retain the heatsink You need to reuse it 188 Oracle Server X5 4 Service Manual December 2015 ...

Page 189: ...e Failure to clean the thermal compound from the heatsink and the CPU prior to removing the CPU could result in accidental contamination of the CPU socket the removal tool or other components Also be careful not to get the grease on your fingers as this could result in contamination of components To access the CPU the CPU load plate needs to be opened The load plate is locked in its closed positio...

Page 190: ... in its fully open position the load plate is unlocked 7 To open the load plate lift the unhinged end to its fully open position Caution Component damage The pins of the CPU socket can be easily damaged To remove the CPU use the correct CPU replacement tool 8 To remove the CPU use the CPU replacement tool The tool is used to remove and install the CPU in the socket The top side of the replacement ...

Page 191: ...bel with a downward pointing triangle Likewise the CPU is marked with a triangle on one of its corners This is a key that aligns the tool and the CPU with the CPU socket The tool and the CPU are correctly positioned with the socket when all of the triangles are aligned b Orient the bottom of the tool over the CPU ensuring that the triangle on the tool aligns with the triangle on the CPU c Lower th...

Page 192: ...acts are facing upward and the topside of the tool is facing downward g Hold the CPU by its edges h On the topside of the tool which is facing downward pull the release tab away from the center button This action is accompanied by a click sound as the tool releases its hold on the CPU 192 Oracle Server X5 4 Service Manual December 2015 ...

Page 193: ...underside Next Steps Replace a Faulty CPU FRU on page 180 or Install a Heatsink and CPU FRU on page 193 or Replace the Motherboard FRU on page 247 Install a Heatsink and CPU FRU Disconnect the server from the AC power and protect components from ESD by wearing an antistatic wrist strap Servicing FRU Components 193 ...

Page 194: ...ter and a tab on one side Pressing down on the button opens the tool Pressing the tab releases the button and closes the tool a Press down on the release button on top of the replacement tool This action opens the tool On one corner of the tool there is a label with a downward pointing triangle Likewise the CPU is marked with a triangle on one of its corners This is a key that aids in correctly po...

Page 195: ...nt of the CPU within the tool 3 Turn the tool over so that the CPU contacts are facing downward This positions the tool with the topside facing upward 4 Orient the tool so that the triangle on the tool aligns with the triangle on the socket 5 Lower the tool onto the socket ensuring that the CPU is correctly positioned and sits flat and evenly in the socket When the CPU is correctly positioned ther...

Page 196: ...nly within the socket 9 Close the CPU load plate 10 Lower and lock the right side lever ensuring that the lever is secured under its retaining clip and that the bend in the lever locks the cover plate The right side lever must be closed first 196 Oracle Server X5 4 Service Manual December 2015 ...

Page 197: ...er its retaining clip 12 To apply the thermal compound dispense the contents of the syringe as a single dollop in the center on the top of the CPU Do not spread the thermal compound The pressure applied during the heatsink installation performs this action 13 To install the heatsink Servicing FRU Components 197 ...

Page 198: ...ve spring loaded heatsink screws with the threaded standoffs on the motherboard b Set the heatsink on top of the CPU Once the heatsink is in contact with the CPU avoid extra movement of the heatsink 198 Oracle Server X5 4 Service Manual December 2015 ...

Page 199: ...htened 14 Prepare the server for operation See Prepare the Server for Operation on page 259 15 If the CPU being installed is replacing a faulty CPU manually clear the CPU fault using Oracle ILOM See Clear Hardware Fault Messages on page 91 See Also Replace a Faulty CPU FRU on page 180 Replace the Motherboard FRU on page 247 Servicing FRU Components 199 ...

Page 200: ... 203 Replace the SAS 12 Gb s Internal HBA SAS Cables FRU on page 204 Replace the SAS 12 Gb s Internal HBA ESM Cable FRU on page 209 Replace the SAS 12 Gb s Internal HBA FRU When servicing the components in this section unplug the AC power cords and use ESD protection Before You Begin If the HBA being replaced is already configured with RAID and its configurations have been saved to a RAID configur...

Page 201: ...Remove a PCIe Card on page 161 3 To install the replacement card connect the cables to the replacement HBA card and install the card in PCIe slot 2 The HBA card has two SAS cables the white labeled cable is 0 and the yellow labeled cable is 1 and an ESM cable that need to be connected before installing the card in the slot Servicing FRU Components 201 ...

Page 202: ...replacement card If you are replacing an HBA that was already configured for RAID obtain the saved configuration file to restore to the replacement HBA card For details on configuring or recovering RAID configurations refer to the Avago Technologies LSI Storage 12Gb s MegaRAID SAS Software User s Guide which is available at the following location http www lsi com sep Pages oracle index aspx 202 Or...

Page 203: ...on 1 Prepare the server for service See Prepare the Server for Cold Service on page 94 2 Disconnect the ESM cable from the ESM and remove the ESM by prying it off the dual lock securing tape on the chassis The ESM is held securely by a heavy duty dual lock strip and might not come off easily 3 Install the new ESM and attach the ESM cable Servicing FRU Components 203 ...

Page 204: ...SM to the heavy duty dual lock strip on the chassis Double check to ensure the dual lock connection is secure Replace the SAS 12 Gb s Internal HBA SAS Cables FRU When servicing the components in this section unplug the AC power cords and use ESD protection 204 Oracle Server X5 4 Service Manual December 2015 ...

Page 205: ... for removal See Remove a Memory Riser Card on page 145 3 Disconnect the two SAS cables from the HBA card in PCIe slot 2 and the DVD SATA cable that branches off of the HBA SAS cables from the motherboard If needed you can first remove the HBA card from its PCIe slot to gain better access to the cable connectors 4 Disconnect the two SAS HBA cables 0 and 1 from the disk backplane board Servicing FR...

Page 206: ...ables from the air divider as follows a Detach the NVMe if installed HBA and ESM cables from the three cable clips on the memory riser side of the air divider Then carefully lift the cables up and out of the cable slot B in the air divider that provides access to the disk backplane area 206 Oracle Server X5 4 Service Manual December 2015 ...

Page 207: ...power supply just enough to allow you to slide out the HBA cables The HBA cables need to be completely free of the air divider 6 Carefully thread the ends of HBA cables you detached from the HBA through the narrow space between the P0 heat sink and the power supply cage and up and out of the system The space between the P0 heat sink and the power supply cage is narrow the SAS cable connectors will...

Page 208: ...nd the power supply cage 8 Reconnect the SAS HBA cables to the HBA card and the SATA cable to the motherboard The white labeled cable is 0 and the yellow labeled cable is 1 If needed reinstall the HBA card to PCIe slot 2 if you removed it earlier 9 Reroute the SAS HBA cables through the air divider to the disk backplane area Refer to the figure in step 5 for cable routing 10 Reconnect the SAS HBA ...

Page 209: ...ory risers you removed earlier See Install a Memory Riser Card on page 152 12 Prepare the server for operation See Prepare the Server for Operation on page 259 Replace the SAS 12 Gb s Internal HBA ESM Cable FRU 1 Prepare the server for service See Prepare the Server for Cold Service on page 94 2 Disconnect the ESM cable from the HBA card in PCIe slot 2 and the ESM module Servicing FRU Components 2...

Page 210: ...cable connections 3 Remove the SAS HBA cables from the air divider as follows a Detach the ESM cable from the cable clip on the memory riser side of the air divider Then carefully lift the cable up and out of the cable slot B in the air divider that provides access to the disk backplane area 210 Oracle Server X5 4 Service Manual December 2015 ...

Page 211: ...able needs to be completely free of the air divider 4 Carefully thread the end of ESM cable you detached from the HBA through the narrow space between the P0 heat sink and the power supply cage and up and out of the system 5 To install the replacement cable carefully thread the to HBA end of the cable through the narrow space between the P0 heat sink and the power supply cage 6 Attach the ESM cabl...

Page 212: ...stalled PCIe NVMe Switch Card This section provides procedures replacing the NVMe Switch card and cables For overview information on the factory installed PCIe NVMe Switch card see Storage Subsystem on page 30 For serviceability information related to this component see Component Serviceability Locations and Designations on page 69 Replace the NVMe Switch Card FRU on page 213 Replace the NVMe Swit...

Page 213: ...rotection 1 Prepare the server for service See Prepare the Server for Cold Service on page 94 2 Remove the NVMe Switch card from PCIe slot 1 slot and disconnect cables attached to it Removing the card from the slot allows easy access to the connected cables For details on removing a card see Remove a PCIe Card on page 161 Servicing FRU Components 213 ...

Page 214: ...t card connect the cables to the replacement NVMe Switch card and install the card in PCIe slot 1 The NVMe Switch card has four cables 0 through 3 that need to be connected before installing the card in the slot For details on installing a card see Install a PCIe Card on page 164 214 Oracle Server X5 4 Service Manual December 2015 ...

Page 215: ...y works in PCIe slot 1 4 Prepare the server for operation See Prepare the Server for Operation on page 259 Replace the NVMe Switch Card Cables FRU When servicing the components in this section unplug the AC power cords and use ESD protection Servicing FRU Components 215 ...

Page 216: ... for Cold Service on page 94 2 Remove the P0 MR0 MR1 memory risers This gives you room to access the cables for removal See Remove a Memory Riser Card on page 145 3 Disconnect the four NVME cables 0 through 3 from the switch card in PCIe slot 1 216 Oracle Server X5 4 Service Manual December 2015 ...

Page 217: ...Replace the NVMe Switch Card Cables FRU If needed first remove the NVMe Switch card from its PCIe slot to gain better access to the cable connectors Servicing FRU Components 217 ...

Page 218: ...VMe cables from the air divider as follows a Detach the NVMe HBA and ESM cables from the three cable clips on the memory riser side of the air divider Then carefully lift the cables up and out of the cable slot B in the air divider that provides access to the disk backplane area 218 Oracle Server X5 4 Service Manual December 2015 ...

Page 219: ...gh to allow you to slide out the NVMe cables The NVMe cables need to be completely free of the air divider 6 Carefully thread the ends of NVMe cables you detached from the NVMe Switch card through the narrow space between the P0 heat sink and the power supply cage and up and out of the system The space between the P0 heat sink and the power supply cage is narrow the NVMe cable connectors will only...

Page 220: ...through the narrow space between the P0 heat sink and the power supply cage 8 Reconnect the NVMe cables to the NVMe Switch card If needed reinstall the NVMe Switch card in PCIe slot 1 if you removed it earlier Note The NVMe Switch card only works in PCIe slot 1 9 Reroute the NVMe cables through the air divider to the disk backplane area Refer to the figure in step 5 for cable routing 10 Reconnect ...

Page 221: ...re the Server for Operation on page 259 Replace the Fan Board FRU This section provides instructions for replacing the fan board When servicing the components in this section unplug the AC power cords and use ESD protection Before You Begin For serviceability considerations see Component Serviceability on page 70 1 Prepare the server for service See Prepare the Server for Cold Service on page 94 2...

Page 222: ...he fan board a Loosen the three captive screws connecting the front side memory riser guide to the motherboard b Remove the two screws on each side of the outside of the chassis that hold the fan board unit in place c Unplug the fan board data and power cables from motherboard 222 Oracle Server X5 4 Service Manual December 2015 ...

Page 223: ...rd unit slide it away from the front of the server to clear the lip at the front of the chassis and lift it out of the server 6 Remove the fan board data and power cables from the faulty fan board unit and plug them into the fan board on the replacement fan board unit 7 To install the fan board unit Servicing FRU Components 223 ...

Page 224: ...sert the fan board unit into the chassis moving it down and toward the front b Reposition the front memory riser guide routing the fan board and power cable through the riser guide 224 Oracle Server X5 4 Service Manual December 2015 ...

Page 225: ...ive screws to hold the front memory riser guide in place e To secure the fan board unit in place fully tighten the two screws that secure the riser guide to the chassis 8 Install the fan modules See Install a Fan Module on page 133 9 Install the memory risers See Install a Memory Riser Card on page 152 10 Prepare the server for operation See Prepare the Server for Operation on page 259 Servicing F...

Page 226: ...servicing the power supply backplane board Before You Begin For serviceability considerations see Component Serviceability on page 70 1 Prepare the server for service See Prepare the Server for Cold Service on page 94 2 Disconnect the SAS SATA cables and the NVMe cables if installed from the disk drive backplane and their PCIe card connections See Replace the NVMe Switch Card Cables FRU on page 21...

Page 227: ...e removed from the system and can remain plugged into the fan board However care must be taken not to damage these cables when removing or inserting the motherboard 8 To disconnect the power supplies from the backplane connectors remove or pull both power supplies at least part way out of the chassis See Remove a Power Supply on page 137 9 Move the air divider The air divider separates the disk dr...

Page 228: ...y can move easily in the gap between the power supply side wall and CPU0 without hanging on the CPU0 heatsink radiator fins b Move the air divider away from the side wall and gently rotate the divider and the cables attached to it away from the backplane area and set it down on the motherboard in the empty memory riser area 10 Disconnect the disk drive backplane power and data cables from the disk...

Page 229: ...ackplane bus bar to the motherboard The backplane board rests on the two support flanges 14 Disconnect the two power supply cables from the back of the power supply backplane board 15 Loosen the green captive screw that secures the motherboard to the chassis Servicing FRU Components 229 ...

Page 230: ...t to slide the motherboard toward the front of the server This action unlocks the motherboard and plate assembly Note As you slide the motherboard forward check that the Locator indicator light pipe extension piece slides out of its hole in the chassis back wall 17 While gently sliding it away from the back of the server carefully lift the front end of the motherboard several inches 230 Oracle Ser...

Page 231: ... during removal ensure that you retrieve it from the server The extension is a clear plastic piece that transmits light and allows you to activate the Locator indicator switch from the back of the server 18 To remove the motherboard slowly guide it up and out of the server Servicing FRU Components 231 ...

Page 232: ...Replace the Power Supply Backplane Board FRU 19 Lift the power supply backplane board off the support flanges and out of the chassis 232 Oracle Server X5 4 Service Manual December 2015 ...

Page 233: ...two power supply cables to the connectors on the back side of the power supply backplane board 22 Lower the motherboard into the server and guide the light pipe extension piece for the Locator indicator at the back of the motherboard into its hole on the server back wall This should also align the bus bar holes on the motherboard to the power supply backplane bus bar connector holes Servicing FRU ...

Page 234: ...are under the motherboard bus bar connection pads 23 Ensure that the Locator indicator switch at the back of the server operates easily and is not stuck in the depressed position 24 To secure the motherboard to the chassis tighten the captive screw 234 Oracle Server X5 4 Service Manual December 2015 ...

Page 235: ...Backplane Board FRU 25 Use the four screws to secure the bus bar to the motherboard 26 Replace the power supply cover and connect the ribbon cable from the motherboard to the power supply backplane Servicing FRU Components 235 ...

Page 236: ...e the motherboard mounted switch the divider must be installed correctly a Gently rotate the air divider and cables from where you set it down in step 9 back to its proper position Ensure that all cables lay flat against the power supply side wall and do not cross over each other Do not allow the cables to interfere with the Fault Remind button mechanism button extension or light pipe Caution Hard...

Page 237: ...RU on page 215 31 Reconnect the ESM cable to the ESM See Replace the SAS 12 Gb s Internal HBA ESM Cable FRU on page 209 Or if you removed the ESM reattach it to the dual lock strip on the chassis 32 Reinstall the memory risers See Install a Memory Riser Card on page 152 33 For a two CPU system install the air baffle The air baffle simply drops into place using existing memory riser guides 34 Insta...

Page 238: ...r slots label the drives with their slot position 3 Remove the DVD drive See Remove the DVD Drive or DVD Drive Filler Panel on page 168 4 Disconnect the SAS SATA cables and any NVMe cables if present from the disk backplane See Replace the NVMe Switch Card Cables FRU on page 215 and Replace the SAS 12 Gb s Internal HBA SAS Cables FRU on page 204 This will help provide the room needed to remove the...

Page 239: ...de wall and gently rotate the divider and the cables attached to it away from the backplane area and set it on top of installed memory risers 7 Disconnect the ribbon data cable and the power cable at the bottom of the disk backplane board See the illustration shown in step 8 8 To release the spring loaded lever 1 lift it upward 2 The disk drive backplane sets on metal flanges and is secured by a s...

Page 240: ...it to slide the DVD connector out from under the disk drive mounting cage 10 Orient the replacement disk drive backplane board in the chassis 11 Tilt the backplane board and insert its bottom edge in the plastic slot at the bottom of the server 240 Oracle Server X5 4 Service Manual December 2015 ...

Page 241: ... side of the board needs to be positioned under the disk drive mounting cage 12 Lift the spring loaded metal hook and tilt the backplane board to its upright position 13 Set the board on its support flanges 14 To secure the board release the metal hook Servicing FRU Components 241 ...

Page 242: ...tly rotate the air divider and cables from where you set it down in step 6 back to its proper position Ensure that all cables lay flat against the power supply side wall and do not cross over each other Do not allow the cables to interfere with the Fault Remind button mechanism button extension or light pipe b Align the two tabs on the divider with the two slots in the power supply side wall c Pus...

Page 243: ...e chassis 19 Install all disk drives and filler panels See Install a Storage Drive CRU on page 118 20 Install the DVD drive See Install the DVD Drive or DVD Drive Filler Panel on page 170 21 Prepare the server for operation See Prepare the Server for Operation on page 259 Note The product serial number used for service entitlement and warranty coverage might need to be reprogrammed by authorized s...

Page 244: ...on Before You Begin For serviceability considerations see Component Serviceability on page 70 1 Prepare the server for service See Prepare the Server for Cold Service on page 94 2 Disconnect the SP card cable The SP card is mounted on the motherboard between the two groups of PCIe slots 244 Oracle Server X5 4 Service Manual December 2015 ...

Page 245: ...ard 4 To remove the SP card disconnect it by pulling it upward and then lift it out of the server Next Steps Install the SP Card FRU on page 245 Install the SP Card FRU When servicing the components in this section unplug the AC power cords and use ESD protection Servicing FRU Components 245 ...

Page 246: ... connectors facing downward The green captive screw head faces upward 2 Align the connectors on the bottom of the SP card with the connectors on the motherboard Use the screw hole and card mounting bracket to assist with the alignment When correctly positioned the mounting bracket cradles the edges of the card 246 Oracle Server X5 4 Service Manual December 2015 ...

Page 247: ...onnector on the SP Card 5 To secure the card tighten the green captive screw 6 Prepare the server for operation See Prepare the Server for Operation on page 259 Replace the Motherboard FRU This section provides instructions for replacing the server motherboard When servicing the components in this section unplug the AC power cords and use ESD protection Servicing FRU Components 247 ...

Page 248: ... all PCIe cards from the server disconnecting any external or internal cables and taking care to note their cable arrangement and slot assignments See Remove a PCIe Card on page 161 The slot population on the replacement motherboard needs to match the population on the failed board 4 If the server has only two CPUs remove the air baffle The air baffle simply lifts straight up and out of the system...

Page 249: ...e cables if present from the disk backplane See Replace the NVMe Switch Card Cables FRU on page 215 and Replace the SAS 12 Gb s Internal HBA SAS Cables FRU on page 204 8 Remove the ESM module from its dual lock strip on the chassis See Replace the SAS 12 Gb s Internal HBA ESM Module FRU on page 203 9 Remove the air divider The divider is mounted to the power supply side wall using two tabs which a...

Page 250: ...rea b Then slid each cable up and out of the three air divider cable clips so that they are loose and gently place them on the memory riser side of the air divider c Slide the air divider upwards so its tabs clear the slots in the power supply side wall d Lift the air divider out of the system leaving the cables SAS NVMe ESM 250 Oracle Server X5 4 Service Manual December 2015 ...

Page 251: ...for the disk backplane See Replace the Disk Drive Backplane FRU on page 238 12 Remove the power supply cable from the motherboard Connected to the motherboard from the power supply backplane 13 Remove any USB flash drives attached to the internal USB ports Make note of the ports for each USB flash drive 14 Remove the heatsinks and CPUs from the motherboard See Remove a Heatsink and CPU FRU on page...

Page 252: ...e chassis use the rear handle by the SP connector and not the memory riser guide as it might bend The motherboard is mounted to a metal plate The plate has eight keyed slots that align with eight mushroom head standoffs mounted to the bottom of the chassis The standoffs lock the motherboard and plate assembly to the chassis To unlock the assembly you need to slide the assembly toward the front of ...

Page 253: ... remove the motherboard slowly guide it up and out of the server 21 Lift the replacement motherboard by the memory riser card guide and the handle above the SP card slot Note Ensure that the removable light pipe extension piece for the Locator indicator is attached to the indicator switch The extension is a clear plastic piece that transmits light and allows you to activate the Locator switch from...

Page 254: ...sure that the keyed holes in the plate attached to the underside of the motherboard are aligned with the locking standoffs in the chassis 25 Slide the motherboard toward the back of the server Ensure that motherboard rear connectors fit completely into the holes provided in the chassis sheet metal This action locks the motherboard and aligns the captive screw on the motherboard plate towards the f...

Page 255: ...nnects to the motherboard from the power supply backplane 30 Reinstall the disk backplane power and data cables 31 Reinstall any USB flash drives that were removed from the internal USB ports 32 Reinstall the system battery 33 Carefully thread the to PCIe card end of each cable SAS NVMe if present and ESM between the CPU 0 heatsink and the power supply side wall and in to the PCIe area Some of the...

Page 256: ...engage with the slots in the power supply side wall Ensure that the flanges on the divider enter their respective slots on the side wall and that the Fault Remind button extender is aligned with the button on the motherboard c Insert cables SAS NVMe ESM into the air divider cable shield by gently prying the shield A in the illustration below away from the power supply side wall enough to slide the...

Page 257: ...divider cable clips in the order shown in the illustration above e Then route the cables through the slot in the air divider B in the illustration above to the disk backplane area 35 Reinstall the ESM module to its dual lock strip on the chassis See Replace the SAS 12 Gb s Internal HBA ESM Module FRU on page 203 36 Reconnect the SAS SATA cables and any NVMe cables if present to the disk backplane ...

Page 258: ...Install a Memory Riser Card on page 152 40 For a two CPU system install the air baffle The air baffle is simply lowered into place on the motherboard utilizing available memory riser slot guides It does not attach to anything 41 Install all PCIe cards See Install a PCIe Card on page 164 Reconnect internal SAS NVMe if present and ESM cables and external cables as applicable 42 Install the SP card S...

Page 259: ...ls and CMA on page 268 Procedure to reposition the server in the rack Return the Server to the Normal Rack Position on page 270 Procedure to power on the server Power On the Server on page 271 Prepare the Server for Operation 1 Ensure that all components are completely installed Check for disconnected cables and unseated components and connect and install them correctly 2 Place the cover on top of...

Page 260: ...and that both latches are fully engaged 7 Lift both latches and firmly push down on the front edge of the cover until both latches lock with an audible click 8 Release the latches and verfy that the cover is locked down 9 Optional If you removed the server entirely from the rack install it now See Optional Install the Server Into the Rack on page 262 10 To return the server to its normal rack posi...

Page 261: ...k 11 Verify that the server is securely mounted in the rack and that the slide rail locks are engaged with the mounting brackets 12 At the rear of the server connect the AC power cords to the server power supplies When the power cords are connected to the server the server powers on to standby power mode Returning the Server to Operation 261 ...

Page 262: ... Management Arm on page 266 Swing the CMA closed and latch it to the left rack rail 16 Power on the server See Power On the Server on page 271 Optional Install the Server Into the Rack Before You Begin When preparing the server for operation use these optional steps to install the server in the rack Caution Physical or component damage The server is heavy and cannot be safely installed in the rack...

Page 263: ...are aligned with the slide rails Caution Physical or component damage The server might fall if the mounting brackets are not inserted properly into the slide rails Ensure that the mounting lips are properly aligned and then insert the brackets into the slide rails properly 4 Insert the mounting brackets into the slide rails and push the server into the rack until the mounting brackets encounter th...

Page 264: ...server does not slide easily it might not be inserted properly 5 To unlock the server and slide it the rest of the way into the rack simultaneously pull and hold the green slide rail release buttons on each mounting bracket and push the server into the rack until it locks into place with an audible click 264 Oracle Server X5 4 Service Manual December 2015 ...

Page 265: ...power supplies When the power cables are connected to the server the server powers on to standby power mode 8 Connect any other cables to their connectors or ports on the back of the server If the cable management arm CMA is in the way disconnect the left CMA release and swing the CMA open 9 If necessary reconnect the CMA See Optional Install Cable Management Arm on page 266 Swing the CMA closed a...

Page 266: ...r On the Server on page 271 Optional Install Cable Management Arm 1 Insert the CMA s mounting bracket connector into the right slide rail until the connector locks into place with an audible click 266 Oracle Server X5 4 Service Manual December 2015 ...

Page 267: ...l Install Cable Management Arm 2 Insert the right CMA slide rail connector 1 into the right slide rail assembly 2 until the connector locks into place with an audible click Returning the Server to Operation 267 ...

Page 268: ...re attach the cable hook and loop straps to the CMA and press them into place to secure the cables For best results place three evenly spaced cable straps on the rear facing side of the CMA and three cable straps on the side of the CMA nearest the server Verify Operation of Slide Rails and CMA Use the following procedure to ensure that the slide rails and CMA are operating correctly 268 Oracle Ser...

Page 269: ... rail stops to return the server to the rack a Push in both green levers simultaneously and slide the server toward the rack The first set of stops are levers located on the inside of each slide rail just behind the back panel of the server The server slides in approximately 18 inches 46 cm and stops Verify that the cables and the CMA retract without binding before you continue b Push the server c...

Page 270: ...rail 2 While pushing on the release tabs slowly push the server into the rack Ensure that the cables do not get in the way 3 Reconnect the cables to the back of the server If the cable management arm CMA is in the way disconnect the left CMA release and swing the CMA open 4 Reconnect the CMA Swing the CMA closed and latch it to the left rack rail 270 Oracle Server X5 4 Service Manual December 2015...

Page 271: ...d After the service processor has booted the System OK indicator on the front panel begins flashing slowly indicating that the host is in standby power mode 2 Press and release the recessed Power button on the server front panel When full power is applied to the server the System OK indicator begins to blink more quickly as the system begins the boot process During the boot process the server init...

Page 272: ...272 Oracle Server X5 4 Service Manual December 2015 ...

Page 273: ...he motherboard and managed using the BIOS setup utility The utility reports system information and provides a graphical user interface that allows you to change the server BIOS settings from the factory configured defaults The BIOS has two operational boot modes Legacy and UEFI Changing modes changes the content of some utility screens The legacy boot mode is the default For a listing of the BIOS ...

Page 274: ... Advanced Configuration information for processors CPU power management USB ports serial ports trusted computing network stack legacy iSCSI BMC network configuration and UEFI iSCSI configuration IO Configuration interface for plug and play PnP devices virtualization internal devices and add in cards Boot Configuration interface for boot settings including boot mode Legacy UEFI Oracle System Assist...

Page 275: ...in Screen Project Version System Date System Time QPI Link Speed Total Memory Current Memory Speed USB Devices BMC Status BMC Firmware Revision Product Information CPU Information DIMM Information Security BIOS Setup Utility Menu Options 275 ...

Page 276: ...About the BIOS Setup Utility Keywords Main Product Information Product Name Product Serial Number Board Serial Number 276 Oracle Server X5 4 Service Manual December 2015 ...

Page 277: ...in Screen Project Version System Date System Time QPI Link Speed Total Memory Current Memory Speed USB Devices BMC Status BMC Firmware Revision Product Information CPU Information DIMM Information Security BIOS Setup Utility Menu Options 277 ...

Page 278: ... Utility Keywords Main CPU Information Socket 0 CPU Information Socket 1 CPU Information Socket 2 CPU Information Socket 3 CPU Information Socket Specific CPU Information 278 Oracle Server X5 4 Service Manual December 2015 ...

Page 279: ...ation Socket 0 CPU Information Intel Xeon CPU Et 4890 v2 CPU Signature Microcode Patch Max CPU Speed min CPU Speed Processor Cores Intel HT Technology Intel VT x Technology L1 Data Cache L1 Code Cache L2 Cache L3 Cache BIOS Setup Utility Menu Options 279 ...

Page 280: ...n Project Version System Date System Time QPI Link Speed Total Memory Current Memory Speed USB Devices BMC Status BMC Firmware Revision Product Information CPU Information DIMM Information Security 280 Oracle Server X5 4 Service Manual December 2015 ...

Page 281: ...About the BIOS Setup Utility Keywords Main DIMM Information Processor 0 DIMMs BIOS Setup Utility Menu Options 281 ...

Page 282: ...About the BIOS Setup Utility Keywords Main Processor 0 DIMMs Not Present 282 Oracle Server X5 4 Service Manual December 2015 ...

Page 283: ...in Screen Project Version System Date System Time QPI Link Speed Total Memory Current Memory Speed USB Devices BMC Status BMC Firmware Revision Product Information CPU Information DIMM Information Security BIOS Setup Utility Menu Options 283 ...

Page 284: ... the BIOS Setup Utility Keywords Main security screen set administrator password password description minimum length maximum length administrator password 284 Oracle Server X5 4 Service Manual December 2015 ...

Page 285: ...Screen Legacy Keywords Advanced processor configuration CPU power management configuration USB ports serial port console redirection trusted computing network stack legacy iSCSI BMC network configuration BIOS Setup Utility Menu Options 285 ...

Page 286: ... processor cores execute disable bit hardware prefetcher adjacent cache prefetch DCU streamer prefetcher DCU IP prefetcher Intel virtualization technology Enables hyper threading software method to enable disable logical processor threads 286 Oracle Server X5 4 Service Manual December 2015 ...

Page 287: ...About the BIOS Setup Utility Keywords Processor Configuration Active Processor Cores Number of cores to enable in each processor package BIOS Setup Utility Menu Options 287 ...

Page 288: ...rds Advanced Processor Configuration CPU Power Management Configuration USB Ports Serial Port Console Redirection Trusted Computing Network Stack Legacy iSCSI BMC Network Configuration 288 Oracle Server X5 4 Service Manual December 2015 ...

Page 289: ...About the BIOS Setup Utility Keywords CPU Power Management Configuration CPU PM Tuning Turbo Mode Energy Performance Balanced Performance BIOS Setup Utility Menu Options 289 ...

Page 290: ...About the BIOS Setup Utility Keywords CPU Power Management Configuration CPU PM Tuning Auto Manual Turbo Mode Energy Performance Balanced Performance 290 Oracle Server X5 4 Service Manual December 2015 ...

Page 291: ...e BIOS Setup Utility Keywords CPU Power Management Configuration CPU PM Tuning Turbo Mode Energy Performance Performance Balanced Performance Balanced Energy Energy Efficient BIOS Setup Utility Menu Options 291 ...

Page 292: ...rds Advanced Processor Configuration CPU Power Management Configuration USB Ports Serial Port Console Redirection Trusted Computing Network Stack Legacy iSCSI BMC Network Configuration 292 Oracle Server X5 4 Service Manual December 2015 ...

Page 293: ...About the BIOS Setup Utility Keywords Memory Configuration Numa Patrol Scrub BIOS Setup Utility Menu Options 293 ...

Page 294: ...rds Advanced Processor Configuration CPU Power Management Configuration USB Ports Serial Port Console Redirection Trusted Computing Network Stack Legacy iSCSI BMC Network Configuration 294 Oracle Server X5 4 Service Manual December 2015 ...

Page 295: ...About the BIOS Setup Utility Keywords USB Ports EHCI Handoff Port 60 64 Emulation Rear Port Front Port Internal Port BIOS Setup Utility Menu Options 295 ...

Page 296: ...rds Advanced Processor Configuration CPU Power Management Configuration USB Ports Serial Port Console Redirection Trusted Computing Network Stack Legacy iSCSI BMC Network Configuration 296 Oracle Server X5 4 Service Manual December 2015 ...

Page 297: ...About the BIOS Setup Utility Keywords Serial Port Redirection EMS Console Redirection Terminal Type Bits per second Data Bits Parity Stop Bits Flow Control BIOS Setup Utility Menu Options 297 ...

Page 298: ...About the BIOS Setup Utility Keywords Serial Port Redirection EMS Console Redirection Terminal Type VT100 VT100 VT UTF8 ANSI 298 Oracle Server X5 4 Service Manual December 2015 ...

Page 299: ...About the BIOS Setup Utility Keywords Serial Port Redirection EMS Console Redirection Terminal Type Bits per second 9600 19200 38400 57600 115200 BIOS Setup Utility Menu Options 299 ...

Page 300: ...About the BIOS Setup Utility Keywords Serial Port Redirection EMS Console Redirection Terminal Type Bits per second Data Bits 7 8 300 Oracle Server X5 4 Service Manual December 2015 ...

Page 301: ...About the BIOS Setup Utility Keywords Serial Port Redirection EMS Console Redirection Terminal Type Bits per second Data Bits Parity None Even Odd Mark Space BIOS Setup Utility Menu Options 301 ...

Page 302: ...About the BIOS Setup Utility Keywords Serial Port Redirection EMS Console Redirection Terminal Type Bits per second Data Bits Parity Stop Bits 1 2 302 Oracle Server X5 4 Service Manual December 2015 ...

Page 303: ...the BIOS Setup Utility Keywords Serial Port Redirection EMS Console Redirection Terminal Type Bits per second Data Bits Parity Stop Bits Flow Control None Hardware RTS CTS BIOS Setup Utility Menu Options 303 ...

Page 304: ...rds Advanced Processor Configuration CPU Power Management Configuration USB Ports Serial Port Console Redirection Trusted Computing Network Stack Legacy iSCSI BMC Network Configuration 304 Oracle Server X5 4 Service Manual December 2015 ...

Page 305: ...About the BIOS Setup Utility Keywords Advanced Trusted Computing TPM Support Enable Disable BIOS Setup Utility Menu Options 305 ...

Page 306: ...rds Advanced Processor Configuration CPU Power Management Configuration USB Ports Serial Port Console Redirection Trusted Computing Network Stack Legacy iSCSI BMC Network Configuration 306 Oracle Server X5 4 Service Manual December 2015 ...

Page 307: ...About the BIOS Setup Utility Keywords Advanced Network Stack BIOS Setup Utility Menu Options 307 ...

Page 308: ...rds Advanced Processor Configuration CPU Power Management Configuration USB Ports Serial Port Console Redirection Trusted Computing Network Stack Legacy iSCSI BMC Network Configuration 308 Oracle Server X5 4 Service Manual December 2015 ...

Page 309: ...About the BIOS Setup Utility Keywords Advanced Legacy iSCSI Launch Legacy iSCSI OpROM BIOS Setup Utility Menu Options 309 ...

Page 310: ...rds Advanced Processor Configuration CPU Power Management Configuration USB Ports Serial Port Console Redirection Trusted Computing Network Stack Legacy iSCSI BMC Network Configuration 310 Oracle Server X5 4 Service Manual December 2015 ...

Page 311: ...About the BIOS Setup Utility Keywords Advanced BMC Network Configuration Refresh Active Mgmt Port NET MGT NET0 NET1 NET2 NET3 BIOS Setup Utility Menu Options 311 ...

Page 312: ...BIOS Setup Utility Keywords Advanced BMC Network Configuration Commit IPv4 Configuration Channel Number Current IPv4 State Current IPv4 Address Current IPv4 MAC 312 Oracle Server X5 4 Service Manual December 2015 ...

Page 313: ...Advanced BMC Network Configuration Commit IPv6 Configuration Channel Number Current IPv6 state Current IPv6 Auto configuration Link Local IPv6 Address Static IPv6 Address IPv6 Gateway Dynamic IPv6 Address BIOS Setup Utility Menu Options 313 ...

Page 314: ...About the BIOS Setup Utility Keywords Advanced BMC Network Configuration Refresh IPv6 State Auto IPv6 Configuration Static IPv6 Address 314 Oracle Server X5 4 Service Manual December 2015 ...

Page 315: ...About the BIOS Setup Utility IO Screen Keywords IO PCI Subsystem Settings IO Virtualization IOAT Configuration Internal Devices Add In Cards BIOS Setup Utility Menu Options 315 ...

Page 316: ...About the BIOS Setup Utility Keywords IO PCI Subsystem Settings PCI 64 bit Resources allocation Maximum Payload Maximum Read Request 316 Oracle Server X5 4 Service Manual December 2015 ...

Page 317: ...he BIOS Setup Utility Keywords IO PCI Subsystem Settings PCI 64 bit Resources allocation Maximum Payload Auto 128 bytes 256 bytes 512 bytes 1024 bytes 2048 bytes 4096 bytes BIOS Setup Utility Menu Options 317 ...

Page 318: ...tup Utility Keywords IO PCI Subsystem Settings PCI 64 bit Resources allocation Maximum Read Request Auto 128 bytes 256 bytes 512 bytes 1024 bytes 2048 bytes 4096 bytes 318 Oracle Server X5 4 Service Manual December 2015 ...

Page 319: ...About the BIOS Setup Utility Keywords IO PCI Subsystem Settings IO Virtualization IOAT Configuration Internal Devices Add In Cards BIOS Setup Utility Menu Options 319 ...

Page 320: ...About the BIOS Setup Utility Keywords IO IO Virtualization VT d SR IOV ARI 320 Oracle Server X5 4 Service Manual December 2015 ...

Page 321: ...About the BIOS Setup Utility Keywords IO PCI Subsystem Settings IO Virtualization IOAT Configuration Internal Devices Add In Cards BIOS Setup Utility Menu Options 321 ...

Page 322: ...About the BIOS Setup Utility Keywords IO IOAT Configuration Intel I OAT DCA Support 322 Oracle Server X5 4 Service Manual December 2015 ...

Page 323: ...About the BIOS Setup Utility Keywords IO PCI Subsystem Settings IO Virtualization IOAT Configuration Internal Devices Add In Cards BIOS Setup Utility Menu Options 323 ...

Page 324: ...About the BIOS Setup Utility Keywords IO Internal Devices Net0 Net1 Net2 Net3 324 Oracle Server X5 4 Service Manual December 2015 ...

Page 325: ...About the BIOS Setup Utility Keywords IO Net 0 PCIE Option ROM or UEFI Driver Enable BIOS Setup Utility Menu Options 325 ...

Page 326: ...About the BIOS Setup Utility Keywords IO PCI Subsystem Settings IO Virtualization IOAT Configuration Internal Devices Add In Cards 326 Oracle Server X5 4 Service Manual December 2015 ...

Page 327: ...About the BIOS Setup Utility Keywords IO Add In Cards Slot 1 Slot 11 BIOS Setup Utility Menu Options 327 ...

Page 328: ...About the BIOS Setup Utility Keywords IO Add In Cards Slot 1 IO Enable PCIE Option ROM or UEFI Driver Enable 328 Oracle Server X5 4 Service Manual December 2015 ...

Page 329: ...etup Utility Boot Screen Legacy Keywords UEFI BIOS Boot Mode Retry Boot List Network Boot Retry Persistent Boot Support UEFICfg LateSync OSA Configuration Legacy Boot Option Priority BIOS Setup Utility Menu Options 329 ...

Page 330: ...Setup Utility Keywords UEFI BIOS Boot Mode Retry Boot List Network Boot Retry Persistent Boot Support UEFICfg LateSync OSA Configuration Legacy Boot Option Priority 330 Oracle Server X5 4 Service Manual December 2015 ...

Page 331: ...About the BIOS Setup Utility Keywords OSA Internal Support Disabled Enabled BIOS Setup Utility Menu Options 331 ...

Page 332: ...Setup Utility Keywords UEFI BIOS Boot Mode Retry Boot List Network Boot Retry Persistent Boot Support UEFICfg LateSync OSA Configuration Legacy Boot Option Priority 332 Oracle Server X5 4 Service Manual December 2015 ...

Page 333: ...Utility Keywords Boot Options SATA DVD PCIE RAID Adapter PXE NET0 PXE NET1 PXE NET2 PXE NET3 UEFI Mode BIOS Setup Utility Screens This section shows the BIOS screens specific to UEFI mode BIOS Setup Utility Menu Options 333 ...

Page 334: ...U power management configuration USB ports serial port console redirection trusted computing network stack legacy iSCSI BMC network configuration RunTime UEFI drivers UEFI iSCSI configuration LSI MegaRAID Configuration Intel Ethernet Controller 334 Oracle Server X5 4 Service Manual December 2015 ...

Page 335: ...About the BIOS Setup Utility Keywords iSCSI Initiator Name Add an attempt Delete attempts Change attempt order BIOS Setup Utility Menu Options 335 ...

Page 336: ...agement configuration USB ports serial port console redirection trusted computing network stack legacy iSCSI BMC network configuration RunTime UEFI drivers UEFI iSCSI configuration LSI MegaRAID Configuration Intel Ethernet Controller 336 Oracle Server X5 4 Service Manual December 2015 ...

Page 337: ...troller management Virtual drive management Drive management Hardware components Note The above configuration options too numerous to list here are described in the MegaRAID User s Guide Refer to http www lsi com sep Pages oracle index aspx BIOS Setup Utility Menu Options 337 ...

Page 338: ... Support UEFICfg LateSync OSA Configuration UEFI Boot Option Priority Access the BIOS Setup Utility To access the BIOS Setup Utility complete the following steps 1 Power on or power cycle the server 2 Press the F2 key while the system is performing the power on self test POST 338 Oracle Server X5 4 Service Manual December 2015 ...

Page 339: ...lity Alternatively you can use the following hot key combinations to access the BIOS Setup Utility from a serial connection F1 Control Q F2 Control E F7 Control D F8 Control P F9 Control O F10 Control S F12 Control N The BIOS Setup Utility Main screen appears Main Screen Legacy on page 274 BIOS Setup Utility Menu Options 339 ...

Page 340: ...340 Oracle Server X5 4 Service Manual December 2015 ...

Page 341: ...exceptions are noted AMI Checkpoint Ranges Status Code Range Description 0x01 0x0B SEC execution PEI 0x0C 0x0F SEC errors 0x10 0x2F PEI execution up to and including memory detection 0x30 0x4F PEI execution after memory detection 0x50 0x5F PEI errors 0x60 0x8F DXE execution up to BDS 0x90 0xCF BDS execution 0xD0 0xDF DXE errors 0xE0 0xE8 S3 fesume PEI 0xE9 0xEF S3 resume errors PEI 0xF0 0xF8 Recov...

Page 342: ...oading 0x09 South Bridge initialization after microcode loading 0x0A OEM initialization after microcode loading 0x0B Cache initialization 0x0C 0x0D Reserved for future AMI SEC error codes 0x0E Microcode not found 0x0F Microcode not loaded SEC Beep Codes There are no SEC beep codes PEI Phase Progress Codes Description 0x10 PEI core is started 0x11 Pre memory CPU initialization is started 0x10 PEI c...

Page 343: ...initialization other 0x30 Reserved for ASL see ASL Status Codes section below 0x31 Memory installed 0x32 CPU post memory initialization is started 0x33 CPU post memory initialization Cache initialization 0x34 CPU post memory initialization Application processor s AP initialization 0x35 CPU post memory initialization Boot strap processor BSP selection 0x36 CPU post memory initialization System mana...

Page 344: ... failed or possible CPU cache error 0x59 CPU micro code is not found or micro code update is failed 0x5A Internal CPU error 0x5B Reset PPI is not available 0x5C 0x5F Reserved for future AMI error codes S3 Resume Progress Codes Codes Description 0xE0 S3 resume is started S3 resume PPI is called by the DXE IPL 0xE1 S3 boot script execution 0xE2 Video repost 0xE3 OS S3 wake vector call 0xE4 0xE7 Rese...

Page 345: ...irmware image is loaded 0xF5 0xF7 Reserved for future AMI progress codes Recovery Error Codes Codes Description 0xF8 Recovery PPI is not available 0xF9 Recovery capsule is not found 0xFA Invalid recovery capsule 0xFB 0xFF Reserved for future AMI error codes PEI Beep Codes Number of Beeps Description 1 Memory not Installed 1 Memory was installed twice InstallPeiMemory routine in PEI Core called twi...

Page 346: ...le specific 0x6D North Bridge DXE initialization North Bridge module specific 0x6E North Bridge DXE initialization North Bridge module specific 0x6F North Bridge DXE initialization North Bridge module specific 0x70 South Bridge DXE initialization is started 0x71 South Bridge DXE SMM initialization is started 0x72 South Bridge devices initialization 0x73 South Bridge DXE initialization South Bridge...

Page 347: ...itialization is started 0xA1 IDE reset 0xA2 IDE detect 0xA3 IDE enable 0xA4 SCSI initialization is started 0xA5 SCSI reset 0xA6 SCSI detect 0xA7 SCSI enable 0xA8 Setup verifying password 0xA9 Start of Setup 0xAA Reserved for ASL see ASL tatus Codes section below 0xAB Setup input wait 0xAC reserved for ASL see ASL Status Codes section below 0xAD Ready to boot event 0xAE Legacy boot event 0xAF Exit ...

Page 348: ...Reserved for future AMI code Intel DDR memory Map 0x00BC Reserved for future AMI code Intel RAS Configuration 0x00BD Reserved for future AMI code 0x00BE Reserved for future AMI code 0x00BF Reserved for future AMI code Intel MRC done 0xC0 0xCF OEM BDS initialization codes DXE Error Codes Codes Description 0xD0 CPU initialization error 0xD1 North Bridge initialization error 0xD2 South Bridge initial...

Page 349: ...ailable 8 Platform PCI resource requirements cannot be met ACPI ASL Checkpoints Codes Description 0x01 System is entering S1 sleep state 0x02 System is entering S2 sleep state 0x03 System is entering S3 sleep state 0x04 System is entering S4 sleep state 0x05 System is entering S5 sleep state 0x10 System is waking up from the S1 sleep state 0x20 System is waking up from the S2 sleep state 0x30 Syst...

Page 350: ...DC Oracle OSC Granted OS native hot plug 0x69DD Oracle OSC Granted OS native PME 0x69DF Oracle Legacy Hot Plug Attn PB SCI interrupt Attn Push Button 0x69D0 Oracle Legacy hot plug cleared presence change detect 0x69D1 Oracle Legacy hot plug Attn PB SCI power on sequence started 0x69D2 Oracle legacy hot plug Attn PB power on error 0x69D3 Oracle Legacy HotPlug Attn PB Link training ed failure 0x69D4...

Page 351: ...ator 17 107 power 17 system fault remind 83 145 146 C cable management arm See CMA cables replacing HBA card SAS cables 204 replacing HBA ESM cables 209 replacing NVMe switch card cables 215 cabling the server 59 Charge Status indicator 51 83 DIMM test circuit 85 146 clearing faults 91 CMA installing 266 releasing 98 resetting 259 verifying operation 268 cold reset 30 cold service See component se...

Page 352: ...lot designations 74 subsystem 22 CRU See replaceable components D designations component 73 diagnostics 37 documentation 58 troubleshooting 57 DIMM Fault indicators 85 fault remind test circuit 85 installing 150 locating 86 failed 82 locating faulty 146 memory subsystem 25 multi DIMM failure state 159 physical layout 155 population rules 157 removing 145 148 replacing faulty 143 servicing 142 slot...

Page 353: ...g 119 storage drive removing 115 fmadm tool 91 four CPU configuration 24 front panel features 17 indicator blink rates 46 troubleshooting 40 FRU See replaceable components servicing 179 full power mode 28 G graceful power off 29 101 H hard drives See storage drives hardware faults troubleshooting 37 HBA See servicing replacing SAS cables 204 replacing the HBA card 200 heatsink See CPU installing 1...

Page 354: ...lease button storage drive 123 128 locating faulty DIMM 146 memory riser card DIMM or CPU 82 replaceable components 70 serial number 67 Locator indicator 94 controlling CLI Oracle ILOM 108 web interface Oracle ILOM 109 front panel 17 managing 110 M memory 25 See also DIMM subsystem overview 25 memory riser card 142 See also DIMM components of 154 Fault indicators 83 installing 152 locating 86 fail...

Page 355: ...ror codes 341 power cover interlock switch 56 issues 54 55 connection 54 cover 56 modes 28 removal 29 101 shutdowns and resets 28 subsystem overview 28 Power button location 17 powering off graceful 102 powering off immediate 103 power supply backplane replacing 226 designations slot 76 indicators 140 installing 138 power issues 55 reference 140 removing 137 voltage range 28 powering off graceful ...

Page 356: ...nt 81 reset 28 cold 30 SP password 63 warm 29 S SAS replacing HBA card cables 204 SAS HBA servicing 200 SATA port 31 sensors temperature 26 serial number locating 67 serial port configuring 61 server attaching devices 59 configurations 22 external components and features 17 front panel blink rates 46 installing rack 262 overview 16 position operational 270 powering on 271 rack position maintenance...

Page 357: ...filler panels removing 115 hot plugging 114 identification 123 128 indicators 119 installing 118 124 129 latch release button 123 128 removing 115 servicing 113 storage drives See disk drive support contacting 66 switches cover interlock 56 pinhole 64 system battery replacing 172 block diagrams 20 CPU configurations 22 fault remind button 145 146 186 fault remind test circuit 51 82 83 management s...

Page 358: ...ilure state 159 power issues 54 system cooling issues 52 two CPU configuration 23 28 U USB ports Service Manual back panel 18 Service Manual front panel 17 internal 32 internal designations 78 V video port back panel 18 front panel 17 W warm reset 29 358 Oracle Server X5 4 Service Manual December 2015 ...

Reviews:

No comments

Brands by name

Popular brands

Load more brands